CX3: CSI-2 to USB 3.0
Solution for HD Video
CSI-2 = Camera Serial Interface v2.0
Sharper Images from a One-Chip Solution:
CX3 Powers the World’s Most Advanced HD Video Cameras
Owner: MARF
001-90288 Rev **
CX3 New Product Presentation
HD Video Requires USB 3.0 Bandwidth
The market requirements for video cameras are changing
Consumers are demanding cameras that support high-definition (HD) video with high image quality
HD video requires 1.5-Gbps bandwidth
USB 2.0 provides only 480 Mbps and requires compression, which degrades image quality
USB 3.0 provides 5 Gbps and delivers high-resolution image quality without the need for compression
USB 3.0 delivers high-resolution image quality that today’s consumers demand
The USB 3.0 Advantage
Bandwidth (Gbps)
5.0
4.0
3.0
2.0
Bandwidth required for Full-HD
(1920 x 1080 @ 30 fps) video
1.0
Compressed USB 2.0 HD video
degrades image quality
Uncompressed USB 3.0 HD video
delivers the best image quality
0.0
USB 2.0
Owner: MARF
001-90288 Rev **
CX3 New Product Presentation
IEEE
1394b
Gigabit
Ethernet
USB
USB 3.0
3.0
2
Terms You Will Hear Today
Bandwidth
Bandwidth = # pixels per frame (resolution) x frames per second (frame rate) x # color bits per pixel (color depth)
For example, Bandwidth required by 1080p video = 2.07 megapixels x 30 frames per second x 24-bit color = 1.5 Gbps
Common Video Standards
Standard
Column
Pixels
Row
Pixels
MegaPixels
Color
Depth
Frame
Rate
Bandwidth
1080p
1920
1080
2.07
24
30
1.5 Gbps
720p
1280
720
0.92
24
30
664 Mbps
VGA
640
480
0.31
16
30
147 Mbps
Compression
Reduces the Bandwidth requirement of an image using a mathematical algorithm
Modifies pixels, degrading image quality
Requires an external Compression Engine, usually implemented with FPGA or ASIC
CSI-2 (Camera Serial Interface v2.0)
A specification that defines the standard data transmission and control interfaces between an image sensor and an image processor
Includes a unidirectional serial interface with data and clock signals, and a bidirectional I 2C control interface
Image Signal Processing (ISP)
Algorithms implemented in hardware (FPGA or ASIC) or software to enhance the image quality
Mobile Industry Processor Interface (MIPI) Alliance
An open membership organization that develops interface specifications for the mobile handset industry
Owner: MARF
001-90288 Rev **
CX3 New Product Presentation
3
Additional Terms
USB 3.0 (SuperSpeed USB)
Operates at 5 Gbps – 10x faster than USB 2.0 (Hi-Speed USB)
Distributes 1.8x more power to bus-powered devices than USB 2.0
Provides backward compatibility with USB 2.0
USB 3.0 Host, USB 3.0 Device
The USB 3.0 Host (e.g., a PC) directs traffic flow and distributes power over the bus
The USB 3.0 Device (e.g., a video camera) is a peripheral on the bus
USB 3.0 Peripheral Controller
A microcontroller in the USB Device that handles the USB 3.0 protocol and communicates with the USB Host
Graphics Processing Unit (GPU)
A specialized IC designed to accelerate image creation for output to a display
USB Video Class (UVC)
A specification that defines the standard behavior of a USB video camera, known as a “UVC camera”
Has been widely adopted in consumer cameras and supported by major PC operating systems
USB3 Vision
A specification that defines the standard behavior of USB 3.0 cameras for machine vision and industrial applications
Owner: MARF
001-90288 Rev **
CX3 New Product Presentation
4
CX3 Terms
EZ-USB® CX3™
Cypress’s programmable CSI-2 to USB 3.0 bridge controller with an integrated USB 3.0 transceiver
Includes a powerful on-chip ARM9™ processor with 512KB RAM for firmware storage and data buffering
Provides additional peripheral connectivity via I2C, I2S, SPI, UART and 12 GPIOs
Includes a software development kit (SDK) with example code to reduce your design effort
CX3 Reference Design Kit (RDK)
A USB 3.0 video camera reference design featuring CX3 and a 5-megapixel (MP) Omnivision OVT5640 image sensor
CX3 Application Programming Interface (API)
Firmware in the SDK library that implements CX3-specific functions
EZ-USB® FX3™
Cypress’s programmable USB 3.0 Peripheral Controller with integrated USB 3.0 PHY
Includes a powerful on-chip ARM9 processor with 512KB RAM
Provides a 32-bit General Programmable Interface (GPIF II), allowing FX3 to communicate with virtually any system at 100 MHz
Interfaces directly with image sensors via GPIF II, providing 3.2 Gbps data throughput for streaming uncompressed HD video
Adopted by customers worldwide, including Avermedia, Canon, Kodak, Leap Motion, Microsoft, Panasonic, Sony, Toshiba, etc.
Complements the CX3, together offering a compelling portfolio of USB 3.0 solutions for HD imaging
Owner: MARF
001-90288 Rev **
CX3 New Product Presentation
5
Cypress USB 3.0 Solutions for HD Video
Feature
CSI-2 to USB 3.0
Bridge Controller
GPIF II to USB 3.0
Peripheral Controller
USB 3.0 Certified
Yes; Test ID 340880047
Yes; Test ID 340800007
Programmability
Yes; ARM9, 512KB RAM
Yes; ARM9, 512KB RAM
Image Sensor Interface
Serial, two- or four-lane CSI-2
Parallel, 16- or 32-bit GPIF II
Maximum Throughput
2.4 Gbps
3.2 Gbps
Hardware DVK
CX3 RDK
FX3 DVK
SDK
EZ-USB SDK version 1.3 or later
EZ-USB SDK version 1.0 or later
UVC Support
Yes
Yes
Package Option
121-ball BGA
121-ball BGA, 131-ball WLCSP
Applications
Machine vision, medical imaging,
video conferencing, 3-D motion
tracking, document scanning,
PC webcam
Machine vision, medical imaging,
video conferencing, 3-D motion
tracking, document scanning,
PC webcam, video capturing
Owner: MARF
001-90288 Rev **
CX3 New Product Presentation
6
CX3: One-Chip CSI-2 to USB 3.0 Bridge
High-resolution image sensors are going serial
Most image sensors with a resolution greater than 3 MP use CSI-2 to meet higher bandwidth requirement
CX3 provides four CSI-2 lanes, interfacing directly with any CSI-2 image sensor without a need for glue logic
Example: CX3 Design Using a 5-MP Image Sensor
5-MP
Image
Sensor
USB 3.0
CSI-2
CX3
4
USB 3.0 Host
System
Low-resolution image sensors remain parallel
Image sensors with a resolution less than 3 MP continue to offer a parallel interface
FX3 provides a 32-bit GPIF II, interfacing directly with any parallel image sensors
Example 1: FX3 Design Using a 1.3-MP Image Sensor
1.3-MP
Image
Sensor
Owner: MARF
001-90288 Rev **
USB 3.0
GPIF II
FX3
16
USB 3.0 Host
System
Example 2: FX3 Design Using Two VGA Sensors for 3-D Imaging
VGA
Image
Sensor
8
USB 3.0
GPIF II
FX3
VGA
Image
Sensor
CX3 New Product Presentation
16
USB 3.0 Host
System
8
7
CX3: Not a Fixed-Function Bridge
CX3 is programmable, so it supports standard or custom camera features
Video Conferencing
Machine Vision
Camera
Protocol
UVC or proprietary
USB3 Vision or
proprietary
UVC
UVC or proprietary
Firmware
Customization
UVC extensions for
camera control
Variable frame
rate control
UVC extensions for
camera control
Custom frame
cropping
I2C, SPI, UART,
GPIOs
Pan, tilt, zoom control
Image sensor
configuration
User interface design
(buttons, LEDs)
Infrared LED control
Owner: MARF
001-90288 Rev **
CX3 New Product Presentation
PC Webcam
3-D Motion Tracking
8
CX3 Solution vs. Competition’s
Features
CYUSB3065
RTS5880
USB 3.0
Yes
Yes
CSI-2 Interface
4 lanes, 1 Gbps per lane
4 lanes, 1 Gbps per lane
ISP
No
Yes
Package Size
121-ball BGA (100 mm2)
48-pin QFN (36 mm2)
Color Format Support
RAW8/10/12/141, YUV422/4442,
RGB888/666/5653
RAW, YUV422
Camera Protocol
UVC or proprietary
UVC only
Interfaces
I2C, I2S, UART, SPI, 12 GPIOs
I2C, I2S, SPI, 6 GPIOs
Programmability
Yes; ARM9
No; fixed-function bridge
Development Kit
SDK, $249 RDK
No
Applications
Machine vision, medical imaging,
video conferencing, 3-D motion
tracking, document scanning,
PC webcam
PC webcam
1 Video
Owner: MARF
001-90288 Rev **
format for raw video data
2 Video
format for luminance and chrominance components
CX3 New Product Presentation
3 Video
format for red, green and blue pixel components
9
CX3: Made for High-Megapixel Cameras
Solution # 1:
Image sensor with built-in ISP
Image
Sensor
Image sensor captures and processes the image
Image sensor sends processed image to CX3
CX3 sends processed image to the host
USB 3.0
USB 3.0 Host
System
USB 3.0
USB 3.0 Host
System
USB 3.0
USB 3.0 Host
System
CX3
2 or 4
ISP
Solution # 2:
Image sensor + discrete ISP ASIC/FPGA
Image sensor sends captured image to ISP ASIC/FPGA
ISP ASIC/FPGA processes the image and sends it to CX3
CX3 sends processed image to the host
Image
Sensor
CSI-2
2 or 4
Solution # 3:
Image sensor + host ISP software
Image sensor sends captured image to CX3
CX3 sends captured image to the host
The ISP software running on the host GPU processes the image
Owner: MARF
001-90288 Rev **
CSI-2
CX3 New Product Presentation
ISP
ASIC/
FPGA
Image
Sensor
CSI-2
CX3
2 or 4
CSI-2
CX3
2 or 4
GPU, ISP
10
CX3 Reference Design Kit
Hardware
CX3 RDK
by e-con Systems
Fully functional USB camera with interchangeable image sensor module
Includes a 5-MP OVT5460 module capable of 1080p video at 30 fps
Preloaded with UVC firmware that works with any PC
Includes RS232 and JTAG connectors for firmware debugging
Powered by a USB cable without the need for an external 5-V supply
Available for $249 at:
www.e-consystems.com/CX3-Reference-Design-Kit.asp
Software
Includes e-CAMView, a free video-capture application for Windows PCs,
and sample camera control plug-ins for:
Brightness
Contrast
Hue
Saturation
Supported Image Resolution and
Sharpness
HD
Column Row
Frame
White balance (auto/manual)
Std
Pixels
Pixels Rate (fps)
Exposure (auto/manual)
VGA
640
480
60
Focus (auto/manual)
720p
1280
720
60
Frame Rate1
Data
Rate (Gbps)
0.3
0.9
Available for download at:
1080p
1920
1080
30
1.0
www.e-consystems.com/CX3-Reference-Design-Kit.asp
5 MP
2592
1944
15
1.2
1 Using
Owner: MARF
001-90288 Rev **
16-bit color, YUV422 video data format
CX3 New Product Presentation
11
CX3 Reference Design Kit Details
Omnivision OV5640 Module
5-MP
OV5640
Image Sensor
CSI-2 Connector
CX3 RDK
CX3 Baseboard
USB 3.0
connector
CX3
RS232
Connector
Owner: MARF
001-90288 Rev **
JTAG Header
CSI-2 Connector
for Interchangeable
Image Sensor Modules
GPIO Header
CX3 New Product Presentation
12
CX3 Software Development Kit (SDK)
CX3 is now part of the EZ-USB FX3 SDK (version 1.3 or later)
Eclipse IDE
New CX3 APIs:
Initialization and configuration of CSI-2 interface
Configuration of CSI-2 image sensors
Configuration of GPIOs for camera control or user-defined functions
New CX3 firmware example codes:
Configuration of Omnivision OV5640 and Aptina AS0260 image sensor
Implementation of a UVC camera for Full-HD video (1080p at 30 fps)
Familiar FX3 development tools and documentation:
Eclipse Integrated Development Environment (IDE)
ARM tool chain and debugger
SDK release notes
Firmware API guide
Programmer’s manual
SDK troubleshooting guide
Technical Reference Manual
Firmware API Guide
Available for download at: www.cypress.com/?rID=57990
Owner: MARF
001-90288 Rev **
CX3 New Product Presentation
13
Here’s How to Get Started
1.
Visit the EZ-USB CX3 web page
2.
Download the CX3 datasheet
3.
Buy the CX3 Reference Design Kit
4.
Download the FX3 Software Development Kit
5.
Contact your local sales representatives for CX3 samples
Owner: MARF
001-90288 Rev **
CX3 New Product Presentation
14
CX3 USB 3.0 Solution Summary
Block Diagram
Applications
Consumer webcams
Notebook PCs, tablet embedded cameras
Industrial, medical, machine vision cameras
Document, fingerprint scanners
Game consoles
Teleconferencing systems
Image acquisition systems
5
CX3 Bridge
JTAG
512KB
RAM
USB 3.0-compliant video-class controller
Four-lane MIPI Camera Serial Interface v2.0 (CSI-2) input
Camera Control Interface (CCI) for image sensor
configuration
Supports industry-standard video data formats:
RAW8/10/12/141, YUV422/4442, RGB888/666/5653
Supports uncompressed streaming video:
1080p at 30 fps, 720p at 60 fps
On-chip ARM9 with 512KB RAM for data processing
Supports I2C, I2S, SPI, UART and 12 GPIOs
121-ball BGA (10 x 10 x 1.7 mm)
Collateral
Datasheet:
Reference Design Kit:
Software Development Kit:
1 Video
4
32
32
32
USB 3.0
Host
32
UART
4
I2C
I2S
2
4
6
SPI
4
GPIO
12
Availability
CX3 datasheet
CX3 RDK
EZ-USB SDK
format for raw video data
Owner: MARF
001-90288 Rev **
Image
Sensor,
Image
Processor
USB 3.0
Features
MIPI CSI-2
ARM9
2 Video
Sampling:
Production:
Now
Q4 2013
format for luminance and chrominance components
CX3 New Product Presentation
3 Video
format for red, green and blue pixel components
15