Imaging and Video Solutions for Smart Embedded Vision
2
Summary Smart Embedded Vision is opening up new possibilities for implementing systems that rely on visual data to make decisions across a broad spectrum of applications. Drones, machine vision, thermal imaging, gaming, video surveillance, robotics, Ad- vanced Driver Assistance Systems (ADAS), machine learning and HMI all rely on cameras and displays that demand low power while supporting high-speed interfaces as well as security in data, and in design so that IP is protected. The inherent parallel processing and high-speed I/O capabilities of FPGAs makes them ideal processing platforms for delivering the high data through- puts needed for both high-resolution imaging and machine learning algorithms. Microchip provides FPGA imaging and video solutions to enable the evaluation of multiple protocols and the development of a host of image and video processing applications. As a best-in-class imaging and video platform, Microchip’s solutions come with a complete ecosystem, including comprehensive application-specific hardware, optimized intellectual property suite for image processing, sample reference designs, demonstration designs and collateral. Microchip’s award-winning PolarFire ™ FPGAs are ideal for mid-bandwidth (4K/2K) imaging/video applications due to their rich memory and digital signal processor (DSP) resources in addition to offering up to 50 percent lower power than competing static random-access memory (SRAM)-based devices. The solution is also supported by Microchip’s SmartFusion ® 2 that integrates a 166 MHz Arm ® Cortex ® -M3 processor and IGLOO ® 2. Both these families are optimal for low resolution applications with embed- ded Flash, PCIe Gen2 support, highest I/O density, Flash security and exceptional reliability. www.microchip.com Imaging and Video Solutions for Smart Embedded Vision Target Applications • Machine learning • Automotive • Surveillance • Machine vision • Drone imaging • Medical imaging FPGAs and SoCs 12V Power Supply Input USB-UART Terminal HDMI 2.0 TX HDMI 2.0 RX MIPi CSI-2RX Connector Dual Camera Sensor HDMI 1.4 TX HPC FMC Connector JTAG Programming Header Display Connector SPI Flash MIPI CSI-2 TX Connector Reset Switch PolarFire FPGA Included Image Sensor Board Imaging and Video FMC SmartFusion2 Advanced Delevopment Kit SmartFusion ® 2 Advanced Dev Kit with Imaging FMC PolarFire ™ Video Kit
Transcript of Imaging and Video Solutions for Smart Embedded Vision
SummarySmart Embedded Vision is opening up new possibilities for implementing systems that rely on visual data to make decisions across a broad spectrum of applications. Drones, machine vision, thermal imaging, gaming, video surveillance, robotics, Ad-vanced Driver Assistance Systems (ADAS), machine learning and HMI all rely on cameras and displays that demand low power while supporting high-speed interfaces as well as security in data, and in design so that IP is protected. The inherent parallel processing and high-speed I/O capabilities of FPGAs makes them ideal processing platforms for delivering the high data through-puts needed for both high-resolution imaging and machine learning algorithms.
Microchip provides FPGA imaging and video solutions to enable the evaluation of multiple protocols and the development of a host of image and video processing applications. As a best-in-class imaging and video platform, Microchip’s solutions come with a complete ecosystem, including comprehensive application-specific hardware, optimized intellectual property suite for image processing, sample reference designs, demonstration designs and collateral.
Microchip’s award-winning PolarFire™ FPGAs are ideal for mid-bandwidth (4K/2K) imaging/video applications due to their rich memory and digital signal processor (DSP) resources in addition to offering up to 50 percent lower power than competing static random-access memory (SRAM)-based devices. The solution is also supported by Microchip’s SmartFusion®2 that integrates a 166 MHz Arm® Cortex®-M3 processor and IGLOO®2. Both these families are optimal for low resolution applications with embed-ded Flash, PCIe Gen2 support, highest I/O density, Flash security and exceptional reliability.
www.microchip.com
Imaging and Video Solutions for Smart Embedded Vision
Target Applications• Machine learning• Automotive• Surveillance
• Machine vision• Drone imaging• Medical imaging
FPGAs and SoCs
12V PowerSupply Input
USB-UARTTerminal
HDMI 2.0 TX
HDMI 2.0 RX
MIPi CSI-2RXConnector
Dual CameraSensor
HDMI 1.4 TX
HPC FMCConnector
JTAG ProgrammingHeader
DisplayConnector SPI Flash
MIPI CSI-2 TX
Connector
Reset Switch
PolarFire FPGA TM
Included Image Sensor Board
Imaging and Video FMC
SmartFusion2 Advanced Delevopment Kit
Included Image Sensor Board
Imaging and Video FMC
SmartFusion2 Advanced Delevopment Kit
SmartFusion®2 Advanced Dev Kit with Imaging FMC PolarFire™ Video Kit
The Microchip name and logo, the Microchip logo, IGLOO and SmartFusion are registered trademarks and PolarFire is a trademark of Microchip Technology Incorporated in the U.S.A. and other countries. Arm and Cortex are registered trademarks of Arm Limited (or its subsidiaries) in the EU and other countries. All other trademarks mentioned herein are property of their respective companies. © 2019, Microchip Technology Incorporated. All Rights Reserved. 1/19 DS00002873A
www.microchip.com
Extensive Demonstrative Designs• Picture-in-picture with two cameras• Edge detection• Alpha blending, brightness, contrast, color balance ISP• 4K resolution with third-party HDMI2.0 IP
Hardware Development PlatformsPolarFire Video and Imaging Kit• 300K LE PolarFire FPGA in an FCG1152 package• Sony dual camera sensor for stereo vision applications• MIPI CSI2-RX @ 1.0 Gbps• MIPI CSI2-TX @ 800 Mbps• 4GB DDR4 @ 1.6 GBps• HDMI 2.0 (4K @ 60fps), HDMI 1.4 (UHD @ 60fps)• 3G/HD SDI, DSI, CSI-2 TX connector
SmartFusion2 Advanced Development Kit• SmartFusion2 SoC FPGA 150K LE M2S150TS-1FCG1152• MIPI CSI-2 sensor FMC: VIDEO-DC-MIPI• Parallel sensor FMC: VIDEO-DC-PRL
Comprehensive IP Suite The IP suite supports PolarFire, SmartFusion2, IGLOO2 and radiation-tolerant RTG4 product families.• Sensor interface—MIPI CSI-2, Parallel
• Display control (LVDS and parallel RGB-HDMI)• Source code in Verilog and VHDL* (requires licensing fee)Available from our partners: HDMI2.0, HDCP 2.2, Display Port 1.4, SLVS, H.264, JPEG 2000, JPEG and JPEG-LS compression and CODEC cores.*Verilog is only supported on source code for the SmartFusion2/IGLOO2 based solution.
Intuitive Software GUIEnables Video and Audio Configurations• Source selectable picture-in-picture menu• Alpha blending and overlay • Image edge detection and enhancements - color balance,
brightness, contrast
Which Device Family Best Suits Your Imaging Application?Feature PolarFire™ SmartFusion®2/IGLOO®2
Performance • [email protected], [email protected], CSI-2 [email protected], [email protected]• 1657 GMAC/s Max DSP Performance
• Transceivers@5G, DDR2/[email protected], [email protected]• Targets lower resolutions
Resolution Up to 4K (3840 x2160) Up to HD (1280 x 720)
Protocol Support MIPI CSI-2 (RX, TX),HDMI 2.0 ,3G SDI,DSI MIPI CSI-2 (RX),HDMI 1.4
Speed and Frame Rate
• MIPI: RX at 4.8 Gbps (4 x 1.0 Gbps), TX at 3.2 Gbps (4x 800 Mbps)• 4K @ 30 fps
• MIPI: RX only up to 700 Mbps, HS mode only• HD @ 30 fps
Ordering Information Microchip Video and Imaging Solution Product Order Code
PolarFire™ Video Kit MPF300-VIDEO-KIT
SmartFusion®2 Advanced Development Kit M2S150-DEV-KIT
Imaging and Video card with MIPI CSI-2 sensor module VIDEO-DC-MIPI
Imaging and Video card with parallel sensor module VIDEO-DC-PRL
Imaging and Video IP Suite RTL source VDSOLCores-RM and VDSOLCores-RMFL
For more information on the solution visit https://www.microsemi.com/product-directory/technology/3861-imaging#software-and-ip Send you queries and comments to [email protected]
• Bayer conversion• Color-space conversion• Image-edge detection
• Video scaler• Alpha blending and overlay• Image enhancement
