Laser World of Photonics, Munich 29 June 2017 …...Jose Pozo Director of Technology and Innovation...
Transcript of Laser World of Photonics, Munich 29 June 2017 …...Jose Pozo Director of Technology and Innovation...
Jose Pozo Director of Technology and Innovation
EPIC [email protected]
Mobile: +31 626978312
Laser World of Photonics, Munich 29 June 2017
Photonics for the Automotive Industry: focus on ADAS
EPIC European Photonics Industry Consortium
EPIC is the industry association that promotes the sustainable
development of organisations working in the field of photonics
in Europe. EPIC fosters a vibrant photonics ecosystem by
maintaining a strong network of 260+ members and acting as
a catalyst and facilitator for technological and commercial
advancement. EPIC publishes market and technology
reports, organizes technology workshops and B2B
roundtables, coordinates EU funding proposals, advocacy
and lobbying, education and training activities, standards
and roadmaps, pavilions at exhibitions.
www.epic-assoc.com
Our members and activities encompass the entire value chain from:
• Biophotonics
• Displays
• Imaging
• Lasers (for industrial, military, medical applications)
• LED, OLED, and Smart Lighting
• Optic fiber
• Optical components
• Photonic Integrated Circuits: III-V, Silicon Photonics, and TriPleX
• Projectors
• PV solar energy including CPV and OPV, and Batteries
• Sensors (for automotive, defense, medical, … applications)
• and all other photonic related technologies
EPIC members have free access to professional technology and market reports
199 SLIDES
Helping EPIC
members
analyse new
markets!
20-30 events per year but….
We are not an event organizer We build knowledge, value and supply
chains
Upcoming events
The trend toward innovation is a huge opportunity for the
Photonics industry. It allowed and will continue to allow new
photonic technology to enter the car.
Evolution of Photonics in Automotive
2005
2010
2020
Entertainment
Comfort
Security
Transmitter for MOST
networks, Hamamatsu
LIDAR, Velodyne
LEDs for ambient
interior lighting, Hella
Technologies: MOST (Media Oriented System
Transport), LCD display for passengers
Technologies: Basic optical components
(photodiodes, thermopiles),
LEDs for interior lighting
Technologies: LIDARs, stereovision camera
systems, Head-up Displays, LEDs
headlamps, laser headlamps, …
Automation vs driver
Currently connectivity and autonomous driving are optional
features in automotive but safety is not
Architecture of Systems for ADAS
Observation Perception Planning &
Decision Action
Information provided by external
source
Simulation and
data processing
Control Unit /
Intelligence
Actuators
Communication systems
Outside:
Radar, LIDAR,
Cameras, Ultrasounds
Inside:
Cameras, Speed
monitoring systems
Data collection and
analysis
Scene description: ego
positioning, objects
trajectory, lane
boundaries, …
Trajectory planning
Emergency brake assist
Emergency steering
assist
Active: Brake, motor,
steering gear
Passive: Airbags,
headlamps
Warnings : sound,
light alarm, displays
Li-Fi, Wi-Fi, Radio-
wave, Micro-wave
Sensors
In red: where Photonics can provide
performant functions and technologies
Road infrastructure,
other vehicles, …
Ca
r
Technology description System composed of an image sensor, packaging and software. Used for imaging applications.
Cameras for ADAS - Synthesis
10
Main sensors providers
Applications in ADAS
Current
• Parking assistance, Lane Keeping Assist, Blind Spot Detection, Traffic Sign Recognition,
Adaptive Cruise Control, Automatic Emergency Braking
Future
• 360° mapping of the car surroundings in 3D
Camera for Lane Keeping Assist, Valeo
Advantages
- Very low cost safety system
- Highly compact
- Easy hardware implementation
Limitations
- Low performance in bad weather conditions and at night
- Requires complex software
Stereovision camera system, Bosch
Photonics, an enabler of ADAS > Current and future photonic technologies > Imaging & sensing outside the car
11
Future camera detectors in cars
Reducing size of components while keeping great accuracy and fast processing are major requirements of automotive manufacturers
Integrating the image processing core directly with the sensor is a promising solution
Example:
The Fraunhofer Institute for Reliability and Microintegration IZM and CogniVue co-developed a microcamera module
CogniVue is a Canadian company that provide a new kind of image processing core for embedded vision, the APEX Image Cognition Processor (ICP)
Combining this technology with the assembly and
interconnection skills of the Fraunhofer IZM allowed the
release a reduced size camera of 1,2 cm3 (without the
optics) offering fast and reliable image processing.
First applications in automotive is Traffic Sign Recognition
but algorithm are under development to allow Lane
Keeping Assist or pedestrian and animals detection. The
camera could also be used for driver drowsiness monitoring Cross-section of the microcamera
(source: Fraunhofer IZM)
Photonics, an enabler of ADAS > Current and future photonic technologies > Imaging & sensing outside the car
12
Future camera systems in cars – Multiple camera systems
On the way toward automated driving, mapping in 3D the complete surrounding of the vehicle will be necessary
One way of achieving this goal is to use several camera systems (generally stereovision) to monitor the environment of the car in real-time and in 3D
Example:
The Italian laboratory VisLab (Artificial Vision and Intelligent Systems Laboratory) in Parma has developed several driverless vehicles prototypes over the last 15 years.
Most of their autonomous driving systems are a combination of several sensors (LIDArs, RADARs, cameras, …)
• In 2010, they ran a real conditions test from Parma to
Shangaï with a system based on 4 laser scanners, 4
stereovision systems, a large field-of-view camera and
a GPS
Their latest goal is to provide a system mainly based
on cameras to replace expensive 3D mapping LIDARs
• The Deeva prototype vehicle holds around 20 cameras
and 4 laser scanners and looks like a normal vehicle Deeva, the new autonomous vehicle of VisLab
Photonics, an enabler of ADAS > Current and future photonic technologies > Imaging & sensing outside the car
13
Main Players
Detector Tier One Suppliers OEMs
Photonics, an enabler of ADAS > Current and future photonic technologies > Imaging & sensing outside the car
Technology description LIDAR (Light Detection and Ranging) uses light to detect objects and measure distances.
LIDARs for ADAS - Synthesis
14
Main LIDAR Players
Applications in ADAS
Current
• Adaptive Cruise Control
• Forward collision avoidance and warning
Future
• 360° mapping of the car’s surrounding for autonomous driving
Small size 3D mapping LIDAR, Velodyne Advantages
- High resolution and field of view
- High measurement range
Limitations
- Poor performance in bad weather conditions
- High cost of 360° mapping systems
Photonics, an enabler of ADAS > Current and future photonic technologies > Imaging & sensing outside the car
Principle of LIDARs
A pulsed laser beam illuminates an object to detect
The light backscattered by the object is then collected and sent onto a photodetector
The distance to the object is deduced from the measurement of the time between the pulse emission and the reception of the reflected pulse
By using mirrors or prisms, the laser scans the environment in 2D over a certain field of view (FOV), it is then possible to obtain a depth map
15
LIDAR - Presentation
Laser
Object to
detect
Backscattered
light
Photodetecto
r Reception
optics
Signal
processing
Emission
Reception
For applications in automotive,
there are 2 types of LIDAR:
The ‘‘laser range finder’’
type: object detection in
front of the car
The ‘‘3D mapping’’ type:
360° scanning of the
environment of the car in
3D
Operating principle of a LIDAR
Photonics, an enabler of ADAS > Current and future photonic technologies > Imaging & sensing outside the car
Comparison with RADAR sensors:
16
Competing technology of LIDARs
Laser RADAR from Denso
Short range LIDAR from
Continental
LIDAR RADAR (long range)
905 nm (eye-safe) Operating band 77 GHz
+ Speed, distance,
angle, object width
Measured parameters Speed, distance
Up to 200 m Detection range Up to 200 m
Relative speed range - 100 km/h…+250 km/h
+ Resolution
+ (~30-40° horizontal)
Field of view (~10-20° horizontal)
Bad weather condition ++
Low reflectance objects (dirt vehicle, pedestrians,…)
+
+ (400 – 600 €)
Sub-system cost (800 – 2 000 €)
The main drawback that limits the adoption of LIDAR in cars is its poor
performance in bad weather conditions (rain, fog, snow, …)
Photonics, an enabler of ADAS > Current and future photonic technologies > Imaging & sensing outside the car
Velodyne (USA)
Started LIDAR activity in 2005
1st product based on 64 lasers and a
spinning head to provide 360° FOV
Integrated on the roof-top of the self-
driving car of Google in 2012
Latest product from Velodyne is based
on 16 lasers, holds in a hand and cost
less than 10 000 €
17
Future LIDAR in cars – Early players of 3D mapping LIDAR
Ibeo Automotive Systems (Germany)
Founded in 2010 (product
development started in 2007)
Partnership with Valeo since 2010 for
co-development
Ibeo LIDAR product offer:
• Sensor fusion: up to 6 LIDARs can be
combined to enable 360° sensing with
special algorithm for data
synchronization
• Object tracking: based on contour
matching, for better object recognition
Ibeo Lux, Ibeo
Velodyne’s LIDAR on top of the Google Car
Photonics, an enabler of ADAS > Current and future photonic technologies > Imaging & sensing outside the car
18
Future LIDAR systems in cars – Flash LIDAR cameras
In 3D mapping LIDAR, one of the major technical challenge lies in the
mechanical scanning that is necessary to provide 360° information
A way of increasing reliability and robustness – and reducing maintenance
requirements - of LIDAR would be to remove scanning : it is what flash LIDAR
cameras do
Flash LIDAR cameras are a type of time-of-flight (TOF) cameras for long range
3D imaging
Flash LIDAR cameras look like a 2D digital camera but have the additional
ability of providing depth information
Photonics, an enabler of ADAS > Current and future photonic technologies > Imaging & sensing outside the car
Comparison of 3D imaging methods principle
Source: Vision Systems
Adoption of LIDAR will remain below 1% until 2020
The adoption of laser range finder will be faster than laser 3D mapping thanks to a lower cost but will remain low because of high competition with RADAR
Cost of 3D mapping LIDAR is dramatically decreasing but their wide adoption should happen after 2025 when complex autonomous driving in city will begin to be implemented into cars
19
Cost and Adoption Rate of LIDAR over Years
1
10
100
1000
10000
100000
0,00%
0,10%
0,20%
0,30%
0,40%
0,50%
0,60%
2013 2014 2015 2016 2017 2018 2019 2020
ASP
(€
)
Ad
op
tio
n r
ate
LIDAR adoption rate and cost over year
LIDAR 3D mapping
LIDAR range finder
Laser range finder ASP
Laser 3D mapping ASP
Photonics, an enabler of ADAS > Current and future photonic technologies > Imaging & sensing outside the car
©
20
Main players of LIDARs in Automotive
LIDAR
manufacturers Tier One Suppliers OEMs
LIDAR range finder
3D mapping LIDAR
Photonics, an enabler of ADAS > Current and future photonic technologies > Imaging & sensing outside the car
Technology description Camera systems using infrared wavelengths to image at night.
Night Vision - Synthesis
21
Main Technology Players
Applications in ADAS
Improving night driving safety:
• Detect animals, pedestrians or other objects on the road
• Warn the driver about potential collisions
Detection of pedestrians thanks to night vision Source: thecarexpert.co.uk
Advantages
- Good imaging resolution
- Good measurement range
Limitations
- Expensive
- Poor performance in bad weather conditions
Photonics, an enabler of ADAS > Current and future photonic technologies > Imaging & sensing outside the car
22
Future systems for night vision in cars
Emerging product: Fusion of active and passive systems
Principle:
• Both an NIR imaging system and a thermal imaging system are integrated into the car
• The NIR system provides high resolution images displayed on an in-dash display
• The FIR system, that has a lower resolution, provides reliable detection and identification of objects on the road through thermal signatures
Future technology : competition with LIDAR 3D mapping
With the development of automated driving, LIDAR for 3D mapping of the car environment
are expected to be widely adopted for day and night driving
Combination of NIR and FIR imaging to enhance night vision
(source: ADOSE FP7 project)
Advantages
- Increased detection sensitivity and range compared to NIR imaging
- Increased resolution compared to FIR imaging
Limitations - Increased complexity
of data processing due to NIR and FIR data fusion
- Very expensive
Photonics, an enabler of ADAS > Current and future photonic technologies > Imaging & sensing outside the car
23
Current IR detectors in cars - Comparison
Parameters CCD – CMOS
(Active IR imaging)
Microbolometers
(Passive IR imaging)
Wavelength 800-900 nm 7.5 - 14 µm (7 500 - 14 000 nm)
Detection range up to 100 m up to 400 m
Resolution Higher Lower
Sensor size Smaller Larger
Limitations for
applications in automotive
Poor performance in adverse
conditions
Dazzled by opposing vehicle’s
headlamps
Poor performance in adverse
conditions
Do not work behind windshield and so
are exposed to dirt, dust, humidity,
heat
Advantages for
applications in automotive
Lower cost
High resolution
High detection distance range
Photonics, an enabler of ADAS > Current and future photonic technologies > Imaging & sensing outside the car
24
Main Players
Camera Tier One Suppliers Automakers
Active IR imaging
Passive IR imaging
Aftermarkets
Stopped option
in 2014
Other chineese
companies Chineese
companies
Valeo and Sagem signed a partnership in 2010 for the co-development of camera
systems for night vision and bad weather conditions driving in military and civil
automotive applications
Active + passive
Photonics, an enabler of ADAS > Current and future photonic technologies > Imaging & sensing outside the car
Technology description Advanced headlamps that adapt mechanically or electronically the light beam to the driving situation. Situation information are provided by sensors.
Adaptive Frontlighting - Synthesis
25
Main Technology Players
Applications in ADAS
Adapt the shape of the headlamp beam to the situation:
• Town or highway
• Straight or bended road
• Wet or dry roads
• Presence or absence of other vehicles
Audi matrix LED adaptive front lighting Source: automoto.ba ; autoevolution.com
Advantages
- Improve visibility at night
- Detect potential danger earlier
Limitations
- More expensive and bulky than classic headlamps
- Can be disturbing for the driver
Photonics, an enabler of ADAS > Current and future photonic technologies > Lighting in ADAS
26
Illustration of the principle of LED matrices
Parameters to monitor:
Speed
Outside brightness
Presence of other
vehicles by detecting
head or rear lights
Distance to other vehicles
Opel LED matrix headlamps
Photonics, an enabler of ADAS > Current and future photonic technologies > Lighting in ADAS
27
Lighting
components Tier One Suppliers Automakers
AFS based on HID
LED Matrices
Photonics, an enabler of ADAS > Current and future photonic technologies > Lighting in ADAS
Main players
Technology description Systems using light sources and optical receiver to transmit information.
Optical communication for ADAS - Synthesis
28
Main Technology Players
Applications in ADAS
Current:
• Vehicle-to-infrastructure communication for electronic toll payment and
parking access control
Future
• Vehicle-to-infrastructure and vehicle-to-vehicle communication to share
traffic and safety data
Principle of car-to-X communication, Mercedes-
Benz
Image
Advantages
- High speed
- Secure network as data are directed from one device to another (difficult to hack)
Limitations
- More expensive than Wi-Fi
- Can be impaired by obstacles on the optical path
Photonics, an enabler of ADAS > Current and future photonic technologies > Communication
Visible Light Communication
Applications of car-to-car or of car-to-infrastructure communication include:
Cooperative Adaptive Cruise Control
Cooperative Forward Collision Warning
Intersection collision avoidance
Approaching emergency vehicle warning (Blue Waves)
Transit or emergency vehicle signal priority
Electronic parking payments
Rollover warning
Highway-rail intersection warning
Electronic toll collection
In the first place, the system would only alert the driver with a warning sound or light, but future developments will allow braking automatically, adapting speed or changing the direction of the car.
Technology description Human-machine interface allowing the display of driving information directly in the line of sight of the driver.
Head-Up Display - Synthesis
30
Examples of Players
Applications in ADAS
Current
• Display basic information: vehicle’s speed, fuel level, directions
Future
• Display critical safety information provided by ADAS sensors
Head-Up Display, Bosch Advantages
- Driver’s eyes remain on the road
- Reduce driver’s fatigue
- Enhance driving in low visibility conditions
Limitations
- Bulky system
- Brightness performance are not always good enough
Photonics, an enabler of ADAS > Current and future photonic technologies > Head-up Displays
More and more photonic technologies are going to be adopted for a wide range of
ADAS functions in the car.
In 2020, we can imagine a driver assistance package based only on photonic
technologies:
31
Cost of a Photonic driver assistance package in 2020
3D mapping
LIDAR
13 cameras (4 stereovision
systems to back-up LIDAR, 1
camera for TSR and LKA, 1 for
driver monitoring, 3 for
passenger monitoring)
Head-up display Adaptive front-lighting
system
Basic sensors (photodiodes for rain
and luminosity
detection)
600 € 130 € < 10’s € 160 € 100 €
2020 total ADAS Photonics package cost:
~1 000€
Option price : ~ 4 - 5 000€
i.e. ~10-15% of the car’s cost Source: Tematys
Photonics, an enabler of ADAS > Conclusion
320 members as of 29 June 2017