Enabling Automotive Solutions at Scale with Arm · Arm in Automotive, bumper to bumper Powertrain...

© 2017 Arm Limited

Robert Day

Director, automotive solutions and platforms, Arm Inc.

Enabling Automotive Solutions at Scale with Arm

Arm Technology Symposium – JapanDecember 2018

© 2018 Arm Limited 2

© 2

01

8 A

rm L

imit

ed

Arm in Automotive, bumper to bumper

Powertrain

IVI / Cockpit

ADAS / Autonomous

Body

Connectivity

Continuously supporting the automotive market since

1996

share of ADAS application processors

>65%

Providing the technology to reach the deployment at scale of the highest levels of autonomy

share of IVI applicationprocessors

>85%

© 2

01

8 A

rm L

imit

ed


Trend : The ‘drive’ to autonomy

Level 1

Driver Assistance

Everything on

ACC (Braking)Lane KeepingAuto Emergency BrakingParallel Park Assist

Level 2

Partial Automation

Feet Off

ACC (Steering)Lane ChangingTraffic Jam AssistOvertaking Assist

Level 3

Conditional Automation

Hands Off

Highway Driving ~ 50mph

Driver Initiated Lane ChangeAutomated Valet ParkTraffic Jam Chauffeur

Level 4

High Automation

Eyes Off

Highway Driving ~100mphAutomated Lane ChangeCruising ChauffeurFree Drive

Level 5

Full Automation

Mind Off

Robo-taxiAutonomous Shuttle

All driving conditions

ADAS Autonomous

2000 2013 2018 2024 2027-2030 ?


AV Adoption curve by ADAS level – in % of global new car sales

Trend : The pace of ‘drive’ to autonomy


Trend : The price of autonomy

Price tag of a L4/L5 Car ($ selling price)


Ultra

sonic

sensor

Cabin monitor camera

Lidar

Rear view

camera

Laser

scanner

Long-

range

radar

Mid-

range

radar

Mid-

range

radar

Mid-

range

radar

Micro-phone

Biometric sensors

360°camera

360°camera

360°camera

Frontview

camera

Ultra sonic

sensor

Trend : The sensor complexity of autonomy

Mid-

range

radar

200 sensors will be used in a car by 2020


Trend : The software complexity of autonomy

Level 5 autonomous car

Boeing 787 Dreamliner

1bnlines of codelines of code

14m

Source: Informationisbeautiful.net & Talisman Executive


Trend : The performance, size, power and thermal of autonomy

• Current Autonomous Levels are reaching L3 for 2018

• Companies are racing to build L4/5 systems for prototype deployment in 2021/2022

• First production of L4/5autonomous vehicles are likely 2024

• But, true mass deployment needs server compute performance, with massively reduced power consumption, constrained size and deployable thermal properties

• Not just a server in a trunk!

By Steve Jurvetson - originally posted to Flickr as Junk in the Trunk, CC BY 2.0, https://commons.wikimedia.org/w/index.php?curid=8271698


Sense Perceive Decide Actuate

• Multiple sensor technologies required for L3+ autonomy

• Range of sensor types with increasing number of sensing points as autonomy rises

• Sensor fusion will also rely on accurate and consistent V2X data

• High levels of scalable amounts of compute required for perception processing

• Large data set needs multiple stages of processing

• Accelerators aid in deep learning algorithms

• Demand for increased level of functional safety in decision making

• Decision making shared between application processing and real time processing with highest safety level

• Changes to the vehicle’s lateral / longitudinal dynamic response must be at the highest functional safety level and must be real time and deterministic.

Assessing the compute capabilities for Autonomous Systems



Meeting the challenge of on board computing


Cortex-AHighest performance

Optimized for rich operating

systems

Cortex-RFast response

Optimized for high performance,

hard real-time applications

Cortex-MSmallest/lowest power

Optimized fordiscrete processing

and microcontrollers

Arm CPUs cover all automotive processing needs


Autonomous systems share a common foundation

Autonomous system


Arm Cortex-M

Arm Cortex-A

Arm NPU

Arm Cortex-R Arm Cortex-M

Gather environment information from

sensors

Filter, interpret & understandsensor data

Safely choose actions

Initiate actions

Arm Cortex-R

Arm Cortex-A Arm Cortex-A Arm Cortex-R


Autonomous systems require a lot of compute

AV controller

Accelerators

Throughput Comp’ Real-time Comp’

Storage

V2x

Body Powertrain Chassis Safety

Modem

Centralised ArchitectureCentral Car computer

Distributed ArchitectureSensor fusion at the edge

AA

AAR

Radar

RR R

R

ML ML X XVision

Vision

R

LiDAR

RR R

Intelligent local signal processing nodes

Thin slave camera node

Intelligent camera node

ISPGateway

R R

AA

AA

AA

AA

I/O

R R

R RA Security

Cortex-M & Cortex-R nodes(Control & small sensors)


Heads Up Display

Connected Services

Music & Video Streaming

Driver Assistance More DisplaysDigital Cluster

Driver Alertness

Mirror Replacement

ReconfigurabilityGesture Recognition

Trend 2 : Building the digital cabin


Technical Considerations for a Changing Cabin Experience

• Consolidation of Cockpit Systems (Cluster, IVI, HUD)

• Mixed-Criticality Systems - Safety + non-safety

• Virtualization and QoS features required

• Ubiquitous connectivity inside and outside the cabin

• Full autonomy will require a complete digital cabin to keep the passengers occupied

Arm is well positioned to meet these challenges with its new generation of Automotive Enhanced processors and continue to be the architecture of choice for the next generation of the digital cabin

One Display View

Pure SafetyCritical Layer

Complex 3DAnimations

ES Layer


Cockpit consolidation architecture

ECUECU

Heads up

Display

LiDARs

Radars

ECUs

V2X/5G

Cameras

Surround

Information

Display

ADAS

ECU

IVI

Head Unit

Meter

Cluster

Surround

Information

Display

Cockpit

ECU

QM / ASIL A

ASIL B

ASIL C/D


A head-start on SafetySpans the Arm Portfolio

Software tools Systematic

certification to ISO26262

Certified software components

Broadest functional safety IP

Comprehensive safety documentation

Innovative safety features for automotive

applications

Leading features and technologies

Software components and tools

Robust methodologies and certification


Automotive Enhanced (AE) Products

Uniquely designed for automotive applications

Features targeting specific automotive use cases, enabling future innovation

Application processors now available with Split-Lock capability

Expanding to a wider range of automotive IP in the future


Automotive Enhanced (AE) Products

Uniquely designed for automotive applications

Features targeting specific automotive use cases, enabling future innovation

Application processors now available with Split-Lock capability

Expanding to a wider range of automotive IP in the future


Split-Lock: Split for performance, Locked for safety

Processors locked for safety

Processors split for performance


Split-Lock: Flexibility for multiple applications

Two cores run the same instructions

Each operation is checked

Giving a higher level of safety

Without increased software complexity

Processors locked for safety


Cortex-A76AE: World's first autonomous-class processor with integrated safety

Game-changing safety innovations optimized for 7nm

Best-in-class performance

per watt

Safety capable to industry standards ISO26262 ASIL

D systematic

Developed for automotive use cases

First application processor with

Split-Lock

<15W Compute Complex *

250 KDMIPS

Autonomous-class performance

>250 KDMIPS <30W SoC

*16 core Cortex-A76AE configuration with CMN-600AE at 7nm


16 core Cortex-A76AE SoC

Flexible software implementations for safety from Arm

Operating System(s)

Non-safe and ASIL B applications

Split Clusters

Mixed criticality applications

Software complexity increases with mixed criticality applications

Split-Lock on Cortex-A76AE is designed to be transparent to software

Simplification of software integrationLocked Clusters

ASIL D applications

Safety RTOS

Safety certified hypervisor


Autonomous vehicle ecosystem: complex and broad


Autonomous software stack supported by a proven Arm automotive ecosystem

Middleware

Operating System/Hypervisor

Maps Control

LocalizationPerception

Planning

SensorFusion

Ubiquitous compute architecture

Platform Security Communication

Commercial Open Source


Arm partners creating Arm autonomous vehicle dev solutions

Blue Box 2

8 x Cortex-A72

+ 4 x Cortex-A53

+ Cortex-M4

DRIVE Pegasus

16 x ARM64 CPUs + GPUs

First computing platform

to handle Level 5 driverless vehicles

HAD solution kit

8 x Cortex-A57

+ 8 x Cortex-A53

+ 2 x Cortex-R7 (DCLS)

EVOLVER

3rd generation:

Multiple Cortex-A57, A53 and Cortex-R7 dual core lock step (DCLS)


Summary – the road to mass deployment of autonomous vehicles

• The market is driving us full force towards higher levels of autonomy (level 3,4,5)

• The level of processing required to run the 100s of millions of autonomous lines of code is currently using server processors which is not a deployable solution for automotive

• Arm has just introduced Cortex-A76AE, the first safe Autonomous-class processor coupling performance with safety

• These power efficient processors coupled with ISP, GPU, ML technologies can provide this processing power at an acceptable power/thermal level

• Innovators are creating solutions today enabling high levels of autonomy based on Arm technology

• The automotive ecosystem surrounding Arm is key to mass deployment

The Arm trademarks featured in this presentation are registered trademarks or trademarks of Arm Limited (or its subsidiaries) in

the US and/or elsewhere. All rights reserved. All other marks featured may be trademarks of their respective owners.

www.arm.com/company/policies/trademarks

© 2018 Arm Limited

Enabling Automotive Solutions at Scale with Arm · Arm in Automotive, bumper to bumper Powertrain...

Documents

Transcript of Enabling Automotive Solutions at Scale with Arm · Arm in Automotive, bumper to bumper Powertrain...