Safe Computing at the Edge - dvcon-europe.org20DV… · PUBLIC. 11. SENSE. THINK. ACT....
31
PUBLIC Chief Technology Officer Lars Reger Safe Computing at the Edge
Transcript of Safe Computing at the Edge - dvcon-europe.org20DV… · PUBLIC. 11. SENSE. THINK. ACT....
PUBLIC
Chief Technology Officer
Lars Reger
Safe Computing at the Edge
INTERNAL / PROPRIETARY 1Source: Extracted from Jefferies Report
10B -
100M -
1M -
0.01M -
1B -
10M -
0.1M -
1950
-
1970
-
1990
-
2000
-
2010
-
2020
-
1980
-
1960
-
Uni
ts S
hipp
ed
Bipolar ICs CMOS MPUDRAM
Bipolar Fast Air InterfaceServers
Free Storage, Big DataNeural Networks & Processing
Mainframe Mini-Computer PCs Cell Phones IoT/ AI
1 2 3 4 5
IoT/ AI the next innovation wave
Waves of Innovation – What’s Next?
Anticipate Demands For Our On-Demand Environments
At homeAt workIn productionFor logisticsFor mobility & transportationAt the point of saleFrom social services
INTERNAL / PROPRIETARY 3
2015 2016 2017 2018 2019 2020 2021 2022 2023 2024 20250
20
40
60
80
(Billions)
Install base edge nodes,
global market
Source: IHS
15 18 20 2327
31 3643
50
62
75
Enabled by Billions of Connected Edge NodesFrom 15 billion in 2015 to 31 billion in 2020
and 75 billion in 2025
PUBLIC 4
EverythingAware
Failure-free sensing of analog environment
EverythingSmart
Computing near end-nodes
EverythingConnected
Heterogenous wireless, energy efficient
EverythingActing
EfficientlyIntelligent actuators
EverythingSafe & SecureSafety, privacy, security
Think ActSenseBasic Architecture of Smart Devices
PUBLIC 5
Remote Access
Advanced Displays
Gateway Capability
Connected Services
Machine Learning
High Bandwidth Connectivity
Local Compute Capacity
Advanced Sensor Hub
Advanced HMI
Ingrained Security
The Ultimate Edge Node & End Point Device
PUBLIC 6
Large Hadron Collider
787
Kernal 2.6.0
Mars Curiosity Rover
Hubble Scape Telescope
Space Shuttle
MODERN HIGH END CAR
Source: Informationisbeautiful.net
Increasing Complexity of Vehicle Software
PUBLIC 7
T O D A Y T O M O R R O W
Distributed Flat Architecture• Low bandwidth network• One MCU per application
Gateway
Connectivity
Powertrain & Vehicle Dynamics
Connected Infotainment
Body & Comfort ADAS Autonomy
Domain ControllerDomain Controller
Domain Controller
Domain Controller Domain Controller
Domain Architecture• High performance domain MPUs• Edge nodes & sensors • High bandwidth• Gateway• Safety & security
Vehicle Architecture Transformation
PUBLIC 8
Vehi
cle
Net
wor
king
Smart VehiclesDomain-based Architecture
Connectivity
ADAS & Automated Driving
Powertrain &Vehicle Dynamics
Body & Comfort
Infotainment & In-Vehicle Experience
Connectivity
DC Infotainment & In-VehicleExperience
Powertrain &Vehicle
Dynamics
DC DC
DC DC
Body &Comfort
ADAS & Automated
Driving
Gateway
PUBLIC 9
SENSE THINK ACT
Connectivity Domain
Controller Connectivity
Infotainment & In-Vehicle
Experience
ADAS & Highly Automated Driving
Body & Comfort
Powertrain & Vehicle Dynamics
Camera
Lidar
Ultrasonic
Cockpit Domain
Controller
PowertrainDomain
Controller
BodyDomain
Controller
Radar
HVAC, Interior Lighting
Doors, seats, steering wheel,mirrors, wipers, sunroof
eCockpit
Audio & Amplifiers
Switch Panels
Motion & Pressure
SpeedSteering
AirbagSuspension
Cellular
WiFi, BT, GNSS, NFC
V2X
Smart Car Access
Safe Central Compute
& PlanningDomain
Controller
PowertrainDomain
Controller
BodyDomain
Controller
eCockpitDomain
Controller
Vehi
cle
Net
wor
ks
EngineTransmission
BrakeBattery Cell Management
Temp, Light, Humidity
Radio Reception
Touch Displays & Gesture
Voice Recognition & Audio
Smart VehiclesDomain-based Architecture
PUBLIC 10
Connectivity
Autonomy
Energy Management
Environment & Facility
Information Management,Human Machine Interaction
Sec
ure
Gat
eway
s &
Net
wor
ks
Secure broadband connectivity (wired [optical fibres] or wireless [5G])
Noise cancellation Smart information for staff (warnings, real time performance & quality data)Smart training (maintenance manuals etc)
Light, Temperature, Humidity, Room Occupancy & Smart Access
Smart Metering, Seamless supply of energy & water, Smart Charging, Management of renewable energy generation (solar, wind)
Self management function of the manufacturing line – ordering material, individualization of processes, surveillance, maintenance & cleaning, moving of production parts & smart logistics, warehousing
Industry 4.0 – Smart FactoryDomain-based Architecture
PUBLIC 11
SENSE THINK ACT
Cell PLCConnectivity
Information Management,
Human MachineInteraction
Autonomy
Environment &Facility
Energy Management
Hand guidance
Body pose tracking
Buttons, switches
Cockpit Domain
Controller
PowertrainDomain
Controller
Encoder, Motor currents
BodyDomain
Controller
Force, torque
Voice/ face recognition
Contact, capacity
Radar, laser, UWB
5G, Ethernet (TSN)
WIFI, BT, Thread
Touch, Joystick
Media supply
Smart Pad, Robot Control
Safety PLC
Industrial PC
Robot Control, Tooling
Net
wor
k G
atew
ay
NFC, RFID,
Fieldbus
VisionCell action
Motor control
Tool control
Program adjustment
Alarm, user feedback
Emergency stop, brake
User feedback
Robot program
Industrial AutomationSemiconductor Content
PUBLIC 12
Connectivity
Autonomy
Energy Management & Motion
Body Electronics & Controls
Human Machine Interface
Sec
ure
Gat
eway
s &
Net
wor
ksSmart Appliances – Example Cleaning RobotDomain-based Architecture
Secure connectivity (Contactless [NFC], wired or wireless [narrow band, cellular, BT, WiFi])
Gesture and speech recognition
Smart (wireless) charging
Highly efficient power management
Self-driving and self-management, machine learning capability on highly efficient µc and sensor architecture,
PUBLIC 13
Opportunity to Create ValueSystem Solutions & Functional Clusters
RepartitionCluster functions
IntegrateReduce number of
Components per domain
OptimizeReduce design
complexity & cost
Safety
Security
Cost
Upgradeability
Personalization
Low-to-high end
Energy efficiencyMaintenance
Computing Power
Reduced complexity
Faster to marketDifferentiate
Customizable
PUBLIC 14
Success Factors in System Innovation
Scalability/portability across markets
Integration of Functions with different safety & security requirements
PUBLIC 15
Processing for Smart Connected Devices
SenseSuperior Senses Think
Smart Compute
ActEfficient Control
ConnectSecurely
PUBLIC 161. Based on analysis of existing NXP Software code in existing customers’ applications2. Based on publicly available competitor roadmap performance statements versus today’s best safe auto platform
Reduces SW R&D1 by 35%10x the Performance2
Safe and SecureAutonomy – Safety
App
licat
ion
Spe
cific
IP
App
licat
ion
Spe
cific
IP
App
licat
ion
Spe
cific
IP
App
licat
ion
Spe
cific
IP
App
licat
ion
Spe
cific
IP
App
licat
ion
Spe
cific
IP
RadarNetwork Processing VisionBody &
General Purpose
Common ChassisSafety & Powertrain
Arm Cortex
Interconnect
Memory
Common Chassis
Arm Cortex
Interconnect
Memory
Common Chassis
Arm Cortex
Interconnect
Memory
Common Chassis
Arm Cortex
Interconnect
Memory
Common Chassis
Arm Cortex
Interconnect
Memory
Common Chassis
Arm Cortex
Interconnect
Memory
Common ChassisSecurity
Safety
Debug
Peripherals
Performance Arm Safe Secure OTA SW Reuse
Vehicle Architecture Transformation
PUBLIC 17
i.MX RT
Functional Integration
Perfo
rman
ce
Software compatibility & ease-of-useARM® Based
Purpose-built, dedicated SoC platforms
NXP Scalable Processing Continuum
PUBLIC 18
Success Factors in System Innovation
Scalability/portability across markets
Integration of Functions with different safety & security requirements
PUBLIC 19
Safety Application Software on M4, 2D GPU, & DisplayComplete Software Solutions Available for i.MX 8 and 8X Families
• FMEDA• SafeAssure Camera
Safety Manual• Code & Supporting
Documentation
• FMEDA• SafeAssure Audio
Safety Manual• Code & Supporting
Documentation
CompleteDocumentation
Packages
• FMEDA• SafeAssure Display
Safety Manual• Code & Supporting
Documentation
SafeAssureRVC
(Rear View Camera)
ASIL-A
SafeAssureDisplay
(Instrument Cluster)
ASIL-Bin development
SafeAssureAudio
(Chimes)
ASIL-Ain development
NXP SafeAssure Application Framework
PUBLIC 20
i.MX 8 and 8X Hardware Virtualization & SafetySafe Display, Camera, Audio & User Monitoring
2 Independent Operating Systems with thin Hypervisor
(Xen) or NO Hypervisori.MX 8 & 8X
PUBLIC 21
Perception and Modeling
Safe Path Planning
BlueBox
Perception & Modeling
Kalray• MPPA high performance AI
accelerator: Bostan & Coolidge portfolio up to 100 Tops
• Baidu Apollo 3.0 perception software
Safe Path Planning
BlueBox 2.0• Safe embedded AI
Processor: S32V2• High performance
embedded processor: LS2084A
• Baidu Apollo 3.0 path planning software
NXP & Kalray enable automotive-grade development platform for autonomous driving
End-to-End Automotive-Grade Development Platform • High Performance
- Embedded Arm® processor
- Embedded AI accelerator
• Addresses Level 3 Autonomy
• Roadmap to Level 5 Autonomy
PUBLIC 22
NXP #1 in Radar - Proven Performance with full System SolutionsTransceivers (SiGe, CMOS)MicroprocessorsPower ManagementNetwork InterfacesSoftware Development Kits for Algorithms Development
Mid-range, UltracompactMid-range Module
Chipset; SOP2018Tiny Antenna-in-Package,
SOP 2021Saving PCB cost and design–in efforts
High-performance Imaging
Chipset SOP 2021
Superior Senses with RadarSensor Platform With Imaging Capabilities, 360°
PUBLIC 23
Full End-to-End Secure Smart Access SystemLeveraging NXP’s Unique Leadership Position in Mobile Security & Secure Car Access
• Secure & precise localization by UWB
• Truly end-to-end: NXP is only supplier to provide all technologies across the system
• x-BL Collaboration to deliver end-to-end validated system solution
• Joint system & application team
• Driving standardization (IEEE, FiRa, NFC-Forum, CCC)
PhoneUWB, BLE, Secure NFC
Key FobUWB, BLE, Secure NFC
Smart CardMIFARE
Digital Key BackendPhone, car & smart home OEM backend
NXP Service Platform
Car
Ranging MPU + MPUUWB outsideBLEDoor NFC readerIn car NFC readerSecure Element
Door Lock
UWBNFCSecure Element
Full Smart Access Ecosystem Ownership
PUBLIC 24
World’s 1st MCU-based AVS development kit
Targets smart home for Alexa built-in
Enables drastically lower system level cost
Turnkey design shortens time-to-market
Alexa Voice Service
PUBLIC 25
• Scalable System Solutions
• Software / Hardware re-use across platforms
• Know-how transfer on critical competencies: functional safety, data privacy & security, quality
Efficiency and Simplifcation through:
Customer Pain Points
Rising Cost of IoT Solutions System Complexity Data Privacy &
SecurityFunctional
SafetyQuality &
Robustness
Great Potential for Broad-based Semiconductor Companies
PUBLIC 26
Standard Based Model Exchange for System Development
• Virtual integration on full system level (HW/SW)
• Accelerate shift left life cycle
• Standard model interfaces in the supply chain
• Model based eco-system
• Standards to support inter-model, inter-tool,
V&V
Model-enabled concurrent workflows
SoC Model ECU Model
Vehicle Model
EnvironmentModels
Chip models Multi Chip models Multi ECU & Multi Chip
Interaction of Simulation frameworks
IP Models
Cores,Accelerators
Software Partner
Feature Software
ECU Test & Release
NXPDriverOS
PUBLIC 27
Standard Based Model Exchange Connectivity
DC Infotainment & In-VehicleExperience
Powertrain &Vehicle
Dynamics
DC DC
DC DC
Body &Comfort
ADAS & Automated
Driving
Gateway
SoC ModelECU Model
Vehicle Model
EnvironmentModels
Chip models Multi Chip models Multi ECU & Multi Chip
Interaction of Simulation frameworks
IP Models
Cores,Accelerators
• IP to SoC modeling interface
• ECU model interfaces
• Vehicle model interfaces
• Environment model interfaces
Standards needed support
inter-model, inter-tool, V&V
PUBLIC 28
Bringing the Edge to LifeAdvancing solutions that make lives easier, better and safer.
Sense Process Connect Act
Leading functional safety & security
WHO ISN’T DREAMING OFCHANGING THE WORLD
NXP, the NXP logo and NXP SECURE CONNECTIONS FOR A SMARTER WORLD are trademarks of NXP B.V. All other product or service names are the property of their respective owners. © 2019 NXP B.V.
