Shri Sundaram, May 8, 2017
BUILDING AUTONOMOUS VEHICLES USING DRIVE PX 2
2
Autonomous Vehicles Artificial Intelligence
NVIDIA AT THE CENTER OF AV REVOLUTION
3
Launched CES 2016
Spike in AV AI engagements after we powered on the discrete GPU late last year
DRIVE PX 2 DRIVING AV AI
4
DRIVE PLATFORM TODAY FOR LEVEL 3/4
DRIVE PX (Xavier)
5
BUILDING BLOCKS
Autonomous Driving SDK
Compute – APIs and Libraries
Compute Engines & IOs
• DriveWorks
• CUDA
• CuDNN
• Tensor RT
• NVMedia
• GPU
• Accelerators
• Sensors
6
BUILDING BLOCKS
Autonomous Driving SDK
Compute – APIs and Libraries
Compute Engines & IOs
• DriveWorks
• CUDA
• CuDNN
• Tensor RT
• NVMedia
• GPU
• Accelerators
• Sensors
7
COMPUTE & IO
System
IOs: 70+ Gbps
Compute: 20+ DL TOPS
SW: Linux, RFS, BSP, OTA
Sensors/Actuators
Camera, Lidar, Radar
DBW, CAN interface
+ More incl. IMU, GPS, V2X modules
8
BUILDING BLOCKS
Autonomous Driving SDK
Compute – APIs and Libraries
Compute Engines
• DriveWorks
• CUDA
• CuDNN
• Tensor RT
• NVMedia
• GPU
• Vision Processors
• Accelerators
9
CUDA
DRIVE PX 2 has latest CUDA-capable GPU – 4x!
Runs latest CUDA 8.
Includes CUDA accelerated DL SDK
TensorRT
CuDNN
CuBLAS.
10
TENSOR RTGPU Inference Engine
11
NVMEDIA
NVMedia: APIs to control cameras as well data
NVMedia abstracts:
• Image capture
• Image Signal processor
• 2D Engine
• Encoding
• Interop with other SW components
12
BUILDING BLOCKS
Autonomous Driving SDK
Compute – APIs and Libraries
Compute Engines
• DriveWorks
• CUDA
• CuDNN
• Tensor RT
• NVMedia
• GPU
• Vision Processors
• Accelerators
13
DRIVEWORKS
Input
Perceive
Localize
Visualize
Vehicle Control
APIsSensors
IMU
GPS
Image Processing
DNN interface
CV Modules
HD Maps interface
CAN/DBW Kit
interface
Tools -Calibration and sensor registration
Vehicle rig configuration
Data Logging/Acquisition
Samples/ Previews
Sensor visualization
DriveNet
LaneNet
Several CV examples
Occupancy Grid
*PilotNet
14
DRIVE PLATFORM
DriveWorks
CUDA, CuDNN, TensorRT
NVMedia
DRIVE PX 2 — System Software
DRIVE PX 2 — System Hardware Vehicle Control
DNNs and Autonomous Driving Applications
Sensors
HD Maps
15
PX2: ON WHEELS
HW
DRIVE PX 2 nicely mounted in the trunk of a car, pre-wired for cameras, and other sensors
Sensors - Your choice or NVIDIA’s configuration.
SW
All of what comes with DRIVE PX2
Photo Courtesy: AutonomouStuff
16
DRIVE PLATFORM
HW
ZF Pro AI – built on DRIVE PX 2 Auto Cruise
Bosch – building on DRIVE PX using Xavier
Xavier: 30 DL TOPS + ASIL-C for Level 4
SW
QNX - Common arch across Linux and QNX
Common APIs across CUDA, TensorRT, cuDNN, NvMedia + Support for POSIX APIs
For production
http://www.qnx.com/partners/partner.html?partnerid=161247
17
OTHER RESOURCES
Tools
Application Development tools
Developer Zone (developer.nvidia.com/DRIVE)
Developer Forums (devtalk.nvidia.com)
Schools
Deep Learning Institute – Autonomous Driving
Udacity Nanodegree
18
DRIVE Platform
DRIVE Platform – Open AI Autonomous Vehicle platform
One architecture, from L2 to L3 to L4 to AI Car
DRIVE PX 2 for L3, L4 development today
Top Related