Shri Sundaram, May 8, 2017

BUILDING AUTONOMOUS VEHICLES USING DRIVE PX 2

2

Autonomous Vehicles Artificial Intelligence

NVIDIA AT THE CENTER OF AV REVOLUTION

3

Launched CES 2016

Spike in AV AI engagements after we powered on the discrete GPU late last year

DRIVE PX 2 DRIVING AV AI

4

DRIVE PLATFORM TODAY FOR LEVEL 3/4

DRIVE PX (Xavier)

5

BUILDING BLOCKS

Autonomous Driving SDK

Compute – APIs and Libraries

Compute Engines & IOs

• DriveWorks

• CUDA

• CuDNN

• Tensor RT

• NVMedia

• GPU

• Accelerators

• Sensors

6

BUILDING BLOCKS

Autonomous Driving SDK

Compute – APIs and Libraries

Compute Engines & IOs

• DriveWorks

• CUDA

• CuDNN

• Tensor RT

• NVMedia

• GPU

• Accelerators

• Sensors

7

COMPUTE & IO

System

IOs: 70+ Gbps

Compute: 20+ DL TOPS

SW: Linux, RFS, BSP, OTA

Sensors/Actuators

Camera, Lidar, Radar

DBW, CAN interface

+ More incl. IMU, GPS, V2X modules

8

BUILDING BLOCKS

Autonomous Driving SDK

Compute – APIs and Libraries

Compute Engines

• DriveWorks

• CUDA

• CuDNN

• Tensor RT

• NVMedia

• GPU

• Vision Processors

• Accelerators

9

CUDA

DRIVE PX 2 has latest CUDA-capable GPU – 4x!

Runs latest CUDA 8.

Includes CUDA accelerated DL SDK

TensorRT

CuDNN

CuBLAS.

10

TENSOR RTGPU Inference Engine

11

NVMEDIA

NVMedia: APIs to control cameras as well data

NVMedia abstracts:

• Image capture

• Image Signal processor

• 2D Engine

• Encoding

• Interop with other SW components

12

BUILDING BLOCKS

Autonomous Driving SDK

Compute – APIs and Libraries

Compute Engines

• DriveWorks

• CUDA

• CuDNN

• Tensor RT

• NVMedia

• GPU

• Vision Processors

• Accelerators

13

DRIVEWORKS

Input

Perceive

Localize

Visualize

Vehicle Control

APIsSensors

IMU

GPS

Image Processing

DNN interface

CV Modules

HD Maps interface

CAN/DBW Kit

interface

Tools -Calibration and sensor registration

Vehicle rig configuration

Data Logging/Acquisition

Samples/ Previews

Sensor visualization

DriveNet

LaneNet

Several CV examples

Occupancy Grid

*PilotNet

14

DRIVE PLATFORM

DriveWorks

CUDA, CuDNN, TensorRT

NVMedia

DRIVE PX 2 — System Software

DRIVE PX 2 — System Hardware Vehicle Control

DNNs and Autonomous Driving Applications

Sensors

HD Maps

15

PX2: ON WHEELS

HW

DRIVE PX 2 nicely mounted in the trunk of a car, pre-wired for cameras, and other sensors

Sensors - Your choice or NVIDIA’s configuration.

SW

All of what comes with DRIVE PX2

Photo Courtesy: AutonomouStuff

16

DRIVE PLATFORM

HW

ZF Pro AI – built on DRIVE PX 2 Auto Cruise

Bosch – building on DRIVE PX using Xavier

Xavier: 30 DL TOPS + ASIL-C for Level 4

SW

QNX - Common arch across Linux and QNX

Common APIs across CUDA, TensorRT, cuDNN, NvMedia + Support for POSIX APIs

For production

http://www.qnx.com/partners/partner.html?partnerid=161247

17

OTHER RESOURCES

Tools

Application Development tools

Developer Zone (developer.nvidia.com/DRIVE)

Developer Forums (devtalk.nvidia.com)

Schools

Deep Learning Institute – Autonomous Driving

Udacity Nanodegree

18

DRIVE Platform

DRIVE Platform – Open AI Autonomous Vehicle platform

One architecture, from L2 to L3 to L4 to AI Car

DRIVE PX 2 for L3, L4 development today