BUILDING AUTONOMOUS VEHICLES USING DRIVE PX 2 Shri Sundaram, May 8, - PowerPoint PPT Presentation

BUILDING AUTONOMOUS VEHICLES USING DRIVE PX 2 Shri Sundaram, May 8, 2017

Autonomous Vehicles Artificial Intelligence NVIDIA AT THE CENTER OF AV REVOLUTION 2

DRIVE PX 2 DRIVING AV AI Launched CES 2016 Spike in AV AI engagements after we powered on the discrete GPU late last year 3

DRIVE PLATFORM TODAY FOR LEVEL 3/4 DRIVE PX (Xavier) 4

BUILDING BLOCKS Autonomous Driving SDK • DriveWorks • CUDA Compute – APIs and • CuDNN Libraries • Tensor RT • NVMedia • GPU Compute Engines & IOs • Accelerators • Sensors 5

BUILDING BLOCKS Autonomous Driving SDK • DriveWorks • CUDA Compute – APIs and • CuDNN Libraries • Tensor RT • NVMedia • GPU Compute Engines & IOs • Accelerators • Sensors 6

COMPUTE & IO System IOs: 70+ Gbps Compute: 20+ DL TOPS SW: Linux, RFS, BSP, OTA Sensors/Actuators Camera, Lidar, Radar DBW, CAN interface + More incl. IMU, GPS, V2X modules 7

BUILDING BLOCKS Autonomous Driving SDK • DriveWorks • CUDA Compute – APIs and • CuDNN Libraries • Tensor RT • NVMedia • GPU Compute Engines • Vision Processors • Accelerators 8

CUDA DRIVE PX 2 has latest CUDA-capable GPU – 4x! Runs latest CUDA 8. Includes CUDA accelerated DL SDK TensorRT CuDNN CuBLAS. 9

TENSOR RT GPU Inference Engine 10

NVMEDIA NVMedia: APIs to control cameras as well data NVMedia abstracts: Image capture • • Image Signal processor 2D Engine • Encoding • • Interop with other SW components 11

BUILDING BLOCKS Autonomous Driving SDK • DriveWorks • CUDA Compute – APIs and • CuDNN Libraries • Tensor RT • NVMedia • GPU Compute Engines • Vision Processors • Accelerators 12

DRIVEWORKS Perceive Input Localize Vehicle Control Visualize Image Processing Sensors DNN interface CAN/DBW Kit APIs IMU CV Modules interface GPS HD Maps interface Calibration and sensor registration Tools - Vehicle rig configuration Data Logging/Acquisition DriveNet Samples/ LaneNet Sensor visualization *PilotNet Previews Several CV examples Occupancy Grid 13

DRIVE PLATFORM DNNs and Autonomous Driving Applications HD Maps DriveWorks CUDA, CuDNN, TensorRT NVMedia DRIVE PX 2 — System Software Sensors DRIVE PX 2 — System Hardware Vehicle Control 14

PX2: ON WHEELS HW DRIVE PX 2 nicely mounted in the trunk of a car, pre-wired for cameras, and other sensors Sensors - Your choice or NVIDIA’s configuration. SW All of what comes with DRIVE PX2 Photo Courtesy: AutonomouStuff 15

DRIVE PLATFORM For production HW ZF Pro AI – built on DRIVE PX 2 Auto Cruise Bosch – building on DRIVE PX using Xavier Xavier: 30 DL TOPS + ASIL-C for Level 4 SW QNX - Common arch across Linux and QNX Common APIs across CUDA, TensorRT, cuDNN, NvMedia + Support for POSIX APIs 16

OTHER RESOURCES Tools Application Development tools Developer Zone (developer.nvidia.com/DRIVE) Developer Forums (devtalk.nvidia.com) Schools Deep Learning Institute – Autonomous Driving Udacity Nanodegree 17

DRIVE Platform DRIVE Platform – Open AI Autonomous Vehicle platform One architecture, from L2 to L3 to L4 to AI Car DRIVE PX 2 for L3, L4 development today 18