DEEP LEARNING DEMYSTIFIED - NVIDIAon-demand.gputechconf.com/gtcdc/2018/pdf/dc8108... · DEEP...
Transcript of DEEP LEARNING DEMYSTIFIED - NVIDIAon-demand.gputechconf.com/gtcdc/2018/pdf/dc8108... · DEEP...
Will Ramey
DEEP LEARNING DEMYSTIFIED
Sr. Director, Global Head of Developer ProgramsNVIDIA Corporation
DEFINITIONS
BEYOND DEEP LEARNINGOpportunities to accelerate data science
Deep
LearningTraditional Machine Learning (regressions, decision trees, graph) Analytics
MACHINE LEARNING / DATA ANALYTICS
ARTIFICIAL INTELLIGENCE
DENSE DATA TABULAR/SPARSE DATA
2.2 exabytes (2.2B GB) of data created daily – McKinsey
$166B in 2018 revenues for big data and business analytics – IDC
RAPIDS DATA SCIENCE PLATFORMGPU-accelerated OSS libraries for data science
VisualizeData Preparation Model Training
cuDF cuDNNcuMLcuGraph
Analytics Deep
Learning
Machine
Learning
Graph
Analytics
RTX
Visualization
Apache Arrow
www.rapids.ai
AI IS CRITICAL FOR INTERNET APPLICATIONSUsers expect intelligence in services
Source: Jeff Dean, leads the Google Brain team, making machines intelligent. www.wsdm-conference.org/2016/slides/WSDM2016-Jeff-Dean.pdf
DEEP LEARNING IS SWEEPING ACROSS INDUSTRIES
MEDICINE MEDIA & ENTERTAINMENT SECURITY & DEFENSE AUTONOMOUS MACHINES
Cancer cell detection
Diabetic grading
Drug discovery
Pedestrian detection
Lane tracking
Recognize traffic signs
Face recognition
Video surveillance
Cyber security
Video captioning
Content based search
Real time translation
Image/Video classification
Speech recognition
Natural language processing
INTERNET SERVICES
news.developer.nvidia.com
WHAT PROBLEM ARE YOU SOLVING?Defining the AI/DL task
BUSINESS QUESTION
AI/DL TASKEXAMPLE OUTPUTS
HEALTHCARE RETAIL FINANCE
Is “it” present
or not?Detection Cancer Detection Targeted ads Cybersecurity
What type of thing
is “it”?Classification Image Classification Basket Analysis Credit Scoring
To what extent is
“it” present?Segmentation
Tumor Size/Shape
Analysis
Build 360º
Customer ViewCredit Risk Analysis
What is the likely
outcome? Prediction
Survivability
Prediction
Sentiment &
behavior recognitionFraud Detection
What will likely
satisfy the objective? Recommendations
Therapy
Recommendation
Recommendation
Engine
Algorithmic
Trading
INPUTS
Text Data Images
AudioVideo
DEEP NEURAL NETWORKSDifferent models for different tasks
Source: Asimov Institute - www.asimovinstitute.org/neural-network-zoo
DEEP LEARNING APPLICATION DEVELOPMENT
DEEP LEARNING APPLICATION DEVELOPMENT
UntrainedNeural Network
Model
DEEP LEARNING APPLICATION DEVELOPMENT
UntrainedNeural Network
Model
Deep Learning
Framework
TRAININGLearning a new capability
from existing data
DEEP LEARNING APPLICATION DEVELOPMENT
UntrainedNeural Network
Model
Deep Learning
Framework
TRAININGLearning a new capability
from existing data
Trained ModelNew Capability
DEEP LEARNING APPLICATION DEVELOPMENT
UntrainedNeural Network
Model
Deep Learning
Framework
TRAININGLearning a new capability
from existing data
Trained ModelNew Capability
Trained ModelOptimized for Performance
DEEP LEARNING APPLICATION DEVELOPMENT
UntrainedNeural Network
Model
Deep Learning
Framework
TRAININGLearning a new capability
from existing data
Trained ModelNew Capability
App or ServiceFeaturing Capability
INFERENCEApplying this capability
to new data
Trained ModelOptimized for Performance
CHALLENGES
DEEP LEARNING NEEDS WHY
Data Scientists New computing model
Latest Algorithms Rapidly evolving
Fast Training Impossible -> Practical
Deployment Platforms Must be available everywhere
www.gputechconf.com
Come join us at a GTC near you - www.gputechconf.com
DISCOVER
See how GPU technologies are creating amazingbreakthroughs in importantfields such as deep learning
CONNECT
Connect with technology experts from NVIDIA and other leading organizations
LEARN
Gain insight and valuable hands-on training through hundreds of sessions and research posters
INNOVATE
Hear about disruptive innovations as early-stage companies and startups present their work
ADVANCE YOUR DEEP LEARNING TRAINING AT GTCDon’t miss the world’s most important event for GPU developers
NVIDIA DEEP LEARNING INSTITUTE
Helping the world to solve challenging problems using AI and deep learning
On-site workshops and online courses presented by certified instructors
Covering complete workflows for proven application use cases
Fundamentals, Autonomous Vehicles, Finance, Healthcare, Video Analytics, IoT/Robotics, …
Hands-on training for data scientists and software engineers
www.nvidia.com/dli
Benefits
Technology access
AI expertise
Go-to-market support
Inception: Virtual Accelerator For AI Startups
300
3200
Jun 2016 Sep 2018
~10x
Membership Impact
Showcasing innovation
Creating a global community
Inception: Virtual Accelerator For AI Startups
www.nvidia.com/inception
NVIDIA DEEP LEARNING SDK and CUDA
developer.nvidia.com/deep-learning-software
NVIDIA DEEP LEARNING SOFTWARE PLATFORMTRAINING
Training
Data Management
Model Assessment
Trained NeuralNetwork
TrainingData
INFERENCE
Embedded
Automotive
Data center GRE + TensorRT
DriveWorks SDK
JETPACK SDK
NVIDIA GPU CLOUD
Discover 30 GPU-Accelerated ContainersDeep learning, third-party managed HPC applications, NVIDIA HPC visualization tools, and partner applications
Innovate in Minutes, Not WeeksGet up and running quickly and reduce complexity
Access from AnywhereUse on PCs with NVIDIA Volta or Pascal™ architecture GPUs, NVIDIA DGX Systems, and supported cloud providers
Simple access to a comprehensive catalog of GPU-accelerated software
END-TO-END PRODUCT FAMILY
FULLY INTEGRATED AI SYSTEMS
DESKTOP
TITAN
WORKSTATION
DGX Station
DATA
CENTER
Tesla V100
DATA CENTER
Tesla V100
AUTOMOTIVE EMBEDDED
Tesla P4/T4
Drive AGX Pegasus Jetson AGX Xavier
VIRTUAL
WS
Virtual GPU
SERVER
PLATFORM
HGX1/ HGX2
HPC / TRAINING INFERENCE
DGX-1 DGX-2
CHALLENGES
DEEP LEARNING NEEDS SOLUTIONS
Data Scientists Deep Learning Institute, GTC
Latest Algorithms NGC, GPU Accelerated Frameworks, DL SDK
Fast Training DGX, V100/T100, TITAN V
Deployment Platforms TensorRT, V100/T4, Drive AGX, Jetson AGX
READY TO GET STARTED?Project checklist
What problem are you solving, what are the AI/DL tasks?
What data do you have/need, and how is it labeled?
Which tools & environment will you use?
On what platform(s) will you train and deploy?
Autonomous Vehicles
Digital Content Creation
Internet Services
Media & Entertainment
Security & DefenseIntelligent Video Analytics
Finance HealthcareGenomics
WHAT’S NEXT?
Work through DLI online courses – www.nvidia.com/dli
Review examples of AI in action - news.developer.nvidia.com
Listen to the NVIDIA AI Podcast - blogs.nvidia.com/ai-podcast
Register for GTC near you – www.nvidia.com/gtc
Thank you!
www.nvidia.com/dli
27
www.nvidia.com/dli