DEEP LEARNING DEMYSTIFIED -...

13
November 2016 DEEP LEARNING DEMYSTIFIED

Transcript of DEEP LEARNING DEMYSTIFIED -...

Page 1: DEEP LEARNING DEMYSTIFIED - NVIDIAon-demand.gputechconf.com/.../2016/...ramey-deep-learning-demysti… · 3 DEEP LEARNING IS SWEEPING ACROSS INDUSTRIES Internet Services Medicine

November 2016

DEEP LEARNING DEMYSTIFIED

Page 2: DEEP LEARNING DEMYSTIFIED - NVIDIAon-demand.gputechconf.com/.../2016/...ramey-deep-learning-demysti… · 3 DEEP LEARNING IS SWEEPING ACROSS INDUSTRIES Internet Services Medicine

2

A NEW COMPUTING MODEL Algorithms that Learn from Examples

Expert Written

Computer

Program

Traditional Approach Requires domain experts Time consuming Error prone Not scalable to new

problems

Deep Neural Network

Deep Learning Approach Learn from data Easily to extend Speedup with GPUs

Page 3: DEEP LEARNING DEMYSTIFIED - NVIDIAon-demand.gputechconf.com/.../2016/...ramey-deep-learning-demysti… · 3 DEEP LEARNING IS SWEEPING ACROSS INDUSTRIES Internet Services Medicine

3

DEEP LEARNING IS SWEEPING ACROSS INDUSTRIES

Internet Services Medicine Media & Entertainment Security & Defense Autonomous Machines

Cancer cell detection

Diabetic grading

Drug discovery

Pedestrian detection

Lane tracking

Recognize traffic signs

Face recognition

Video surveillance

Cyber security

Video captioning

Content based search

Real time translation

Image/Video classification

Speech recognition

Natural language processing

Page 4: DEEP LEARNING DEMYSTIFIED - NVIDIAon-demand.gputechconf.com/.../2016/...ramey-deep-learning-demysti… · 3 DEEP LEARNING IS SWEEPING ACROSS INDUSTRIES Internet Services Medicine

4

Molecular energetics studies can lead to

breakthroughs in drug discovery and materials

science, but traditional computing approaches are

time-consuming and expensive. Researchers at the

University of Florida and the University of North

Carolina leveraged GPU deep learning to develop

ANAKIN-ME, which can reproduce molecular energy

surfaces with super speed, extremely high

accuracy, and at 1-10/millionth the cost of current

computational methods.

AN AI QUANTUM BREAKTHROUGH

Page 5: DEEP LEARNING DEMYSTIFIED - NVIDIAon-demand.gputechconf.com/.../2016/...ramey-deep-learning-demysti… · 3 DEEP LEARNING IS SWEEPING ACROSS INDUSTRIES Internet Services Medicine

5

AN AI MONITOR OF EARTH’S VITALS The Earth’s climate has changed throughout history, but in recent years there have been record increases in temperature, glacial retreat and rising sea levels. NASA Ames is using satellite imagery to measure the effects of carbon and greenhouse gas emissions on the planet. To do so, they developed DeepSat — a deep learning framework for satellite image classification trained on a GPU-powered supercomputer. The enhanced satellite imagery will help scientists plan to protect ecosystems and farmers improve crop production.

Page 6: DEEP LEARNING DEMYSTIFIED - NVIDIAon-demand.gputechconf.com/.../2016/...ramey-deep-learning-demysti… · 3 DEEP LEARNING IS SWEEPING ACROSS INDUSTRIES Internet Services Medicine

6

HOW IT WORKS

Page 7: DEEP LEARNING DEMYSTIFIED - NVIDIAon-demand.gputechconf.com/.../2016/...ramey-deep-learning-demysti… · 3 DEEP LEARNING IS SWEEPING ACROSS INDUSTRIES Internet Services Medicine

7

CHALLENGES

Deep Learning Needs Why

Data Scientists New computing model

Latest Algorithms Rapidly evolving

Fast Training Impossible -> Practical

Deployment Platform Must be available everywhere

Page 8: DEEP LEARNING DEMYSTIFIED - NVIDIAon-demand.gputechconf.com/.../2016/...ramey-deep-learning-demysti… · 3 DEEP LEARNING IS SWEEPING ACROSS INDUSTRIES Internet Services Medicine

8

NVIDIA DEEP LEARNING INSTITUTE

Training organizations and individuals to solve challenging problems using Deep Learning

On-site workshops and online courses presented by certified experts

Covering complete workflows for proven application use cases Self-driving cars, recommendation engines, medical image classification, intelligent video analytics and more

www.nvidia.com/dli

Hands-on Training for Data Scientists and Software Engineers

http://www.nvidia.com/dli
http://www.nvidia.com/dli
Page 9: DEEP LEARNING DEMYSTIFIED - NVIDIAon-demand.gputechconf.com/.../2016/...ramey-deep-learning-demysti… · 3 DEEP LEARNING IS SWEEPING ACROSS INDUSTRIES Internet Services Medicine

9

OBJECT DETECTION

IMAGE CLASSIFICATION

DIGITS DEEP LEARNING WORKFLOWS

Classify images into classes or categories

Object of interest could be anywhere in the image

Find instances of objects in an image

Objects are identified with bounding boxes

98% Dog

2% Cat

New in DIGITS 5

Partition image into multiple regions

Regions are classified at the pixel level

IMAGE SEGMENTATION

Page 10: DEEP LEARNING DEMYSTIFIED - NVIDIAon-demand.gputechconf.com/.../2016/...ramey-deep-learning-demysti… · 3 DEEP LEARNING IS SWEEPING ACROSS INDUSTRIES Internet Services Medicine

10

DEEP LEARNING SOFTWARE

developer.nvidia.com/deep-learning

https://developer.nvidia.com/deep-learning
https://developer.nvidia.com/deep-learning
https://developer.nvidia.com/deep-learning
Page 11: DEEP LEARNING DEMYSTIFIED - NVIDIAon-demand.gputechconf.com/.../2016/...ramey-deep-learning-demysti… · 3 DEEP LEARNING IS SWEEPING ACROSS INDUSTRIES Internet Services Medicine

11

END-TO-END PRODUCT FAMILY

TRAINING INFERENCE

EMBEDDED

Jetson TX1

DATA CENTER

Tesla P4

Tesla P40

AUTOMOTIVE

Drive PX2

Tesla P100

Tesla P40

Tesla P100

Titan X Pascal

DATA CENTER DESKTOP

FULLY INTERGRATED DL SUPERCOMPUTER

Page 12: DEEP LEARNING DEMYSTIFIED - NVIDIAon-demand.gputechconf.com/.../2016/...ramey-deep-learning-demysti… · 3 DEEP LEARNING IS SWEEPING ACROSS INDUSTRIES Internet Services Medicine

12

Deep Learning Needs Why

Data Scientists New computing model

Latest Algorithms Rapidly evolving

Fast Training Impossible -> Practical

Deployment Platform Must be available everywhere

CHALLENGES

Deep Learning Needs NVIDIA Delivers

Data Scientists DIGITS, DLI Training, GTC

Latest Algorithms DL SDK, GPU-Accelerated Frameworks

Fast Training DGX, P100, P40, TITAN X

Deployment Platform TensorRT, P40, P4, Jetson, Drive PX

Page 13: DEEP LEARNING DEMYSTIFIED - NVIDIAon-demand.gputechconf.com/.../2016/...ramey-deep-learning-demysti… · 3 DEEP LEARNING IS SWEEPING ACROSS INDUSTRIES Internet Services Medicine

13

May 8 - 11, 2017 | Silicon Valley | #GTC17 www.gputechconf.com

CONNECT

Connect with technology experts from NVIDIA and other leading organizations

LEARN

Gain insight and valuable hands-on training through hundreds of sessions and research posters

DISCOVER

See how GPU technologies are creating amazing breakthroughs in important fields such as deep learning

INNOVATE

Hear about disruptive innovations as early-stage companies and startups present their work

Don’t miss the world’s most important event for GPU developers May 8 – 11, 2017 in Silicon Valley

JOIN THE ACTION! APPLY BY NOV. 20 TO PRESENT A GTC 2017 TALK OR LAB AT WWW.GPUTECHCONF.COM

http://www.gputechconf.com/
http://www.gputechconf.com/

Deep Learning for Reinforcement Learning in · PDF fileDeep Learning for Reinforcement Learning in ... Deep Learning for Reinforcement Learning in Pacman Deep Learning für ... Während

Deep Learning for Reinforcement Learning in · PDF fileDeep Learning for Reinforcement Learning in ... Deep Learning for Reinforcement Learning in Pacman Deep Learning für ... Während

Tutorial: Deep Reinforcement Learning - Machine Learning ...hunch.net/~beygel/deep_rl_tutorial.pdfTutorial: Deep Reinforcement Learning - Machine Learning ...

Tutorial: Deep Reinforcement Learning - Machine Learning ...hunch.net/~beygel/deep_rl_tutorial.pdfTutorial: Deep Reinforcement Learning - Machine Learning ...

Tutorial: Deep Reinforcement Learning · Outline Introduction to Deep Learning Introduction to Reinforcement Learning Value-Based Deep RL Policy-Based Deep RL Model-Based Deep RL

Tutorial: Deep Reinforcement Learning · Outline Introduction to Deep Learning Introduction to Reinforcement Learning Value-Based Deep RL Policy-Based Deep RL Model-Based Deep RL

Deep Learning - South Dakota State UniversityDeep Learning Deep learning (also known as deep structured learning, hierarchical learning or deep machine learning) is a branch of machine

Deep Learning - South Dakota State UniversityDeep Learning Deep learning (also known as deep structured learning, hierarchical learning or deep machine learning) is a branch of machine

20151216 Computer Vision Meetup Deep Learning Deep Learning - Rene...Deep Learning . René Donner Deep Learning Overview 2 ... coursera ... 20151216 Computer Vision Meetup Deep Learning

20151216 Computer Vision Meetup Deep Learning Deep Learning - Rene...Deep Learning . René Donner Deep Learning Overview 2 ... coursera ... 20151216 Computer Vision Meetup Deep Learning

Deep Learning - Oxford Statisticspalamara/teaching/SML19/HT19_lecture15.pdf · SB2b/SM4 - Deep Learning Deep Learning Infrastructure! Computational Infrastructure critical to deep

Deep Learning - Oxford Statisticspalamara/teaching/SML19/HT19_lecture15.pdf · SB2b/SM4 - Deep Learning Deep Learning Infrastructure! Computational Infrastructure critical to deep

Lecture 1: Introduction to Deep Learning · uva deep learning course –efstratios gavves introduction to deep learning - 1

Lecture 1: Introduction to Deep Learning · uva deep learning course –efstratios gavves introduction to deep learning - 1

Deep Learning for Reinforcement Learning in Pacman · Deep Learning for Reinforcement Learning in Pacman Deep Learning für Reinforcement Learning in Pacman Vorgelegte Bachelor-Thesis

Deep Learning for Reinforcement Learning in Pacman · Deep Learning for Reinforcement Learning in Pacman Deep Learning für Reinforcement Learning in Pacman Vorgelegte Bachelor-Thesis

Deep Learning for Laser Based Odometry Estimation - …juxi.net/workshop/deep-learning-rss-2016/papers/Nicolai - Deep... · Deep Learning for Laser Based Odometry Estimation ... deep

Deep Learning for Laser Based Odometry Estimation - …juxi.net/workshop/deep-learning-rss-2016/papers/Nicolai - Deep... · Deep Learning for Laser Based Odometry Estimation ... deep

Deep Learning in real world @Deep Learning Tokyo

Deep Learning in real world @Deep Learning Tokyo

Binary Deep Learning - TAUweb.eng.tau.ac.il/.../wp-content/uploads/2017/03/Binary-Deep-Learning.pdf · Binary Deep Learning Deep Learning Seminar, School of Electrical Engineering,

Binary Deep Learning - TAUweb.eng.tau.ac.il/.../wp-content/uploads/2017/03/Binary-Deep-Learning.pdf · Binary Deep Learning Deep Learning Seminar, School of Electrical Engineering,

Deep Learning Early Work Why Deep Learning Stacked Auto Encoders Deep Belief Networks CS 678 – Deep Learning1.

Deep Learning Early Work Why Deep Learning Stacked Auto Encoders Deep Belief Networks CS 678 – Deep Learning1.

Introduction to Deep Learning - Joyce Hojoyceho.github.io/cs534_s17/slide/25-deep-learning.pdf · Deep Learning: Overview ... Review: Backpropogation https: ... • Deep Learning

Introduction to Deep Learning - Joyce Hojoyceho.github.io/cs534_s17/slide/25-deep-learning.pdf · Deep Learning: Overview ... Review: Backpropogation https: ... • Deep Learning

OpenFlow Timeouts Demysti ed - University of Torontolie/papers/zarek_mscthesis.pdf · OpenFlow Timeouts Demysti ed Adam Zarek Department of Computer Science University of Toronto

OpenFlow Timeouts Demysti ed - University of Torontolie/papers/zarek_mscthesis.pdf · OpenFlow Timeouts Demysti ed Adam Zarek Department of Computer Science University of Toronto

Deep Learning: An Introduction from the NLP Perspective Deep Learning - An...Deep Learning Approach 1 Deep Learning Approach 2 Disclaimer I am not (yet) an expert in Deep Learning.

Deep Learning: An Introduction from the NLP Perspective Deep Learning - An...Deep Learning Approach 1 Deep Learning Approach 2 Disclaimer I am not (yet) an expert in Deep Learning.

Deep Learning Lab Course 2017 (Deep Learning …ais.informatik.uni-freiburg.de/teaching/ws17/deep...Deep Learning Lab Course 2017 (Deep Learning Practical) Labs: (Computer Vision)

Deep Learning Lab Course 2017 (Deep Learning …ais.informatik.uni-freiburg.de/teaching/ws17/deep...Deep Learning Lab Course 2017 (Deep Learning Practical) Labs: (Computer Vision)

Modern Deep Learning through Bayesian Eyesmlg.eng.cam.ac.uk/yarin/PDFs/2015_UCL_Bayesian_Deep_Learning_t… · Modern Deep Learning through Bayesian Eyes ... deep learning models

Modern Deep Learning through Bayesian Eyesmlg.eng.cam.ac.uk/yarin/PDFs/2015_UCL_Bayesian_Deep_Learning_t… · Modern Deep Learning through Bayesian Eyes ... deep learning models

From Reinforcement Learning to Deep Reinforcement …fagostin/assets/files/...Keywords: Machine learning · Reinforcement learning Deep learning · Deep reinforcement learning 1 Introduction

From Reinforcement Learning to Deep Reinforcement …fagostin/assets/files/...Keywords: Machine learning · Reinforcement learning Deep learning · Deep reinforcement learning 1 Introduction

Introduction to Deep Learning - Computer Graphics€¦ · Introduction to Deep Learning CS468 Spring 2017 Charles Qi. What is Deep Learning? Deep learning allows computational models

Introduction to Deep Learning - Computer Graphics€¦ · Introduction to Deep Learning CS468 Spring 2017 Charles Qi. What is Deep Learning? Deep learning allows computational models

Study Guide: Simply Einstein: Relativity Demysti ed · 2017-04-29 · Study Guide: Simply Einstein: Relativity Demysti ed Allen Olson E-mail: olsona@evergreen.edu General Advice and

Study Guide: Simply Einstein: Relativity Demysti ed · 2017-04-29 · Study Guide: Simply Einstein: Relativity Demysti ed Allen Olson E-mail: [email protected] General Advice and