Deep Learning - BigSkyEarth › wp-content › uploads › 2018 › 12 › DL_intro.pdf · Nov...

37
Nov 2018, Tuorla Deep Learning Nima Sedaghat University of Freiburg

Transcript of Deep Learning - BigSkyEarth › wp-content › uploads › 2018 › 12 › DL_intro.pdf · Nov...

Page 1: Deep Learning - BigSkyEarth › wp-content › uploads › 2018 › 12 › DL_intro.pdf · Nov 2018, Tuorla Outline Classical Machine Learning vs. Deep Learning The Rapid Evolution

Nov 2018, Tuorla

Deep Learning

Nima SedaghatUniversity of Freiburg

Page 2: Deep Learning - BigSkyEarth › wp-content › uploads › 2018 › 12 › DL_intro.pdf · Nov 2018, Tuorla Outline Classical Machine Learning vs. Deep Learning The Rapid Evolution

Nov 2018, Tuorla

Outline

● Classical Machine Learning vs. Deep Learning

● The Rapid Evolution of Deep Learning

● Deep Learning and Types of Supervision

Page 3: Deep Learning - BigSkyEarth › wp-content › uploads › 2018 › 12 › DL_intro.pdf · Nov 2018, Tuorla Outline Classical Machine Learning vs. Deep Learning The Rapid Evolution

Nov 2018, Tuorla

Classical Machine Learning vs. Deep Learning

Page 4: Deep Learning - BigSkyEarth › wp-content › uploads › 2018 › 12 › DL_intro.pdf · Nov 2018, Tuorla Outline Classical Machine Learning vs. Deep Learning The Rapid Evolution

Nov 2018, Tuorla

From Hand-Crafted Features to Representation Learning

Page 5: Deep Learning - BigSkyEarth › wp-content › uploads › 2018 › 12 › DL_intro.pdf · Nov 2018, Tuorla Outline Classical Machine Learning vs. Deep Learning The Rapid Evolution

Nov 2018, Tuorla

Why didn’t we do it before?

We needed to go deeper: more parameters, more sophisticated features

It would take forever to tell a cat from a dog!

Page 6: Deep Learning - BigSkyEarth › wp-content › uploads › 2018 › 12 › DL_intro.pdf · Nov 2018, Tuorla Outline Classical Machine Learning vs. Deep Learning The Rapid Evolution

Nov 2018, Tuorla

What made it possible?

Convolutional Layers

Page 7: Deep Learning - BigSkyEarth › wp-content › uploads › 2018 › 12 › DL_intro.pdf · Nov 2018, Tuorla Outline Classical Machine Learning vs. Deep Learning The Rapid Evolution

Nov 2018, Tuorla

GPU: Graphical Processing Unit

https://www.wikihow.com/Connect-an-External-TV-Tuner-Card-to-a-Desktop

Page 8: Deep Learning - BigSkyEarth › wp-content › uploads › 2018 › 12 › DL_intro.pdf · Nov 2018, Tuorla Outline Classical Machine Learning vs. Deep Learning The Rapid Evolution

Nov 2018, Tuorla

GPU: Graphical Processing Unit

Page 9: Deep Learning - BigSkyEarth › wp-content › uploads › 2018 › 12 › DL_intro.pdf · Nov 2018, Tuorla Outline Classical Machine Learning vs. Deep Learning The Rapid Evolution

Nov 2018, Tuorla

Convolutional Layers

https://www.analyticsindiamag.com/convolutional-neural-network-image-classification-overview

Page 10: Deep Learning - BigSkyEarth › wp-content › uploads › 2018 › 12 › DL_intro.pdf · Nov 2018, Tuorla Outline Classical Machine Learning vs. Deep Learning The Rapid Evolution

Nov 2018, Tuorla

Why Convolutional Layers help?

“Shared Weights”

Seongwon Hwang, “Convolutional Neural Network (CNN) presentation from theory to code in Theano”

Page 11: Deep Learning - BigSkyEarth › wp-content › uploads › 2018 › 12 › DL_intro.pdf · Nov 2018, Tuorla Outline Classical Machine Learning vs. Deep Learning The Rapid Evolution

Nov 2018, Tuorla

Deep ConvNets

Page 12: Deep Learning - BigSkyEarth › wp-content › uploads › 2018 › 12 › DL_intro.pdf · Nov 2018, Tuorla Outline Classical Machine Learning vs. Deep Learning The Rapid Evolution

Nov 2018, Tuorla

Hierarchical Representation Learning

Page 13: Deep Learning - BigSkyEarth › wp-content › uploads › 2018 › 12 › DL_intro.pdf · Nov 2018, Tuorla Outline Classical Machine Learning vs. Deep Learning The Rapid Evolution

Nov 2018, Tuorla

On the Importance of Data

Page 14: Deep Learning - BigSkyEarth › wp-content › uploads › 2018 › 12 › DL_intro.pdf · Nov 2018, Tuorla Outline Classical Machine Learning vs. Deep Learning The Rapid Evolution

Nov 2018, Tuorla

On the Importance of Dataover-fittingSmall Dataset

It’s a cat

Page 15: Deep Learning - BigSkyEarth › wp-content › uploads › 2018 › 12 › DL_intro.pdf · Nov 2018, Tuorla Outline Classical Machine Learning vs. Deep Learning The Rapid Evolution

Nov 2018, Tuorla

The Rapid Evolution of Deep Learning

Page 16: Deep Learning - BigSkyEarth › wp-content › uploads › 2018 › 12 › DL_intro.pdf · Nov 2018, Tuorla Outline Classical Machine Learning vs. Deep Learning The Rapid Evolution

Nov 2018, Tuorla

Classification

https://becominghuman.ai/building-an-image-classifier-using-deep-learning-in-python-totally-from-a-beginners-perspective-be8dbaf22dd8

Page 17: Deep Learning - BigSkyEarth › wp-content › uploads › 2018 › 12 › DL_intro.pdf · Nov 2018, Tuorla Outline Classical Machine Learning vs. Deep Learning The Rapid Evolution

Nov 2018, Tuorla

● Question: examples from other domains?

(E.g. Astronomy)

Classification

https://github.com/EdwardJKim/dl4astro/

Page 18: Deep Learning - BigSkyEarth › wp-content › uploads › 2018 › 12 › DL_intro.pdf · Nov 2018, Tuorla Outline Classical Machine Learning vs. Deep Learning The Rapid Evolution

Nov 2018, Tuorla

Regression

Sedaghat, Brox, “Unsupervised Generation of a Viewpoint Annotated Car Dataset from Videos”

Page 19: Deep Learning - BigSkyEarth › wp-content › uploads › 2018 › 12 › DL_intro.pdf · Nov 2018, Tuorla Outline Classical Machine Learning vs. Deep Learning The Rapid Evolution

Nov 2018, Tuorla

● Question: What examples can you think of in Sky/Earth?

Regression

Page 20: Deep Learning - BigSkyEarth › wp-content › uploads › 2018 › 12 › DL_intro.pdf · Nov 2018, Tuorla Outline Classical Machine Learning vs. Deep Learning The Rapid Evolution

Nov 2018, Tuorla

Encoder-Decoder Networks

Page 21: Deep Learning - BigSkyEarth › wp-content › uploads › 2018 › 12 › DL_intro.pdf · Nov 2018, Tuorla Outline Classical Machine Learning vs. Deep Learning The Rapid Evolution

Nov 2018, Tuorla

E.g. Auto-Encoder

Page 22: Deep Learning - BigSkyEarth › wp-content › uploads › 2018 › 12 › DL_intro.pdf · Nov 2018, Tuorla Outline Classical Machine Learning vs. Deep Learning The Rapid Evolution

Nov 2018, Tuorla

Why an Auto-Encoder?

Page 23: Deep Learning - BigSkyEarth › wp-content › uploads › 2018 › 12 › DL_intro.pdf · Nov 2018, Tuorla Outline Classical Machine Learning vs. Deep Learning The Rapid Evolution

Nov 2018, Tuorla

E.g. De-noising

Question: How would you train this?

Page 24: Deep Learning - BigSkyEarth › wp-content › uploads › 2018 › 12 › DL_intro.pdf · Nov 2018, Tuorla Outline Classical Machine Learning vs. Deep Learning The Rapid Evolution

Nov 2018, Tuorla

E.g. Segmentation

Page 25: Deep Learning - BigSkyEarth › wp-content › uploads › 2018 › 12 › DL_intro.pdf · Nov 2018, Tuorla Outline Classical Machine Learning vs. Deep Learning The Rapid Evolution

Nov 2018, Tuorla

E.g. Optical Flow (Motion) Estimation

Page 26: Deep Learning - BigSkyEarth › wp-content › uploads › 2018 › 12 › DL_intro.pdf · Nov 2018, Tuorla Outline Classical Machine Learning vs. Deep Learning The Rapid Evolution

Nov 2018, Tuorla

Generative Adversarial Network (GAN)

https://towardsdatascience.com/understanding-generative-adversarial-networks-4dafc963f2ef

Page 27: Deep Learning - BigSkyEarth › wp-content › uploads › 2018 › 12 › DL_intro.pdf · Nov 2018, Tuorla Outline Classical Machine Learning vs. Deep Learning The Rapid Evolution

Nov 2018, Tuorla

GAN Use-case example

Antreas Antoniou et al., “Data Augmentation Generative Adversarial Networks”

Page 28: Deep Learning - BigSkyEarth › wp-content › uploads › 2018 › 12 › DL_intro.pdf · Nov 2018, Tuorla Outline Classical Machine Learning vs. Deep Learning The Rapid Evolution

Nov 2018, Tuorla

Deep Learning and Types of Supervision

Page 29: Deep Learning - BigSkyEarth › wp-content › uploads › 2018 › 12 › DL_intro.pdf · Nov 2018, Tuorla Outline Classical Machine Learning vs. Deep Learning The Rapid Evolution

Nov 2018, Tuorla

Deep Learning and Types of Supervision

● Fully Supervised Learning

● Unsupervised/Self-Supervised Learning

● Reinforcement Learning

● (Imitation Learning)

Page 30: Deep Learning - BigSkyEarth › wp-content › uploads › 2018 › 12 › DL_intro.pdf · Nov 2018, Tuorla Outline Classical Machine Learning vs. Deep Learning The Rapid Evolution

Nov 2018, Tuorla

Fully Supervised Learning

● During Training: Input AND Output

Labels

Annotations

Page 31: Deep Learning - BigSkyEarth › wp-content › uploads › 2018 › 12 › DL_intro.pdf · Nov 2018, Tuorla Outline Classical Machine Learning vs. Deep Learning The Rapid Evolution

Nov 2018, Tuorla

Unsupervised/Self-supervised Learning

● No Labels● No “unsupervised task” such as clustering● Use self-supervision instead

– Auto-encoder

– Denoising

– Jigsaw-puzzle

– ...

Page 32: Deep Learning - BigSkyEarth › wp-content › uploads › 2018 › 12 › DL_intro.pdf · Nov 2018, Tuorla Outline Classical Machine Learning vs. Deep Learning The Rapid Evolution

Nov 2018, Tuorla

Reinforcement Learning

Page 33: Deep Learning - BigSkyEarth › wp-content › uploads › 2018 › 12 › DL_intro.pdf · Nov 2018, Tuorla Outline Classical Machine Learning vs. Deep Learning The Rapid Evolution

Nov 2018, Tuorla

Reinforcement Learning

Google DeepMind’s RL

Page 34: Deep Learning - BigSkyEarth › wp-content › uploads › 2018 › 12 › DL_intro.pdf · Nov 2018, Tuorla Outline Classical Machine Learning vs. Deep Learning The Rapid Evolution

Nov 2018, Tuorla

Covariate Shift and Domain Adaptation

Page 35: Deep Learning - BigSkyEarth › wp-content › uploads › 2018 › 12 › DL_intro.pdf · Nov 2018, Tuorla Outline Classical Machine Learning vs. Deep Learning The Rapid Evolution

Nov 2018, Tuorla

Covariate Shift and Domain Adaptation

Hybrid Learning of Optical Flow and Next Frame Prediction to Boost Optical Flow in the Wild. Nima Sedaghat, Zolfaghari M., Brox T.

Page 36: Deep Learning - BigSkyEarth › wp-content › uploads › 2018 › 12 › DL_intro.pdf · Nov 2018, Tuorla Outline Classical Machine Learning vs. Deep Learning The Rapid Evolution

Nov 2018, Tuorla

Probabilistic Networks

https://medium.com/@joeDiHare/deep-bayesian-neural-networks-952763a9537

Page 37: Deep Learning - BigSkyEarth › wp-content › uploads › 2018 › 12 › DL_intro.pdf · Nov 2018, Tuorla Outline Classical Machine Learning vs. Deep Learning The Rapid Evolution

Nov 2018, Tuorla

Application Example: TransiNet

Reference Image Science Image Ideal output


Demystifying Deep Learning - MathWorks · Demystifying Deep Learning. 2 What’s Deep Learning and why should I care? A practical approach to Deep Learning (for images) –Transfer

Demystifying Deep Learning - MathWorks · Demystifying Deep Learning. 2 What’s Deep Learning and why should I care? A practical approach to Deep Learning (for images) –Transfer

20151216 Computer Vision Meetup Deep Learning Deep Learning - Rene...Deep Learning . René Donner Deep Learning Overview 2 ... coursera ... 20151216 Computer Vision Meetup Deep Learning

20151216 Computer Vision Meetup Deep Learning Deep Learning - Rene...Deep Learning . René Donner Deep Learning Overview 2 ... coursera ... 20151216 Computer Vision Meetup Deep Learning

From Reinforcement Learning to Deep Reinforcement …fagostin/assets/files/...Keywords: Machine learning · Reinforcement learning Deep learning · Deep reinforcement learning 1 Introduction

From Reinforcement Learning to Deep Reinforcement …fagostin/assets/files/...Keywords: Machine learning · Reinforcement learning Deep learning · Deep reinforcement learning 1 Introduction

Binary Deep Learning - TAUweb.eng.tau.ac.il/.../wp-content/uploads/2017/03/Binary-Deep-Learning.pdf · Binary Deep Learning Deep Learning Seminar, School of Electrical Engineering,

Binary Deep Learning - TAUweb.eng.tau.ac.il/.../wp-content/uploads/2017/03/Binary-Deep-Learning.pdf · Binary Deep Learning Deep Learning Seminar, School of Electrical Engineering,

Deep Learning Early Work Why Deep Learning Stacked Auto Encoders Deep Belief Networks CS 678 – Deep Learning1.

Deep Learning Early Work Why Deep Learning Stacked Auto Encoders Deep Belief Networks CS 678 – Deep Learning1.

Lecture 1: Introduction to Deep Learning - uvadlc.github.io · Lecture 1: Introduction to Deep Learning Efstratios Gavves. UVA DEEP LEARNING COURSE UVA DEEP LEARNING COURSE –EFSTRATIOS

Lecture 1: Introduction to Deep Learning - uvadlc.github.io · Lecture 1: Introduction to Deep Learning Efstratios Gavves. UVA DEEP LEARNING COURSE UVA DEEP LEARNING COURSE –EFSTRATIOS

Tutorial: Deep Reinforcement Learning - Machine Learning ...hunch.net/~beygel/deep_rl_tutorial.pdfTutorial: Deep Reinforcement Learning - Machine Learning ...

Tutorial: Deep Reinforcement Learning - Machine Learning ...hunch.net/~beygel/deep_rl_tutorial.pdfTutorial: Deep Reinforcement Learning - Machine Learning ...

Lecture 3: Deep Learning Optimizations - GitHub Pagesuvadlc.github.io/lectures/nov2019/lecture3.pdf · Lecture 3: Deep Learning Optimizations Deep Learning @ UvA. UVA DEEP LEARNING

Lecture 3: Deep Learning Optimizations - GitHub Pagesuvadlc.github.io/lectures/nov2019/lecture3.pdf · Lecture 3: Deep Learning Optimizations Deep Learning @ UvA. UVA DEEP LEARNING

An Introduction to Deep Learning · Deep Learning An Introduction to ... •Deep Learning •Feed Forward Network •Problems of Deep Learning •AutoEncoders •Restricted Boltzmann

An Introduction to Deep Learning · Deep Learning An Introduction to ... •Deep Learning •Feed Forward Network •Problems of Deep Learning •AutoEncoders •Restricted Boltzmann

Deep Learning I - Korea Universitydsba.korea.ac.kr/wp/wp-content/seminar/Deep learning/Deep Learning... · Deep Learning I Deep learning is research on learning models with multilayer

Deep Learning I - Korea Universitydsba.korea.ac.kr/wp/wp-content/seminar/Deep learning/Deep Learning... · Deep Learning I Deep learning is research on learning models with multilayer

THE DEEP LEARNING REVOLUTION - Nvidia...THE DEEP LEARNING REVOLUTION Superhuman Breakthroughs in Modern Artificial Intelligence Powered by GPUs JOIN THE DEEP LEARNING ERA DEEP LEARNING

THE DEEP LEARNING REVOLUTION - Nvidia...THE DEEP LEARNING REVOLUTION Superhuman Breakthroughs in Modern Artificial Intelligence Powered by GPUs JOIN THE DEEP LEARNING ERA DEEP LEARNING

Deep Learning with H2O - University of Idahostevel/504/Deep Learning with...Deep Learning with H2O. . 4Deep Learning Overview Unlike the neural networks of the past, modern Deep Learning

Deep Learning with H2O - University of Idahostevel/504/Deep Learning with...Deep Learning with H2O. . 4Deep Learning Overview Unlike the neural networks of the past, modern Deep Learning

Deep Learning for Reinforcement Learning in · PDF fileDeep Learning for Reinforcement Learning in ... Deep Learning for Reinforcement Learning in Pacman Deep Learning für ... Während

Deep Learning for Reinforcement Learning in · PDF fileDeep Learning for Reinforcement Learning in ... Deep Learning for Reinforcement Learning in Pacman Deep Learning für ... Während

Introduction to Deep Learning - Joyce Hojoyceho.github.io/cs534_s17/slide/25-deep-learning.pdf · Deep Learning: Overview ... Review: Backpropogation https: ... • Deep Learning

Introduction to Deep Learning - Joyce Hojoyceho.github.io/cs534_s17/slide/25-deep-learning.pdf · Deep Learning: Overview ... Review: Backpropogation https: ... • Deep Learning

Deep Learning Lab Course 2017 (Deep Learning …ais.informatik.uni-freiburg.de/teaching/ws17/deep...Deep Learning Lab Course 2017 (Deep Learning Practical) Labs: (Computer Vision)

Deep Learning Lab Course 2017 (Deep Learning …ais.informatik.uni-freiburg.de/teaching/ws17/deep...Deep Learning Lab Course 2017 (Deep Learning Practical) Labs: (Computer Vision)

Deep Learning for Depth Learning CS 229 Course Project ...cs229.stanford.edu/...DepthLearning_FinalReport.pdf · Deep Learning for Depth Learning CS 229 Course Project, ... Deep Learning

Deep Learning for Depth Learning CS 229 Course Project ...cs229.stanford.edu/...DepthLearning_FinalReport.pdf · Deep Learning for Depth Learning CS 229 Course Project, ... Deep Learning

Deep Learning

Deep Learning

Deep Learning - Oxford Statisticspalamara/teaching/SML19/HT19_lecture15.pdf · SB2b/SM4 - Deep Learning Deep Learning Infrastructure! Computational Infrastructure critical to deep

Deep Learning - Oxford Statisticspalamara/teaching/SML19/HT19_lecture15.pdf · SB2b/SM4 - Deep Learning Deep Learning Infrastructure! Computational Infrastructure critical to deep

Mingaliev M ., Sotnikova Yu., Erkenov A. + Metsähovi & Tuorla “extragalactic” people

Mingaliev M ., Sotnikova Yu., Erkenov A. + Metsähovi & Tuorla “extragalactic” people

Executing Deep Learning Strategies Masterclass Preview - Enterprise Deep Learning

Executing Deep Learning Strategies Masterclass Preview - Enterprise Deep Learning