Deep Learning - mat.univie.ac.atgrohs/tmp/DeepLearningLectureIntro.pdf · Deep Learning Author:...
Transcript of Deep Learning - mat.univie.ac.atgrohs/tmp/DeepLearningLectureIntro.pdf · Deep Learning Author:...
![Page 1: Deep Learning - mat.univie.ac.atgrohs/tmp/DeepLearningLectureIntro.pdf · Deep Learning Author: Philipp Grohs[2.8ex] [scale=.4]univie Created Date: 4/28/2017 10:38:49 AM ...](https://reader033.fdocuments.us/reader033/viewer/2022042404/5f1a97e1a128334ea1730163/html5/thumbnails/1.jpg)
Deep Learning
Philipp Grohs
March 1st 2017
![Page 2: Deep Learning - mat.univie.ac.atgrohs/tmp/DeepLearningLectureIntro.pdf · Deep Learning Author: Philipp Grohs[2.8ex] [scale=.4]univie Created Date: 4/28/2017 10:38:49 AM ...](https://reader033.fdocuments.us/reader033/viewer/2022042404/5f1a97e1a128334ea1730163/html5/thumbnails/2.jpg)
Organisatorial Stuff...
3h lecture (MSc Level)
Monday 11:30 - 13:00 (seminar room 2nd floor) & Wednesday13:15 - 14:00 (seminar room 2nd floor)
Oral exam at the end of the semester
Exercise classes during the semester
Prerequisites: Linear algebra, Analysis
Desirable: Probability Theory, Functional Analysis, Experiencewith Python or MATLAB
I will create a website at http://mat.univie.ac.at/~grohs/DeepLearningCourse.html.
![Page 3: Deep Learning - mat.univie.ac.atgrohs/tmp/DeepLearningLectureIntro.pdf · Deep Learning Author: Philipp Grohs[2.8ex] [scale=.4]univie Created Date: 4/28/2017 10:38:49 AM ...](https://reader033.fdocuments.us/reader033/viewer/2022042404/5f1a97e1a128334ea1730163/html5/thumbnails/3.jpg)
Face recognition
![Page 4: Deep Learning - mat.univie.ac.atgrohs/tmp/DeepLearningLectureIntro.pdf · Deep Learning Author: Philipp Grohs[2.8ex] [scale=.4]univie Created Date: 4/28/2017 10:38:49 AM ...](https://reader033.fdocuments.us/reader033/viewer/2022042404/5f1a97e1a128334ea1730163/html5/thumbnails/4.jpg)
Face recognition
D. Trump
B. Sanders
B. Johnson
A. Merkel
![Page 5: Deep Learning - mat.univie.ac.atgrohs/tmp/DeepLearningLectureIntro.pdf · Deep Learning Author: Philipp Grohs[2.8ex] [scale=.4]univie Created Date: 4/28/2017 10:38:49 AM ...](https://reader033.fdocuments.us/reader033/viewer/2022042404/5f1a97e1a128334ea1730163/html5/thumbnails/5.jpg)
Describing the content of an image
AI generates sentences describing the content of animage [Vinyals et al., 2015 ]
![Page 6: Deep Learning - mat.univie.ac.atgrohs/tmp/DeepLearningLectureIntro.pdf · Deep Learning Author: Philipp Grohs[2.8ex] [scale=.4]univie Created Date: 4/28/2017 10:38:49 AM ...](https://reader033.fdocuments.us/reader033/viewer/2022042404/5f1a97e1a128334ea1730163/html5/thumbnails/6.jpg)
Go!
AI beats Go-champion Lee Sedol [Silver et al., 2016 ]
![Page 7: Deep Learning - mat.univie.ac.atgrohs/tmp/DeepLearningLectureIntro.pdf · Deep Learning Author: Philipp Grohs[2.8ex] [scale=.4]univie Created Date: 4/28/2017 10:38:49 AM ...](https://reader033.fdocuments.us/reader033/viewer/2022042404/5f1a97e1a128334ea1730163/html5/thumbnails/7.jpg)
Atari games
AI beats professional human Atari-players [Mnih et al., 2015 ]
![Page 8: Deep Learning - mat.univie.ac.atgrohs/tmp/DeepLearningLectureIntro.pdf · Deep Learning Author: Philipp Grohs[2.8ex] [scale=.4]univie Created Date: 4/28/2017 10:38:49 AM ...](https://reader033.fdocuments.us/reader033/viewer/2022042404/5f1a97e1a128334ea1730163/html5/thumbnails/8.jpg)
Rating Attractiveness
Swiss Dating App Blinq (developed in cooperation with ETHZ)
![Page 9: Deep Learning - mat.univie.ac.atgrohs/tmp/DeepLearningLectureIntro.pdf · Deep Learning Author: Philipp Grohs[2.8ex] [scale=.4]univie Created Date: 4/28/2017 10:38:49 AM ...](https://reader033.fdocuments.us/reader033/viewer/2022042404/5f1a97e1a128334ea1730163/html5/thumbnails/9.jpg)
Goal of This Course
How does this work???
![Page 10: Deep Learning - mat.univie.ac.atgrohs/tmp/DeepLearningLectureIntro.pdf · Deep Learning Author: Philipp Grohs[2.8ex] [scale=.4]univie Created Date: 4/28/2017 10:38:49 AM ...](https://reader033.fdocuments.us/reader033/viewer/2022042404/5f1a97e1a128334ea1730163/html5/thumbnails/10.jpg)
Syllabus
1. Machine Learning Basics
2. Neural Networks
3. Convolutional Neural Networks
Caution
This is not a pure Mathematics course!
![Page 11: Deep Learning - mat.univie.ac.atgrohs/tmp/DeepLearningLectureIntro.pdf · Deep Learning Author: Philipp Grohs[2.8ex] [scale=.4]univie Created Date: 4/28/2017 10:38:49 AM ...](https://reader033.fdocuments.us/reader033/viewer/2022042404/5f1a97e1a128334ea1730163/html5/thumbnails/11.jpg)
Some Literature
I. Goodfellow, Y. Bengio and A. Courville. Deep Learning.(2016). Available from http://www.deeplearningbook.org.
F. Cucker and S. Smale. On the Mathematical Foundations ofLearning. Bulletin of the AMS 39/1, pp 1 – 49 (2001).
M. Nielsen. Neural Networks and Deep Learning. Available fromhttp://neuralnetworksanddeeplearning.com.
MATLAB Library MatConvNet, available fromhttp://www.vlfeat.org/matconvnet.
Python Library Theano, available fromhttp://deeplearning.net/software/theano.