A Fast Learning Algorithm for Deep Belief Nets
23
A Fast Learning Algorithm for Deep Belief Nets Hinton, Osindero, Teh
-
Upload
hadassah-ware -
Category
Documents
-
view
33 -
download
0
description
A Fast Learning Algorithm for Deep Belief Nets. Hinton, Osindero , Teh. Conditional Learning is Hard. Conditional Learning is Hard. Conditional Learning is Hard. Conditional Learning is Hard. ?. Complementary Priors. A specially structured deep network. Training our deep network. - PowerPoint PPT Presentation
Transcript of A Fast Learning Algorithm for Deep Belief Nets
![Page 1: A Fast Learning Algorithm for Deep Belief Nets](https://reader035.fdocuments.us/reader035/viewer/2022062517/5681362f550346895d9daa3f/html5/thumbnails/1.jpg)
A Fast Learning Algorithm for Deep Belief NetsHinton, Osindero, Teh
![Page 2: A Fast Learning Algorithm for Deep Belief Nets](https://reader035.fdocuments.us/reader035/viewer/2022062517/5681362f550346895d9daa3f/html5/thumbnails/2.jpg)
Conditional Learning is Hard
![Page 3: A Fast Learning Algorithm for Deep Belief Nets](https://reader035.fdocuments.us/reader035/viewer/2022062517/5681362f550346895d9daa3f/html5/thumbnails/3.jpg)
Conditional Learning is Hard
![Page 4: A Fast Learning Algorithm for Deep Belief Nets](https://reader035.fdocuments.us/reader035/viewer/2022062517/5681362f550346895d9daa3f/html5/thumbnails/4.jpg)
Conditional Learning is Hard
![Page 5: A Fast Learning Algorithm for Deep Belief Nets](https://reader035.fdocuments.us/reader035/viewer/2022062517/5681362f550346895d9daa3f/html5/thumbnails/5.jpg)
Conditional Learning is Hard
?
![Page 6: A Fast Learning Algorithm for Deep Belief Nets](https://reader035.fdocuments.us/reader035/viewer/2022062517/5681362f550346895d9daa3f/html5/thumbnails/6.jpg)
![Page 7: A Fast Learning Algorithm for Deep Belief Nets](https://reader035.fdocuments.us/reader035/viewer/2022062517/5681362f550346895d9daa3f/html5/thumbnails/7.jpg)
Complementary Priors
![Page 8: A Fast Learning Algorithm for Deep Belief Nets](https://reader035.fdocuments.us/reader035/viewer/2022062517/5681362f550346895d9daa3f/html5/thumbnails/8.jpg)
A specially structured deep network
![Page 9: A Fast Learning Algorithm for Deep Belief Nets](https://reader035.fdocuments.us/reader035/viewer/2022062517/5681362f550346895d9daa3f/html5/thumbnails/9.jpg)
Training our deep network
![Page 10: A Fast Learning Algorithm for Deep Belief Nets](https://reader035.fdocuments.us/reader035/viewer/2022062517/5681362f550346895d9daa3f/html5/thumbnails/10.jpg)
Training our deep network
![Page 11: A Fast Learning Algorithm for Deep Belief Nets](https://reader035.fdocuments.us/reader035/viewer/2022062517/5681362f550346895d9daa3f/html5/thumbnails/11.jpg)
Training our deep network
• This is the update for a restricted Boltzmann Machine
![Page 12: A Fast Learning Algorithm for Deep Belief Nets](https://reader035.fdocuments.us/reader035/viewer/2022062517/5681362f550346895d9daa3f/html5/thumbnails/12.jpg)
RBM training
![Page 13: A Fast Learning Algorithm for Deep Belief Nets](https://reader035.fdocuments.us/reader035/viewer/2022062517/5681362f550346895d9daa3f/html5/thumbnails/13.jpg)
Let’s relax the assumptions
![Page 14: A Fast Learning Algorithm for Deep Belief Nets](https://reader035.fdocuments.us/reader035/viewer/2022062517/5681362f550346895d9daa3f/html5/thumbnails/14.jpg)
RBM
Input
![Page 15: A Fast Learning Algorithm for Deep Belief Nets](https://reader035.fdocuments.us/reader035/viewer/2022062517/5681362f550346895d9daa3f/html5/thumbnails/15.jpg)
Greedy Training
Input
![Page 16: A Fast Learning Algorithm for Deep Belief Nets](https://reader035.fdocuments.us/reader035/viewer/2022062517/5681362f550346895d9daa3f/html5/thumbnails/16.jpg)
Greedy Training
Input
![Page 17: A Fast Learning Algorithm for Deep Belief Nets](https://reader035.fdocuments.us/reader035/viewer/2022062517/5681362f550346895d9daa3f/html5/thumbnails/17.jpg)
Greedy Training
Input
![Page 18: A Fast Learning Algorithm for Deep Belief Nets](https://reader035.fdocuments.us/reader035/viewer/2022062517/5681362f550346895d9daa3f/html5/thumbnails/18.jpg)
Fine tuning
Input
![Page 19: A Fast Learning Algorithm for Deep Belief Nets](https://reader035.fdocuments.us/reader035/viewer/2022062517/5681362f550346895d9daa3f/html5/thumbnails/19.jpg)
Fine tuning
Input
![Page 20: A Fast Learning Algorithm for Deep Belief Nets](https://reader035.fdocuments.us/reader035/viewer/2022062517/5681362f550346895d9daa3f/html5/thumbnails/20.jpg)
Fine tuning
Input
![Page 21: A Fast Learning Algorithm for Deep Belief Nets](https://reader035.fdocuments.us/reader035/viewer/2022062517/5681362f550346895d9daa3f/html5/thumbnails/21.jpg)
Fine tuning
Input
![Page 22: A Fast Learning Algorithm for Deep Belief Nets](https://reader035.fdocuments.us/reader035/viewer/2022062517/5681362f550346895d9daa3f/html5/thumbnails/22.jpg)
Yes, this actually works
![Page 23: A Fast Learning Algorithm for Deep Belief Nets](https://reader035.fdocuments.us/reader035/viewer/2022062517/5681362f550346895d9daa3f/html5/thumbnails/23.jpg)
All Done!