Nando de Freitas - cs.ox.ac.uk · Convnets for object recognition and language How to design...
Transcript of Nando de Freitas - cs.ox.ac.uk · Convnets for object recognition and language How to design...
![Page 1: Nando de Freitas - cs.ox.ac.uk · Convnets for object recognition and language How to design convolutional layers How to design pooling layers How to build convnets in torch. Convnets](https://reader034.fdocuments.us/reader034/viewer/2022042409/5f26bdb9fd29af1620685760/html5/thumbnails/1.jpg)
ConvnetsNando de Freitas
![Page 2: Nando de Freitas - cs.ox.ac.uk · Convnets for object recognition and language How to design convolutional layers How to design pooling layers How to build convnets in torch. Convnets](https://reader034.fdocuments.us/reader034/viewer/2022042409/5f26bdb9fd29af1620685760/html5/thumbnails/2.jpg)
Outline of the lecture
This lecture introduces you to convolutional neural networks. Thesemodels have revolutionized speech and object recognition. The goalis for you to learn
Convnets for object recognition and language How to design convolutional layers How to design pooling layers How to build convnets in torch
![Page 3: Nando de Freitas - cs.ox.ac.uk · Convnets for object recognition and language How to design convolutional layers How to design pooling layers How to build convnets in torch. Convnets](https://reader034.fdocuments.us/reader034/viewer/2022042409/5f26bdb9fd29af1620685760/html5/thumbnails/3.jpg)
Convnets (Fukushima, LeCun, Hinton)
![Page 4: Nando de Freitas - cs.ox.ac.uk · Convnets for object recognition and language How to design convolutional layers How to design pooling layers How to build convnets in torch. Convnets](https://reader034.fdocuments.us/reader034/viewer/2022042409/5f26bdb9fd29af1620685760/html5/thumbnails/4.jpg)
[Matthew Zeiler & Rob Fergus]
Convolutional networks
![Page 5: Nando de Freitas - cs.ox.ac.uk · Convnets for object recognition and language How to design convolutional layers How to design pooling layers How to build convnets in torch. Convnets](https://reader034.fdocuments.us/reader034/viewer/2022042409/5f26bdb9fd29af1620685760/html5/thumbnails/5.jpg)
![Page 6: Nando de Freitas - cs.ox.ac.uk · Convnets for object recognition and language How to design convolutional layers How to design pooling layers How to build convnets in torch. Convnets](https://reader034.fdocuments.us/reader034/viewer/2022042409/5f26bdb9fd29af1620685760/html5/thumbnails/6.jpg)
Convolution
![Page 7: Nando de Freitas - cs.ox.ac.uk · Convnets for object recognition and language How to design convolutional layers How to design pooling layers How to build convnets in torch. Convnets](https://reader034.fdocuments.us/reader034/viewer/2022042409/5f26bdb9fd29af1620685760/html5/thumbnails/7.jpg)
Image convolution
![Page 8: Nando de Freitas - cs.ox.ac.uk · Convnets for object recognition and language How to design convolutional layers How to design pooling layers How to build convnets in torch. Convnets](https://reader034.fdocuments.us/reader034/viewer/2022042409/5f26bdb9fd29af1620685760/html5/thumbnails/8.jpg)
Convnets (Fukushima, LeCun, Hinton)
![Page 9: Nando de Freitas - cs.ox.ac.uk · Convnets for object recognition and language How to design convolutional layers How to design pooling layers How to build convnets in torch. Convnets](https://reader034.fdocuments.us/reader034/viewer/2022042409/5f26bdb9fd29af1620685760/html5/thumbnails/9.jpg)
Image convolution layer
![Page 10: Nando de Freitas - cs.ox.ac.uk · Convnets for object recognition and language How to design convolutional layers How to design pooling layers How to build convnets in torch. Convnets](https://reader034.fdocuments.us/reader034/viewer/2022042409/5f26bdb9fd29af1620685760/html5/thumbnails/10.jpg)
Image convolution layer
![Page 11: Nando de Freitas - cs.ox.ac.uk · Convnets for object recognition and language How to design convolutional layers How to design pooling layers How to build convnets in torch. Convnets](https://reader034.fdocuments.us/reader034/viewer/2022042409/5f26bdb9fd29af1620685760/html5/thumbnails/11.jpg)
Image convolution layer
![Page 12: Nando de Freitas - cs.ox.ac.uk · Convnets for object recognition and language How to design convolutional layers How to design pooling layers How to build convnets in torch. Convnets](https://reader034.fdocuments.us/reader034/viewer/2022042409/5f26bdb9fd29af1620685760/html5/thumbnails/12.jpg)
Image max-pooling layer
![Page 13: Nando de Freitas - cs.ox.ac.uk · Convnets for object recognition and language How to design convolutional layers How to design pooling layers How to build convnets in torch. Convnets](https://reader034.fdocuments.us/reader034/viewer/2022042409/5f26bdb9fd29af1620685760/html5/thumbnails/13.jpg)
Convnets in Torch
![Page 14: Nando de Freitas - cs.ox.ac.uk · Convnets for object recognition and language How to design convolutional layers How to design pooling layers How to build convnets in torch. Convnets](https://reader034.fdocuments.us/reader034/viewer/2022042409/5f26bdb9fd29af1620685760/html5/thumbnails/14.jpg)
ConvNets for Language
[Nal Kalchbrenner, Ed Grefenstette, Phil Blunsom, 2014]
[Ronan Collobert, Jason Weston, 2008]
![Page 15: Nando de Freitas - cs.ox.ac.uk · Convnets for object recognition and language How to design convolutional layers How to design pooling layers How to build convnets in torch. Convnets](https://reader034.fdocuments.us/reader034/viewer/2022042409/5f26bdb9fd29af1620685760/html5/thumbnails/15.jpg)
Sentence ConvNets
[Kalchbrenner, Grefenstette, Blunsom, 2014]
![Page 16: Nando de Freitas - cs.ox.ac.uk · Convnets for object recognition and language How to design convolutional layers How to design pooling layers How to build convnets in torch. Convnets](https://reader034.fdocuments.us/reader034/viewer/2022042409/5f26bdb9fd29af1620685760/html5/thumbnails/16.jpg)
SentenceDynConvNet
[Kalchbrenner et al, 2014]
![Page 17: Nando de Freitas - cs.ox.ac.uk · Convnets for object recognition and language How to design convolutional layers How to design pooling layers How to build convnets in torch. Convnets](https://reader034.fdocuments.us/reader034/viewer/2022042409/5f26bdb9fd29af1620685760/html5/thumbnails/17.jpg)
Document models ( Misha Denil )