Administrative - Stanford Universitycs231n.stanford.edu/slides/2016/winter1516_lecture15.pdfFei-Fei...
Transcript of Administrative - Stanford Universitycs231n.stanford.edu/slides/2016/winter1516_lecture15.pdfFei-Fei...
Lecture 15 - 7 Mar 2016Fei-Fei Li & Andrej Karpathy & Justin JohnsonFei-Fei Li & Andrej Karpathy & Justin Johnson Lecture 15 - 7 Mar 20161
Administrative
- Poster Session on Wednesday!- http://cs231n.stanford.edu/postersession.html- Facebook group: https://www.facebook.
com/events/1024309900974098/ - If using AWS, use EBS
- Instructions on Piazza- A3 Grades out soon
Lecture 15 - 7 Mar 2016Fei-Fei Li & Andrej Karpathy & Justin JohnsonFei-Fei Li & Andrej Karpathy & Justin Johnson Lecture 15 - 7 Mar 20162
Together, we’ve defined Score Functions...
Lecture 15 - 7 Mar 2016Fei-Fei Li & Andrej Karpathy & Justin JohnsonFei-Fei Li & Andrej Karpathy & Justin Johnson Lecture 15 - 7 Mar 20163
And Loss Functions...
Lecture 15 - 7 Mar 2016Fei-Fei Li & Andrej Karpathy & Justin JohnsonFei-Fei Li & Andrej Karpathy & Justin Johnson Lecture 15 - 7 Mar 20164
We’ve learned how to optimize them...
Chain rule:
Lecture 15 - 7 Mar 2016Fei-Fei Li & Andrej Karpathy & Justin JohnsonFei-Fei Li & Andrej Karpathy & Justin Johnson Lecture 15 - 7 Mar 20165
NEURAL NETWORKS
We learned to express more powerful Score Functions...
Lecture 15 - 7 Mar 2016Fei-Fei Li & Andrej Karpathy & Justin JohnsonFei-Fei Li & Andrej Karpathy & Justin Johnson Lecture 15 - 7 Mar 20166
For an extra wiggle...
Lecture 15 - 7 Mar 2016Fei-Fei Li & Andrej Karpathy & Justin JohnsonFei-Fei Li & Andrej Karpathy & Justin Johnson Lecture 15 - 7 Mar 20167
Together we tamed the learning process...
Lecture 15 - 7 Mar 2016Fei-Fei Li & Andrej Karpathy & Justin JohnsonFei-Fei Li & Andrej Karpathy & Justin Johnson Lecture 15 - 7 Mar 20168
Together we explored image-specific Neural Nets...CONV
ReLUCONV
ReLUPOOLCONV
ReLUCONV
ReLUPOOL CONV
ReLUCONV
ReLUPOOL FC
(Fully-connected)
Lecture 15 - 7 Mar 2016Fei-Fei Li & Andrej Karpathy & Justin JohnsonFei-Fei Li & Andrej Karpathy & Justin Johnson Lecture 15 - 7 Mar 20169
We explored how they work...
Lecture 15 - 7 Mar 2016Fei-Fei Li & Andrej Karpathy & Justin JohnsonFei-Fei Li & Andrej Karpathy & Justin Johnson Lecture 15 - 7 Mar 201610
And how they don’t… (but really they still do)
Lecture 15 - 7 Mar 2016Fei-Fei Li & Andrej Karpathy & Justin JohnsonFei-Fei Li & Andrej Karpathy & Justin Johnson Lecture 15 - 7 Mar 201611
And how to make art
Lecture 15 - 7 Mar 2016Fei-Fei Li & Andrej Karpathy & Justin JohnsonFei-Fei Li & Andrej Karpathy & Justin Johnson Lecture 15 - 7 Mar 201612
We looked at what makes ConvNets “tick”...
Lecture 15 - 7 Mar 2016Fei-Fei Li & Andrej Karpathy & Justin JohnsonFei-Fei Li & Andrej Karpathy & Justin Johnson Lecture 15 - 7 Mar 201613
We learned tips/tricks for making ConvNets work well in practice
Lecture 15 - 7 Mar 2016Fei-Fei Li & Andrej Karpathy & Justin JohnsonFei-Fei Li & Andrej Karpathy & Justin Johnson Lecture 15 - 7 Mar 201614
And explored their practical bottlenecks...
Moving parts lol
Lecture 15 - 7 Mar 2016Fei-Fei Li & Andrej Karpathy & Justin JohnsonFei-Fei Li & Andrej Karpathy & Justin Johnson Lecture 15 - 7 Mar 201615
And we bravely ventured beyond Image Classification...
Lecture 15 - 7 Mar 2016Fei-Fei Li & Andrej Karpathy & Justin JohnsonFei-Fei Li & Andrej Karpathy & Justin Johnson Lecture 15 - 7 Mar 201616
And developed an understanding of cutting-edge research
Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning
[Szegedy et al., 2016] (Google)
We saw 2015 & 2016 citations...e.g.
Deep Residual Learning for Image Recognition[He et al., CVPR 2016] (MSR)
Lecture 15 - 7 Mar 2016Fei-Fei Li & Andrej Karpathy & Justin JohnsonFei-Fei Li & Andrej Karpathy & Justin Johnson Lecture 15 - 7 Mar 201617
You are now ready.
Lecture 15 - 7 Mar 2016Fei-Fei Li & Andrej Karpathy & Justin JohnsonFei-Fei Li & Andrej Karpathy & Justin Johnson Lecture 15 - 7 Mar 201618
You are now ready.
Lecture 15 - 7 Mar 2016Fei-Fei Li & Andrej Karpathy & Justin JohnsonFei-Fei Li & Andrej Karpathy & Justin Johnson Lecture 15 - 7 Mar 201619
You are now ready.
Lecture 15 - 7 Mar 2016Fei-Fei Li & Andrej Karpathy & Justin JohnsonFei-Fei Li & Andrej Karpathy & Justin Johnson Lecture 15 - 7 Mar 201620
Lecture 15 - 7 Mar 2016Fei-Fei Li & Andrej Karpathy & Justin JohnsonFei-Fei Li & Andrej Karpathy & Justin Johnson Lecture 15 - 7 Mar 201621
END