Introduction and course overview - Carnegie Mellon School of Computer...
Transcript of Introduction and course overview - Carnegie Mellon School of Computer...
![Page 1: Introduction and course overview - Carnegie Mellon School of Computer …16385/lectures/lecture29b.pdf · 2020. 4. 29. · See also 15-462: Computer Graphics See also 15-463: Computational](https://reader036.fdocuments.us/reader036/viewer/2022071504/6123d74ccc6d47507e56d781/html5/thumbnails/1.jpg)
Wrap-up
16-385 Computer VisionSpring 2020, Lecture 29http://www.cs.cmu.edu/~16385/
![Page 2: Introduction and course overview - Carnegie Mellon School of Computer …16385/lectures/lecture29b.pdf · 2020. 4. 29. · See also 15-462: Computer Graphics See also 15-463: Computational](https://reader036.fdocuments.us/reader036/viewer/2022071504/6123d74ccc6d47507e56d781/html5/thumbnails/2.jpg)
Course announcements
• Programming assignment 7 is due on Sunday.- Any questions about PA 7?
• Take-home quiz 11 is due on Sunday.- Any questions about TQ 11?
• You can use all of your remaining late days on either PA7 or TQ11.
![Page 3: Introduction and course overview - Carnegie Mellon School of Computer …16385/lectures/lecture29b.pdf · 2020. 4. 29. · See also 15-462: Computer Graphics See also 15-463: Computational](https://reader036.fdocuments.us/reader036/viewer/2022071504/6123d74ccc6d47507e56d781/html5/thumbnails/3.jpg)
Class evaluation*s* – please take them!
• CMU’s Faculty Course Evaluations (FCE): https://cmu.smartevals.com/
• 16-385 end-of-semester survey: https://docs.google.com/forms/d/e/1FAIpQLSeO2CcSkCpi7RB0KXUm0su8s9tMMBaRLcxNaB9t0Fk7CVxwNg/viewform
• Please take both, super helpful for developing future offerings of the class.
• Thanks in advance!
![Page 4: Introduction and course overview - Carnegie Mellon School of Computer …16385/lectures/lecture29b.pdf · 2020. 4. 29. · See also 15-462: Computer Graphics See also 15-463: Computational](https://reader036.fdocuments.us/reader036/viewer/2022071504/6123d74ccc6d47507e56d781/html5/thumbnails/4.jpg)
Today’s lecture
• Structure from motion.
• Class wrap-up.
![Page 5: Introduction and course overview - Carnegie Mellon School of Computer …16385/lectures/lecture29b.pdf · 2020. 4. 29. · See also 15-462: Computer Graphics See also 15-463: Computational](https://reader036.fdocuments.us/reader036/viewer/2022071504/6123d74ccc6d47507e56d781/html5/thumbnails/5.jpg)
1. Image processing.
2. Geometry-based vision.
3. Physics-based vision.
4. Semantic vision.
5. Dealing with motion.
Lectures 13 – 16
See also 16-823: Physics-based Methods in Vision
See also 15-462: Computer Graphics
See also 15-463: Computational Photography
Lectures 7 – 12
See also 16-822: Geometry-based Methods in Vision
Lectures 1 – 7
See also 18-793: Image and Video Processing
Lectures 17 – 20
See also 16-824: Vision Learning and Recognition
See also 10-703: Deep Reinforcement Learning
Course overview
Lectures 21 – 24
See also 16-831: Statistical Techniques in Robotics
See also 16-833: Robot Localization and Mapping
![Page 6: Introduction and course overview - Carnegie Mellon School of Computer …16385/lectures/lecture29b.pdf · 2020. 4. 29. · See also 15-462: Computer Graphics See also 15-463: Computational](https://reader036.fdocuments.us/reader036/viewer/2022071504/6123d74ccc6d47507e56d781/html5/thumbnails/6.jpg)
Image processing
Fourier filtering
![Page 7: Introduction and course overview - Carnegie Mellon School of Computer …16385/lectures/lecture29b.pdf · 2020. 4. 29. · See also 15-462: Computer Graphics See also 15-463: Computational](https://reader036.fdocuments.us/reader036/viewer/2022071504/6123d74ccc6d47507e56d781/html5/thumbnails/7.jpg)
Image features
![Page 8: Introduction and course overview - Carnegie Mellon School of Computer …16385/lectures/lecture29b.pdf · 2020. 4. 29. · See also 15-462: Computer Graphics See also 15-463: Computational](https://reader036.fdocuments.us/reader036/viewer/2022071504/6123d74ccc6d47507e56d781/html5/thumbnails/8.jpg)
2D alignment
![Page 9: Introduction and course overview - Carnegie Mellon School of Computer …16385/lectures/lecture29b.pdf · 2020. 4. 29. · See also 15-462: Computer Graphics See also 15-463: Computational](https://reader036.fdocuments.us/reader036/viewer/2022071504/6123d74ccc6d47507e56d781/html5/thumbnails/9.jpg)
Camera and multi-view geometry
![Page 10: Introduction and course overview - Carnegie Mellon School of Computer …16385/lectures/lecture29b.pdf · 2020. 4. 29. · See also 15-462: Computer Graphics See also 15-463: Computational](https://reader036.fdocuments.us/reader036/viewer/2022071504/6123d74ccc6d47507e56d781/html5/thumbnails/10.jpg)
Stereo
![Page 11: Introduction and course overview - Carnegie Mellon School of Computer …16385/lectures/lecture29b.pdf · 2020. 4. 29. · See also 15-462: Computer Graphics See also 15-463: Computational](https://reader036.fdocuments.us/reader036/viewer/2022071504/6123d74ccc6d47507e56d781/html5/thumbnails/11.jpg)
Image formation and physics
Image processing pipeline
Radiometric and color calibration
Photometric stereo
reflectance
illumination
shape
Radiometry and image formation
![Page 12: Introduction and course overview - Carnegie Mellon School of Computer …16385/lectures/lecture29b.pdf · 2020. 4. 29. · See also 15-462: Computer Graphics See also 15-463: Computational](https://reader036.fdocuments.us/reader036/viewer/2022071504/6123d74ccc6d47507e56d781/html5/thumbnails/12.jpg)
Object recognition
![Page 13: Introduction and course overview - Carnegie Mellon School of Computer …16385/lectures/lecture29b.pdf · 2020. 4. 29. · See also 15-462: Computer Graphics See also 15-463: Computational](https://reader036.fdocuments.us/reader036/viewer/2022071504/6123d74ccc6d47507e56d781/html5/thumbnails/13.jpg)
Neural networks
Convolutional Neural Networks
![Page 14: Introduction and course overview - Carnegie Mellon School of Computer …16385/lectures/lecture29b.pdf · 2020. 4. 29. · See also 15-462: Computer Graphics See also 15-463: Computational](https://reader036.fdocuments.us/reader036/viewer/2022071504/6123d74ccc6d47507e56d781/html5/thumbnails/14.jpg)
Optical flow and alignment
![Page 15: Introduction and course overview - Carnegie Mellon School of Computer …16385/lectures/lecture29b.pdf · 2020. 4. 29. · See also 15-462: Computer Graphics See also 15-463: Computational](https://reader036.fdocuments.us/reader036/viewer/2022071504/6123d74ccc6d47507e56d781/html5/thumbnails/15.jpg)
Tracking in videos
![Page 16: Introduction and course overview - Carnegie Mellon School of Computer …16385/lectures/lecture29b.pdf · 2020. 4. 29. · See also 15-462: Computer Graphics See also 15-463: Computational](https://reader036.fdocuments.us/reader036/viewer/2022071504/6123d74ccc6d47507e56d781/html5/thumbnails/16.jpg)
1. Detect lines (circles, shapes) in an image.
2. Perform automatic image warping and basic AR.
3. Reconstruct 3D scene structure from two images.
4. Do photometric stereo and render simple images.
5. Recognize objects using a bag-of-words model.
6. Recognize objects using deep CNNs.
7. Track objects in video.
Things you should know how to do
![Page 17: Introduction and course overview - Carnegie Mellon School of Computer …16385/lectures/lecture29b.pdf · 2020. 4. 29. · See also 15-462: Computer Graphics See also 15-463: Computational](https://reader036.fdocuments.us/reader036/viewer/2022071504/6123d74ccc6d47507e56d781/html5/thumbnails/17.jpg)
Questions?
![Page 18: Introduction and course overview - Carnegie Mellon School of Computer …16385/lectures/lecture29b.pdf · 2020. 4. 29. · See also 15-462: Computer Graphics See also 15-463: Computational](https://reader036.fdocuments.us/reader036/viewer/2022071504/6123d74ccc6d47507e56d781/html5/thumbnails/18.jpg)
Do you plan on taking any other vision courses?
![Page 19: Introduction and course overview - Carnegie Mellon School of Computer …16385/lectures/lecture29b.pdf · 2020. 4. 29. · See also 15-462: Computer Graphics See also 15-463: Computational](https://reader036.fdocuments.us/reader036/viewer/2022071504/6123d74ccc6d47507e56d781/html5/thumbnails/19.jpg)
Which part of the class did you like the most?
![Page 20: Introduction and course overview - Carnegie Mellon School of Computer …16385/lectures/lecture29b.pdf · 2020. 4. 29. · See also 15-462: Computer Graphics See also 15-463: Computational](https://reader036.fdocuments.us/reader036/viewer/2022071504/6123d74ccc6d47507e56d781/html5/thumbnails/20.jpg)
Which part of the class did you like the least?
![Page 21: Introduction and course overview - Carnegie Mellon School of Computer …16385/lectures/lecture29b.pdf · 2020. 4. 29. · See also 15-462: Computer Graphics See also 15-463: Computational](https://reader036.fdocuments.us/reader036/viewer/2022071504/6123d74ccc6d47507e56d781/html5/thumbnails/21.jpg)
Any topics you wanted to learn more about?
![Page 22: Introduction and course overview - Carnegie Mellon School of Computer …16385/lectures/lecture29b.pdf · 2020. 4. 29. · See also 15-462: Computer Graphics See also 15-463: Computational](https://reader036.fdocuments.us/reader036/viewer/2022071504/6123d74ccc6d47507e56d781/html5/thumbnails/22.jpg)
Any topics you wanted to learn less about?
![Page 23: Introduction and course overview - Carnegie Mellon School of Computer …16385/lectures/lecture29b.pdf · 2020. 4. 29. · See also 15-462: Computer Graphics See also 15-463: Computational](https://reader036.fdocuments.us/reader036/viewer/2022071504/6123d74ccc6d47507e56d781/html5/thumbnails/23.jpg)
Would the class work better if we did learning first?
![Page 24: Introduction and course overview - Carnegie Mellon School of Computer …16385/lectures/lecture29b.pdf · 2020. 4. 29. · See also 15-462: Computer Graphics See also 15-463: Computational](https://reader036.fdocuments.us/reader036/viewer/2022071504/6123d74ccc6d47507e56d781/html5/thumbnails/24.jpg)
Which was your favorite programming assignment?
![Page 25: Introduction and course overview - Carnegie Mellon School of Computer …16385/lectures/lecture29b.pdf · 2020. 4. 29. · See also 15-462: Computer Graphics See also 15-463: Computational](https://reader036.fdocuments.us/reader036/viewer/2022071504/6123d74ccc6d47507e56d781/html5/thumbnails/25.jpg)
Which was your least favorite programming assignment?
![Page 26: Introduction and course overview - Carnegie Mellon School of Computer …16385/lectures/lecture29b.pdf · 2020. 4. 29. · See also 15-462: Computer Graphics See also 15-463: Computational](https://reader036.fdocuments.us/reader036/viewer/2022071504/6123d74ccc6d47507e56d781/html5/thumbnails/26.jpg)
Would it be better if programming assignments were in Matlab?
![Page 27: Introduction and course overview - Carnegie Mellon School of Computer …16385/lectures/lecture29b.pdf · 2020. 4. 29. · See also 15-462: Computer Graphics See also 15-463: Computational](https://reader036.fdocuments.us/reader036/viewer/2022071504/6123d74ccc6d47507e56d781/html5/thumbnails/27.jpg)
Do the take-home quizzes work?
![Page 28: Introduction and course overview - Carnegie Mellon School of Computer …16385/lectures/lecture29b.pdf · 2020. 4. 29. · See also 15-462: Computer Graphics See also 15-463: Computational](https://reader036.fdocuments.us/reader036/viewer/2022071504/6123d74ccc6d47507e56d781/html5/thumbnails/28.jpg)
How does course workload compare to other classes?