Announcements - University Of Marylanddjacobs/CMSC426/Conclusion.pdf · Announcements • Final:...
Transcript of Announcements - University Of Marylanddjacobs/CMSC426/Conclusion.pdf · Announcements • Final:...
![Page 1: Announcements - University Of Marylanddjacobs/CMSC426/Conclusion.pdf · Announcements • Final: Thursday, December 15, 8am, ... nearly every shot of the movie Titanic. (From Vision](https://reader033.fdocuments.us/reader033/viewer/2022052515/5a7695b37f8b9a0d558d4680/html5/thumbnails/1.jpg)
Announcements
• Final: Thursday, December 15, 8am, here.
• Review Session, Wednesday, Dec 14, 1pm, AV Williams 4424.
• Review sheet with practice problems on-line.
![Page 2: Announcements - University Of Marylanddjacobs/CMSC426/Conclusion.pdf · Announcements • Final: Thursday, December 15, 8am, ... nearly every shot of the movie Titanic. (From Vision](https://reader033.fdocuments.us/reader033/viewer/2022052515/5a7695b37f8b9a0d558d4680/html5/thumbnails/2.jpg)
Hints for Final
• Focus on core techniques/ideas: convolution, gradients, statistical modeling, 3D geometry, motion matrices and optimization methods we studied, and their use in vision.
• Of course, other topics from course may show up.
![Page 3: Announcements - University Of Marylanddjacobs/CMSC426/Conclusion.pdf · Announcements • Final: Thursday, December 15, 8am, ... nearly every shot of the movie Titanic. (From Vision](https://reader033.fdocuments.us/reader033/viewer/2022052515/5a7695b37f8b9a0d558d4680/html5/thumbnails/3.jpg)
Vision is inferential
(http://www-bcs.mit.edu/people/adelson/checkershadow_illusion.html)
![Page 4: Announcements - University Of Marylanddjacobs/CMSC426/Conclusion.pdf · Announcements • Final: Thursday, December 15, 8am, ... nearly every shot of the movie Titanic. (From Vision](https://reader033.fdocuments.us/reader033/viewer/2022052515/5a7695b37f8b9a0d558d4680/html5/thumbnails/4.jpg)
Boundary Detection
• Images don’t come color-coded with boundaries.– Filtering to combine evidence.– Define discontinuities in 2D.– Snakes to combine evidence further.– Good continuation, comes from knowledge of
shape.– Texture understanding as modeling random
processes.
• Boundary detection involves combination of different kinds of knowledge.
![Page 5: Announcements - University Of Marylanddjacobs/CMSC426/Conclusion.pdf · Announcements • Final: Thursday, December 15, 8am, ... nearly every shot of the movie Titanic. (From Vision](https://reader033.fdocuments.us/reader033/viewer/2022052515/5a7695b37f8b9a0d558d4680/html5/thumbnails/5.jpg)
Modeling + Algorithms
• Build a simple model of the world(eg., flat, uniform intensity).
• Find provably good algorithms.• Experiment on real world.• Update model.Problem: Too often models are simplistic
or intractable.
![Page 6: Announcements - University Of Marylanddjacobs/CMSC426/Conclusion.pdf · Announcements • Final: Thursday, December 15, 8am, ... nearly every shot of the movie Titanic. (From Vision](https://reader033.fdocuments.us/reader033/viewer/2022052515/5a7695b37f8b9a0d558d4680/html5/thumbnails/6.jpg)
Stereo
• Modeling: Geometry, Photometry.– Perspective camera, known pose allows
reconstruction.– Epipolar Constraint.– Ordering constraint– Match similar intensities.– Disparities similar in nearby pixels.
• Algorithms– Straightforward Reconstruction.– Shortest path, Graph Algorithms.
![Page 7: Announcements - University Of Marylanddjacobs/CMSC426/Conclusion.pdf · Announcements • Final: Thursday, December 15, 8am, ... nearly every shot of the movie Titanic. (From Vision](https://reader033.fdocuments.us/reader033/viewer/2022052515/5a7695b37f8b9a0d558d4680/html5/thumbnails/7.jpg)
Where is Computer Vision Going?
• More Data, Faster Machines =>• More Interaction with Other Fields.• Fundamental Problems Remain
![Page 8: Announcements - University Of Marylanddjacobs/CMSC426/Conclusion.pdf · Announcements • Final: Thursday, December 15, 8am, ... nearly every shot of the movie Titanic. (From Vision](https://reader033.fdocuments.us/reader033/viewer/2022052515/5a7695b37f8b9a0d558d4680/html5/thumbnails/8.jpg)
Optimization
• Partly push of video meant bigger optimization problems.
• Early 90s, SVD, Gradient Descent, Filtering.
• More recently, Graph Algorithms, Particle Filtering, Mean-shift, Multi-grid….
• Techniques from theoretical CS, applied math, physics, learning, ….
![Page 9: Announcements - University Of Marylanddjacobs/CMSC426/Conclusion.pdf · Announcements • Final: Thursday, December 15, 8am, ... nearly every shot of the movie Titanic. (From Vision](https://reader033.fdocuments.us/reader033/viewer/2022052515/5a7695b37f8b9a0d558d4680/html5/thumbnails/9.jpg)
![Page 10: Announcements - University Of Marylanddjacobs/CMSC426/Conclusion.pdf · Announcements • Final: Thursday, December 15, 8am, ... nearly every shot of the movie Titanic. (From Vision](https://reader033.fdocuments.us/reader033/viewer/2022052515/5a7695b37f8b9a0d558d4680/html5/thumbnails/10.jpg)
State of the art methodBoykov et al., Fast Approximate Energy Minimization via Graph Cuts,
International Conference on Computer Vision, September 1999.
Ground truth
(Seitz)
![Page 11: Announcements - University Of Marylanddjacobs/CMSC426/Conclusion.pdf · Announcements • Final: Thursday, December 15, 8am, ... nearly every shot of the movie Titanic. (From Vision](https://reader033.fdocuments.us/reader033/viewer/2022052515/5a7695b37f8b9a0d558d4680/html5/thumbnails/11.jpg)
(Comaniciu and Meer)
![Page 12: Announcements - University Of Marylanddjacobs/CMSC426/Conclusion.pdf · Announcements • Final: Thursday, December 15, 8am, ... nearly every shot of the movie Titanic. (From Vision](https://reader033.fdocuments.us/reader033/viewer/2022052515/5a7695b37f8b9a0d558d4680/html5/thumbnails/12.jpg)
Learning
• Recognition using supervised learning.– Given examples of an object– Use classifiers: eg, SVMs, Winnow,
Boosting.
• Grouping using unsupervised learning.– Eg., E-M
• Probabilistic Modeling– Eg., Graphical models, texture, ….
![Page 13: Announcements - University Of Marylanddjacobs/CMSC426/Conclusion.pdf · Announcements • Final: Thursday, December 15, 8am, ... nearly every shot of the movie Titanic. (From Vision](https://reader033.fdocuments.us/reader033/viewer/2022052515/5a7695b37f8b9a0d558d4680/html5/thumbnails/13.jpg)
Viola and Jones: Real time Face Detection
![Page 14: Announcements - University Of Marylanddjacobs/CMSC426/Conclusion.pdf · Announcements • Final: Thursday, December 15, 8am, ... nearly every shot of the movie Titanic. (From Vision](https://reader033.fdocuments.us/reader033/viewer/2022052515/5a7695b37f8b9a0d558d4680/html5/thumbnails/14.jpg)
Viola and Jones: Real time Face Detection
![Page 15: Announcements - University Of Marylanddjacobs/CMSC426/Conclusion.pdf · Announcements • Final: Thursday, December 15, 8am, ... nearly every shot of the movie Titanic. (From Vision](https://reader033.fdocuments.us/reader033/viewer/2022052515/5a7695b37f8b9a0d558d4680/html5/thumbnails/15.jpg)
Graphics
• Common interest in modeling reflection, light, 3D shape.
• Image-Based Rendering.
![Page 16: Announcements - University Of Marylanddjacobs/CMSC426/Conclusion.pdf · Announcements • Final: Thursday, December 15, 8am, ... nearly every shot of the movie Titanic. (From Vision](https://reader033.fdocuments.us/reader033/viewer/2022052515/5a7695b37f8b9a0d558d4680/html5/thumbnails/16.jpg)
input depth image novel view
Szeliski
![Page 17: Announcements - University Of Marylanddjacobs/CMSC426/Conclusion.pdf · Announcements • Final: Thursday, December 15, 8am, ... nearly every shot of the movie Titanic. (From Vision](https://reader033.fdocuments.us/reader033/viewer/2022052515/5a7695b37f8b9a0d558d4680/html5/thumbnails/17.jpg)
Figure 1: 3D tracking software developed at Digital Domain was used on nearly every shot of the movie Titanic. (From Vision in Film and Special Effects Doug Roble, Digital Domain)
![Page 18: Announcements - University Of Marylanddjacobs/CMSC426/Conclusion.pdf · Announcements • Final: Thursday, December 15, 8am, ... nearly every shot of the movie Titanic. (From Vision](https://reader033.fdocuments.us/reader033/viewer/2022052515/5a7695b37f8b9a0d558d4680/html5/thumbnails/18.jpg)
Figure 3: 2D tracking was used to apply digital makeup to Brad Pitt in Interview with a Vampire.
![Page 19: Announcements - University Of Marylanddjacobs/CMSC426/Conclusion.pdf · Announcements • Final: Thursday, December 15, 8am, ... nearly every shot of the movie Titanic. (From Vision](https://reader033.fdocuments.us/reader033/viewer/2022052515/5a7695b37f8b9a0d558d4680/html5/thumbnails/19.jpg)
Image Editing: Snakes, Intelligent Scissors, Contour-based editing (Vision-Assisted Image Editing Eric N. Mortensen Brigham Young University)
![Page 20: Announcements - University Of Marylanddjacobs/CMSC426/Conclusion.pdf · Announcements • Final: Thursday, December 15, 8am, ... nearly every shot of the movie Titanic. (From Vision](https://reader033.fdocuments.us/reader033/viewer/2022052515/5a7695b37f8b9a0d558d4680/html5/thumbnails/20.jpg)
Biomedical Engineering
• Segmentation – Identify organs to measure them.– Find tumors.
• Tracking– Is a heart beating properly? Is there dead
tissue?
• Registration/Matching.– Positions of Tumors in Surgery.
![Page 21: Announcements - University Of Marylanddjacobs/CMSC426/Conclusion.pdf · Announcements • Final: Thursday, December 15, 8am, ... nearly every shot of the movie Titanic. (From Vision](https://reader033.fdocuments.us/reader033/viewer/2022052515/5a7695b37f8b9a0d558d4680/html5/thumbnails/21.jpg)
Figures by kind permission of Eric Grimson; further information can be obtained from his web site http://www.ai.mit.edu/people/welg/welg.html.
![Page 22: Announcements - University Of Marylanddjacobs/CMSC426/Conclusion.pdf · Announcements • Final: Thursday, December 15, 8am, ... nearly every shot of the movie Titanic. (From Vision](https://reader033.fdocuments.us/reader033/viewer/2022052515/5a7695b37f8b9a0d558d4680/html5/thumbnails/22.jpg)
Figures by kind permission of Eric Grimson; further information can be obtained from his web site http://www.ai.mit.edu/people/welg/welg.html.
![Page 23: Announcements - University Of Marylanddjacobs/CMSC426/Conclusion.pdf · Announcements • Final: Thursday, December 15, 8am, ... nearly every shot of the movie Titanic. (From Vision](https://reader033.fdocuments.us/reader033/viewer/2022052515/5a7695b37f8b9a0d558d4680/html5/thumbnails/23.jpg)
Figures by kind permission of Eric Grimson; further information can be obtained from his web site http://www.ai.mit.edu/people/welg/welg.html.
![Page 24: Announcements - University Of Marylanddjacobs/CMSC426/Conclusion.pdf · Announcements • Final: Thursday, December 15, 8am, ... nearly every shot of the movie Titanic. (From Vision](https://reader033.fdocuments.us/reader033/viewer/2022052515/5a7695b37f8b9a0d558d4680/html5/thumbnails/24.jpg)
Figures by kind permission of Eric Grimson; further information can be obtained from his web site http://www.ai.mit.edu/people/welg/welg.html.
![Page 25: Announcements - University Of Marylanddjacobs/CMSC426/Conclusion.pdf · Announcements • Final: Thursday, December 15, 8am, ... nearly every shot of the movie Titanic. (From Vision](https://reader033.fdocuments.us/reader033/viewer/2022052515/5a7695b37f8b9a0d558d4680/html5/thumbnails/25.jpg)
Figures by kind permission of Eric Grimson; further information can be obtained from his web site http://www.ai.mit.edu/people/welg/welg.html.
![Page 26: Announcements - University Of Marylanddjacobs/CMSC426/Conclusion.pdf · Announcements • Final: Thursday, December 15, 8am, ... nearly every shot of the movie Titanic. (From Vision](https://reader033.fdocuments.us/reader033/viewer/2022052515/5a7695b37f8b9a0d558d4680/html5/thumbnails/26.jpg)
Big Data Sets
• Image Data Bases– Kodak, commercial data bases w/ tens of
thousands of images.– Internet, with millions?
• Satellite imagery (Petabytes).– Monitoring effects of climate change.
• Custom Data Sets
![Page 27: Announcements - University Of Marylanddjacobs/CMSC426/Conclusion.pdf · Announcements • Final: Thursday, December 15, 8am, ... nearly every shot of the movie Titanic. (From Vision](https://reader033.fdocuments.us/reader033/viewer/2022052515/5a7695b37f8b9a0d558d4680/html5/thumbnails/27.jpg)
![Page 28: Announcements - University Of Marylanddjacobs/CMSC426/Conclusion.pdf · Announcements • Final: Thursday, December 15, 8am, ... nearly every shot of the movie Titanic. (From Vision](https://reader033.fdocuments.us/reader033/viewer/2022052515/5a7695b37f8b9a0d558d4680/html5/thumbnails/28.jpg)
Vision at Maryland
![Page 29: Announcements - University Of Marylanddjacobs/CMSC426/Conclusion.pdf · Announcements • Final: Thursday, December 15, 8am, ... nearly every shot of the movie Titanic. (From Vision](https://reader033.fdocuments.us/reader033/viewer/2022052515/5a7695b37f8b9a0d558d4680/html5/thumbnails/29.jpg)
Background Subtraction
![Page 30: Announcements - University Of Marylanddjacobs/CMSC426/Conclusion.pdf · Announcements • Final: Thursday, December 15, 8am, ... nearly every shot of the movie Titanic. (From Vision](https://reader033.fdocuments.us/reader033/viewer/2022052515/5a7695b37f8b9a0d558d4680/html5/thumbnails/30.jpg)
Tracking and Activity Classification
![Page 31: Announcements - University Of Marylanddjacobs/CMSC426/Conclusion.pdf · Announcements • Final: Thursday, December 15, 8am, ... nearly every shot of the movie Titanic. (From Vision](https://reader033.fdocuments.us/reader033/viewer/2022052515/5a7695b37f8b9a0d558d4680/html5/thumbnails/31.jpg)
![Page 32: Announcements - University Of Marylanddjacobs/CMSC426/Conclusion.pdf · Announcements • Final: Thursday, December 15, 8am, ... nearly every shot of the movie Titanic. (From Vision](https://reader033.fdocuments.us/reader033/viewer/2022052515/5a7695b37f8b9a0d558d4680/html5/thumbnails/32.jpg)
![Page 33: Announcements - University Of Marylanddjacobs/CMSC426/Conclusion.pdf · Announcements • Final: Thursday, December 15, 8am, ... nearly every shot of the movie Titanic. (From Vision](https://reader033.fdocuments.us/reader033/viewer/2022052515/5a7695b37f8b9a0d558d4680/html5/thumbnails/33.jpg)
![Page 34: Announcements - University Of Marylanddjacobs/CMSC426/Conclusion.pdf · Announcements • Final: Thursday, December 15, 8am, ... nearly every shot of the movie Titanic. (From Vision](https://reader033.fdocuments.us/reader033/viewer/2022052515/5a7695b37f8b9a0d558d4680/html5/thumbnails/34.jpg)
![Page 35: Announcements - University Of Marylanddjacobs/CMSC426/Conclusion.pdf · Announcements • Final: Thursday, December 15, 8am, ... nearly every shot of the movie Titanic. (From Vision](https://reader033.fdocuments.us/reader033/viewer/2022052515/5a7695b37f8b9a0d558d4680/html5/thumbnails/35.jpg)
![Page 36: Announcements - University Of Marylanddjacobs/CMSC426/Conclusion.pdf · Announcements • Final: Thursday, December 15, 8am, ... nearly every shot of the movie Titanic. (From Vision](https://reader033.fdocuments.us/reader033/viewer/2022052515/5a7695b37f8b9a0d558d4680/html5/thumbnails/36.jpg)
![Page 37: Announcements - University Of Marylanddjacobs/CMSC426/Conclusion.pdf · Announcements • Final: Thursday, December 15, 8am, ... nearly every shot of the movie Titanic. (From Vision](https://reader033.fdocuments.us/reader033/viewer/2022052515/5a7695b37f8b9a0d558d4680/html5/thumbnails/37.jpg)
Smart Thumbnails
![Page 38: Announcements - University Of Marylanddjacobs/CMSC426/Conclusion.pdf · Announcements • Final: Thursday, December 15, 8am, ... nearly every shot of the movie Titanic. (From Vision](https://reader033.fdocuments.us/reader033/viewer/2022052515/5a7695b37f8b9a0d558d4680/html5/thumbnails/38.jpg)
![Page 39: Announcements - University Of Marylanddjacobs/CMSC426/Conclusion.pdf · Announcements • Final: Thursday, December 15, 8am, ... nearly every shot of the movie Titanic. (From Vision](https://reader033.fdocuments.us/reader033/viewer/2022052515/5a7695b37f8b9a0d558d4680/html5/thumbnails/39.jpg)
Many Big Problems Not Answered
• Matching when brightness changes.• Interaction between motion and lighting• Single-frame segmentation and multiple
images.• Representing 3D shape, and its
appearance in 2D images.• ….