The University of CS 4487/9587 Algorithms for Image · PDF fileThe University of Ontario...
Transcript of The University of CS 4487/9587 Algorithms for Image · PDF fileThe University of Ontario...
![Page 1: The University of CS 4487/9587 Algorithms for Image · PDF fileThe University of Ontario detection motion estimation recognition surface and shape estimation Image Analysis (Computer](https://reader031.fdocuments.us/reader031/viewer/2022030416/5aa21bdc7f8b9a1f6d8cc9a6/html5/thumbnails/1.jpg)
The University of
Ontario
CS 4487/9587
Algorithms for Image Analysis
Web page: www.csd.uwo.ca/courses/CS4487a/ • announcements, assignments, code samples/libraries, syllabus
• lecture notes
Text-books: • Recommended text:
– Richard Szeliski (Microsoft Research). Computer Vision: Algorithms and Applications
szeliski.org/Book (hard copy can be bought)
• Other readings:
– Sonka, Hlavac, Boyle. Image Processing, Analysis, and Machine Vision. Thomson
Learning; 3d edition (2007)
– Gonzalez and Woods. Digital Image Processing, Prentice Hall, 2002
– Stan Z. Li. Markov Random Field Modeling in Image Analysis, Springer, 2009
– Cormen et al. Introduction to Algorithms, The MIT Press, 3d edition, 2009
– Kleinberg and Tardos. Algorithm Design, Addison Wesley, 2006
![Page 2: The University of CS 4487/9587 Algorithms for Image · PDF fileThe University of Ontario detection motion estimation recognition surface and shape estimation Image Analysis (Computer](https://reader031.fdocuments.us/reader031/viewer/2022030416/5aa21bdc7f8b9a1f6d8cc9a6/html5/thumbnails/2.jpg)
The University of
Ontario
CS 4487/9587
Algorithms for Image Analysis
Today
• Topic 1. Overview of computer vision applications
– recommended reading: Szeliski, Ch.1
• Topic 2. Image modalities
![Page 3: The University of CS 4487/9587 Algorithms for Image · PDF fileThe University of Ontario detection motion estimation recognition surface and shape estimation Image Analysis (Computer](https://reader031.fdocuments.us/reader031/viewer/2022030416/5aa21bdc7f8b9a1f6d8cc9a6/html5/thumbnails/3.jpg)
The University of
Ontario
detection
motion estimation
recognition
surface and shape
estimation
Image Analysis
(Computer Vision)
tracking
Slide from Steve Seitz
Overview of Image Analysis
modeling
- shape
- light
- motion
- optics
- images
animation
rendering
user-interfaces
surface design
Computer Graphics
modeling
- shape
- light
- motion
- optics
- images
= Image Processing
(pre-processing, filtering)
![Page 4: The University of CS 4487/9587 Algorithms for Image · PDF fileThe University of Ontario detection motion estimation recognition surface and shape estimation Image Analysis (Computer](https://reader031.fdocuments.us/reader031/viewer/2022030416/5aa21bdc7f8b9a1f6d8cc9a6/html5/thumbnails/4.jpg)
The University of
Ontario
CS 4487/9587
Overview of Image Analysis
Segmentation in Medical Imaging:
2D segmentation (snakes)
![Page 5: The University of CS 4487/9587 Algorithms for Image · PDF fileThe University of Ontario detection motion estimation recognition surface and shape estimation Image Analysis (Computer](https://reader031.fdocuments.us/reader031/viewer/2022030416/5aa21bdc7f8b9a1f6d8cc9a6/html5/thumbnails/5.jpg)
The University of
Ontario
CS 4487/9587
Overview of Image Analysis
Segmentation in Medical Imaging:
3D Model of a liver from Medical Data
2D model
![Page 6: The University of CS 4487/9587 Algorithms for Image · PDF fileThe University of Ontario detection motion estimation recognition surface and shape estimation Image Analysis (Computer](https://reader031.fdocuments.us/reader031/viewer/2022030416/5aa21bdc7f8b9a1f6d8cc9a6/html5/thumbnails/6.jpg)
The University of
Ontario
CS 4487/9587
Algorithms for Image Analysis
Segmentation in photo editing:
livewire
“Grab cuts”
![Page 7: The University of CS 4487/9587 Algorithms for Image · PDF fileThe University of Ontario detection motion estimation recognition surface and shape estimation Image Analysis (Computer](https://reader031.fdocuments.us/reader031/viewer/2022030416/5aa21bdc7f8b9a1f6d8cc9a6/html5/thumbnails/7.jpg)
The University of
Ontario
CS 4487/9587
Algorithms for Image Analysis
Object Detection and tracking:
pictorial structures
tracking pictorial structures
face detection ++
![Page 8: The University of CS 4487/9587 Algorithms for Image · PDF fileThe University of Ontario detection motion estimation recognition surface and shape estimation Image Analysis (Computer](https://reader031.fdocuments.us/reader031/viewer/2022030416/5aa21bdc7f8b9a1f6d8cc9a6/html5/thumbnails/8.jpg)
The University of
Ontario
CS 4487/9587
Algorithms for Image Analysis
Object Detection and tracking:
![Page 9: The University of CS 4487/9587 Algorithms for Image · PDF fileThe University of Ontario detection motion estimation recognition surface and shape estimation Image Analysis (Computer](https://reader031.fdocuments.us/reader031/viewer/2022030416/5aa21bdc7f8b9a1f6d8cc9a6/html5/thumbnails/9.jpg)
The University of
Ontario
CS 4487/9587
Algorithms for Image Analysis
Object Recognition and tracking:
Bottom-up tracker
![Page 10: The University of CS 4487/9587 Algorithms for Image · PDF fileThe University of Ontario detection motion estimation recognition surface and shape estimation Image Analysis (Computer](https://reader031.fdocuments.us/reader031/viewer/2022030416/5aa21bdc7f8b9a1f6d8cc9a6/html5/thumbnails/10.jpg)
The University of
Ontario
CS 4487/9587
Algorithms for Image Analysis
Motion and tracking in medical imaging:
beating heart
![Page 11: The University of CS 4487/9587 Algorithms for Image · PDF fileThe University of Ontario detection motion estimation recognition surface and shape estimation Image Analysis (Computer](https://reader031.fdocuments.us/reader031/viewer/2022030416/5aa21bdc7f8b9a1f6d8cc9a6/html5/thumbnails/11.jpg)
The University of
Ontario
Slide by Aleosha Effros
Algorithms for Image Analysis
Stereo Reconstruction from Photo Images
• Shape from two (or more) images
• Biological motivation
knownknown
cameracamera
viewpointsviewpoints
![Page 12: The University of CS 4487/9587 Algorithms for Image · PDF fileThe University of Ontario detection motion estimation recognition surface and shape estimation Image Analysis (Computer](https://reader031.fdocuments.us/reader031/viewer/2022030416/5aa21bdc7f8b9a1f6d8cc9a6/html5/thumbnails/12.jpg)
The University of
Ontario
CS 4487/9587
Algorithms for Image Analysis
(state of the art) stereo depth map Ground truth
![Page 13: The University of CS 4487/9587 Algorithms for Image · PDF fileThe University of Ontario detection motion estimation recognition surface and shape estimation Image Analysis (Computer](https://reader031.fdocuments.us/reader031/viewer/2022030416/5aa21bdc7f8b9a1f6d8cc9a6/html5/thumbnails/13.jpg)
The University of
Ontario
CS 4487/9587
Algorithms for Image Analysis
3D model
Vogiatis et al. CVPR’05
More then
2 images
![Page 14: The University of CS 4487/9587 Algorithms for Image · PDF fileThe University of Ontario detection motion estimation recognition surface and shape estimation Image Analysis (Computer](https://reader031.fdocuments.us/reader031/viewer/2022030416/5aa21bdc7f8b9a1f6d8cc9a6/html5/thumbnails/14.jpg)
The University of
Ontario
CS 4487/9587
Algorithms for Image Analysis
images from a cheap
consumer-grade digital camera
Automatic 3D model reconstruction
![Page 15: The University of CS 4487/9587 Algorithms for Image · PDF fileThe University of Ontario detection motion estimation recognition surface and shape estimation Image Analysis (Computer](https://reader031.fdocuments.us/reader031/viewer/2022030416/5aa21bdc7f8b9a1f6d8cc9a6/html5/thumbnails/15.jpg)
The University of
Ontario
CS 4487/9587
Algorithms for Image Analysis
3D model
multi-view reconstruction set up
Furukawa&Ponce ECCV’06
(texture mapped)
![Page 16: The University of CS 4487/9587 Algorithms for Image · PDF fileThe University of Ontario detection motion estimation recognition surface and shape estimation Image Analysis (Computer](https://reader031.fdocuments.us/reader031/viewer/2022030416/5aa21bdc7f8b9a1f6d8cc9a6/html5/thumbnails/16.jpg)
The University of
Ontario
CS 4487/9587
Algorithms for Image Analysis
3D model
multi-view reconstruction set up
Furukawa&Ponce ECCV’06
(texture mapped)
![Page 17: The University of CS 4487/9587 Algorithms for Image · PDF fileThe University of Ontario detection motion estimation recognition surface and shape estimation Image Analysis (Computer](https://reader031.fdocuments.us/reader031/viewer/2022030416/5aa21bdc7f8b9a1f6d8cc9a6/html5/thumbnails/17.jpg)
The University of
Ontario
CS 4487/9587
Algorithms for Image Analysis
a cloud of 3D points (e.g. from a laser scanner)
3D model:
surface fitting:
![Page 18: The University of CS 4487/9587 Algorithms for Image · PDF fileThe University of Ontario detection motion estimation recognition surface and shape estimation Image Analysis (Computer](https://reader031.fdocuments.us/reader031/viewer/2022030416/5aa21bdc7f8b9a1f6d8cc9a6/html5/thumbnails/18.jpg)
The University of
Ontario
CS 4487/9587
Algorithms for Image Analysis
features detection (SIFT) and model fitting (planes, homographies)
2 photos
![Page 19: The University of CS 4487/9587 Algorithms for Image · PDF fileThe University of Ontario detection motion estimation recognition surface and shape estimation Image Analysis (Computer](https://reader031.fdocuments.us/reader031/viewer/2022030416/5aa21bdc7f8b9a1f6d8cc9a6/html5/thumbnails/19.jpg)
The University of
Ontario
CS 4487/9587
Algorithms for Image Analysis
3D model constructed form 9 images
![Page 20: The University of CS 4487/9587 Algorithms for Image · PDF fileThe University of Ontario detection motion estimation recognition surface and shape estimation Image Analysis (Computer](https://reader031.fdocuments.us/reader031/viewer/2022030416/5aa21bdc7f8b9a1f6d8cc9a6/html5/thumbnails/20.jpg)
The University of
Ontario
CS 4487/9587
Algorithms for Image Analysis
Debevec, Taylor, and Malik, SIGGRAPH 1996
3D Scene Reconstruction:
![Page 21: The University of CS 4487/9587 Algorithms for Image · PDF fileThe University of Ontario detection motion estimation recognition surface and shape estimation Image Analysis (Computer](https://reader031.fdocuments.us/reader031/viewer/2022030416/5aa21bdc7f8b9a1f6d8cc9a6/html5/thumbnails/21.jpg)
The University of
Ontario
CS 4487/9587
Algorithms for Image Analysis
3D Scene Reconstruction:
From a single view!!!
Courtesy Creminisi et al.
![Page 22: The University of CS 4487/9587 Algorithms for Image · PDF fileThe University of Ontario detection motion estimation recognition surface and shape estimation Image Analysis (Computer](https://reader031.fdocuments.us/reader031/viewer/2022030416/5aa21bdc7f8b9a1f6d8cc9a6/html5/thumbnails/22.jpg)
The University of
Ontario
Texture Synthesis:
CS 4487/9587
Algorithms for Image Analysis
![Page 23: The University of CS 4487/9587 Algorithms for Image · PDF fileThe University of Ontario detection motion estimation recognition surface and shape estimation Image Analysis (Computer](https://reader031.fdocuments.us/reader031/viewer/2022030416/5aa21bdc7f8b9a1f6d8cc9a6/html5/thumbnails/23.jpg)
The University of
Ontario
CS 4487/9587
Algorithms for Image Analysis
Video Texture:
![Page 24: The University of CS 4487/9587 Algorithms for Image · PDF fileThe University of Ontario detection motion estimation recognition surface and shape estimation Image Analysis (Computer](https://reader031.fdocuments.us/reader031/viewer/2022030416/5aa21bdc7f8b9a1f6d8cc9a6/html5/thumbnails/24.jpg)
The University of
Ontario
CS 4487/9587
Algorithms for Image Analysis
Super-imposing R G B channels without exact alignment
After proper registration
![Page 25: The University of CS 4487/9587 Algorithms for Image · PDF fileThe University of Ontario detection motion estimation recognition surface and shape estimation Image Analysis (Computer](https://reader031.fdocuments.us/reader031/viewer/2022030416/5aa21bdc7f8b9a1f6d8cc9a6/html5/thumbnails/25.jpg)
The University of
Ontario
CS 4487/9587
Algorithms for Image Analysis
Medical Image Fusion:
MRI + CT
![Page 26: The University of CS 4487/9587 Algorithms for Image · PDF fileThe University of Ontario detection motion estimation recognition surface and shape estimation Image Analysis (Computer](https://reader031.fdocuments.us/reader031/viewer/2022030416/5aa21bdc7f8b9a1f6d8cc9a6/html5/thumbnails/26.jpg)
The University of
Ontario
CS 4487/9587
Algorithms for Image Analysis
Photo Image Morphing:
![Page 27: The University of CS 4487/9587 Algorithms for Image · PDF fileThe University of Ontario detection motion estimation recognition surface and shape estimation Image Analysis (Computer](https://reader031.fdocuments.us/reader031/viewer/2022030416/5aa21bdc7f8b9a1f6d8cc9a6/html5/thumbnails/27.jpg)
The University of
Ontario
CS 4487/9587
Algorithms for Image Analysis
Image Blending:
![Page 28: The University of CS 4487/9587 Algorithms for Image · PDF fileThe University of Ontario detection motion estimation recognition surface and shape estimation Image Analysis (Computer](https://reader031.fdocuments.us/reader031/viewer/2022030416/5aa21bdc7f8b9a1f6d8cc9a6/html5/thumbnails/28.jpg)
The University of
Ontario
CS 4487/9587
Algorithms for Image Analysis
Image Blending: