Announcements Class web site – Handouts –class info –lab access/accounts –survey Readings.
-
Upload
byron-mcgee -
Category
Documents
-
view
217 -
download
0
Transcript of Announcements Class web site – Handouts –class info –lab access/accounts –survey Readings.
![Page 1: Announcements Class web site – Handouts –class info –lab access/accounts –survey Readings.](https://reader034.fdocuments.us/reader034/viewer/2022051401/56649dd25503460f94ac92da/html5/thumbnails/1.jpg)
Announcements• Class web site
– http://www.cs.washington.edu/homes/seitz/course/590SS/v4g.htm
• Handouts– class info
– lab access/accounts
– survey
• Readings for Monday (via web site)– Paul Heckbert, Survey of Texture Mapping, IEEE Computer Graphics and
Applications, 6(11), November 1986, 56-67.
– Beier, T. and Neely, S., Feature-Based Image Metamorphosis, ACM Computer Graphics (SIGGRAPH'92), 26(2), July 1992, 35-42
CSE 590 “Vision for Graphics”
![Page 2: Announcements Class web site – Handouts –class info –lab access/accounts –survey Readings.](https://reader034.fdocuments.us/reader034/viewer/2022051401/56649dd25503460f94ac92da/html5/thumbnails/2.jpg)
Today
Intro• Admin• Survey• Introductions• Course overview
2D image processing• Blending• Filtering• Pyramids
on Monday (1/8)• image warping, morphing• image enhancement
![Page 3: Announcements Class web site – Handouts –class info –lab access/accounts –survey Readings.](https://reader034.fdocuments.us/reader034/viewer/2022051401/56649dd25503460f94ac92da/html5/thumbnails/3.jpg)
Vision for Graphics—Why?
Vision and Graphics are inverse problems
Computervision
World model
Computergraphics
World model
![Page 4: Announcements Class web site – Handouts –class info –lab access/accounts –survey Readings.](https://reader034.fdocuments.us/reader034/viewer/2022051401/56649dd25503460f94ac92da/html5/thumbnails/4.jpg)
Intersection of Vision and Graphics
modeling- shape- light- motion- optics- images IP
animation
rendering
user-interfaces
surface design
Computer Graphics
shape estimation
motion estimation
recognition
2D modeling
modeling- shape- light- motion- optics- images IP
Computer Vision
![Page 5: Announcements Class web site – Handouts –class info –lab access/accounts –survey Readings.](https://reader034.fdocuments.us/reader034/viewer/2022051401/56649dd25503460f94ac92da/html5/thumbnails/5.jpg)
Cross Fertilization
Vision impacts graphics• image-based rendering
• model acquisition
• motion capture
• perceptual user interfaces
• special effects
• image editing
Graphics impacts vision• reflectance
• transparency
• shape modeling
![Page 6: Announcements Class web site – Handouts –class info –lab access/accounts –survey Readings.](https://reader034.fdocuments.us/reader034/viewer/2022051401/56649dd25503460f94ac92da/html5/thumbnails/6.jpg)
Course Objectives
What to expect• Knowledge of vision that is relevant to graphics
• How to apply your expertise in image analysis to synthesis
• Fundamentals
• Explore new avenues for research
What not to expect• Not a graphics course
• Not a complete vision course
![Page 7: Announcements Class web site – Handouts –class info –lab access/accounts –survey Readings.](https://reader034.fdocuments.us/reader034/viewer/2022051401/56649dd25503460f94ac92da/html5/thumbnails/7.jpg)
Administrative StuffWeb Site
• http://www.cs.washington.edu/homes/seitz/course/590SS/v4g.htm
Grading• 2 programming projects• 1 final research project• Class presentation• Class participation
Software and Hardware• Programming projects in C/C++• Support code for Windows and Linux• Lab: 228 Sieg Hall (Win2K PC’s)
– Fill out forms to get key access, CSE class account– You’re welcome to use your own machines instead
• Digital still and video cameras, tripods, etc.
![Page 8: Announcements Class web site – Handouts –class info –lab access/accounts –survey Readings.](https://reader034.fdocuments.us/reader034/viewer/2022051401/56649dd25503460f94ac92da/html5/thumbnails/8.jpg)
Prerequisites
Prior course on vision OR graphics
Assume• Familiarity with image representations• Basic image processing (linear filtering, transforms, etc.)• Differential equations, linear algebra• Camera modeling and projection• Ability to read research articles, fill in gaps
Questions? See Steve or Rick
![Page 9: Announcements Class web site – Handouts –class info –lab access/accounts –survey Readings.](https://reader034.fdocuments.us/reader034/viewer/2022051401/56649dd25503460f94ac92da/html5/thumbnails/9.jpg)
Image Processing
Elder, J. H. and R. M. Goldberg. "Image Editing in the Contour Domain," Proc. IEEE: Computer Vision and Pattern Recognition, pp. 374-381, June, 1998.
http://www.fearthis.com/warpimages/pres.shtml
![Page 10: Announcements Class web site – Handouts –class info –lab access/accounts –survey Readings.](https://reader034.fdocuments.us/reader034/viewer/2022051401/56649dd25503460f94ac92da/html5/thumbnails/10.jpg)
Motion Estimation
Interview with a Vampire, Courtesy Doug Roble, Digital Domain
mosaic demo
![Page 11: Announcements Class web site – Handouts –class info –lab access/accounts –survey Readings.](https://reader034.fdocuments.us/reader034/viewer/2022051401/56649dd25503460f94ac92da/html5/thumbnails/11.jpg)
Pose Estimation
Ascending Stairs,Eadweard Muybridge, 1884-85
![Page 12: Announcements Class web site – Handouts –class info –lab access/accounts –survey Readings.](https://reader034.fdocuments.us/reader034/viewer/2022051401/56649dd25503460f94ac92da/html5/thumbnails/12.jpg)
3D Shape Reconstruction
Debevec, Taylor, and Malik, SIGGRAPH 1996
![Page 13: Announcements Class web site – Handouts –class info –lab access/accounts –survey Readings.](https://reader034.fdocuments.us/reader034/viewer/2022051401/56649dd25503460f94ac92da/html5/thumbnails/13.jpg)
Image-Based Rendering
View Morphing, Seitz and Dyer, SIGGRAPH 96
![Page 14: Announcements Class web site – Handouts –class info –lab access/accounts –survey Readings.](https://reader034.fdocuments.us/reader034/viewer/2022051401/56649dd25503460f94ac92da/html5/thumbnails/14.jpg)
Modeling light
"Interface", courtesy of Lance Williams, 1985
Environment Matting and Compositing, Zongker, Werner, Curless, and Salesin. SIGGRAPH 99
![Page 15: Announcements Class web site – Handouts –class info –lab access/accounts –survey Readings.](https://reader034.fdocuments.us/reader034/viewer/2022051401/56649dd25503460f94ac92da/html5/thumbnails/15.jpg)
Image Blending
![Page 16: Announcements Class web site – Handouts –class info –lab access/accounts –survey Readings.](https://reader034.fdocuments.us/reader034/viewer/2022051401/56649dd25503460f94ac92da/html5/thumbnails/16.jpg)
Feathering
01
01
+
=
Encoding transparency
I(x,y) = (R, G, B, )
Iblend = Ileft + Iright
See Blinn reading (CGA, 1994) for details
![Page 17: Announcements Class web site – Handouts –class info –lab access/accounts –survey Readings.](https://reader034.fdocuments.us/reader034/viewer/2022051401/56649dd25503460f94ac92da/html5/thumbnails/17.jpg)
Affect of Window Size
0
1 left
right0
1
![Page 18: Announcements Class web site – Handouts –class info –lab access/accounts –survey Readings.](https://reader034.fdocuments.us/reader034/viewer/2022051401/56649dd25503460f94ac92da/html5/thumbnails/18.jpg)
Affect of Window Size
0
1
0
1
![Page 19: Announcements Class web site – Handouts –class info –lab access/accounts –survey Readings.](https://reader034.fdocuments.us/reader034/viewer/2022051401/56649dd25503460f94ac92da/html5/thumbnails/19.jpg)
Good Window Size
0
1
“Optimal” Window: smooth but not ghosted
![Page 20: Announcements Class web site – Handouts –class info –lab access/accounts –survey Readings.](https://reader034.fdocuments.us/reader034/viewer/2022051401/56649dd25503460f94ac92da/html5/thumbnails/20.jpg)
What is the Optimal Window?
To avoid seams• window = size of largest prominent feature
To avoid ghosting• window <= 2*size of smallest prominent feature
Natural to cast this in the Fourier domain• largest frequency <= 2*size of smallest frequency• image frequency content should occupy one “octave” (power of two)
FFT
![Page 21: Announcements Class web site – Handouts –class info –lab access/accounts –survey Readings.](https://reader034.fdocuments.us/reader034/viewer/2022051401/56649dd25503460f94ac92da/html5/thumbnails/21.jpg)
What if the Frequency Spread is Wide
Idea (Burt and Adelson)• Compute Fleft = FFT(Ileft), Fright = FFT(Iright)
• Decompose Fourier image into octaves (bands)– Fleft = Fleft
1 + Fleft2 + …
• Feather corresponding octaves Flefti with Fright
i
– Can compute inverse FFT and feather in spatial domain
• Sum feathered octave images in frequency domain
Better implemented in spatial domain
FFT
![Page 22: Announcements Class web site – Handouts –class info –lab access/accounts –survey Readings.](https://reader034.fdocuments.us/reader034/viewer/2022051401/56649dd25503460f94ac92da/html5/thumbnails/22.jpg)
Octaves in the Spatial Domain
Bandpass Images
Lowpass Images
![Page 23: Announcements Class web site – Handouts –class info –lab access/accounts –survey Readings.](https://reader034.fdocuments.us/reader034/viewer/2022051401/56649dd25503460f94ac92da/html5/thumbnails/23.jpg)
Image Pyramids
![Page 24: Announcements Class web site – Handouts –class info –lab access/accounts –survey Readings.](https://reader034.fdocuments.us/reader034/viewer/2022051401/56649dd25503460f94ac92da/html5/thumbnails/24.jpg)
Pyramid Creation
“Laplacian” Pyramid• Created from Gaussian
pyramid by subtractionLl = Gl – expand(Gl+1)
filter mask
“Gaussian” Pyramid
![Page 25: Announcements Class web site – Handouts –class info –lab access/accounts –survey Readings.](https://reader034.fdocuments.us/reader034/viewer/2022051401/56649dd25503460f94ac92da/html5/thumbnails/25.jpg)
PyramidsAdvantages of pyramids
• Faster than Fourier transform• Avoids “ringing” artifacts
Many applications• small images faster to process• good for multiresolution processing• compression• progressive transmission
Known as “mip-maps” in graphics communityPrecursor to wavelets
• Wavelets also have these advantages
![Page 26: Announcements Class web site – Handouts –class info –lab access/accounts –survey Readings.](https://reader034.fdocuments.us/reader034/viewer/2022051401/56649dd25503460f94ac92da/html5/thumbnails/26.jpg)
Pyramid Blending
![Page 27: Announcements Class web site – Handouts –class info –lab access/accounts –survey Readings.](https://reader034.fdocuments.us/reader034/viewer/2022051401/56649dd25503460f94ac92da/html5/thumbnails/27.jpg)
laplacianlevel
4
laplacianlevel
2
laplacianlevel
0
left pyramid right pyramid blended pyramid
![Page 28: Announcements Class web site – Handouts –class info –lab access/accounts –survey Readings.](https://reader034.fdocuments.us/reader034/viewer/2022051401/56649dd25503460f94ac92da/html5/thumbnails/28.jpg)
![Page 29: Announcements Class web site – Handouts –class info –lab access/accounts –survey Readings.](https://reader034.fdocuments.us/reader034/viewer/2022051401/56649dd25503460f94ac92da/html5/thumbnails/29.jpg)
Blending Regions
Other applications• Removing block artifacts in compressed images
![Page 30: Announcements Class web site – Handouts –class info –lab access/accounts –survey Readings.](https://reader034.fdocuments.us/reader034/viewer/2022051401/56649dd25503460f94ac92da/html5/thumbnails/30.jpg)
Limitations?
![Page 31: Announcements Class web site – Handouts –class info –lab access/accounts –survey Readings.](https://reader034.fdocuments.us/reader034/viewer/2022051401/56649dd25503460f94ac92da/html5/thumbnails/31.jpg)
Related Topics
Matting• Given image and background(s), estimate foreground• What if foreground object is refractive?
– Environment matting
Hole filling• Remove scratches, holes in an image
Texture synthesis
Environment Matting and Compositing, Zongker, Werner, Curless, and Salesin. SIGGRAPH 99