Real-Time High Quality Rendering
-
Upload
rochelle-meunier -
Category
Documents
-
view
35 -
download
1
description
Transcript of Real-Time High Quality Rendering
![Page 1: Real-Time High Quality Rendering](https://reader036.fdocuments.us/reader036/viewer/2022062422/56812c60550346895d90ee1c/html5/thumbnails/1.jpg)
Real-Time High Quality Rendering
CSE 291 [Winter 2015], Lecture 6
Image-Based Rendering and Light Fields
http://www.cs.ucsd.edu/~ravir
![Page 2: Real-Time High Quality Rendering](https://reader036.fdocuments.us/reader036/viewer/2022062422/56812c60550346895d90ee1c/html5/thumbnails/2.jpg)
Motivation for Lecture
IBR is tangentially related to course (more pertinent to acquisition of measured materials and scenes)
But many of the rendering methods, especially precomputed techniques borrow from it
And many methods use measured data
Also, images are an important source for rendering
Later: Signal-Processing techniques very relevant
![Page 3: Real-Time High Quality Rendering](https://reader036.fdocuments.us/reader036/viewer/2022062422/56812c60550346895d90ee1c/html5/thumbnails/3.jpg)
Next few slides courtesy Paul Debevec; SIGGRAPH 99 course notes
![Page 4: Real-Time High Quality Rendering](https://reader036.fdocuments.us/reader036/viewer/2022062422/56812c60550346895d90ee1c/html5/thumbnails/4.jpg)
![Page 5: Real-Time High Quality Rendering](https://reader036.fdocuments.us/reader036/viewer/2022062422/56812c60550346895d90ee1c/html5/thumbnails/5.jpg)
![Page 6: Real-Time High Quality Rendering](https://reader036.fdocuments.us/reader036/viewer/2022062422/56812c60550346895d90ee1c/html5/thumbnails/6.jpg)
![Page 7: Real-Time High Quality Rendering](https://reader036.fdocuments.us/reader036/viewer/2022062422/56812c60550346895d90ee1c/html5/thumbnails/7.jpg)
IBR: Pros and Cons
Advantages Easy to capture images: photorealistic by definition Simple, universal representation Often bypass geometry estimation? Independent of scene complexity?
Disadvantages WYSIWYG but also WYSIAYG Explosion of data as flexibility increased Often discards intrinsic structure of model?
Today, IBR-type methods also often used in synthetic rendering (e.g. real-time rendering PRT) General concept of data-driven graphics, appearance Also, data-driven geometry, animation, simulation Spawned light field cameras for image capture
![Page 8: Real-Time High Quality Rendering](https://reader036.fdocuments.us/reader036/viewer/2022062422/56812c60550346895d90ee1c/html5/thumbnails/8.jpg)
![Page 9: Real-Time High Quality Rendering](https://reader036.fdocuments.us/reader036/viewer/2022062422/56812c60550346895d90ee1c/html5/thumbnails/9.jpg)
IBR: A brief history Texture maps, bump maps, environment maps [70s]
Poggio MIT 90s: Faces, image-based analysis/synthesis
Mid-Late 90s Chen and Williams 93, View Interpolation [Images+depth] Chen 95 Quicktime VR [Images from many viewpoints] McMillan and Bishop 95 Plenoptic Modeling [Images w
disparity] Gortler et al, Levoy and Hanrahan 96 Light Fields [4D] Shade et al. 98 Layered Depth Images [2.5D] Debevec et al. 00 Reflectance Field [4D] Inverse rendering (Marschner,Sato,Yu,Boivin,…)
Today: IBR hasn’t replaced conventional rendering, but has brought sampled and data-driven representations to graphics
![Page 10: Real-Time High Quality Rendering](https://reader036.fdocuments.us/reader036/viewer/2022062422/56812c60550346895d90ee1c/html5/thumbnails/10.jpg)
![Page 11: Real-Time High Quality Rendering](https://reader036.fdocuments.us/reader036/viewer/2022062422/56812c60550346895d90ee1c/html5/thumbnails/11.jpg)
![Page 12: Real-Time High Quality Rendering](https://reader036.fdocuments.us/reader036/viewer/2022062422/56812c60550346895d90ee1c/html5/thumbnails/12.jpg)
Outline
Overview of IBR
Basic approaches Image Warping
[2D + depth. Requires correspondence/disparity] Light Fields [4D] Survey of some early work
![Page 13: Real-Time High Quality Rendering](https://reader036.fdocuments.us/reader036/viewer/2022062422/56812c60550346895d90ee1c/html5/thumbnails/13.jpg)
Warping slides courtesy Leonard McMillan, SIGGRAPH 99 course notes
![Page 14: Real-Time High Quality Rendering](https://reader036.fdocuments.us/reader036/viewer/2022062422/56812c60550346895d90ee1c/html5/thumbnails/14.jpg)
![Page 15: Real-Time High Quality Rendering](https://reader036.fdocuments.us/reader036/viewer/2022062422/56812c60550346895d90ee1c/html5/thumbnails/15.jpg)
![Page 16: Real-Time High Quality Rendering](https://reader036.fdocuments.us/reader036/viewer/2022062422/56812c60550346895d90ee1c/html5/thumbnails/16.jpg)
![Page 17: Real-Time High Quality Rendering](https://reader036.fdocuments.us/reader036/viewer/2022062422/56812c60550346895d90ee1c/html5/thumbnails/17.jpg)
![Page 18: Real-Time High Quality Rendering](https://reader036.fdocuments.us/reader036/viewer/2022062422/56812c60550346895d90ee1c/html5/thumbnails/18.jpg)
![Page 19: Real-Time High Quality Rendering](https://reader036.fdocuments.us/reader036/viewer/2022062422/56812c60550346895d90ee1c/html5/thumbnails/19.jpg)
![Page 20: Real-Time High Quality Rendering](https://reader036.fdocuments.us/reader036/viewer/2022062422/56812c60550346895d90ee1c/html5/thumbnails/20.jpg)
Demo: Lytro Perspective Shift
See demos at http://www.lytro.com/camera
Some of my pictures [8/14-9/08]
Notice image is everywhere in focus
Only small motions, interpolate in aperture
![Page 21: Real-Time High Quality Rendering](https://reader036.fdocuments.us/reader036/viewer/2022062422/56812c60550346895d90ee1c/html5/thumbnails/21.jpg)
![Page 22: Real-Time High Quality Rendering](https://reader036.fdocuments.us/reader036/viewer/2022062422/56812c60550346895d90ee1c/html5/thumbnails/22.jpg)
![Page 23: Real-Time High Quality Rendering](https://reader036.fdocuments.us/reader036/viewer/2022062422/56812c60550346895d90ee1c/html5/thumbnails/23.jpg)
![Page 24: Real-Time High Quality Rendering](https://reader036.fdocuments.us/reader036/viewer/2022062422/56812c60550346895d90ee1c/html5/thumbnails/24.jpg)
![Page 25: Real-Time High Quality Rendering](https://reader036.fdocuments.us/reader036/viewer/2022062422/56812c60550346895d90ee1c/html5/thumbnails/25.jpg)
Outline
Overview of IBR
Basic approaches Image Warping
[2D + depth. Requires correspondence/disparity] Light Fields [4D] Survey of some early work
![Page 26: Real-Time High Quality Rendering](https://reader036.fdocuments.us/reader036/viewer/2022062422/56812c60550346895d90ee1c/html5/thumbnails/26.jpg)
![Page 27: Real-Time High Quality Rendering](https://reader036.fdocuments.us/reader036/viewer/2022062422/56812c60550346895d90ee1c/html5/thumbnails/27.jpg)
![Page 28: Real-Time High Quality Rendering](https://reader036.fdocuments.us/reader036/viewer/2022062422/56812c60550346895d90ee1c/html5/thumbnails/28.jpg)
![Page 29: Real-Time High Quality Rendering](https://reader036.fdocuments.us/reader036/viewer/2022062422/56812c60550346895d90ee1c/html5/thumbnails/29.jpg)
![Page 30: Real-Time High Quality Rendering](https://reader036.fdocuments.us/reader036/viewer/2022062422/56812c60550346895d90ee1c/html5/thumbnails/30.jpg)
![Page 31: Real-Time High Quality Rendering](https://reader036.fdocuments.us/reader036/viewer/2022062422/56812c60550346895d90ee1c/html5/thumbnails/31.jpg)
Lytro Camera
![Page 32: Real-Time High Quality Rendering](https://reader036.fdocuments.us/reader036/viewer/2022062422/56812c60550346895d90ee1c/html5/thumbnails/32.jpg)
![Page 33: Real-Time High Quality Rendering](https://reader036.fdocuments.us/reader036/viewer/2022062422/56812c60550346895d90ee1c/html5/thumbnails/33.jpg)
![Page 34: Real-Time High Quality Rendering](https://reader036.fdocuments.us/reader036/viewer/2022062422/56812c60550346895d90ee1c/html5/thumbnails/34.jpg)
![Page 35: Real-Time High Quality Rendering](https://reader036.fdocuments.us/reader036/viewer/2022062422/56812c60550346895d90ee1c/html5/thumbnails/35.jpg)
![Page 36: Real-Time High Quality Rendering](https://reader036.fdocuments.us/reader036/viewer/2022062422/56812c60550346895d90ee1c/html5/thumbnails/36.jpg)
Outline
Overview of IBR
Basic approaches Image Warping
[2D + depth. Requires correspondence/disparity] Light Fields [4D] Survey of some early work
![Page 37: Real-Time High Quality Rendering](https://reader036.fdocuments.us/reader036/viewer/2022062422/56812c60550346895d90ee1c/html5/thumbnails/37.jpg)
Layered Depth Images [Shade 98]
Geometry
Camera
Slide from Agrawala, Ramamoorthi, Heirich, Moll, SIGGRAPH 2000
![Page 38: Real-Time High Quality Rendering](https://reader036.fdocuments.us/reader036/viewer/2022062422/56812c60550346895d90ee1c/html5/thumbnails/38.jpg)
Layered Depth Images [Shade 98]
LDI
![Page 39: Real-Time High Quality Rendering](https://reader036.fdocuments.us/reader036/viewer/2022062422/56812c60550346895d90ee1c/html5/thumbnails/39.jpg)
Layered Depth Images [Shade 98]
LDI
(Depth, Color)
![Page 40: Real-Time High Quality Rendering](https://reader036.fdocuments.us/reader036/viewer/2022062422/56812c60550346895d90ee1c/html5/thumbnails/40.jpg)
![Page 41: Real-Time High Quality Rendering](https://reader036.fdocuments.us/reader036/viewer/2022062422/56812c60550346895d90ee1c/html5/thumbnails/41.jpg)
Miller 98, Nishino 99, Wood 00
Reflected light field (lumisphere) on surface
Explicit geometry as against light fields. Easier compress
Surface Light Fields
![Page 42: Real-Time High Quality Rendering](https://reader036.fdocuments.us/reader036/viewer/2022062422/56812c60550346895d90ee1c/html5/thumbnails/42.jpg)
Acquiring Reflectance Field of Human Face [Debevec et al. SIGGRAPH 00]
Illuminate subject from many incident directions
![Page 43: Real-Time High Quality Rendering](https://reader036.fdocuments.us/reader036/viewer/2022062422/56812c60550346895d90ee1c/html5/thumbnails/43.jpg)
Example Images
![Page 44: Real-Time High Quality Rendering](https://reader036.fdocuments.us/reader036/viewer/2022062422/56812c60550346895d90ee1c/html5/thumbnails/44.jpg)
Outline
Overview of IBR
Basic approaches Image Warping
[2D + depth. Requires correspondence/disparity] Light Fields [4D] Survey of some recent work
Sampled data representations
![Page 45: Real-Time High Quality Rendering](https://reader036.fdocuments.us/reader036/viewer/2022062422/56812c60550346895d90ee1c/html5/thumbnails/45.jpg)
Conclusion (my views) IBR initially spurred great excitement: revolutionize pipeline
But, IBR in pure form not really practical WYSIAYG Explosion as increase dimensions (8D transfer function) Good compression, flexibility needs at least implicit geometry/BRDF
Real future is sampled representations, data-driven method Acquire (synthetic or real) data Good representations for interpolation, fast rendering Much of visual appearance, graphics moving in this direction
Understand from Signal-Processing Viewpoint Sampling rates, reconstruction filters Factored representations, Fourier analysis
Light Fields fundamental in many ways, including imaging