Depth - of -Field Rendering by Pyramidal Image Processing
description
Transcript of Depth - of -Field Rendering by Pyramidal Image Processing
![Page 1: Depth - of -Field Rendering by Pyramidal Image Processing](https://reader035.fdocuments.us/reader035/viewer/2022062410/56816174550346895dd1007d/html5/thumbnails/1.jpg)
Depth-of-Field Renderingby Pyramidal Image Processing
Martin Kraus (TU München) andMagnus Strengert (Universität Stuttgart)
E U R O G R A P H I C S07
![Page 2: Depth - of -Field Rendering by Pyramidal Image Processing](https://reader035.fdocuments.us/reader035/viewer/2022062410/56816174550346895dd1007d/html5/thumbnails/2.jpg)
01 Introduction02 Related work03 Proposed method04 Experiments05 Future work
Outline of this Talk00
![Page 3: Depth - of -Field Rendering by Pyramidal Image Processing](https://reader035.fdocuments.us/reader035/viewer/2022062410/56816174550346895dd1007d/html5/thumbnails/3.jpg)
What Is Depth of Field?• The depth in front and beyond the focus
plane where objects appear to be in focus• A property of all real optical systems
– only virtual pin-hole cameras have infinite depth of field
• Used for important photographic and cinematographic techniques
I N T R O D U C T I O N01
![Page 4: Depth - of -Field Rendering by Pyramidal Image Processing](https://reader035.fdocuments.us/reader035/viewer/2022062410/56816174550346895dd1007d/html5/thumbnails/4.jpg)
photo by Jon Sullivan (http://pdphoto.org/PictureDetail.php?mat=pdef&pg=8202)
![Page 5: Depth - of -Field Rendering by Pyramidal Image Processing](https://reader035.fdocuments.us/reader035/viewer/2022062410/56816174550346895dd1007d/html5/thumbnails/5.jpg)
photo by "che" (http://commons.wikimedia.org/wiki/Image:Dandelion_clock_detail.jpg)
![Page 6: Depth - of -Field Rendering by Pyramidal Image Processing](https://reader035.fdocuments.us/reader035/viewer/2022062410/56816174550346895dd1007d/html5/thumbnails/6.jpg)
Classification of Techniques:• Splatting [Potmesil & Chakravarty 1982]• Stochastic sampling [Cook et al. 1984]
– e.g., in distributed ray tracing or in REYES– state of the art in offline rendering
• Pre-filtering [Rokita 1993]– lots of artifacts [Demers 2004]– state of the art in real-time rendering
• Blurring of sub-images [Barsky 2004]
R E L A T E D W O R K02
![Page 7: Depth - of -Field Rendering by Pyramidal Image Processing](https://reader035.fdocuments.us/reader035/viewer/2022062410/56816174550346895dd1007d/html5/thumbnails/7.jpg)
High Quality in Real Time?• Real-time performance requires:
– independence of scene complexity• excludes stochastic sampling
– thus: image post-processing of a pin-hole color image and depth map
• independence of image synthesis for free– convolution filtering is too expensive
• even with FFTs on GPUs– thus: blurring using pyramid algorithms
R E L A T E D W O R K02
![Page 8: Depth - of -Field Rendering by Pyramidal Image Processing](https://reader035.fdocuments.us/reader035/viewer/2022062410/56816174550346895dd1007d/html5/thumbnails/8.jpg)
High Quality in Real Time?• High image quality requires:
– smooth blurring without interpolation artifacts• pyramid blurring [Kraus & Strengert 2007]
– no incorrect color bleeding• excludes pre-filtering• separate blurring of sub-images
– disocclusion of semi-transparent pixels• inpainting of colors and depths with pyramid
algorithm [Strengert et al. 2006]
R E L A T E D W O R K02
![Page 9: Depth - of -Field Rendering by Pyramidal Image Processing](https://reader035.fdocuments.us/reader035/viewer/2022062410/56816174550346895dd1007d/html5/thumbnails/9.jpg)
Overview
P R O P O S E D M E T H O D03decomposition into sub-images
blending of sub-images blurring
resulting image
pin-hole image & depth map
12
5
34
matting disocclusion
![Page 10: Depth - of -Field Rendering by Pyramidal Image Processing](https://reader035.fdocuments.us/reader035/viewer/2022062410/56816174550346895dd1007d/html5/thumbnails/10.jpg)
Decomposition• decompose into sub-images and cull
foreground pixels according to depth map
P R O P O S E D M E T H O D03 1
![Page 11: Depth - of -Field Rendering by Pyramidal Image Processing](https://reader035.fdocuments.us/reader035/viewer/2022062410/56816174550346895dd1007d/html5/thumbnails/11.jpg)
Disocclusion• for each sub-image: disocclude culled
foreground (using pyramidal inpainting)
P R O P O S E D M E T H O D03 2
![Page 12: Depth - of -Field Rendering by Pyramidal Image Processing](https://reader035.fdocuments.us/reader035/viewer/2022062410/56816174550346895dd1007d/html5/thumbnails/12.jpg)
Matting• for each sub-image: compute alpha-
matting according to each pixel's depth
P R O P O S E D M E T H O D03 3
![Page 13: Depth - of -Field Rendering by Pyramidal Image Processing](https://reader035.fdocuments.us/reader035/viewer/2022062410/56816174550346895dd1007d/html5/thumbnails/13.jpg)
Blurring• for each sub-image: blur color and alpha
(using pyramidal blurring)
P R O P O S E D M E T H O D03 4
![Page 14: Depth - of -Field Rendering by Pyramidal Image Processing](https://reader035.fdocuments.us/reader035/viewer/2022062410/56816174550346895dd1007d/html5/thumbnails/14.jpg)
Blending• back-to-front blending of all sub-images
P R O P O S E D M E T H O D03 5
result computed in 70.4 ms (12 sub-images, hardware:NVIDIA GeForce 7900 GTX)
![Page 15: Depth - of -Field Rendering by Pyramidal Image Processing](https://reader035.fdocuments.us/reader035/viewer/2022062410/56816174550346895dd1007d/html5/thumbnails/15.jpg)
Main Features• independent of scene complexity
– and independent of image synthesis• interactive perfomance on GPUs
– real-time for small circles of confusion• high image quality
– avoids artifacts of pre-filtering techniques– let's do some experiments …
P R O P O S E D M E T H O D03
![Page 16: Depth - of -Field Rendering by Pyramidal Image Processing](https://reader035.fdocuments.us/reader035/viewer/2022062410/56816174550346895dd1007d/html5/thumbnails/16.jpg)
Our Method vs. pbrt• pbrt uses
stochasticsampling
• Which iswhich?
E X P E R I M E N T S04
![Page 17: Depth - of -Field Rendering by Pyramidal Image Processing](https://reader035.fdocuments.us/reader035/viewer/2022062410/56816174550346895dd1007d/html5/thumbnails/17.jpg)
Our Method vs. pbrt
E X P E R I M E N T S04pbrt
our method
![Page 18: Depth - of -Field Rendering by Pyramidal Image Processing](https://reader035.fdocuments.us/reader035/viewer/2022062410/56816174550346895dd1007d/html5/thumbnails/18.jpg)
Our Method vs. pbrt• Which is
which?
E X P E R I M E N T S04
![Page 19: Depth - of -Field Rendering by Pyramidal Image Processing](https://reader035.fdocuments.us/reader035/viewer/2022062410/56816174550346895dd1007d/html5/thumbnails/19.jpg)
Our Method vs. pbrt
E X P E R I M E N T S04pbrt
our method
![Page 20: Depth - of -Field Rendering by Pyramidal Image Processing](https://reader035.fdocuments.us/reader035/viewer/2022062410/56816174550346895dd1007d/html5/thumbnails/20.jpg)
Can We Break Our Method?• Yes, with a
very largelens radius.
E X P E R I M E N T S04pbrt
our method too opaquebleeding gray
![Page 21: Depth - of -Field Rendering by Pyramidal Image Processing](https://reader035.fdocuments.us/reader035/viewer/2022062410/56816174550346895dd1007d/html5/thumbnails/21.jpg)
Can We Break Our Method?
E X P E R I M E N T S04• Video with very large lens radii: eg07.mov
– also available at: http://wwwcg.in.tum.de/Research/Publications/DepthOfField
![Page 22: Depth - of -Field Rendering by Pyramidal Image Processing](https://reader035.fdocuments.us/reader035/viewer/2022062410/56816174550346895dd1007d/html5/thumbnails/22.jpg)
Are We there yet?• No, but we avoid typical rendering artifacts
of real-time techniques• Specialized variants for better
performance and image quality• Alternative blur filters• High-potential application:
– gaze-directed focus
F U T U R E W O R K05
![Page 23: Depth - of -Field Rendering by Pyramidal Image Processing](https://reader035.fdocuments.us/reader035/viewer/2022062410/56816174550346895dd1007d/html5/thumbnails/23.jpg)
• The photos appear courtesy of "che" and
Jon Sullivan.• The dragon model appears courtesy of the
Stanford University Scanning Repository.• The pbrt scene appears courtesy of
Gregory Humphreys and Matt Pharr.
A C K N O W L E D G M E N T S06
![Page 24: Depth - of -Field Rendering by Pyramidal Image Processing](https://reader035.fdocuments.us/reader035/viewer/2022062410/56816174550346895dd1007d/html5/thumbnails/24.jpg)
Thank you!
And have a safe trip home!
Questions?
E U R O G R A P H I C S07
![Page 25: Depth - of -Field Rendering by Pyramidal Image Processing](https://reader035.fdocuments.us/reader035/viewer/2022062410/56816174550346895dd1007d/html5/thumbnails/25.jpg)
E U R O G R A P H I C S07