Binary Shading using Geometry and Appearance
description
Transcript of Binary Shading using Geometry and Appearance
![Page 1: Binary Shading using Geometry and Appearance](https://reader030.fdocuments.us/reader030/viewer/2022020417/568142a5550346895daee04f/html5/thumbnails/1.jpg)
Binary Shading using Geometry and Appearance
Bert Buchholz Tamy Boubekeur Doug DeCarlo Marc Alexa
Telecom ParisTech – CNRS Rutgers University TU Berlin
Computer Graphics Forum Vol. 29, N. 6, 2010Presented at Eurographics 2011
![Page 2: Binary Shading using Geometry and Appearance](https://reader030.fdocuments.us/reader030/viewer/2022020417/568142a5550346895daee04f/html5/thumbnails/2.jpg)
Binary Drawing
Depicting scenes using 2 colors
![Page 3: Binary Shading using Geometry and Appearance](https://reader030.fdocuments.us/reader030/viewer/2022020417/568142a5550346895daee04f/html5/thumbnails/3.jpg)
Conversion
Binary Rendering
3 D S c e n e
Lighting Reflectance
Geometry
Camera
![Page 4: Binary Shading using Geometry and Appearance](https://reader030.fdocuments.us/reader030/viewer/2022020417/568142a5550346895daee04f/html5/thumbnails/4.jpg)
Related Work
Line Drawing [DeCarlo 2003][Judd 2007]
Image Binarization [Mould and Kaplan 2008]
Local shading operators [Vergne 2008]
Half-Toning [Floyd and Steinberg 1976][Ostromoukhov and Hersch 1995]
![Page 5: Binary Shading using Geometry and Appearance](https://reader030.fdocuments.us/reader030/viewer/2022020417/568142a5550346895daee04f/html5/thumbnails/5.jpg)
Analysis
Variational Rendering Model
Per-pixel decision
Contradictory criteria
Geometry enhancement
Low shading depiction power
![Page 6: Binary Shading using Geometry and Appearance](https://reader030.fdocuments.us/reader030/viewer/2022020417/568142a5550346895daee04f/html5/thumbnails/6.jpg)
VARIATIONAL BINARY RENDERING
![Page 7: Binary Shading using Geometry and Appearance](https://reader030.fdocuments.us/reader030/viewer/2022020417/568142a5550346895daee04f/html5/thumbnails/7.jpg)
Variational Binary Shading
• Deferred shading framework• Rendering data structured as a ST image graph• Edges energies derived from geometry and appearance• Final rendering as a min cut in the image graph
![Page 8: Binary Shading using Geometry and Appearance](https://reader030.fdocuments.us/reader030/viewer/2022020417/568142a5550346895daee04f/html5/thumbnails/8.jpg)
Deferred Shading
Generate a set of arrays (render buffers)– Geometric Properties– Appearance Properties nm
iA 1,0
nmiG
1,0
Rasterization
Ray Tracing
![Page 9: Binary Shading using Geometry and Appearance](https://reader030.fdocuments.us/reader030/viewer/2022020417/568142a5550346895daee04f/html5/thumbnails/9.jpg)
Graph construction
Standard Source-to-Sink Image Graph {V,E}
TiSi
pi eeeE
TSpV i
ImagePixels
Source(white)
Sink(black)
ImageConnectivity
Edges to Source
Edges toSInk
![Page 10: Binary Shading using Geometry and Appearance](https://reader030.fdocuments.us/reader030/viewer/2022020417/568142a5550346895daee04f/html5/thumbnails/10.jpg)
Appearance Contribution to the Graph
• Through terminal weights on • Appearance initiate B/W
segmentation• Experiments using :– Diffuse component– Specular component– Headlight component– Ambient Occlusion/Accessibility
component
TiSi ee
yxWi ,
yxBi ,TerminalWeights
![Page 11: Binary Shading using Geometry and Appearance](https://reader030.fdocuments.us/reader030/viewer/2022020417/568142a5550346895daee04f/html5/thumbnails/11.jpg)
Appearance Graph Terms
Global to local feature control using spatial averages
2
22)(
,
,, ih
vyux
vuii evuAyxA
Support
sizeLocal term: yxAyxAyxA iii ,,,'
Sign:locally lighter or darker
Weighted combination to the global measure.
yxAgyxAgyxB
yxAgyxAgyxW
iiiii
iiiii
,',0max1,1,
,',0max1,,
![Page 12: Binary Shading using Geometry and Appearance](https://reader030.fdocuments.us/reader030/viewer/2022020417/568142a5550346895daee04f/html5/thumbnails/12.jpg)
Global versus Local Thresholding
Global Local
![Page 13: Binary Shading using Geometry and Appearance](https://reader030.fdocuments.us/reader030/viewer/2022020417/568142a5550346895daee04f/html5/thumbnails/13.jpg)
Geometry Contribution to the Graph
• Modelled with neighbor edge weights• Tailors anisotropic, non-local B/W diffusion• Redistributes B/W values to enhance
geometric features• Based on:– View depth values – View dependent curvature, estimated as screen
space normal derivatives [Judd 2007]
pie 1100 ,,, yxyxN
yxz ,
11001100 ,,,,,, 2 yxnyxndyxyxS
Geodesic distance on the Gauss sphereUnit surface normal gathered at 00 , yx
![Page 14: Binary Shading using Geometry and Appearance](https://reader030.fdocuments.us/reader030/viewer/2022020417/568142a5550346895daee04f/html5/thumbnails/14.jpg)
Geometric Term
Local curvature normalization:
2
22
,1100 ,,,,,, c
vyux
vu
evuyxyxyx
Support
size
Yields neighbor edge weights:
2
211001100 ,,,,,,
11001 ,,, k
yxyxyxyx
eyxyxN
![Page 15: Binary Shading using Geometry and Appearance](https://reader030.fdocuments.us/reader030/viewer/2022020417/568142a5550346895daee04f/html5/thumbnails/15.jpg)
Geometry Contribution Modulation
![Page 16: Binary Shading using Geometry and Appearance](https://reader030.fdocuments.us/reader030/viewer/2022020417/568142a5550346895daee04f/html5/thumbnails/16.jpg)
Geometry Contribution Modulation
Small components are successively connected
![Page 17: Binary Shading using Geometry and Appearance](https://reader030.fdocuments.us/reader030/viewer/2022020417/568142a5550346895daee04f/html5/thumbnails/17.jpg)
Graph Minimum Cut
• Max Flow Min Cut Theorem– Shortest split path in the graph→Feature size control through
graph energy• Separate the graph in two components• Boykov and Kolmogorov
implementation [2004]
![Page 18: Binary Shading using Geometry and Appearance](https://reader030.fdocuments.us/reader030/viewer/2022020417/568142a5550346895daee04f/html5/thumbnails/18.jpg)
Cut performance
• Rendering buffers can be speed up using rasterization• Measured on a Core2Duo 1.83GHz (single thread)
![Page 19: Binary Shading using Geometry and Appearance](https://reader030.fdocuments.us/reader030/viewer/2022020417/568142a5550346895daee04f/html5/thumbnails/19.jpg)
RESULTS
![Page 20: Binary Shading using Geometry and Appearance](https://reader030.fdocuments.us/reader030/viewer/2022020417/568142a5550346895daee04f/html5/thumbnails/20.jpg)
Binary Shading
• Global to local features• Appearance & geometry depiction• Large variety of style• Interactive control
![Page 21: Binary Shading using Geometry and Appearance](https://reader030.fdocuments.us/reader030/viewer/2022020417/568142a5550346895daee04f/html5/thumbnails/21.jpg)
Comparison to Line Drawing
Line Drawing Binary Shading
![Page 22: Binary Shading using Geometry and Appearance](https://reader030.fdocuments.us/reader030/viewer/2022020417/568142a5550346895daee04f/html5/thumbnails/22.jpg)
Combination with Line Drawing
![Page 23: Binary Shading using Geometry and Appearance](https://reader030.fdocuments.us/reader030/viewer/2022020417/568142a5550346895daee04f/html5/thumbnails/23.jpg)
Combination with Line Drawing
RGBN Picture Rendering [Toler-Franklin 2007]
![Page 24: Binary Shading using Geometry and Appearance](https://reader030.fdocuments.us/reader030/viewer/2022020417/568142a5550346895daee04f/html5/thumbnails/24.jpg)
Combination with Line Drawing
![Page 25: Binary Shading using Geometry and Appearance](https://reader030.fdocuments.us/reader030/viewer/2022020417/568142a5550346895daee04f/html5/thumbnails/25.jpg)
Comparison to Thresholding
Diffuse Component
Thresholding ThresholdingOver Gaussian Filtering
Binary Rendering
![Page 26: Binary Shading using Geometry and Appearance](https://reader030.fdocuments.us/reader030/viewer/2022020417/568142a5550346895daee04f/html5/thumbnails/26.jpg)
Comparison to Thresholding
![Page 27: Binary Shading using Geometry and Appearance](https://reader030.fdocuments.us/reader030/viewer/2022020417/568142a5550346895daee04f/html5/thumbnails/27.jpg)
Comparison to Image Binarization
(b,e) equivalent to [Mould and Kaplan 2008]
![Page 28: Binary Shading using Geometry and Appearance](https://reader030.fdocuments.us/reader030/viewer/2022020417/568142a5550346895daee04f/html5/thumbnails/28.jpg)
INTERACTIVE CONTROLOn-going work
![Page 29: Binary Shading using Geometry and Appearance](https://reader030.fdocuments.us/reader030/viewer/2022020417/568142a5550346895daee04f/html5/thumbnails/29.jpg)
Interactive Control
• Solution 1: slider-based, for experts– Accurate control– « Too much » control for novice users
• Solution 2: painting interface
![Page 30: Binary Shading using Geometry and Appearance](https://reader030.fdocuments.us/reader030/viewer/2022020417/568142a5550346895daee04f/html5/thumbnails/30.jpg)
Paint Interface
• Supervised sparse B/W contraints• Derive the graph energy structure
![Page 31: Binary Shading using Geometry and Appearance](https://reader030.fdocuments.us/reader030/viewer/2022020417/568142a5550346895daee04f/html5/thumbnails/31.jpg)
Paint Interface
![Page 32: Binary Shading using Geometry and Appearance](https://reader030.fdocuments.us/reader030/viewer/2022020417/568142a5550346895daee04f/html5/thumbnails/32.jpg)
LIMITATIONS AND FUTURE WORK
![Page 33: Binary Shading using Geometry and Appearance](https://reader030.fdocuments.us/reader030/viewer/2022020417/568142a5550346895daee04f/html5/thumbnails/33.jpg)
Animation
… most of straightforward solutions have some temporal coherency failure cases.
Works most of the time but…
![Page 34: Binary Shading using Geometry and Appearance](https://reader030.fdocuments.us/reader030/viewer/2022020417/568142a5550346895daee04f/html5/thumbnails/34.jpg)
K-color Rendering
• Extend to multi-label cuts• Alternative energy minimizer– Lloyd relaxation/k-means– Mean Shift
• k-Component cut• Vector Rendering
![Page 35: Binary Shading using Geometry and Appearance](https://reader030.fdocuments.us/reader030/viewer/2022020417/568142a5550346895daee04f/html5/thumbnails/35.jpg)
CONCLUSION
![Page 36: Binary Shading using Geometry and Appearance](https://reader030.fdocuments.us/reader030/viewer/2022020417/568142a5550346895daee04f/html5/thumbnails/36.jpg)
Binary Shading as a Single Cut
• Global solution• Local to global control• Appearance vs geometry control• High level control
• For automatic binary drawing from 3D Scenes, decals, cut-out, etc…
![Page 37: Binary Shading using Geometry and Appearance](https://reader030.fdocuments.us/reader030/viewer/2022020417/568142a5550346895daee04f/html5/thumbnails/37.jpg)
Thank you
Binary Shading Using Geometry and Appearance.Bert Buchholz, Tamy Boubekeur, Doug DeCarlo and Marc Alexa
Computer Graphics Forum Vol. 29, Nb. 6, 2010Presented at Eurographics 2011