Dual Representations for Light Field Compression
description
Transcript of Dual Representations for Light Field Compression
![Page 1: Dual Representations for Light Field Compression](https://reader036.fdocuments.us/reader036/viewer/2022081519/56813c5a550346895da5d746/html5/thumbnails/1.jpg)
Dual Representations for Light Field Compression
EE368C ProjectJanuary 30, 2001
Peter ChouPrashant Ramanathan
![Page 2: Dual Representations for Light Field Compression](https://reader036.fdocuments.us/reader036/viewer/2022081519/56813c5a550346895da5d746/html5/thumbnails/2.jpg)
Outline Background Model-based Coding Surface Light Fields Trade-offs Duality Proposed Experiments
![Page 3: Dual Representations for Light Field Compression](https://reader036.fdocuments.us/reader036/viewer/2022081519/56813c5a550346895da5d746/html5/thumbnails/3.jpg)
Light Fields and Compression What are light fields?
2-D array of images
Why is compression necessary? Light fields are very large data
setsMichelangelo’s Night96 GB raw image data
Stanford Computer Graphics Laboratory
Mouse Hemispherical Light FieldUniversity of Erlangen
![Page 4: Dual Representations for Light Field Compression](https://reader036.fdocuments.us/reader036/viewer/2022081519/56813c5a550346895da5d746/html5/thumbnails/4.jpg)
Light Fields with Geometry Geometry used for light fields to
aid compression ex. model-based coding
Light fields are used with geometry for more realistic rendering ex. surface light fields
![Page 5: Dual Representations for Light Field Compression](https://reader036.fdocuments.us/reader036/viewer/2022081519/56813c5a550346895da5d746/html5/thumbnails/5.jpg)
Model-based Coding Model-based Coding of Multi-Viewpoint
Imagery (Magnor and Girod, VCIP-2000) Eigen-Texture Method: Appearance
Compression based on 3D Model (Nishino, Sato, and Ikeuchi, CVPR-1999)
http://www.lnt.de/~magnor
![Page 6: Dual Representations for Light Field Compression](https://reader036.fdocuments.us/reader036/viewer/2022081519/56813c5a550346895da5d746/html5/thumbnails/6.jpg)
Surface Light Fields Surface Light Fields for 3D Photography (Wood
et al., Siggraph 2000)
http://grail.cs.washington.edu/projects/slf/
![Page 7: Dual Representations for Light Field Compression](https://reader036.fdocuments.us/reader036/viewer/2022081519/56813c5a550346895da5d746/html5/thumbnails/7.jpg)
Surface Light Fields (cont’d) Geometry acquired through range
scan For each point on surface, a
lumisphere represents radiance in all directions
Lumispheres are coded using either: function quantization (similar to VQ) principal function analysis (similar to
PCA)
![Page 8: Dual Representations for Light Field Compression](https://reader036.fdocuments.us/reader036/viewer/2022081519/56813c5a550346895da5d746/html5/thumbnails/8.jpg)
Trade-offs Textures
+ coherency along 4D coordinate directions
– warping introduces artifacts, and possible loss of information
Surface Light Fields+ more intuitive representation for
compression– lumispheres are represented as
continuous functions
![Page 9: Dual Representations for Light Field Compression](https://reader036.fdocuments.us/reader036/viewer/2022081519/56813c5a550346895da5d746/html5/thumbnails/9.jpg)
Duality View-dominant organization
(textures)
Geometry-dominant organization (surface light fields)
View 1
View 2
View N
Surface Points
Surface Point 1
Surface Point 2
Surface Point N
Views
![Page 10: Dual Representations for Light Field Compression](https://reader036.fdocuments.us/reader036/viewer/2022081519/56813c5a550346895da5d746/html5/thumbnails/10.jpg)
Proposed Experiments I Compare the two organizations for
any difference in compression results
View 1
View 2
View N
Surface Points
Surface Point 1
Surface Point 2
Surface Point N
Views
![Page 11: Dual Representations for Light Field Compression](https://reader036.fdocuments.us/reader036/viewer/2022081519/56813c5a550346895da5d746/html5/thumbnails/11.jpg)
Proposed Experiments II Reparameterize geometry-
dominant organization using local coordinate system w.r.t. surface normals
Surface Point 1
Surface Point 2
Surface Point N
Views
Normal Direction View
![Page 12: Dual Representations for Light Field Compression](https://reader036.fdocuments.us/reader036/viewer/2022081519/56813c5a550346895da5d746/html5/thumbnails/12.jpg)
Proposed Experiments III Use image data directly, instead of
converting from warped texture data
Surface Point 1
Surface Point 2
Surface Point N
Views
image pixels
![Page 13: Dual Representations for Light Field Compression](https://reader036.fdocuments.us/reader036/viewer/2022081519/56813c5a550346895da5d746/html5/thumbnails/13.jpg)
Workplan
Week 1 Week 2 Week 3 Week 4 Week 5 Acquire Data Familiarize with source code Get programs running Convert between representations (Experiment 1) Apply compression
Perform reparameterization (Experiment 2)
Analyze results Write report Prepare presentation
Use images directly (Experiment 3)
Peter
Prashant
Joint