Basis function Wavelet function · Haar wavelets Basis function Wavelet function. 320491: Advanced...

45
320491: Advanced Graphics - Chapter 1 146 Visualization and Computer Graphics Lab Jacobs University Haar wavelets Basis function Wavelet function

Transcript of Basis function Wavelet function · Haar wavelets Basis function Wavelet function. 320491: Advanced...

Page 1: Basis function Wavelet function · Haar wavelets Basis function Wavelet function. 320491: Advanced Graphics - Chapter 1 147 Visualization and Computer Graphics Lab Jacobs University

320491: Advanced Graphics - Chapter 1 146

Visualization and Computer Graphics LabJacobs University

Haar wavelets

Basis function

Wavelet function

Page 2: Basis function Wavelet function · Haar wavelets Basis function Wavelet function. 320491: Advanced Graphics - Chapter 1 147 Visualization and Computer Graphics Lab Jacobs University

320491: Advanced Graphics - Chapter 1 147

Visualization and Computer Graphics LabJacobs University

Haar wavelets

Page 3: Basis function Wavelet function · Haar wavelets Basis function Wavelet function. 320491: Advanced Graphics - Chapter 1 147 Visualization and Computer Graphics Lab Jacobs University

320491: Advanced Graphics - Chapter 1 148

Visualization and Computer Graphics LabJacobs University

Multiresolution representation

Page 4: Basis function Wavelet function · Haar wavelets Basis function Wavelet function. 320491: Advanced Graphics - Chapter 1 147 Visualization and Computer Graphics Lab Jacobs University

320491: Advanced Graphics - Chapter 1 149

Visualization and Computer Graphics LabJacobs University

Multiresolution representation

• Object is represented as a sequence of resolutions.• The resolutions are called levels (levels of detail,

LOD)• The differences are called detail coefficients.• The levels build a multiresolution hierarchy:

• The level is the base level.• The base level does not need to be represented by a

regular mesh. All levels use then semi-regular meshes.

Page 5: Basis function Wavelet function · Haar wavelets Basis function Wavelet function. 320491: Advanced Graphics - Chapter 1 147 Visualization and Computer Graphics Lab Jacobs University

320491: Advanced Graphics - Chapter 1 150

Visualization and Computer Graphics LabJacobs University

Multiresolution representation with Haar wavelets

Page 6: Basis function Wavelet function · Haar wavelets Basis function Wavelet function. 320491: Advanced Graphics - Chapter 1 147 Visualization and Computer Graphics Lab Jacobs University

320491: Advanced Graphics - Chapter 1 151

Visualization and Computer Graphics LabJacobs University

Memory requirements

Storing the highest resolutionrequires the same amount of storageas storing the coarsest resolutionand all detail coefficients

Page 7: Basis function Wavelet function · Haar wavelets Basis function Wavelet function. 320491: Advanced Graphics - Chapter 1 147 Visualization and Computer Graphics Lab Jacobs University

320491: Advanced Graphics - Chapter 1 152

Visualization and Computer Graphics LabJacobs University

1.4.2 Wavelets

Page 8: Basis function Wavelet function · Haar wavelets Basis function Wavelet function. 320491: Advanced Graphics - Chapter 1 147 Visualization and Computer Graphics Lab Jacobs University

320491: Advanced Graphics - Chapter 1 153

Visualization and Computer Graphics LabJacobs University

References

• Wavelets for Computer Graphics: A Primer.Eric J. Stollnitz, Tony D. DeRose, David H. SalesinUniversity of Washington, technical report, September 1994.

Page 9: Basis function Wavelet function · Haar wavelets Basis function Wavelet function. 320491: Advanced Graphics - Chapter 1 147 Visualization and Computer Graphics Lab Jacobs University

320491: Advanced Graphics - Chapter 1 154

Visualization and Computer Graphics LabJacobs University

Wavelets• Haar wavelets are the simplest and oldest wavelets

(Alfred Haar, 1909).• Wavelet theory started much later (boom in the 80s).• Wavelet functions must fulfill the criteria:

• Examples:

Page 10: Basis function Wavelet function · Haar wavelets Basis function Wavelet function. 320491: Advanced Graphics - Chapter 1 147 Visualization and Computer Graphics Lab Jacobs University

320491: Advanced Graphics - Chapter 1 155

Visualization and Computer Graphics LabJacobs University

Multiresolution discrete wavelet transform• Basis and wavelet functions span spaces:

Page 11: Basis function Wavelet function · Haar wavelets Basis function Wavelet function. 320491: Advanced Graphics - Chapter 1 147 Visualization and Computer Graphics Lab Jacobs University

320491: Advanced Graphics - Chapter 1 156

Visualization and Computer Graphics LabJacobs University

Multiresolution discrete wavelet transform

• The spaces form a multiresolution analysis:

• The spaces are the orthogonal complements:

Page 12: Basis function Wavelet function · Haar wavelets Basis function Wavelet function. 320491: Advanced Graphics - Chapter 1 147 Visualization and Computer Graphics Lab Jacobs University

320491: Advanced Graphics - Chapter 1 157

Visualization and Computer Graphics LabJacobs University

Constant B-spline wavelets (Haar wavelets)

Page 13: Basis function Wavelet function · Haar wavelets Basis function Wavelet function. 320491: Advanced Graphics - Chapter 1 147 Visualization and Computer Graphics Lab Jacobs University

320491: Advanced Graphics - Chapter 1 158

Visualization and Computer Graphics LabJacobs University

Constant B-spline wavelets (Haar wavelets)

The wavelet transform can also be written in matrix form:

The matrices are called synthesis matrices.

Page 14: Basis function Wavelet function · Haar wavelets Basis function Wavelet function. 320491: Advanced Graphics - Chapter 1 147 Visualization and Computer Graphics Lab Jacobs University

320491: Advanced Graphics - Chapter 1 159

Visualization and Computer Graphics LabJacobs University

Linear B-spline wavelets

Page 15: Basis function Wavelet function · Haar wavelets Basis function Wavelet function. 320491: Advanced Graphics - Chapter 1 147 Visualization and Computer Graphics Lab Jacobs University

320491: Advanced Graphics - Chapter 1 160

Visualization and Computer Graphics LabJacobs University

Linear B-spline wavelets

Synthesis matrices:

Page 16: Basis function Wavelet function · Haar wavelets Basis function Wavelet function. 320491: Advanced Graphics - Chapter 1 147 Visualization and Computer Graphics Lab Jacobs University

320491: Advanced Graphics - Chapter 1 161

Visualization and Computer Graphics LabJacobs University

Quadratic B-spline wavelets

Page 17: Basis function Wavelet function · Haar wavelets Basis function Wavelet function. 320491: Advanced Graphics - Chapter 1 147 Visualization and Computer Graphics Lab Jacobs University

320491: Advanced Graphics - Chapter 1 162

Visualization and Computer Graphics LabJacobs University

Quadratic B-spline wavelets

Synthesis matrices:

Page 18: Basis function Wavelet function · Haar wavelets Basis function Wavelet function. 320491: Advanced Graphics - Chapter 1 147 Visualization and Computer Graphics Lab Jacobs University

320491: Advanced Graphics - Chapter 1 163

Visualization and Computer Graphics LabJacobs University

Quadratic B-spline wavelets

Synthesis matrices:

Page 19: Basis function Wavelet function · Haar wavelets Basis function Wavelet function. 320491: Advanced Graphics - Chapter 1 147 Visualization and Computer Graphics Lab Jacobs University

320491: Advanced Graphics - Chapter 1 164

Visualization and Computer Graphics LabJacobs University

Cubic B-spline wavelets

Page 20: Basis function Wavelet function · Haar wavelets Basis function Wavelet function. 320491: Advanced Graphics - Chapter 1 147 Visualization and Computer Graphics Lab Jacobs University

320491: Advanced Graphics - Chapter 1 165

Visualization and Computer Graphics LabJacobs University

Cubic B-spline wavelets

Synthesis matrices:

Page 21: Basis function Wavelet function · Haar wavelets Basis function Wavelet function. 320491: Advanced Graphics - Chapter 1 147 Visualization and Computer Graphics Lab Jacobs University

320491: Advanced Graphics - Chapter 1 166

Visualization and Computer Graphics LabJacobs University

Cubic B-spline wavelets

Synthesis matrices:

Page 22: Basis function Wavelet function · Haar wavelets Basis function Wavelet function. 320491: Advanced Graphics - Chapter 1 147 Visualization and Computer Graphics Lab Jacobs University

320491: Advanced Graphics - Chapter 1 167

Visualization and Computer Graphics LabJacobs University

2D Haar wavelet transform

• 2D basis and wavelet functions are tensor productsof 1D basis and wavelet functions.

Page 23: Basis function Wavelet function · Haar wavelets Basis function Wavelet function. 320491: Advanced Graphics - Chapter 1 147 Visualization and Computer Graphics Lab Jacobs University

320491: Advanced Graphics - Chapter 1 168

Visualization and Computer Graphics LabJacobs University

2D Haar wavelet transformBasis:

Page 24: Basis function Wavelet function · Haar wavelets Basis function Wavelet function. 320491: Advanced Graphics - Chapter 1 147 Visualization and Computer Graphics Lab Jacobs University

320491: Advanced Graphics - Chapter 1 169

Visualization and Computer Graphics LabJacobs University

2D Haar wavelet transform

Page 25: Basis function Wavelet function · Haar wavelets Basis function Wavelet function. 320491: Advanced Graphics - Chapter 1 147 Visualization and Computer Graphics Lab Jacobs University

320491: Advanced Graphics - Chapter 1 170

Visualization and Computer Graphics LabJacobs University

2D Haar wavelet transformAlternative construction:

Use 2D basis function

and three 2D wavelet functions

Page 26: Basis function Wavelet function · Haar wavelets Basis function Wavelet function. 320491: Advanced Graphics - Chapter 1 147 Visualization and Computer Graphics Lab Jacobs University

320491: Advanced Graphics - Chapter 1 171

Visualization and Computer Graphics LabJacobs University

2D Haar wavelet transformBasis:

Page 27: Basis function Wavelet function · Haar wavelets Basis function Wavelet function. 320491: Advanced Graphics - Chapter 1 147 Visualization and Computer Graphics Lab Jacobs University

320491: Advanced Graphics - Chapter 1 172

Visualization and Computer Graphics LabJacobs University

2D Haar wavelet transform

Advantage: One obtains undistorteddownscaled versions of the 2D image.

Page 28: Basis function Wavelet function · Haar wavelets Basis function Wavelet function. 320491: Advanced Graphics - Chapter 1 147 Visualization and Computer Graphics Lab Jacobs University

320491: Advanced Graphics - Chapter 1 173

Visualization and Computer Graphics LabJacobs University

2D wavelet transform in RGB space

Page 29: Basis function Wavelet function · Haar wavelets Basis function Wavelet function. 320491: Advanced Graphics - Chapter 1 147 Visualization and Computer Graphics Lab Jacobs University

320491: Advanced Graphics - Chapter 1 174

Visualization and Computer Graphics LabJacobs University

Image compression

• Loss-less compression– Do not store detail coefficients that are 0.– Constant regions are stored by 1 value only.

• Lossy compression– Set detail coefficients with small absolute values to 0.– A threshold determines the compression rate.

Page 30: Basis function Wavelet function · Haar wavelets Basis function Wavelet function. 320491: Advanced Graphics - Chapter 1 147 Visualization and Computer Graphics Lab Jacobs University

320491: Advanced Graphics - Chapter 1 175

Visualization and Computer Graphics LabJacobs University

Image compression

100% 21% 4% 1%Error: 0% 5% 10% 15%

Haar wavelets:

Page 31: Basis function Wavelet function · Haar wavelets Basis function Wavelet function. 320491: Advanced Graphics - Chapter 1 147 Visualization and Computer Graphics Lab Jacobs University

320491: Advanced Graphics - Chapter 1 176

Visualization and Computer Graphics LabJacobs University

Image compressionJPEG 2000: Cohen-Daubechies-Feauveau wavelets

Page 32: Basis function Wavelet function · Haar wavelets Basis function Wavelet function. 320491: Advanced Graphics - Chapter 1 147 Visualization and Computer Graphics Lab Jacobs University

320491: Advanced Graphics - Chapter 1 177

Visualization and Computer Graphics LabJacobs University

Image compressionJPEG 2000: lossy compression leads to blurring.

Page 33: Basis function Wavelet function · Haar wavelets Basis function Wavelet function. 320491: Advanced Graphics - Chapter 1 147 Visualization and Computer Graphics Lab Jacobs University

320491: Advanced Graphics - Chapter 1 178

Visualization and Computer Graphics LabJacobs University

1.4.3 Multiresolution Modeling

Page 34: Basis function Wavelet function · Haar wavelets Basis function Wavelet function. 320491: Advanced Graphics - Chapter 1 147 Visualization and Computer Graphics Lab Jacobs University

320491: Advanced Graphics - Chapter 1 179

Visualization and Computer Graphics LabJacobs University

References

• Multiresolution Techniques. Leif P. Kobbelt. In: Handbook of Computer Aided Geometric Design, G. Farin, J. Hoschek, M-S. Kim (eds.), Elsevier, 2002.

Page 35: Basis function Wavelet function · Haar wavelets Basis function Wavelet function. 320491: Advanced Graphics - Chapter 1 147 Visualization and Computer Graphics Lab Jacobs University

320491: Advanced Graphics - Chapter 1 180

Visualization and Computer Graphics LabJacobs University

Multiresolution modeling

• Filter bank

small details large detailslow frequencyhigh frequency

frequency spectrum

Page 36: Basis function Wavelet function · Haar wavelets Basis function Wavelet function. 320491: Advanced Graphics - Chapter 1 147 Visualization and Computer Graphics Lab Jacobs University

320491: Advanced Graphics - Chapter 1 181

Visualization and Computer Graphics LabJacobs University

Multiresolution modeling: Example 1

1. Remove high-frequency detail by going to coarseresolution.

2. Perform modeling at coarse resolution byinteractively changing the shape.

3. Reinsert high-frequency detail by going to fine resolution.

Page 37: Basis function Wavelet function · Haar wavelets Basis function Wavelet function. 320491: Advanced Graphics - Chapter 1 147 Visualization and Computer Graphics Lab Jacobs University

320491: Advanced Graphics - Chapter 1 182

Visualization and Computer Graphics LabJacobs University

Multiresolution modeling: Example 1

• Global vs. local details:

Page 38: Basis function Wavelet function · Haar wavelets Basis function Wavelet function. 320491: Advanced Graphics - Chapter 1 147 Visualization and Computer Graphics Lab Jacobs University

320491: Advanced Graphics - Chapter 1 183

Visualization and Computer Graphics LabJacobs University

Multiresolution modeling: Example 2

• Change the character of an object by replacing detail coefficients with new ones, e.g., by replacing smallhigh-frequency details with large ones.

Page 39: Basis function Wavelet function · Haar wavelets Basis function Wavelet function. 320491: Advanced Graphics - Chapter 1 147 Visualization and Computer Graphics Lab Jacobs University

320491: Advanced Graphics - Chapter 1 184

Visualization and Computer Graphics LabJacobs University

Multiresolution modeling: Example 3

• Performing interactive changes of the shape at different levels of resolution.

fine level intermediate level coarse level

Page 40: Basis function Wavelet function · Haar wavelets Basis function Wavelet function. 320491: Advanced Graphics - Chapter 1 147 Visualization and Computer Graphics Lab Jacobs University

320491: Advanced Graphics - Chapter 1 185

Visualization and Computer Graphics LabJacobs University

Multiresolution modeling: Example 3• The finer the level of resolution, the more local the

change.

Page 41: Basis function Wavelet function · Haar wavelets Basis function Wavelet function. 320491: Advanced Graphics - Chapter 1 147 Visualization and Computer Graphics Lab Jacobs University

320491: Advanced Graphics - Chapter 1 186

Visualization and Computer Graphics LabJacobs University

• • •

ApplicationsHierarchy:

Page 42: Basis function Wavelet function · Haar wavelets Basis function Wavelet function. 320491: Advanced Graphics - Chapter 1 147 Visualization and Computer Graphics Lab Jacobs University

320491: Advanced Graphics - Chapter 1 187

Visualization and Computer Graphics LabJacobs University

~70,000 faces ~11,000 faces~70,000 faces ~11,000 faces

ε < 0.8%ε < 0.8%

CompressionReduction of storage requirements with error bounds:

Page 43: Basis function Wavelet function · Haar wavelets Basis function Wavelet function. 320491: Advanced Graphics - Chapter 1 147 Visualization and Computer Graphics Lab Jacobs University

320491: Advanced Graphics - Chapter 1 188

Visualization and Computer Graphics LabJacobs University

Level of detail controlDisplay at appropriatelevel of detail:

Page 44: Basis function Wavelet function · Haar wavelets Basis function Wavelet function. 320491: Advanced Graphics - Chapter 1 147 Visualization and Computer Graphics Lab Jacobs University

320491: Advanced Graphics - Chapter 1 189

Visualization and Computer Graphics LabJacobs University

Progressive transmission and renderingProgressive refinement of mesh over time:

Page 45: Basis function Wavelet function · Haar wavelets Basis function Wavelet function. 320491: Advanced Graphics - Chapter 1 147 Visualization and Computer Graphics Lab Jacobs University

320491: Advanced Graphics - Chapter 1 190

Visualization and Computer Graphics LabJacobs University

Multiresolution editingShape editing at different LODs: