Two High Speed Quantization Algorithms Luc Brun Myriam Mokhtari L.E.R.I. Reims University (I.U.T.)

33
Two High Speed Quantization Algorithms Luc Brun Myriam Mokhtari L.E.R.I. Reims University (I.U.T.)

Transcript of Two High Speed Quantization Algorithms Luc Brun Myriam Mokhtari L.E.R.I. Reims University (I.U.T.)

Page 1: Two High Speed Quantization Algorithms Luc Brun Myriam Mokhtari L.E.R.I. Reims University (I.U.T.)

Two High Speed Quantization Algorithms

Luc BrunMyriam Mokhtari

L.E.R.I. Reims University (I.U.T.)

Page 2: Two High Speed Quantization Algorithms Luc Brun Myriam Mokhtari L.E.R.I. Reims University (I.U.T.)

Contents

Quantization algorithms

Our Methods

Discussion

Page 3: Two High Speed Quantization Algorithms Luc Brun Myriam Mokhtari L.E.R.I. Reims University (I.U.T.)

Quantization algorithms

Reduce the number of colours

Number of colours: 141,000 Number of colours: 16

Page 4: Two High Speed Quantization Algorithms Luc Brun Myriam Mokhtari L.E.R.I. Reims University (I.U.T.)

Quantization Algorithms

Applications

Display

Compression

Classification

Segmentation

Page 5: Two High Speed Quantization Algorithms Luc Brun Myriam Mokhtari L.E.R.I. Reims University (I.U.T.)

Quantization steps

Create clusters

Page 6: Two High Speed Quantization Algorithms Luc Brun Myriam Mokhtari L.E.R.I. Reims University (I.U.T.)

Quantization steps

Create clusters: Squared error

Partition error

K

iiCSEPE

1

)()(

Cx

CxxfCSE2

KCCP ,,1

Page 7: Two High Speed Quantization Algorithms Luc Brun Myriam Mokhtari L.E.R.I. Reims University (I.U.T.)

Quantization steps

Create clusters

Compute means

Page 8: Two High Speed Quantization Algorithms Luc Brun Myriam Mokhtari L.E.R.I. Reims University (I.U.T.)

Quantization steps

Create clusters

Compute means

Create output image (inverse colormap)

Quantization Inverse colormap dithtering

Page 9: Two High Speed Quantization Algorithms Luc Brun Myriam Mokhtari L.E.R.I. Reims University (I.U.T.)

Type of quantization methods

Three kind of Methods

Top-down

Bottom-up

Split & Merge

Page 10: Two High Speed Quantization Algorithms Luc Brun Myriam Mokhtari L.E.R.I. Reims University (I.U.T.)

Top-down methods

Recursive split of the image color set

Page 11: Two High Speed Quantization Algorithms Luc Brun Myriam Mokhtari L.E.R.I. Reims University (I.U.T.)

Bottom-up methods

For each colour c in the image colour set

Select K “empty” clusters

Aggregate c to its closest cluster

Page 12: Two High Speed Quantization Algorithms Luc Brun Myriam Mokhtari L.E.R.I. Reims University (I.U.T.)

Split and Merge methods

Select N>K clusters (split step)

Merge these clusters to obtain the K final clusters (merge step)

Page 13: Two High Speed Quantization Algorithms Luc Brun Myriam Mokhtari L.E.R.I. Reims University (I.U.T.)

Our Method: Split step

Create a uniform quantization.

Page 14: Two High Speed Quantization Algorithms Luc Brun Myriam Mokhtari L.E.R.I. Reims University (I.U.T.)

Our Method: Merge Step

Create a graph

Page 15: Two High Speed Quantization Algorithms Luc Brun Myriam Mokhtari L.E.R.I. Reims University (I.U.T.)

Our Method: Merge Step

Create a graph: Cluster Adjacency Graph

Page 16: Two High Speed Quantization Algorithms Luc Brun Myriam Mokhtari L.E.R.I. Reims University (I.U.T.)

Our Method: Merge Step

Merge of clusters: Ci and Cj

Minimize the partition error Select i0 and j0 such that:

2

, )()'( ji

ji

ji

ji CCCC

CCPEPE

jinji

ji

ji

Min ,,1),(

, 200

Page 17: Two High Speed Quantization Algorithms Luc Brun Myriam Mokhtari L.E.R.I. Reims University (I.U.T.)

Our Method: Merge Step

Merge clusters: Edge contraction

Page 18: Two High Speed Quantization Algorithms Luc Brun Myriam Mokhtari L.E.R.I. Reims University (I.U.T.)

Our Method: Merge Step

Merge clusters: Edge contraction

Page 19: Two High Speed Quantization Algorithms Luc Brun Myriam Mokhtari L.E.R.I. Reims University (I.U.T.)

Our Method: Merge Step

Merge clusters: Edge contraction

Page 20: Two High Speed Quantization Algorithms Luc Brun Myriam Mokhtari L.E.R.I. Reims University (I.U.T.)

Our Method: Merge Step

Merge clusters: Edge contraction

Page 21: Two High Speed Quantization Algorithms Luc Brun Myriam Mokhtari L.E.R.I. Reims University (I.U.T.)

Our Method: Merge Step

Merge clusters: Edge contraction

Page 22: Two High Speed Quantization Algorithms Luc Brun Myriam Mokhtari L.E.R.I. Reims University (I.U.T.)

Our Method: Merge Step

Merge clusters: Edge contraction

Page 23: Two High Speed Quantization Algorithms Luc Brun Myriam Mokhtari L.E.R.I. Reims University (I.U.T.)

Our Method: Merge Step

Merge clusters: Edge contraction

Page 24: Two High Speed Quantization Algorithms Luc Brun Myriam Mokhtari L.E.R.I. Reims University (I.U.T.)

Our Method: First Inverse colormap

Given a colour c

Find its enclosing clusterFind its enclosing meta-clusterMap c to its mean

Page 25: Two High Speed Quantization Algorithms Luc Brun Myriam Mokhtari L.E.R.I. Reims University (I.U.T.)

Our Method: Second Inverse colormap

Given a color cFind its enclosing clusterFind the adjacent meta-clustersMap c to the closest mean

Page 26: Two High Speed Quantization Algorithms Luc Brun Myriam Mokhtari L.E.R.I. Reims University (I.U.T.)

Our Method: Results

Compared to the Top-down method [Wu-91] Image quality:

First inverse colormap: slightly lowerSecond Inverse colormap: Improved

Computing time 15 time faster

Compared to the Bottom-up method [Xiang-97] Image quality: Improved [Tremeau-96] Computing time 10 time faster

Page 27: Two High Speed Quantization Algorithms Luc Brun Myriam Mokhtari L.E.R.I. Reims University (I.U.T.)

Our method: Results

First inverse colormap Second inverse colormap

Wu 91 Xiang 97

Original

Page 28: Two High Speed Quantization Algorithms Luc Brun Myriam Mokhtari L.E.R.I. Reims University (I.U.T.)

Discussion: The idea

Merge at each step the two closest clusters.

Reduce the amount of data (uniform quantization)

Apply an expansive heuristic: O(n2) (merge step)

Split & Merge strategy

Page 29: Two High Speed Quantization Algorithms Luc Brun Myriam Mokhtari L.E.R.I. Reims University (I.U.T.)

Discussion: Short History

Top down methods Intensively explored since 1982 [Heckbert 82]

Bottom-up methods Restricted to simple Heuristics

Page 30: Two High Speed Quantization Algorithms Luc Brun Myriam Mokhtari L.E.R.I. Reims University (I.U.T.)

Discussion: Short History

Number of clusters

Partition Error

Page 31: Two High Speed Quantization Algorithms Luc Brun Myriam Mokhtari L.E.R.I. Reims University (I.U.T.)

Discussion: Short History

Top down methods Bottom-up methods

Split & Merge methodsFirst attempts based on top-down algorithms.

Page 32: Two High Speed Quantization Algorithms Luc Brun Myriam Mokhtari L.E.R.I. Reims University (I.U.T.)

Conclusion Possible improvements

Uniform quantization Avoid empty clusters

Merge Step Find a better heuristic

Inverse colormap No improvement needed.

Combinatorial optimisation ?

Page 33: Two High Speed Quantization Algorithms Luc Brun Myriam Mokhtari L.E.R.I. Reims University (I.U.T.)

References

[Wu 91] Xiaolin Wu and K. Zhang. A better tree structured vector quantizer. In Proceedings of the IEEE Data Compression Conference, pages 392-401. IEEE Computer Society Press, 1991.

[Xiang-97] Color Image quantization by minimizing the maximum inter-cluster distance. ACM Transactions on Graphics, 16(3):260-276, July 1997.

[Tremeau-96] A. Tremeau, E. Dinet and E. Favier. Measurement and display of color image differences based on visual attention. Journal of Imaging Science and Technology, 40(6):522-534, 1996.IS&T/SID

http://www.univ-reims.fr/Labos/LERI/membre/luc