Cartesian k-means
description
Transcript of Cartesian k-means
![Page 1: Cartesian k-means](https://reader035.fdocuments.us/reader035/viewer/2022081506/56813a23550346895da2022b/html5/thumbnails/1.jpg)
Cartesian k-means
Mohammad Norouzi
David Fleet
![Page 2: Cartesian k-means](https://reader035.fdocuments.us/reader035/viewer/2022081506/56813a23550346895da2022b/html5/thumbnails/2.jpg)
![Page 3: Cartesian k-means](https://reader035.fdocuments.us/reader035/viewer/2022081506/56813a23550346895da2022b/html5/thumbnails/3.jpg)
![Page 4: Cartesian k-means](https://reader035.fdocuments.us/reader035/viewer/2022081506/56813a23550346895da2022b/html5/thumbnails/4.jpg)
![Page 5: Cartesian k-means](https://reader035.fdocuments.us/reader035/viewer/2022081506/56813a23550346895da2022b/html5/thumbnails/5.jpg)
We need many clusters
Increasing number of clusters
Problem: Search time, storage cost
![Page 6: Cartesian k-means](https://reader035.fdocuments.us/reader035/viewer/2022081506/56813a23550346895da2022b/html5/thumbnails/6.jpg)
![Page 7: Cartesian k-means](https://reader035.fdocuments.us/reader035/viewer/2022081506/56813a23550346895da2022b/html5/thumbnails/7.jpg)
![Page 8: Cartesian k-means](https://reader035.fdocuments.us/reader035/viewer/2022081506/56813a23550346895da2022b/html5/thumbnails/8.jpg)
(subspace 1) (subspace 2)
![Page 9: Cartesian k-means](https://reader035.fdocuments.us/reader035/viewer/2022081506/56813a23550346895da2022b/html5/thumbnails/9.jpg)
(subspace 1) (subspace 2)
![Page 10: Cartesian k-means](https://reader035.fdocuments.us/reader035/viewer/2022081506/56813a23550346895da2022b/html5/thumbnails/10.jpg)
(subspace 1) (subspace 2)
![Page 11: Cartesian k-means](https://reader035.fdocuments.us/reader035/viewer/2022081506/56813a23550346895da2022b/html5/thumbnails/11.jpg)
(subspace 1) (subspace 2)
![Page 12: Cartesian k-means](https://reader035.fdocuments.us/reader035/viewer/2022081506/56813a23550346895da2022b/html5/thumbnails/12.jpg)
(subspace 1) (subspace 2)
![Page 13: Cartesian k-means](https://reader035.fdocuments.us/reader035/viewer/2022081506/56813a23550346895da2022b/html5/thumbnails/13.jpg)
(subspace 1) (subspace 2)
![Page 14: Cartesian k-means](https://reader035.fdocuments.us/reader035/viewer/2022081506/56813a23550346895da2022b/html5/thumbnails/14.jpg)
Compositional representation
![Page 15: Cartesian k-means](https://reader035.fdocuments.us/reader035/viewer/2022081506/56813a23550346895da2022b/html5/thumbnails/15.jpg)
Compositional representation
![Page 16: Cartesian k-means](https://reader035.fdocuments.us/reader035/viewer/2022081506/56813a23550346895da2022b/html5/thumbnails/16.jpg)
Compositional representation
![Page 17: Cartesian k-means](https://reader035.fdocuments.us/reader035/viewer/2022081506/56813a23550346895da2022b/html5/thumbnails/17.jpg)
Which subspaces?
![Page 18: Cartesian k-means](https://reader035.fdocuments.us/reader035/viewer/2022081506/56813a23550346895da2022b/html5/thumbnails/18.jpg)
Which subspaces? Learning
![Page 19: Cartesian k-means](https://reader035.fdocuments.us/reader035/viewer/2022081506/56813a23550346895da2022b/html5/thumbnails/19.jpg)
k-means
![Page 20: Cartesian k-means](https://reader035.fdocuments.us/reader035/viewer/2022081506/56813a23550346895da2022b/html5/thumbnails/20.jpg)
k-means
![Page 21: Cartesian k-means](https://reader035.fdocuments.us/reader035/viewer/2022081506/56813a23550346895da2022b/html5/thumbnails/21.jpg)
k-means
![Page 22: Cartesian k-means](https://reader035.fdocuments.us/reader035/viewer/2022081506/56813a23550346895da2022b/html5/thumbnails/22.jpg)
Orthogonal k-means
![Page 23: Cartesian k-means](https://reader035.fdocuments.us/reader035/viewer/2022081506/56813a23550346895da2022b/html5/thumbnails/23.jpg)
Orthogonal k-means
![Page 24: Cartesian k-means](https://reader035.fdocuments.us/reader035/viewer/2022081506/56813a23550346895da2022b/html5/thumbnails/24.jpg)
Orthogonal k-means
![Page 25: Cartesian k-means](https://reader035.fdocuments.us/reader035/viewer/2022081506/56813a23550346895da2022b/html5/thumbnails/25.jpg)
Iterative Quantization [Gong & Lazebnik, CVPR’11]
![Page 26: Cartesian k-means](https://reader035.fdocuments.us/reader035/viewer/2022081506/56813a23550346895da2022b/html5/thumbnails/26.jpg)
![Page 27: Cartesian k-means](https://reader035.fdocuments.us/reader035/viewer/2022081506/56813a23550346895da2022b/html5/thumbnails/27.jpg)
![Page 28: Cartesian k-means](https://reader035.fdocuments.us/reader035/viewer/2022081506/56813a23550346895da2022b/html5/thumbnails/28.jpg)
Product Quantization [Jegou, Douze, Schmid, PAMI’11]
![Page 29: Cartesian k-means](https://reader035.fdocuments.us/reader035/viewer/2022081506/56813a23550346895da2022b/html5/thumbnails/29.jpg)
Cartesian k-means
![Page 30: Cartesian k-means](https://reader035.fdocuments.us/reader035/viewer/2022081506/56813a23550346895da2022b/html5/thumbnails/30.jpg)
Cartesian k-means
![Page 31: Cartesian k-means](https://reader035.fdocuments.us/reader035/viewer/2022081506/56813a23550346895da2022b/html5/thumbnails/31.jpg)
Cartesian k-means
![Page 32: Cartesian k-means](https://reader035.fdocuments.us/reader035/viewer/2022081506/56813a23550346895da2022b/html5/thumbnails/32.jpg)
Learning Cartesian k-means
![Page 33: Cartesian k-means](https://reader035.fdocuments.us/reader035/viewer/2022081506/56813a23550346895da2022b/html5/thumbnails/33.jpg)
Learning Cartesian k-means
![Page 34: Cartesian k-means](https://reader035.fdocuments.us/reader035/viewer/2022081506/56813a23550346895da2022b/html5/thumbnails/34.jpg)
Learning Cartesian k-means
![Page 35: Cartesian k-means](https://reader035.fdocuments.us/reader035/viewer/2022081506/56813a23550346895da2022b/html5/thumbnails/35.jpg)
Learning Cartesian k-means
![Page 36: Cartesian k-means](https://reader035.fdocuments.us/reader035/viewer/2022081506/56813a23550346895da2022b/html5/thumbnails/36.jpg)
Learning Cartesian k-means
![Page 37: Cartesian k-means](https://reader035.fdocuments.us/reader035/viewer/2022081506/56813a23550346895da2022b/html5/thumbnails/37.jpg)
Learning Cartesian k-means
![Page 38: Cartesian k-means](https://reader035.fdocuments.us/reader035/viewer/2022081506/56813a23550346895da2022b/html5/thumbnails/38.jpg)
Learning Cartesian k-means
![Page 39: Cartesian k-means](https://reader035.fdocuments.us/reader035/viewer/2022081506/56813a23550346895da2022b/html5/thumbnails/39.jpg)
Learning Cartesian k-means
![Page 40: Cartesian k-means](https://reader035.fdocuments.us/reader035/viewer/2022081506/56813a23550346895da2022b/html5/thumbnails/40.jpg)
Cartesian k-means
![Page 41: Cartesian k-means](https://reader035.fdocuments.us/reader035/viewer/2022081506/56813a23550346895da2022b/html5/thumbnails/41.jpg)
Cartesian k-means
compositionality
![Page 42: Cartesian k-means](https://reader035.fdocuments.us/reader035/viewer/2022081506/56813a23550346895da2022b/html5/thumbnails/42.jpg)
![Page 43: Cartesian k-means](https://reader035.fdocuments.us/reader035/viewer/2022081506/56813a23550346895da2022b/html5/thumbnails/43.jpg)
![Page 44: Cartesian k-means](https://reader035.fdocuments.us/reader035/viewer/2022081506/56813a23550346895da2022b/html5/thumbnails/44.jpg)
![Page 45: Cartesian k-means](https://reader035.fdocuments.us/reader035/viewer/2022081506/56813a23550346895da2022b/html5/thumbnails/45.jpg)
![Page 46: Cartesian k-means](https://reader035.fdocuments.us/reader035/viewer/2022081506/56813a23550346895da2022b/html5/thumbnails/46.jpg)
![Page 47: Cartesian k-means](https://reader035.fdocuments.us/reader035/viewer/2022081506/56813a23550346895da2022b/html5/thumbnails/47.jpg)
![Page 48: Cartesian k-means](https://reader035.fdocuments.us/reader035/viewer/2022081506/56813a23550346895da2022b/html5/thumbnails/48.jpg)
Codebook learning (CIFAR-10)
![Page 49: Cartesian k-means](https://reader035.fdocuments.us/reader035/viewer/2022081506/56813a23550346895da2022b/html5/thumbnails/49.jpg)
Codebook learning (CIFAR-10)
![Page 50: Cartesian k-means](https://reader035.fdocuments.us/reader035/viewer/2022081506/56813a23550346895da2022b/html5/thumbnails/50.jpg)
Codebook learning (CIFAR-10)
![Page 51: Cartesian k-means](https://reader035.fdocuments.us/reader035/viewer/2022081506/56813a23550346895da2022b/html5/thumbnails/51.jpg)
![Page 52: Cartesian k-means](https://reader035.fdocuments.us/reader035/viewer/2022081506/56813a23550346895da2022b/html5/thumbnails/52.jpg)
![Page 53: Cartesian k-means](https://reader035.fdocuments.us/reader035/viewer/2022081506/56813a23550346895da2022b/html5/thumbnails/53.jpg)
![Page 54: Cartesian k-means](https://reader035.fdocuments.us/reader035/viewer/2022081506/56813a23550346895da2022b/html5/thumbnails/54.jpg)
Run-time complexity
![Page 55: Cartesian k-means](https://reader035.fdocuments.us/reader035/viewer/2022081506/56813a23550346895da2022b/html5/thumbnails/55.jpg)
Summary
ok-means
ITQ
ck-means
PQ
![Page 56: Cartesian k-means](https://reader035.fdocuments.us/reader035/viewer/2022081506/56813a23550346895da2022b/html5/thumbnails/56.jpg)
Thank you for your attention!
![Page 57: Cartesian k-means](https://reader035.fdocuments.us/reader035/viewer/2022081506/56813a23550346895da2022b/html5/thumbnails/57.jpg)
![Page 58: Cartesian k-means](https://reader035.fdocuments.us/reader035/viewer/2022081506/56813a23550346895da2022b/html5/thumbnails/58.jpg)
![Page 59: Cartesian k-means](https://reader035.fdocuments.us/reader035/viewer/2022081506/56813a23550346895da2022b/html5/thumbnails/59.jpg)
![Page 60: Cartesian k-means](https://reader035.fdocuments.us/reader035/viewer/2022081506/56813a23550346895da2022b/html5/thumbnails/60.jpg)
![Page 61: Cartesian k-means](https://reader035.fdocuments.us/reader035/viewer/2022081506/56813a23550346895da2022b/html5/thumbnails/61.jpg)
![Page 62: Cartesian k-means](https://reader035.fdocuments.us/reader035/viewer/2022081506/56813a23550346895da2022b/html5/thumbnails/62.jpg)
![Page 63: Cartesian k-means](https://reader035.fdocuments.us/reader035/viewer/2022081506/56813a23550346895da2022b/html5/thumbnails/63.jpg)
![Page 64: Cartesian k-means](https://reader035.fdocuments.us/reader035/viewer/2022081506/56813a23550346895da2022b/html5/thumbnails/64.jpg)
![Page 65: Cartesian k-means](https://reader035.fdocuments.us/reader035/viewer/2022081506/56813a23550346895da2022b/html5/thumbnails/65.jpg)
![Page 66: Cartesian k-means](https://reader035.fdocuments.us/reader035/viewer/2022081506/56813a23550346895da2022b/html5/thumbnails/66.jpg)
![Page 67: Cartesian k-means](https://reader035.fdocuments.us/reader035/viewer/2022081506/56813a23550346895da2022b/html5/thumbnails/67.jpg)
![Page 68: Cartesian k-means](https://reader035.fdocuments.us/reader035/viewer/2022081506/56813a23550346895da2022b/html5/thumbnails/68.jpg)