Rufus von Woofles, D.D. David Fouhey, Daniel Maturana,...
Transcript of Rufus von Woofles, D.D. David Fouhey, Daniel Maturana,...
![Page 1: Rufus von Woofles, D.D. David Fouhey, Daniel Maturana, …oneweirdkerneltrick.com/rank_slides.pdf · 2017-10-09 · Visually Identifying Rank David Fouhey, Daniel Maturana, Rufus](https://reader034.fdocuments.us/reader034/viewer/2022042402/5f114d205be5d333544ad358/html5/thumbnails/1.jpg)
Visually Identifying RankDavid Fouhey, Daniel Maturana,
Rufus von Woofles, D.D.
C.H.O.C.O.L.A.T.E Lab, Neurotic Computing InstituteCarnegie Mellon University
![Page 2: Rufus von Woofles, D.D. David Fouhey, Daniel Maturana, …oneweirdkerneltrick.com/rank_slides.pdf · 2017-10-09 · Visually Identifying Rank David Fouhey, Daniel Maturana, Rufus](https://reader034.fdocuments.us/reader034/viewer/2022042402/5f114d205be5d333544ad358/html5/thumbnails/2.jpg)
![Page 3: Rufus von Woofles, D.D. David Fouhey, Daniel Maturana, …oneweirdkerneltrick.com/rank_slides.pdf · 2017-10-09 · Visually Identifying Rank David Fouhey, Daniel Maturana, Rufus](https://reader034.fdocuments.us/reader034/viewer/2022042402/5f114d205be5d333544ad358/html5/thumbnails/3.jpg)
![Page 4: Rufus von Woofles, D.D. David Fouhey, Daniel Maturana, …oneweirdkerneltrick.com/rank_slides.pdf · 2017-10-09 · Visually Identifying Rank David Fouhey, Daniel Maturana, Rufus](https://reader034.fdocuments.us/reader034/viewer/2022042402/5f114d205be5d333544ad358/html5/thumbnails/4.jpg)
Approach
1.3 … 5.6
-2.5 … 6.0
... … ... 10
A .png Computer Vision + Machine Learning
A Matrix
![Page 5: Rufus von Woofles, D.D. David Fouhey, Daniel Maturana, …oneweirdkerneltrick.com/rank_slides.pdf · 2017-10-09 · Visually Identifying Rank David Fouhey, Daniel Maturana, Rufus](https://reader034.fdocuments.us/reader034/viewer/2022042402/5f114d205be5d333544ad358/html5/thumbnails/5.jpg)
Why this shouldn’t work
1.3 … 5.6
-2.5 … 6.0
... … ... 10
Quantization Machine Learning Doesn’t Work
![Page 6: Rufus von Woofles, D.D. David Fouhey, Daniel Maturana, …oneweirdkerneltrick.com/rank_slides.pdf · 2017-10-09 · Visually Identifying Rank David Fouhey, Daniel Maturana, Rufus](https://reader034.fdocuments.us/reader034/viewer/2022042402/5f114d205be5d333544ad358/html5/thumbnails/6.jpg)
Did you really do this?
Yes. Every number is a real experiment.
Please don’t tell our advisors. Please?
![Page 7: Rufus von Woofles, D.D. David Fouhey, Daniel Maturana, …oneweirdkerneltrick.com/rank_slides.pdf · 2017-10-09 · Visually Identifying Rank David Fouhey, Daniel Maturana, Rufus](https://reader034.fdocuments.us/reader034/viewer/2022042402/5f114d205be5d333544ad358/html5/thumbnails/7.jpg)
Setup
1. 10x10 Matrices2. 10 Ranks3. 1000 (.png) Images / Rank
...
![Page 8: Rufus von Woofles, D.D. David Fouhey, Daniel Maturana, …oneweirdkerneltrick.com/rank_slides.pdf · 2017-10-09 · Visually Identifying Rank David Fouhey, Daniel Maturana, Rufus](https://reader034.fdocuments.us/reader034/viewer/2022042402/5f114d205be5d333544ad358/html5/thumbnails/8.jpg)
Does it work?
![Page 9: Rufus von Woofles, D.D. David Fouhey, Daniel Maturana, …oneweirdkerneltrick.com/rank_slides.pdf · 2017-10-09 · Visually Identifying Rank David Fouhey, Daniel Maturana, Rufus](https://reader034.fdocuments.us/reader034/viewer/2022042402/5f114d205be5d333544ad358/html5/thumbnails/9.jpg)
Does it generalize?Train (10x10) Test (30x30)
![Page 10: Rufus von Woofles, D.D. David Fouhey, Daniel Maturana, …oneweirdkerneltrick.com/rank_slides.pdf · 2017-10-09 · Visually Identifying Rank David Fouhey, Daniel Maturana, Rufus](https://reader034.fdocuments.us/reader034/viewer/2022042402/5f114d205be5d333544ad358/html5/thumbnails/10.jpg)
Does it generalize?
![Page 11: Rufus von Woofles, D.D. David Fouhey, Daniel Maturana, …oneweirdkerneltrick.com/rank_slides.pdf · 2017-10-09 · Visually Identifying Rank David Fouhey, Daniel Maturana, Rufus](https://reader034.fdocuments.us/reader034/viewer/2022042402/5f114d205be5d333544ad358/html5/thumbnails/11.jpg)
Why bother?
1. Better than traditional linear algebra2. Lets us answer questions about matrices,
linear algebra
![Page 12: Rufus von Woofles, D.D. David Fouhey, Daniel Maturana, …oneweirdkerneltrick.com/rank_slides.pdf · 2017-10-09 · Visually Identifying Rank David Fouhey, Daniel Maturana, Rufus](https://reader034.fdocuments.us/reader034/viewer/2022042402/5f114d205be5d333544ad358/html5/thumbnails/12.jpg)
Comparison with Linear AlgebraLin. Algebra: SVD, Determinant,...
Pros:- 100% Accuracy
Cons:- Boring- > O(n^2)- Requires numbers
Computer Vision: SIFT+RF, CNN
Pros:- Requires images- O(n^2)- Exciting and dangerous
Cons:- 78.6% Accuracy
![Page 13: Rufus von Woofles, D.D. David Fouhey, Daniel Maturana, …oneweirdkerneltrick.com/rank_slides.pdf · 2017-10-09 · Visually Identifying Rank David Fouhey, Daniel Maturana, Rufus](https://reader034.fdocuments.us/reader034/viewer/2022042402/5f114d205be5d333544ad358/html5/thumbnails/13.jpg)
What colormap is best?
![Page 14: Rufus von Woofles, D.D. David Fouhey, Daniel Maturana, …oneweirdkerneltrick.com/rank_slides.pdf · 2017-10-09 · Visually Identifying Rank David Fouhey, Daniel Maturana, Rufus](https://reader034.fdocuments.us/reader034/viewer/2022042402/5f114d205be5d333544ad358/html5/thumbnails/14.jpg)
What colormap is best?
Jet is #1! MATLAB is vindicated! Bye Bye Haters!
![Page 15: Rufus von Woofles, D.D. David Fouhey, Daniel Maturana, …oneweirdkerneltrick.com/rank_slides.pdf · 2017-10-09 · Visually Identifying Rank David Fouhey, Daniel Maturana, Rufus](https://reader034.fdocuments.us/reader034/viewer/2022042402/5f114d205be5d333544ad358/html5/thumbnails/15.jpg)
What matrices smell what rank?
![Page 16: Rufus von Woofles, D.D. David Fouhey, Daniel Maturana, …oneweirdkerneltrick.com/rank_slides.pdf · 2017-10-09 · Visually Identifying Rank David Fouhey, Daniel Maturana, Rufus](https://reader034.fdocuments.us/reader034/viewer/2022042402/5f114d205be5d333544ad358/html5/thumbnails/16.jpg)
Structured outputs: Deep Multiplication
![Page 17: Rufus von Woofles, D.D. David Fouhey, Daniel Maturana, …oneweirdkerneltrick.com/rank_slides.pdf · 2017-10-09 · Visually Identifying Rank David Fouhey, Daniel Maturana, Rufus](https://reader034.fdocuments.us/reader034/viewer/2022042402/5f114d205be5d333544ad358/html5/thumbnails/17.jpg)
Structured outputs: Deep Inverse
![Page 18: Rufus von Woofles, D.D. David Fouhey, Daniel Maturana, …oneweirdkerneltrick.com/rank_slides.pdf · 2017-10-09 · Visually Identifying Rank David Fouhey, Daniel Maturana, Rufus](https://reader034.fdocuments.us/reader034/viewer/2022042402/5f114d205be5d333544ad358/html5/thumbnails/18.jpg)
Legacy Matrices
Rank 1
Rank 10
Cellphone Picture
![Page 19: Rufus von Woofles, D.D. David Fouhey, Daniel Maturana, …oneweirdkerneltrick.com/rank_slides.pdf · 2017-10-09 · Visually Identifying Rank David Fouhey, Daniel Maturana, Rufus](https://reader034.fdocuments.us/reader034/viewer/2022042402/5f114d205be5d333544ad358/html5/thumbnails/19.jpg)
Thank You!
We gratefully acknowledge NVIDIA for GPUs used in this very serious research.