Rufus von Woofles, D.D. David Fouhey, Daniel Maturana,...

19
Visually Identifying Rank David Fouhey, Daniel Maturana, Rufus von Woofles, D.D. C.H.O.C.O.L.A.T.E Lab, Neurotic Computing Institute Carnegie Mellon University

Transcript of Rufus von Woofles, D.D. David Fouhey, Daniel Maturana,...

Page 1: Rufus von Woofles, D.D. David Fouhey, Daniel Maturana, …oneweirdkerneltrick.com/rank_slides.pdf · 2017-10-09 · Visually Identifying Rank David Fouhey, Daniel Maturana, Rufus

Visually Identifying RankDavid Fouhey, Daniel Maturana,

Rufus von Woofles, D.D.

C.H.O.C.O.L.A.T.E Lab, Neurotic Computing InstituteCarnegie Mellon University

Page 2: Rufus von Woofles, D.D. David Fouhey, Daniel Maturana, …oneweirdkerneltrick.com/rank_slides.pdf · 2017-10-09 · Visually Identifying Rank David Fouhey, Daniel Maturana, Rufus
Page 3: Rufus von Woofles, D.D. David Fouhey, Daniel Maturana, …oneweirdkerneltrick.com/rank_slides.pdf · 2017-10-09 · Visually Identifying Rank David Fouhey, Daniel Maturana, Rufus
Page 4: Rufus von Woofles, D.D. David Fouhey, Daniel Maturana, …oneweirdkerneltrick.com/rank_slides.pdf · 2017-10-09 · Visually Identifying Rank David Fouhey, Daniel Maturana, Rufus

Approach

1.3 … 5.6

-2.5 … 6.0

... … ... 10

A .png Computer Vision + Machine Learning

A Matrix

Page 5: Rufus von Woofles, D.D. David Fouhey, Daniel Maturana, …oneweirdkerneltrick.com/rank_slides.pdf · 2017-10-09 · Visually Identifying Rank David Fouhey, Daniel Maturana, Rufus

Why this shouldn’t work

1.3 … 5.6

-2.5 … 6.0

... … ... 10

Quantization Machine Learning Doesn’t Work

Page 6: Rufus von Woofles, D.D. David Fouhey, Daniel Maturana, …oneweirdkerneltrick.com/rank_slides.pdf · 2017-10-09 · Visually Identifying Rank David Fouhey, Daniel Maturana, Rufus

Did you really do this?

Yes. Every number is a real experiment.

Please don’t tell our advisors. Please?

Page 7: Rufus von Woofles, D.D. David Fouhey, Daniel Maturana, …oneweirdkerneltrick.com/rank_slides.pdf · 2017-10-09 · Visually Identifying Rank David Fouhey, Daniel Maturana, Rufus

Setup

1. 10x10 Matrices2. 10 Ranks3. 1000 (.png) Images / Rank

...

Page 8: Rufus von Woofles, D.D. David Fouhey, Daniel Maturana, …oneweirdkerneltrick.com/rank_slides.pdf · 2017-10-09 · Visually Identifying Rank David Fouhey, Daniel Maturana, Rufus

Does it work?

Page 9: Rufus von Woofles, D.D. David Fouhey, Daniel Maturana, …oneweirdkerneltrick.com/rank_slides.pdf · 2017-10-09 · Visually Identifying Rank David Fouhey, Daniel Maturana, Rufus

Does it generalize?Train (10x10) Test (30x30)

Page 10: Rufus von Woofles, D.D. David Fouhey, Daniel Maturana, …oneweirdkerneltrick.com/rank_slides.pdf · 2017-10-09 · Visually Identifying Rank David Fouhey, Daniel Maturana, Rufus

Does it generalize?

Page 11: Rufus von Woofles, D.D. David Fouhey, Daniel Maturana, …oneweirdkerneltrick.com/rank_slides.pdf · 2017-10-09 · Visually Identifying Rank David Fouhey, Daniel Maturana, Rufus

Why bother?

1. Better than traditional linear algebra2. Lets us answer questions about matrices,

linear algebra

Page 12: Rufus von Woofles, D.D. David Fouhey, Daniel Maturana, …oneweirdkerneltrick.com/rank_slides.pdf · 2017-10-09 · Visually Identifying Rank David Fouhey, Daniel Maturana, Rufus

Comparison with Linear AlgebraLin. Algebra: SVD, Determinant,...

Pros:- 100% Accuracy

Cons:- Boring- > O(n^2)- Requires numbers

Computer Vision: SIFT+RF, CNN

Pros:- Requires images- O(n^2)- Exciting and dangerous

Cons:- 78.6% Accuracy

Page 13: Rufus von Woofles, D.D. David Fouhey, Daniel Maturana, …oneweirdkerneltrick.com/rank_slides.pdf · 2017-10-09 · Visually Identifying Rank David Fouhey, Daniel Maturana, Rufus

What colormap is best?

Page 14: Rufus von Woofles, D.D. David Fouhey, Daniel Maturana, …oneweirdkerneltrick.com/rank_slides.pdf · 2017-10-09 · Visually Identifying Rank David Fouhey, Daniel Maturana, Rufus

What colormap is best?

Jet is #1! MATLAB is vindicated! Bye Bye Haters!

Page 15: Rufus von Woofles, D.D. David Fouhey, Daniel Maturana, …oneweirdkerneltrick.com/rank_slides.pdf · 2017-10-09 · Visually Identifying Rank David Fouhey, Daniel Maturana, Rufus

What matrices smell what rank?

Page 16: Rufus von Woofles, D.D. David Fouhey, Daniel Maturana, …oneweirdkerneltrick.com/rank_slides.pdf · 2017-10-09 · Visually Identifying Rank David Fouhey, Daniel Maturana, Rufus

Structured outputs: Deep Multiplication

Page 17: Rufus von Woofles, D.D. David Fouhey, Daniel Maturana, …oneweirdkerneltrick.com/rank_slides.pdf · 2017-10-09 · Visually Identifying Rank David Fouhey, Daniel Maturana, Rufus

Structured outputs: Deep Inverse

Page 18: Rufus von Woofles, D.D. David Fouhey, Daniel Maturana, …oneweirdkerneltrick.com/rank_slides.pdf · 2017-10-09 · Visually Identifying Rank David Fouhey, Daniel Maturana, Rufus

Legacy Matrices

Rank 1

Rank 10

Cellphone Picture

Page 19: Rufus von Woofles, D.D. David Fouhey, Daniel Maturana, …oneweirdkerneltrick.com/rank_slides.pdf · 2017-10-09 · Visually Identifying Rank David Fouhey, Daniel Maturana, Rufus

Thank You!

We gratefully acknowledge NVIDIA for GPUs used in this very serious research.