Foundations of Visual Analytics Pat Hanrahan Director, RVAC Stanford University.

42
Foundations of Visual Analytics Pat Hanrahan Director, RVAC Stanford University

Transcript of Foundations of Visual Analytics Pat Hanrahan Director, RVAC Stanford University.

Page 1: Foundations of Visual Analytics Pat Hanrahan Director, RVAC Stanford University.

Foundations of

Visual Analytics

Pat Hanrahan

Director, RVAC

Stanford University

Page 2: Foundations of Visual Analytics Pat Hanrahan Director, RVAC Stanford University.

Analytical Reasoning

Facilitated by

Interactive Visualization

Page 3: Foundations of Visual Analytics Pat Hanrahan Director, RVAC Stanford University.

Why is a Picture

(Sometimes) Worth

10,000 Words

Page 4: Foundations of Visual Analytics Pat Hanrahan Director, RVAC Stanford University.

Let’s Solve a Problem:

Number Scrabble

Herb Simon

Page 5: Foundations of Visual Analytics Pat Hanrahan Director, RVAC Stanford University.

Number Scrabble

Goal: Pick three numbers that sum to 15

Page 6: Foundations of Visual Analytics Pat Hanrahan Director, RVAC Stanford University.

Number Scrabble

Goal: Pick three numbers that sum to 15

A:

B:

Page 7: Foundations of Visual Analytics Pat Hanrahan Director, RVAC Stanford University.

Number Scrabble

Goal: Pick three numbers that sum to 15

A:

B:

Page 8: Foundations of Visual Analytics Pat Hanrahan Director, RVAC Stanford University.

Number Scrabble

Goal: Pick three numbers that sum to 15

A:

B:

Page 9: Foundations of Visual Analytics Pat Hanrahan Director, RVAC Stanford University.

Number Scrabble

Goal: Pick three numbers that sum to 15

A:

B:

Page 10: Foundations of Visual Analytics Pat Hanrahan Director, RVAC Stanford University.

Number Scrabble

Goal: Pick three numbers that sum to 15

A:

B:

Page 11: Foundations of Visual Analytics Pat Hanrahan Director, RVAC Stanford University.

Number Scrabble

Goal: Pick three numbers that sum to 15

A:

B: ?

Page 12: Foundations of Visual Analytics Pat Hanrahan Director, RVAC Stanford University.

Tic-Tac-Toe

Page 13: Foundations of Visual Analytics Pat Hanrahan Director, RVAC Stanford University.

Tic-Tac-Toe

X

Page 14: Foundations of Visual Analytics Pat Hanrahan Director, RVAC Stanford University.

Tic-Tac-Toe

X

O

Page 15: Foundations of Visual Analytics Pat Hanrahan Director, RVAC Stanford University.

Tic-Tac-Toe

X

O

X

Page 16: Foundations of Visual Analytics Pat Hanrahan Director, RVAC Stanford University.

Tic-Tac-Toe

X

O

X O

Page 17: Foundations of Visual Analytics Pat Hanrahan Director, RVAC Stanford University.

Tic-Tac-Toe

X

O

X O

X

Page 18: Foundations of Visual Analytics Pat Hanrahan Director, RVAC Stanford University.

Tic-Tac-Toe

X

O

X O

X

O

Page 19: Foundations of Visual Analytics Pat Hanrahan Director, RVAC Stanford University.

Problem Isomorph

34 8

59 1

72 6

Magic Square: All rows, columns, diagonals sum to 15

Page 20: Foundations of Visual Analytics Pat Hanrahan Director, RVAC Stanford University.

Switching to a Visual Representation

8

59 1

72 6

34

Page 21: Foundations of Visual Analytics Pat Hanrahan Director, RVAC Stanford University.

Switching to a Visual Representation

8

59 1

72 6

34

Page 22: Foundations of Visual Analytics Pat Hanrahan Director, RVAC Stanford University.

Switching to a Visual Representation

34 8

59 1

72 6

Page 23: Foundations of Visual Analytics Pat Hanrahan Director, RVAC Stanford University.

Switching to a Visual Representation

34 8

59 1

72 6

Page 24: Foundations of Visual Analytics Pat Hanrahan Director, RVAC Stanford University.

Switching to a Visual Representation

34 8

59 1

72 6

?

Page 25: Foundations of Visual Analytics Pat Hanrahan Director, RVAC Stanford University.

Switching to a Visual Representation

34 8

59 1

72 6

Page 26: Foundations of Visual Analytics Pat Hanrahan Director, RVAC Stanford University.

Why is a Picture Worth 10,000 Words?Reduce search time

Pre-attentive (constant-time) search process

Spatially-indexed patterns store the “facts”

Reduce memory load

Working memory is limited

Store information in the diagram

Allow perceptual inference

Map inference to pattern finding

Larkin and Simon, Why is a diagram (sometimes) worth 10,000

words, Cognitive Science, 1987

Page 27: Foundations of Visual Analytics Pat Hanrahan Director, RVAC Stanford University.

The Value of Visualization

It is possible to improve human performance by 100:1

Faster solution

Fewer errors

Better comprehension

The best representation depends on the problem

Page 28: Foundations of Visual Analytics Pat Hanrahan Director, RVAC Stanford University.

Number Representations

Norman and Zhang

Page 29: Foundations of Visual Analytics Pat Hanrahan Director, RVAC Stanford University.

Number Representations

Counting – Tallying

Adding – Roman numerals

Multiplication – Arabic number systems

XXIII + XII = XXXIIIII = XXXV

Page 30: Foundations of Visual Analytics Pat Hanrahan Director, RVAC Stanford University.

Zhang and Norman, The Representations of Numbers,

Cognition, 57, 271-295, 1996

Page 31: Foundations of Visual Analytics Pat Hanrahan Director, RVAC Stanford University.

Distributed Cognition

1. Separate power & base I E

2. Get base value E I

3. Multiply base values I I

4. Get power values I E

5. Add power values I E

6. Combine base & power I E

7. Add results I E

Roman Arabic

Arabic more efficient than Roman

External (E) vs. Internal (I) process

Page 32: Foundations of Visual Analytics Pat Hanrahan Director, RVAC Stanford University.

Long-Hand Multiplication

34x 72

68238

2448

From “Introduction to Information Visualization,”

Card, Schneiderman, Mackinlay

Page 33: Foundations of Visual Analytics Pat Hanrahan Director, RVAC Stanford University.

Power of Representations

The representational effect

Different representations have different cost-structures / ”running” times

Distributed cognition

Internal representations (mental models)

External representations (cognitive artifacts)

Representations 101

Representations are not the real thing

Manipulate symbols to perform useful work

Page 34: Foundations of Visual Analytics Pat Hanrahan Director, RVAC Stanford University.
Page 35: Foundations of Visual Analytics Pat Hanrahan Director, RVAC Stanford University.

Modeling and Simulation

Simulation for computer graphics is sophisticated

Diversity of phenomenon

Complexity of the environment

Robustness

Range of models: fast to accurate

Lots of breakthroughs: one small example is GPUs which may become the major platform for scientific computation

Page 36: Foundations of Visual Analytics Pat Hanrahan Director, RVAC Stanford University.

Mathematics of Visual Analysis

MSRI, Berkeley, CA, Oct 16-17, 2006

Organizers: P. Hanrahan, W. Cleveland, S. Harabagliu, P. Jones, L. Wilkinson

Participants: J. Arvo, A. Braverman, J. Byrnes, E. Candes, D. Carr, S. Chan, N. Chinchor, N. Coehlo, V. de Silva, L. Edlefsen, R. Gentleman, G. Lebanon, J. Lewis, J. Mackinlay, M. Mahoney, R. May, N. Meinshausen, F. Meyer, M. Muthukrishnan, D. Nolan, J-M. Pomarede, C. Posse, E. Purdom, D. Purdy, L. Rosenblum, N. Saito, M. Sips, D. W. Temple Lang, J. Thomas, D. Vainsencher, A. Vasilescu, S. Venkatasubramanian, Y. Wang, C. Wickham, R. Wong Kew

Page 37: Foundations of Visual Analytics Pat Hanrahan Director, RVAC Stanford University.

Supporting Interaction

Panelists: William Cleveland, Robert Gentleman, Muthu Muthukrishnan, Suresh Venkatasubramanian, Emmanuel Candez

Fast algorithms: streaming and approximate algorithms, compressed sensing, randomized numerical linear algebra, …

Fast systems: map-reduce, column stores, beyond R, …

Page 38: Foundations of Visual Analytics Pat Hanrahan Director, RVAC Stanford University.

Finding Patterns

Panelists: Peter Jones, Vin de Silva, Francois Meyer, Naoki Saito, Michael Mahoney

How to represent patterns?

Data/dimensional reduction vs. transformation to meaningful form?

Are humans required to build good models? How is domain knowledge added?

When are computers good pattern finders? When are people good pattern finders?

Page 39: Foundations of Visual Analytics Pat Hanrahan Director, RVAC Stanford University.

Computation Steeringvs.

Interactive Simulation

Page 40: Foundations of Visual Analytics Pat Hanrahan Director, RVAC Stanford University.

Integrating Heterogenous Data

Panelists: Sanda Harabagliu, John Byrnes, Jean-Michel Pomeranz, Christian Posse, Guy Lebanon

Many important datatypes: text and language, audio, video, image, sensors, logs, transactions, nD relations, …

How to fuse into common semantic representation?

Beyond the desktop to new representations of information spaces: vispedia, jigsaw, …

Page 41: Foundations of Visual Analytics Pat Hanrahan Director, RVAC Stanford University.

Smart Visual Analysis

Panelists: Leland Wilkinson, Jock Mackinlay, Jim Arvo, Amy Braverman, Dan Carr

Automatic graphical presentation and summarization; guided analysis

How do people reason about uncertainty?

Page 42: Foundations of Visual Analytics Pat Hanrahan Director, RVAC Stanford University.

Summary

Visual analytics merges

Cognitive psychology

Mathematics and computation (algm, stat, nlp)

Interactive visualization techniques

Need to rethink how these capabilities are combined