Cavanagh's pseudorealism Jan 23 - David Thompson.

33
cavanagh's pseudorealism n 23 - David Thompson

Transcript of Cavanagh's pseudorealism Jan 23 - David Thompson.

Page 1: Cavanagh's pseudorealism Jan 23 - David Thompson.

cavanagh's pseudorealism

Jan 23 - David Thompson

Page 2: Cavanagh's pseudorealism Jan 23 - David Thompson.

(Outline)

1. Marr's Model2. Cavanagh's Model 3. What more can artists tell us about vision?

Page 3: Cavanagh's pseudorealism Jan 23 - David Thompson.

the Marr vision model

Page 4: Cavanagh's pseudorealism Jan 23 - David Thompson.

the Marr vision model

input image

Page 5: Cavanagh's pseudorealism Jan 23 - David Thompson.

the Marr vision model

primal sketch

Page 6: Cavanagh's pseudorealism Jan 23 - David Thompson.

the Marr vision model

2.5-D sketch

Page 7: Cavanagh's pseudorealism Jan 23 - David Thompson.

the Marr vision model

3D model

Page 8: Cavanagh's pseudorealism Jan 23 - David Thompson.

stimulus

2½D sketch

Object

3D model

primal sketch

viewer-centric coordinates

object-centric coordinates

the Marr vision model

Page 9: Cavanagh's pseudorealism Jan 23 - David Thompson.

stimulus

2½D sketch

Object

3D model

bottom-up reconstruction of shape from image features

recognition with object-centric 3D models

primal sketch

viewer-centric coordinates

object-centric coordinates

the Marr vision model

Page 10: Cavanagh's pseudorealism Jan 23 - David Thompson.

Geons(Biederman '87)

Page 11: Cavanagh's pseudorealism Jan 23 - David Thompson.

Cavanagh's model

Page 12: Cavanagh's pseudorealism Jan 23 - David Thompson.

two-tone images

Page 13: Cavanagh's pseudorealism Jan 23 - David Thompson.
Page 14: Cavanagh's pseudorealism Jan 23 - David Thompson.
Page 15: Cavanagh's pseudorealism Jan 23 - David Thompson.

hair (not shadow!)

inferred external contours

“attached shadow” contour

“cast shadow” contour

Page 16: Cavanagh's pseudorealism Jan 23 - David Thompson.
Page 17: Cavanagh's pseudorealism Jan 23 - David Thompson.

A. Finding 3D structure in two-tone images requires distinguishing cast shadows, attached shadows, and areas of low reflectivity

B. The images do not contain this information a priori

D. Therefore, our recognition process must involve matching viewpoint-specific 2D templates

Cavanagh's claim

Page 18: Cavanagh's pseudorealism Jan 23 - David Thompson.
Page 19: Cavanagh's pseudorealism Jan 23 - David Thompson.

What else can art tell us about object recognition?

Cavanagh's model

Page 20: Cavanagh's pseudorealism Jan 23 - David Thompson.

What else can art tell us about object recognition?

Cavanagh's model

neurobiological evidence!(Logothetis '95)

Page 21: Cavanagh's pseudorealism Jan 23 - David Thompson.

What else can art tell us about object recognition?

Cavanagh's model

stimulus

2D shape

memory

3D shape

top-down feedback

basic recognition with 2D primitives

Page 22: Cavanagh's pseudorealism Jan 23 - David Thompson.
Page 23: Cavanagh's pseudorealism Jan 23 - David Thompson.

shadows and lighting

Page 24: Cavanagh's pseudorealism Jan 23 - David Thompson.
Page 25: Cavanagh's pseudorealism Jan 23 - David Thompson.
Page 26: Cavanagh's pseudorealism Jan 23 - David Thompson.

transparency

Page 27: Cavanagh's pseudorealism Jan 23 - David Thompson.

humans don't do ray tracing

Page 28: Cavanagh's pseudorealism Jan 23 - David Thompson.
Page 29: Cavanagh's pseudorealism Jan 23 - David Thompson.
Page 30: Cavanagh's pseudorealism Jan 23 - David Thompson.

line drawings are universal

Page 31: Cavanagh's pseudorealism Jan 23 - David Thompson.

recognition with few cues

Page 32: Cavanagh's pseudorealism Jan 23 - David Thompson.

Human object recognition uses shortcuts, not complete physical models - local lighting - simplified reflections

At least some of our processing happens through “simple vision” - viewer-centric 2D template matching - simple 3D memory provides top-down feedback

take-home lessons?

Page 33: Cavanagh's pseudorealism Jan 23 - David Thompson.

Marr's model (circa 1980) Cavanagh's model (circa 1990)

Two models of Human visual processing

stimulus

stimulus

2D shape

memory

3D shape

2½D sketch

Object

3D model

feedback

basic recognition with 2D primitives

reconstruction of shape from image features

object recognition by matching 3D models

primal sketch