SPATIAL AWARENESS DEMO 20 juni 2008 detection of self motion sensing body orientation in space...

48
SPATIAL AWARENESS DEMO 20 juni 2008 detection of self motion sensing body orientation in space visual perception in earth-centric

Transcript of SPATIAL AWARENESS DEMO 20 juni 2008 detection of self motion sensing body orientation in space...

Page 1: SPATIAL AWARENESS DEMO 20 juni 2008 detection of self motion sensing body orientation in space visual perception in earth-centric coordinates.

SPATIAL AWARENESS DEMO

20 juni 2008

detection of self motion sensing body orientation in space visual perception in earth-centric coordinates

Page 2: SPATIAL AWARENESS DEMO 20 juni 2008 detection of self motion sensing body orientation in space visual perception in earth-centric coordinates.

VESTIBULAR SENSORS

canals

otoliths

Page 3: SPATIAL AWARENESS DEMO 20 juni 2008 detection of self motion sensing body orientation in space visual perception in earth-centric coordinates.

CANALS DETECT ROTATION

high-pass filter

insensitive to constant velocity rotation

nerve fibers code head velocity

Page 4: SPATIAL AWARENESS DEMO 20 juni 2008 detection of self motion sensing body orientation in space visual perception in earth-centric coordinates.

CONSTANT ROTATION IN DARKNESS

• rotation percept decays

• after stop, percept of rotation in opposite direction

• reflects cupular mechanics

Page 5: SPATIAL AWARENESS DEMO 20 juni 2008 detection of self motion sensing body orientation in space visual perception in earth-centric coordinates.

OTOLITHS

sensitive to tilt and translation

Page 6: SPATIAL AWARENESS DEMO 20 juni 2008 detection of self motion sensing body orientation in space visual perception in earth-centric coordinates.

OTOLITH SIGNAL IS AMBIGUOUS

hair cells cannot distinguish tilt and translation

Page 7: SPATIAL AWARENESS DEMO 20 juni 2008 detection of self motion sensing body orientation in space visual perception in earth-centric coordinates.

SPATIAL ORIENTATION ILLUSION

pilot is upright, but feels tilted

Page 8: SPATIAL AWARENESS DEMO 20 juni 2008 detection of self motion sensing body orientation in space visual perception in earth-centric coordinates.

AMBIGUITY PROBLEM

otolith signal may have various causes:

• translation (a)• force of gravity due to tilt (g)• combination of a and g

How can the brain resolve this ambiguity ?

inverse problem

Page 9: SPATIAL AWARENESS DEMO 20 juni 2008 detection of self motion sensing body orientation in space visual perception in earth-centric coordinates.

CANAL- OTOLITH INTERACTION MODEL

• canals detect rotation during tilt changes

• their signal helps to decompose otolith signal

Angelaki et al. (1999)

Page 10: SPATIAL AWARENESS DEMO 20 juni 2008 detection of self motion sensing body orientation in space visual perception in earth-centric coordinates.

CANAL–OTOLITH INTERACTION MODEL

basic principle:- tilt stimulates otoliths AND canals- translation stimulates only otoliths

Merfeld and Zupan (2002) J. Neurophysiology

tilt angle

linear acceleration

angular velocity

Page 11: SPATIAL AWARENESS DEMO 20 juni 2008 detection of self motion sensing body orientation in space visual perception in earth-centric coordinates.

OVAR

Vingerhoets et al. (2006) J. Neurophysiol.

Vingerhoets et al. (2007) J. Neurophysiol.

TESTING THE MODEL

Page 12: SPATIAL AWARENESS DEMO 20 juni 2008 detection of self motion sensing body orientation in space visual perception in earth-centric coordinates.

THE ACTUAL MOTION

- rotation about tilted axis

- in darkness

- constant velocity

Page 13: SPATIAL AWARENESS DEMO 20 juni 2008 detection of self motion sensing body orientation in space visual perception in earth-centric coordinates.

MODEL PREDICTIONS

rotation signal decays gradually

wrong interpretation otolith signal: illusory translation percept

Page 14: SPATIAL AWARENESS DEMO 20 juni 2008 detection of self motion sensing body orientation in space visual perception in earth-centric coordinates.

SCHEMATIC SUMMARY OF RESULTS

confirms prediction

rotation percept

translation percept

Actual motion:

Percept:

Page 15: SPATIAL AWARENESS DEMO 20 juni 2008 detection of self motion sensing body orientation in space visual perception in earth-centric coordinates.

TRANSLATION AND ROTATION PERCEPT DATA

rotation percept

translation percept

Page 16: SPATIAL AWARENESS DEMO 20 juni 2008 detection of self motion sensing body orientation in space visual perception in earth-centric coordinates.

SPATIAL PERCEPTION IN STATIC TILT

Page 17: SPATIAL AWARENESS DEMO 20 juni 2008 detection of self motion sensing body orientation in space visual perception in earth-centric coordinates.

SENSING THE DIRECTION OF GRAVITY

Two different tasks:

1. Set line to vertical (SVV)

2. Estimate your body tilt (SBT)

Van Beuzekom & Van Gisbergen (2000) J. Neurophysiol.

Van Beuzekom et al. (2001) Vision Res.

Kaptein & Van Gisbergen (2004, 2005) J. Neurophysiol.

De Vrijer et al. (2008) J. Neurophysiol.

experiments in darkness

Page 18: SPATIAL AWARENESS DEMO 20 juni 2008 detection of self motion sensing body orientation in space visual perception in earth-centric coordinates.

ACCURACY vs PRECISION

Accuracy:

How close is the response to the true value?

Precision:

How reproducible is the response?

darts analogy:

Page 19: SPATIAL AWARENESS DEMO 20 juni 2008 detection of self motion sensing body orientation in space visual perception in earth-centric coordinates.

ACCURACY AND PRECISION IN LINE TASK (SVV)

accuracy

precision

De Vrijer et al. (2008) J. Neurophysiol.

De Vrijer et al. (2008) in progress

Page 20: SPATIAL AWARENESS DEMO 20 juni 2008 detection of self motion sensing body orientation in space visual perception in earth-centric coordinates.

ACCURACY IN LINE TASK

due to underestimation of body tilt?

Page 21: SPATIAL AWARENESS DEMO 20 juni 2008 detection of self motion sensing body orientation in space visual perception in earth-centric coordinates.

NO UNDERESTIMATION OF BODY TILT

SVV SBT

• Subjects know quite well how they are tilted (SBT)

• Yet, their line settings undercompensate for tilt (SVV)

Van Beuzekom et al. (2001) Vision Res.

Kaptein and Van Gisbergen (2004) J. Neurophysiol.

Page 22: SPATIAL AWARENESS DEMO 20 juni 2008 detection of self motion sensing body orientation in space visual perception in earth-centric coordinates.

PRECISION IN LINE TASK

is scatter in SVV simply reflection of noise in body tilt signal?

De Vrijer et al. (2008) J. Neurophysiol.

De Vrijer et al. (2008) in progress

Page 23: SPATIAL AWARENESS DEMO 20 juni 2008 detection of self motion sensing body orientation in space visual perception in earth-centric coordinates.

SVV LESS NOISY THAN SBT

De Vrijer et al. in progress

psychometric experiments at 0o and 90o tilt:

Page 24: SPATIAL AWARENESS DEMO 20 juni 2008 detection of self motion sensing body orientation in space visual perception in earth-centric coordinates.

SVV LESS NOISY THAN SBT

Page 25: SPATIAL AWARENESS DEMO 20 juni 2008 detection of self motion sensing body orientation in space visual perception in earth-centric coordinates.

SUMMARY SBT AND SVV DATA

Two paradoxical findings:

1. subject knows tilt angle, yet makes biased line settings

2. more certain about line setting than about body tilt

estimate body tilt (SBT) adjust line to vertical (SVV)

Page 26: SPATIAL AWARENESS DEMO 20 juni 2008 detection of self motion sensing body orientation in space visual perception in earth-centric coordinates.

SBT DATA SHOW:

• An unbiased head tilt signal is available

• Noise increases with tilt angle

Page 27: SPATIAL AWARENESS DEMO 20 juni 2008 detection of self motion sensing body orientation in space visual perception in earth-centric coordinates.

SIGNALS REQUIRED FOR SPATIAL VISION

retinal signal

to compute line in space (Ls), brain must combine info about line orientation on retina (LR) and head tilt (HS)

head-tilt signal

Page 28: SPATIAL AWARENESS DEMO 20 juni 2008 detection of self motion sensing body orientation in space visual perception in earth-centric coordinates.

SIMPLY USING RAW TILT SIGNAL …

would not explain SVV bias !!spatial vision would be accurate, but noisy

raw tilt signal

Page 29: SPATIAL AWARENESS DEMO 20 juni 2008 detection of self motion sensing body orientation in space visual perception in earth-centric coordinates.

A BAYESIAN PERSPECTIVE

IDEAL OBSERVER MODEL

Page 30: SPATIAL AWARENESS DEMO 20 juni 2008 detection of self motion sensing body orientation in space visual perception in earth-centric coordinates.

IDEAL OBSERVER STRATEGY

1) Use sensory data: noisy tilt signal suggests range of possible tilt angles (likelihood)

2) Use prior knowledge: we know that large tilt angles are very uncommon (prior)

3) Most likely tilt angle (posterior) is product of likelihood and prior

Eggert (1998) PhD Thesis, Munich

MacNeilage et al. (2007) Exp. Brain Res.

De Vrijer et al. (2008) J. Neurophysiol.

Page 31: SPATIAL AWARENESS DEMO 20 juni 2008 detection of self motion sensing body orientation in space visual perception in earth-centric coordinates.

IDEAL OBSERVER STRATEGY

Tilt prior has 2 effects on SVV:

• Less noise

• Bias at large tilt

Page 32: SPATIAL AWARENESS DEMO 20 juni 2008 detection of self motion sensing body orientation in space visual perception in earth-centric coordinates.

WHY WOULD THIS MAKE SENSE?

1) Less noise in spatial vision

2) Downside: bias at large tilts

3) Average performance improves (large tilts are rare)

Page 33: SPATIAL AWARENESS DEMO 20 juni 2008 detection of self motion sensing body orientation in space visual perception in earth-centric coordinates.

DEMO

BIAS EFFECT INCREASES WITH TILT

Page 34: SPATIAL AWARENESS DEMO 20 juni 2008 detection of self motion sensing body orientation in space visual perception in earth-centric coordinates.

no bias

De Vrijer et al. (2008) J. Neurophysiology

no bias

Page 35: SPATIAL AWARENESS DEMO 20 juni 2008 detection of self motion sensing body orientation in space visual perception in earth-centric coordinates.
Page 36: SPATIAL AWARENESS DEMO 20 juni 2008 detection of self motion sensing body orientation in space visual perception in earth-centric coordinates.

small bias

small bias

Page 37: SPATIAL AWARENESS DEMO 20 juni 2008 detection of self motion sensing body orientation in space visual perception in earth-centric coordinates.

large bias

Page 38: SPATIAL AWARENESS DEMO 20 juni 2008 detection of self motion sensing body orientation in space visual perception in earth-centric coordinates.

large bias

Page 39: SPATIAL AWARENESS DEMO 20 juni 2008 detection of self motion sensing body orientation in space visual perception in earth-centric coordinates.

MODEL PARAMETERS

1) head tilt noise level in upright

2) increase of head tilt noise with tilt

3) prior width

4) eye torsion amplitude

Page 40: SPATIAL AWARENESS DEMO 20 juni 2008 detection of self motion sensing body orientation in space visual perception in earth-centric coordinates.

MODEL FITS: SVV ACCURACY

Page 41: SPATIAL AWARENESS DEMO 20 juni 2008 detection of self motion sensing body orientation in space visual perception in earth-centric coordinates.

MODEL FITS: SVV ACCURACY

< 0

Page 42: SPATIAL AWARENESS DEMO 20 juni 2008 detection of self motion sensing body orientation in space visual perception in earth-centric coordinates.

MODEL EXPLANATION OF NOISE LEVELS:SVV vs SBT PRECISION

• SVV is less noisy than the SBT (remarkable, but explained by model)

• SBT becomes more noisy at larger tilt (supports model assumption)

• SBT noise levels compatible with head-tilt fit results

Page 43: SPATIAL AWARENESS DEMO 20 juni 2008 detection of self motion sensing body orientation in space visual perception in earth-centric coordinates.

CONCLUSION

Accuracy-precision trade-off in spatial vision:

• Bayesian strategy reduces noise at small tilts

• causes systematic errors at large tilts

Page 44: SPATIAL AWARENESS DEMO 20 juni 2008 detection of self motion sensing body orientation in space visual perception in earth-centric coordinates.

ACTIVE-TILT RESULTS ARE SIMILAR

body tilt estimates are quite accurate

but large errors in line task

line task body tilt estimate

Van Beuzekom et al. (2001) Vision Res.

Page 45: SPATIAL AWARENESS DEMO 20 juni 2008 detection of self motion sensing body orientation in space visual perception in earth-centric coordinates.

psychometrische curvevan 0o tilt percept

proefpersoon wordt vaak in allerlei standen rond 0o gekanteld

beoordeelt elke stand als links of rechts

geen scherpe drempel door ruis in tiltsignaal

Page 46: SPATIAL AWARENESS DEMO 20 juni 2008 detection of self motion sensing body orientation in space visual perception in earth-centric coordinates.

Ruis tiltsignaal bij 00

psychometrische kromme

ruis in tiltsignaal

Page 47: SPATIAL AWARENESS DEMO 20 juni 2008 detection of self motion sensing body orientation in space visual perception in earth-centric coordinates.

Ruis tiltsignaal bij 0 en 90o

meer ruis bij 90o

Page 48: SPATIAL AWARENESS DEMO 20 juni 2008 detection of self motion sensing body orientation in space visual perception in earth-centric coordinates.

Ruis tiltsignaal bij 0 en 90o

resultaten 5 proefpersonen

meer ruis bij 90o