UNVEILING THE HIDDEN SENSE Farewell lecture May 30, 2008.

52
UNVEILING THE HIDDEN SENSE Farewell lecture May 30, 2008

Transcript of UNVEILING THE HIDDEN SENSE Farewell lecture May 30, 2008.

Page 1: UNVEILING THE HIDDEN SENSE Farewell lecture May 30, 2008.

UNVEILING THE HIDDEN SENSE

Farewell lectureMay 30, 2008

Page 2: UNVEILING THE HIDDEN SENSE Farewell lecture May 30, 2008.

VESTIBULAR CONTRIBUTION TO SPATIAL AWARENESS

detection of self motion sensing body orientation in space visual perception in earth-centric coordinates

Page 3: UNVEILING THE HIDDEN SENSE Farewell lecture May 30, 2008.

SCOPE

Vestibular sensors

Spatial orientation in dynamic conditions

Spatial vision in tilted observers

Bayesian model

Page 4: UNVEILING THE HIDDEN SENSE Farewell lecture May 30, 2008.

VESTIBULAR SENSORS

canals

otoliths

Page 5: UNVEILING THE HIDDEN SENSE Farewell lecture May 30, 2008.

CANALS DETECT ROTATION

high-pass filter

insensitive to constant velocity rotation

nerve fibers code head velocity

Page 6: UNVEILING THE HIDDEN SENSE Farewell lecture May 30, 2008.

CONSTANT ROTATION IN DARKNESS

• rotation percept decays

• after stop, percept of rotation in opposite direction

• reflects cupular mechanics

Page 7: UNVEILING THE HIDDEN SENSE Farewell lecture May 30, 2008.

OTOLITHS

sensitive to tilt and translation

Page 8: UNVEILING THE HIDDEN SENSE Farewell lecture May 30, 2008.

OTOLITH SIGNAL IS AMBIGUOUS

hair cells cannot distinguish tilt and translation

Page 9: UNVEILING THE HIDDEN SENSE Farewell lecture May 30, 2008.

AMBIGUITY PROBLEM

otolith signal may have various causes:

• translation (a)• force of gravity due to tilt (g)• combination of a and g

How can the brain resolve this ambiguity ?

inverse problem

Page 10: UNVEILING THE HIDDEN SENSE Farewell lecture May 30, 2008.

CANAL- OTOLITH INTERACTION MODEL

• canals detect rotation during tilt changes

• their signal helps to decompose otolith signal

Angelaki et al. (1999)

Page 11: UNVEILING THE HIDDEN SENSE Farewell lecture May 30, 2008.

CANAL–OTOLITH INTERACTION MODEL

basic principle:- tilt stimulates otoliths AND canals- translation stimulates only otoliths

Merfeld and Zupan (2002) J. Neurophysiology

tilt angle

linear acceleration

angular velocity

Page 12: UNVEILING THE HIDDEN SENSE Farewell lecture May 30, 2008.

percepts during rotation about a tilted axis

(OVAR)

Vingerhoets et al. (2006) J. Neurophysiol.

Vingerhoets et al. (2007) J. Neurophysiol.

TESTING THE MODEL

Page 13: UNVEILING THE HIDDEN SENSE Farewell lecture May 30, 2008.

THE ACTUAL MOTION

- rotation about tilted axis

- in darkness

- constant velocity

Page 14: UNVEILING THE HIDDEN SENSE Farewell lecture May 30, 2008.

MODEL PREDICTIONS

rotation signal decays gradually

wrong interpretation otolith signal: illusory translation percept

Page 15: UNVEILING THE HIDDEN SENSE Farewell lecture May 30, 2008.

SCHEMATIC SUMMARY OF RESULTS

confirms prediction

rotation percept

translation percept

Actual motion:

Percept:

Page 16: UNVEILING THE HIDDEN SENSE Farewell lecture May 30, 2008.

TRANSLATION AND ROTATION PERCEPT DATA

rotation percept

translation percept

Page 17: UNVEILING THE HIDDEN SENSE Farewell lecture May 30, 2008.

SPATIAL PERCEPTION IN STATIC TILT

Page 18: UNVEILING THE HIDDEN SENSE Farewell lecture May 30, 2008.

SENSING THE DIRECTION OF GRAVITY

Two different tasks:

1. Set line to vertical (SVV)

2. Estimate your body tilt (SBT)

Van Beuzekom & Van Gisbergen (2000) J. Neurophysiol.

Van Beuzekom et al. (2001) Vision Res.

Kaptein & Van Gisbergen (2004, 2005) J. Neurophysiol.

De Vrijer et al. (2008) J. Neurophysiol.

experiments in darkness

Page 19: UNVEILING THE HIDDEN SENSE Farewell lecture May 30, 2008.

ACCURACY vs PRECISION

Accuracy:

How close is the response to the true value?

Precision:

How reproducible is the response?

darts analogy:

Page 20: UNVEILING THE HIDDEN SENSE Farewell lecture May 30, 2008.

ACCURACY AND PRECISION IN LINE TASK (SVV)

accuracy

precision

De Vrijer et al. (2008) J. Neurophysiol.

De Vrijer et al. (2008) in progress

Page 21: UNVEILING THE HIDDEN SENSE Farewell lecture May 30, 2008.

ACCURACY IN LINE TASK

due to underestimation of body tilt?

Page 22: UNVEILING THE HIDDEN SENSE Farewell lecture May 30, 2008.

NO UNDERESTIMATION OF BODY TILT

SVV SBT

• Subjects know quite well how they are tilted (SBT)

• Yet, their line settings undercompensate for tilt (SVV)

Van Beuzekom et al. (2001) Vision Res.

Kaptein and Van Gisbergen (2004) J. Neurophysiol.

Page 23: UNVEILING THE HIDDEN SENSE Farewell lecture May 30, 2008.

PRECISION IN LINE TASK

is scatter in SVV simply reflection of noise in body tilt signal?

De Vrijer et al. (2008) J. Neurophysiol.

De Vrijer et al. (2008) in progress

Page 24: UNVEILING THE HIDDEN SENSE Farewell lecture May 30, 2008.

SVV LESS NOISY THAN SBT

De Vrijer et al. in progress

psychometric experiments at 0o and 90o tilt:

Page 25: UNVEILING THE HIDDEN SENSE Farewell lecture May 30, 2008.

SVV LESS NOISY THAN SBT

Page 26: UNVEILING THE HIDDEN SENSE Farewell lecture May 30, 2008.

SUMMARY SBT AND SVV DATA

Two paradoxical findings:

1. subject knows tilt angle, yet makes biased line settings

2. more certain about line setting than about body tilt

estimate body tilt (SBT) adjust line to vertical (SVV)

Page 27: UNVEILING THE HIDDEN SENSE Farewell lecture May 30, 2008.

SBT DATA SHOW:

• An unbiased head tilt signal is available

• Noise increases with tilt angle

Page 28: UNVEILING THE HIDDEN SENSE Farewell lecture May 30, 2008.

SIGNALS REQUIRED FOR SPATIAL VISION

retinal signal

to compute line in space (Ls), brain must combine info about line orientation on retina (LR) and head tilt (HS)

head-tilt signal

Page 29: UNVEILING THE HIDDEN SENSE Farewell lecture May 30, 2008.

SIMPLY USING RAW TILT SIGNAL …

would not explain SVV bias !!spatial vision would be accurate, but noisy

raw tilt signal

Page 30: UNVEILING THE HIDDEN SENSE Farewell lecture May 30, 2008.

A BAYESIAN PERSPECTIVE

IDEAL OBSERVER MODEL

Page 31: UNVEILING THE HIDDEN SENSE Farewell lecture May 30, 2008.

IDEAL OBSERVER STRATEGY

1) Use sensory data: noisy tilt signal suggests range of possible tilt angles (likelihood)

2) Use prior knowledge: we know that large tilt angles are very uncommon (prior)

3) Most likely tilt angle (posterior) is product of likelihood and prior

Eggert (1998) PhD Thesis, Munich

MacNeilage et al. (2007) Exp. Brain Res.

De Vrijer et al. (2008) J. Neurophysiol.

Page 32: UNVEILING THE HIDDEN SENSE Farewell lecture May 30, 2008.

IDEAL OBSERVER STRATEGY

Tilt prior has 2 effects on SVV:

• Less noise

• Bias at large tilt

Page 33: UNVEILING THE HIDDEN SENSE Farewell lecture May 30, 2008.

WHY WOULD THIS MAKE SENSE?

1) Less noise in spatial vision

2) Downside: bias at large tilts

3) Average performance improves (large tilts are rare)

Page 34: UNVEILING THE HIDDEN SENSE Farewell lecture May 30, 2008.

DEMO

BIAS EFFECT INCREASES WITH TILT

Page 35: UNVEILING THE HIDDEN SENSE Farewell lecture May 30, 2008.

no bias

De Vrijer et al. (2008) J. Neurophysiology

no bias

Page 36: UNVEILING THE HIDDEN SENSE Farewell lecture May 30, 2008.
Page 37: UNVEILING THE HIDDEN SENSE Farewell lecture May 30, 2008.

small bias

small bias

Page 38: UNVEILING THE HIDDEN SENSE Farewell lecture May 30, 2008.

large bias

Page 39: UNVEILING THE HIDDEN SENSE Farewell lecture May 30, 2008.

large bias

Page 40: UNVEILING THE HIDDEN SENSE Farewell lecture May 30, 2008.

MODEL PARAMETERS

1) head tilt noise level in upright

2) increase of head tilt noise with tilt

3) prior width

4) eye torsion amplitude

Page 41: UNVEILING THE HIDDEN SENSE Farewell lecture May 30, 2008.

MODEL FITS: SVV ACCURACY

Page 42: UNVEILING THE HIDDEN SENSE Farewell lecture May 30, 2008.

MODEL FITS: SVV ACCURACY

< 0

Page 43: UNVEILING THE HIDDEN SENSE Farewell lecture May 30, 2008.

MODEL EXPLANATION OF NOISE LEVELS:SVV vs SBT PRECISION

• SVV is less noisy than the SBT (remarkable, but explained by model)

• SBT becomes more noisy at larger tilt (supports model assumption)

• SBT noise levels compatible with head-tilt fit results

Page 44: UNVEILING THE HIDDEN SENSE Farewell lecture May 30, 2008.

CONCLUSION

Accuracy-precision trade-off in spatial vision:

• Bayesian strategy reduces noise at small tilts

• causes systematic errors at large tilts

Page 45: UNVEILING THE HIDDEN SENSE Farewell lecture May 30, 2008.

ACKNOWLEDGMENTS

Page 46: UNVEILING THE HIDDEN SENSE Farewell lecture May 30, 2008.

COWORKERS OCULOMOTOR CONTROL

David Robinson

Stan Gielen

Fenno Ottes

John van Opstal

Arend Smit

André Minken

Karin Krommenhoek

Bart Melis

Vivek Chaturvedi

Lo Bour

DIck Stegeman

Klaus Kopec

Hubert Misslisch

Page 47: UNVEILING THE HIDDEN SENSE Farewell lecture May 30, 2008.

COWORKERS SPATIAL AWARENESS

Anton Van Beuzekom

Ronald Kaptein

Rens Vingerhoets

Stan Van Pelt

Maaike De Vrijer

Pieter Medendorp

Page 48: UNVEILING THE HIDDEN SENSE Farewell lecture May 30, 2008.

TECHNICAL SUPPORT

Ger van Lingen

Victor Langeveld

Günter Windau

Hans Kleijnen

Ton van Dreumel

Stijn Martens

Wil Corbeek, Harrie van Brakel,

Arno Engels, Jaap Nieboer (TD-FNWI)

Fred Philipsen, Theo Arts (CDL)

Page 49: UNVEILING THE HIDDEN SENSE Farewell lecture May 30, 2008.

FOR THIS SYMPOSIUM:

THE SPEAKERS:

Dora Angelaki

Bernhard Hess

Daniel Merfeld

Casper Erkelens

Wolfgang Becker

Jos Eggermont

THE ORGANIZERS:

Pieter Medendorp

John van Opstal

Stan Gielen

Margiet van Pelt

Page 50: UNVEILING THE HIDDEN SENSE Farewell lecture May 30, 2008.

FOR MORAL SUPPORT

Page 51: UNVEILING THE HIDDEN SENSE Farewell lecture May 30, 2008.

THANK YOU FOR COMING !!

Page 52: UNVEILING THE HIDDEN SENSE Farewell lecture May 30, 2008.

THANK YOU FOR COMING !!