Early Occurrence Of Auditory Change Detection In The Human ... · Brain Res Grimm et al., 2012,...

23
Early Occurrence Of Auditory Change Detection In The Human Brain SABINE GRIMM University of Leipzig, Germany (formerly University of Barcelona, Spain) ICON, Brisbane, July 28 th , 2014

Transcript of Early Occurrence Of Auditory Change Detection In The Human ... · Brain Res Grimm et al., 2012,...

Page 1: Early Occurrence Of Auditory Change Detection In The Human ... · Brain Res Grimm et al., 2012, Biol Psychol Cornella et al. 2012, PLoS One Pa/Nb enhancement for ... * acting in a

Early Occurrence Of Auditory Change

Detection In The Human Brain

SABINE GRIMM University of Leipzig, Germany (formerly University of Barcelona, Spain)

ICON, Brisbane, July 28th, 2014

Page 2: Early Occurrence Of Auditory Change Detection In The Human ... · Brain Res Grimm et al., 2012, Biol Psychol Cornella et al. 2012, PLoS One Pa/Nb enhancement for ... * acting in a

from: Schröger, 2005 from: Ulanovsky et al. , 2004

Human scalp potential Animal multi-/single-unit responses from A1

Astonishing similarities in their characteristics! (see Nelken et al., 2007)

similar relation to magnitude of change, to probability of deviant events, to the number of

standards; similar local effects in 50-50% conditions;

Auditory deviance detection in animals and humans 2

The auditory system constantly scans the acoustic input for regularities and respectively for unexpected, novel events!

Page 3: Early Occurrence Of Auditory Change Detection In The Human ... · Brain Res Grimm et al., 2012, Biol Psychol Cornella et al. 2012, PLoS One Pa/Nb enhancement for ... * acting in a

Animal studies

Neurons that show SSA have been reported in primary auditory cortex (A1, Ulanovsky et al.

2003, 2004) and in subcortical areas (IC and MGB, Pérez-González et al.,

2005; Antunes et al., 2010)

Generators of MMN are localized in auditory cortical areas and frontal cortex (Alho, 1995; Huotilainen

et al., 1998)

Human studies

Early occurrence of animal SSA

Release from SSA occurs already within the first 30 ms after deviant onset (Pérez-

González et al., 2005; von der Behrens et al., 2009)

MMN peaks between 100-250 ms

3

Page 4: Early Occurrence Of Auditory Change Detection In The Human ... · Brain Res Grimm et al., 2012, Biol Psychol Cornella et al. 2012, PLoS One Pa/Nb enhancement for ... * acting in a

Are there any human correlates of deviance detection at earlier latencies than those of MMN, that could bridge the

gap to novelty-related responses recorded in animal studies?

Page 5: Early Occurrence Of Auditory Change Detection In The Human ... · Brain Res Grimm et al., 2012, Biol Psychol Cornella et al. 2012, PLoS One Pa/Nb enhancement for ... * acting in a

In principle, one should be able to use the Auditory Evoked Potential, in its whole complex morphology, to tackle this question.

1. The Auditory Brainstem Response [ABR].

Is human deviance detection a multi-stage process?

Page 6: Early Occurrence Of Auditory Change Detection In The Human ... · Brain Res Grimm et al., 2012, Biol Psychol Cornella et al. 2012, PLoS One Pa/Nb enhancement for ... * acting in a

In principle, one should be able to use the Auditory Evoked Potential, in its whole complex morphology, to tackle this question.

1. The Auditory Brainstem Response [ABR].

2. The Middle Latency Response [MLR].

Is human deviance detection a multi-stage process?

Page 7: Early Occurrence Of Auditory Change Detection In The Human ... · Brain Res Grimm et al., 2012, Biol Psychol Cornella et al. 2012, PLoS One Pa/Nb enhancement for ... * acting in a

In principle, one should be able to use the Auditory Evoked Potential, in its whole complex morphology, to tackle this question.

1. The Auditory Brainstem Response [ABR].

2. The Middle Latency Response [MLR].

3. The Long-Latency Auditory Evoked Potential [including the MMN].

TípicoDiscrepante

Onda diferencia

300 ms

-1 µV

N1 MMN

Is human deviance detection a multi-stage process?

Page 8: Early Occurrence Of Auditory Change Detection In The Human ... · Brain Res Grimm et al., 2012, Biol Psychol Cornella et al. 2012, PLoS One Pa/Nb enhancement for ... * acting in a

3730 Hz2580 Hz1770 Hz1200 Hz800 Hz

deviant 800 Hz

standard 800 Hz

control 800 Hz

SOA: 293 msTone duration: 50 ms

deviant 3730 Hz

standard 3730 Hz

control 3730 Hz

a

b

c

3730 Hz2580 Hz1770 Hz1200 Hz800 Hz

Grimm et al. (2011). Psychophysiology.

[p=0.012]

~ 42 ms !!

Early EEG correlates of deviance detection 8

EEG: Nb enhancement for frequency deviants

MEG: Nbm enhancement for frequency deviants More anterior and medial activations (Heschl‘s gyrus) for Nbm compared to MMNm

Recasens et al. (2012). Cer Cortex.

MMNm Nbm difference

Page 9: Early Occurrence Of Auditory Change Detection In The Human ... · Brain Res Grimm et al., 2012, Biol Psychol Cornella et al. 2012, PLoS One Pa/Nb enhancement for ... * acting in a

frequency

EEG: Nb enhancement for MF pitch changes

Alho, Grimm et al. (2012). EJN

Early EEG correlates of deviance detection 9

N1

-100 300 ms

-2

2

µV

-50 100 ms

-0.5

0.5

µV

Missing fundamental (MF) stimuli:

frequency

Page 10: Early Occurrence Of Auditory Change Detection In The Human ... · Brain Res Grimm et al., 2012, Biol Psychol Cornella et al. 2012, PLoS One Pa/Nb enhancement for ... * acting in a

Early EEG correlates of deviance detection 10

Na enhancement for location deviants

Na [24 ms] -

Na [20ms]

+

-

Sonnadara et al. 2006, Brain Res

Grimm et al., 2012, Biol Psychol Cornella et al. 2012, PLoS One

Pa/Nb enhancement for SOA shortenings

Leung, Recasens, Grimm, Escera, 2013, Clin Neurophysiol

+ Na difference topography

deviant

control

Page 11: Early Occurrence Of Auditory Change Detection In The Human ... · Brain Res Grimm et al., 2012, Biol Psychol Cornella et al. 2012, PLoS One Pa/Nb enhancement for ... * acting in a

So far, so good…

Deviance-related effects occur at multiple latencies including much

shorter ones than those of the MMN!!!

Early deviance effects occur at different components (Na, Nb: 20-40 ms) of the

Middle Latency Response depending on the stimulus feature:

Some indication that the early effects reflect an enhanced deviance processing

rather then repetition suppression (based on experiments controlling for stimulus

probability)

MEG: Nbm effect is localized near primary auditory cortex whereas MMNm

shows more posterior and lateral activations

Functional role of these multiple stages of deviance detection?

* acting in a complementary, hierarchical, interactive, or a redundant manner?

11

Page 12: Early Occurrence Of Auditory Change Detection In The Human ... · Brain Res Grimm et al., 2012, Biol Psychol Cornella et al. 2012, PLoS One Pa/Nb enhancement for ... * acting in a

Can the early deviance-related effects be observed in the context of more complex regularities?

Page 13: Early Occurrence Of Auditory Change Detection In The Human ... · Brain Res Grimm et al., 2012, Biol Psychol Cornella et al. 2012, PLoS One Pa/Nb enhancement for ... * acting in a

Early detection of violation within complex regularities

FEATURE CONJUNCTION DEVIANTS

-90° 90°

800 Hz 45% 5%

1200 Hz 5% 45%

-90° 90°

800 Hz 45% 45%

1200 Hz 5% 5%

13

Althen, Grimm, Escera, 2013, EJN

Page 14: Early Occurrence Of Auditory Change Detection In The Human ... · Brain Res Grimm et al., 2012, Biol Psychol Cornella et al. 2012, PLoS One Pa/Nb enhancement for ... * acting in a

Early detection of violation within pattern regularities

A: Global deviant confirming local rule of frequency repetition breaking global pattern rule

B: Local deviant breaking local rule of frequency repetition confirming global pattern rule

B: A:

mMLR

14

No MLR effect! MLR effect! - Nb

Page 15: Early Occurrence Of Auditory Change Detection In The Human ... · Brain Res Grimm et al., 2012, Biol Psychol Cornella et al. 2012, PLoS One Pa/Nb enhancement for ... * acting in a

Early detection of violation within pattern regularities

A: Global deviant confirming local rule of frequency repetition breaking global pattern rule

B: Local deviant breaking local rule of frequency repetition confirming global pattern rule

B: A:

mMMN

15

MMN! MMN/N1 effect

Page 16: Early Occurrence Of Auditory Change Detection In The Human ... · Brain Res Grimm et al., 2012, Biol Psychol Cornella et al. 2012, PLoS One Pa/Nb enhancement for ... * acting in a

Whereas simple regularities are encoded in the earlier time range, more complex regularities (such as the frequent occurrence of

specific patterns or feature combinations) are likely to be encoded only at the higher levels.

(well, at least deviations of this simple and complex regularities

are detected at different time points)

16

Page 17: Early Occurrence Of Auditory Change Detection In The Human ... · Brain Res Grimm et al., 2012, Biol Psychol Cornella et al. 2012, PLoS One Pa/Nb enhancement for ... * acting in a

Can we observe deviance-related responses at the human scalp that reflect a processing of stimulus statistics at

subcortical levels?

17

Page 18: Early Occurrence Of Auditory Change Detection In The Human ... · Brain Res Grimm et al., 2012, Biol Psychol Cornella et al. 2012, PLoS One Pa/Nb enhancement for ... * acting in a

Deviance-related changes at subcortical levels? fMRI

Stimuli were arranged in 2 different sessions

Each session: 250 trials; each trial: 20 stimuli (constant SOA = 150ms)

In total, 5000 stimuli delivered per session

12 subjects (age 24-36; 7 females; 4 left-handed)

1 …… ……

20 1 Freq.1

Freq.2 19 16 14 10

Freq.5

Freq.4

Freq.3

Freq.2

…… …… Freq.1

Session #2: 125 control trials + 125 silent trials (baseline)

Session #1: 125 standard trials + 125 deviant trials

Trial #1 Trial #2

…… 20

……

18

Page 19: Early Occurrence Of Auditory Change Detection In The Human ... · Brain Res Grimm et al., 2012, Biol Psychol Cornella et al. 2012, PLoS One Pa/Nb enhancement for ... * acting in a

DEV>STD

Deviance-related changes at subcortical levels? fMRI

IC

MGB

IC

MGB

DEV>STA

DEV>CON

Cacciaglia et al., in preparation

Page 20: Early Occurrence Of Auditory Change Detection In The Human ... · Brain Res Grimm et al., 2012, Biol Psychol Cornella et al. 2012, PLoS One Pa/Nb enhancement for ... * acting in a

Summary

deviance-related activity can be observed at multiple time scales

sources of these deviance-related activities are organized in

spatially distinct areas of the Human Auditory Cortex

whereas deviance-related MLR effects indicate the early

processing of simple feature changes, more complex regularity

violations are only reflected in the MMN time range

already at the level of the inferior colliculus, the statistical status of

a sound is processed as reflected by an enhanced BOLD response

to deviants

20

Page 21: Early Occurrence Of Auditory Change Detection In The Human ... · Brain Res Grimm et al., 2012, Biol Psychol Cornella et al. 2012, PLoS One Pa/Nb enhancement for ... * acting in a

Summary 21

Deviance detection, based on regularity encoding, is a key principle of the functional organization of the auditory system, spanning

from lower levels in the auditory brainstem to higher order areas of the cerebral cortex.

At higher levels in the auditory system deviant responses become stronger (in terms of amplitude) and functional complexity of

deviant processing increases.

Page 22: Early Occurrence Of Auditory Change Detection In The Human ... · Brain Res Grimm et al., 2012, Biol Psychol Cornella et al. 2012, PLoS One Pa/Nb enhancement for ... * acting in a

Thank you for your attention

Thanks to the members of the Group for Cognitive Neuroscience at the University Barcelona:

and to our collaborators:

Kimmo Alho, Torsten Baldeweg, Manolo Malmierca, Israel Nelken, Minna Huotilainen, Erich Schröger, Istvan Winkler et al.

Page 23: Early Occurrence Of Auditory Change Detection In The Human ... · Brain Res Grimm et al., 2012, Biol Psychol Cornella et al. 2012, PLoS One Pa/Nb enhancement for ... * acting in a

Important announcement:

at the University of Leipzig, Germany