Basic Bits of Neuronal Grammar Friedemann Pulvermüller MRC Cognition and Brain Sciences Unit...

65
Basic Bits of Neuronal Grammar Friedemann Pulvermüller MRC Cognition and Brain Sciences Unit Cambridge

Transcript of Basic Bits of Neuronal Grammar Friedemann Pulvermüller MRC Cognition and Brain Sciences Unit...

Page 1: Basic Bits of Neuronal Grammar Friedemann Pulvermüller MRC Cognition and Brain Sciences Unit Cambridge.

Basic Bits of Neuronal Grammar

Friedemann Pulvermüller

MRC Cognition and Brain Sciences Unit Cambridge

Page 2: Basic Bits of Neuronal Grammar Friedemann Pulvermüller MRC Cognition and Brain Sciences Unit Cambridge.

Activity states:

• Ignition -- full activation, momentary

• Reverberation -- continuous enhanced activity following ignition

• Priming -- “parasitic” activity caused by strongly connected sets

• Rest -- inactivity

Page 3: Basic Bits of Neuronal Grammar Friedemann Pulvermüller MRC Cognition and Brain Sciences Unit Cambridge.

Activity states:

• Darker colours denote reduced activity states

Page 4: Basic Bits of Neuronal Grammar Friedemann Pulvermüller MRC Cognition and Brain Sciences Unit Cambridge.

The network:

Page 5: Basic Bits of Neuronal Grammar Friedemann Pulvermüller MRC Cognition and Brain Sciences Unit Cambridge.

The represented elements: WORDS

SEQUENCE FEATURES

Page 6: Basic Bits of Neuronal Grammar Friedemann Pulvermüller MRC Cognition and Brain Sciences Unit Cambridge.

The representing elements:WORD WEBS

Page 7: Basic Bits of Neuronal Grammar Friedemann Pulvermüller MRC Cognition and Brain Sciences Unit Cambridge.

The representing elements:WORD WEBS

SEQUENCE DETECTORS (SDs)

Page 8: Basic Bits of Neuronal Grammar Friedemann Pulvermüller MRC Cognition and Brain Sciences Unit Cambridge.

I

3 word inputcongruent with thenetwork structure

Page 9: Basic Bits of Neuronal Grammar Friedemann Pulvermüller MRC Cognition and Brain Sciences Unit Cambridge.

The sentence“Betty get up”

will appear in the inputand will not be accepted

by the network

Page 10: Basic Bits of Neuronal Grammar Friedemann Pulvermüller MRC Cognition and Brain Sciences Unit Cambridge.

Time step / Input / Process

Page 11: Basic Bits of Neuronal Grammar Friedemann Pulvermüller MRC Cognition and Brain Sciences Unit Cambridge.

0 -- All webs at rest

Page 12: Basic Bits of Neuronal Grammar Friedemann Pulvermüller MRC Cognition and Brain Sciences Unit Cambridge.

1 Betty Ignition of word web

Page 13: Basic Bits of Neuronal Grammar Friedemann Pulvermüller MRC Cognition and Brain Sciences Unit Cambridge.

2 -- Priming of SD

Page 14: Basic Bits of Neuronal Grammar Friedemann Pulvermüller MRC Cognition and Brain Sciences Unit Cambridge.

3 -- Priming of SD

Page 15: Basic Bits of Neuronal Grammar Friedemann Pulvermüller MRC Cognition and Brain Sciences Unit Cambridge.

4 -- Priming of word web

Page 16: Basic Bits of Neuronal Grammar Friedemann Pulvermüller MRC Cognition and Brain Sciences Unit Cambridge.

5 gets Primed ignition ofword web

Page 17: Basic Bits of Neuronal Grammar Friedemann Pulvermüller MRC Cognition and Brain Sciences Unit Cambridge.

6 -- Priming of SDsBackward ignition

Page 18: Basic Bits of Neuronal Grammar Friedemann Pulvermüller MRC Cognition and Brain Sciences Unit Cambridge.

7 -- Priming of SDsBackward ignition

Page 19: Basic Bits of Neuronal Grammar Friedemann Pulvermüller MRC Cognition and Brain Sciences Unit Cambridge.

8 -- Priming of word webBackward ignition

Page 20: Basic Bits of Neuronal Grammar Friedemann Pulvermüller MRC Cognition and Brain Sciences Unit Cambridge.

9 -- --

Page 21: Basic Bits of Neuronal Grammar Friedemann Pulvermüller MRC Cognition and Brain Sciences Unit Cambridge.

10 up Ignition of word web

Page 22: Basic Bits of Neuronal Grammar Friedemann Pulvermüller MRC Cognition and Brain Sciences Unit Cambridge.

11 -- Backward ignition

Page 23: Basic Bits of Neuronal Grammar Friedemann Pulvermüller MRC Cognition and Brain Sciences Unit Cambridge.

12 -- Backward ignition

Page 24: Basic Bits of Neuronal Grammar Friedemann Pulvermüller MRC Cognition and Brain Sciences Unit Cambridge.

13 -- Backward ignition

Page 25: Basic Bits of Neuronal Grammar Friedemann Pulvermüller MRC Cognition and Brain Sciences Unit Cambridge.

14 -- Backward ignition

Page 26: Basic Bits of Neuronal Grammar Friedemann Pulvermüller MRC Cognition and Brain Sciences Unit Cambridge.

15 -- Backward ignition

Page 27: Basic Bits of Neuronal Grammar Friedemann Pulvermüller MRC Cognition and Brain Sciences Unit Cambridge.

16 -- Backward ignition

Page 28: Basic Bits of Neuronal Grammar Friedemann Pulvermüller MRC Cognition and Brain Sciences Unit Cambridge.

17 -- Backward ignition

Page 29: Basic Bits of Neuronal Grammar Friedemann Pulvermüller MRC Cognition and Brain Sciences Unit Cambridge.

18 -- Deactivation

Page 30: Basic Bits of Neuronal Grammar Friedemann Pulvermüller MRC Cognition and Brain Sciences Unit Cambridge.

At time step 17, the 3 criteria for string acceptance were met:

• All activated word webs were visible (i.e., reverberated at the highest reverberation level).

• All activate word webs were satisfied (i.e., their set of sequence detectors reverberated at a high level).

• All active sets were synchronized (I.e., participated in a continuous wave of ignitions).

Page 31: Basic Bits of Neuronal Grammar Friedemann Pulvermüller MRC Cognition and Brain Sciences Unit Cambridge.
Page 32: Basic Bits of Neuronal Grammar Friedemann Pulvermüller MRC Cognition and Brain Sciences Unit Cambridge.

II

3 word inputincongruent with the

network structure

Page 33: Basic Bits of Neuronal Grammar Friedemann Pulvermüller MRC Cognition and Brain Sciences Unit Cambridge.

The sentence“Up get Betty”

will appear in the inputand will not be accepted

by the network

Page 34: Basic Bits of Neuronal Grammar Friedemann Pulvermüller MRC Cognition and Brain Sciences Unit Cambridge.

Time step / Input / Process

Page 35: Basic Bits of Neuronal Grammar Friedemann Pulvermüller MRC Cognition and Brain Sciences Unit Cambridge.

0 -- All webs at rest

Page 36: Basic Bits of Neuronal Grammar Friedemann Pulvermüller MRC Cognition and Brain Sciences Unit Cambridge.

1 up Ignition of word web

Page 37: Basic Bits of Neuronal Grammar Friedemann Pulvermüller MRC Cognition and Brain Sciences Unit Cambridge.

2 -- --

Page 38: Basic Bits of Neuronal Grammar Friedemann Pulvermüller MRC Cognition and Brain Sciences Unit Cambridge.

3 -- --

Page 39: Basic Bits of Neuronal Grammar Friedemann Pulvermüller MRC Cognition and Brain Sciences Unit Cambridge.

4 get Unprimed ignition I^of word web

Page 40: Basic Bits of Neuronal Grammar Friedemann Pulvermüller MRC Cognition and Brain Sciences Unit Cambridge.

5 -- Priming of SDThreshold regulation

Page 41: Basic Bits of Neuronal Grammar Friedemann Pulvermüller MRC Cognition and Brain Sciences Unit Cambridge.

6 -- Priming of SD

Page 42: Basic Bits of Neuronal Grammar Friedemann Pulvermüller MRC Cognition and Brain Sciences Unit Cambridge.

7 -- Priming of SD

Page 43: Basic Bits of Neuronal Grammar Friedemann Pulvermüller MRC Cognition and Brain Sciences Unit Cambridge.

8 Betty Unprimed ignition I^of word web

Page 44: Basic Bits of Neuronal Grammar Friedemann Pulvermüller MRC Cognition and Brain Sciences Unit Cambridge.

9 -- Priming of SDThreshold regulation

Page 45: Basic Bits of Neuronal Grammar Friedemann Pulvermüller MRC Cognition and Brain Sciences Unit Cambridge.

10 -- Priming of SD

Page 46: Basic Bits of Neuronal Grammar Friedemann Pulvermüller MRC Cognition and Brain Sciences Unit Cambridge.

11 -- Priming of SD

Page 47: Basic Bits of Neuronal Grammar Friedemann Pulvermüller MRC Cognition and Brain Sciences Unit Cambridge.

At time step 10, the 3 criteria for string acceptance were not met:

• Only 1 word web was visible (the 2 others were at lower activity levels, R2 and R3; cf. darker colours).

• No one of the 3 word webs was satisfied (SDs did not reverberate).

• No final synchronization process.

Page 48: Basic Bits of Neuronal Grammar Friedemann Pulvermüller MRC Cognition and Brain Sciences Unit Cambridge.
Page 49: Basic Bits of Neuronal Grammar Friedemann Pulvermüller MRC Cognition and Brain Sciences Unit Cambridge.

III

3 word input partly incongruent with the

network structure

Page 50: Basic Bits of Neuronal Grammar Friedemann Pulvermüller MRC Cognition and Brain Sciences Unit Cambridge.

The sentence“Up Betty get”

will appear in the inputand will not be accepted

by the network

Page 51: Basic Bits of Neuronal Grammar Friedemann Pulvermüller MRC Cognition and Brain Sciences Unit Cambridge.

Time step / Input / Process

Page 52: Basic Bits of Neuronal Grammar Friedemann Pulvermüller MRC Cognition and Brain Sciences Unit Cambridge.

0 -- All webs at rest

Page 53: Basic Bits of Neuronal Grammar Friedemann Pulvermüller MRC Cognition and Brain Sciences Unit Cambridge.

1 up Ignition of word web

Page 54: Basic Bits of Neuronal Grammar Friedemann Pulvermüller MRC Cognition and Brain Sciences Unit Cambridge.

2 -- --

Page 55: Basic Bits of Neuronal Grammar Friedemann Pulvermüller MRC Cognition and Brain Sciences Unit Cambridge.

3 -- --

Page 56: Basic Bits of Neuronal Grammar Friedemann Pulvermüller MRC Cognition and Brain Sciences Unit Cambridge.

4 Betty Unprimed ignition I^of word web

Page 57: Basic Bits of Neuronal Grammar Friedemann Pulvermüller MRC Cognition and Brain Sciences Unit Cambridge.

5 -- Priming of SDThreshold regulation

Page 58: Basic Bits of Neuronal Grammar Friedemann Pulvermüller MRC Cognition and Brain Sciences Unit Cambridge.

6 Betty Priming of SD

Page 59: Basic Bits of Neuronal Grammar Friedemann Pulvermüller MRC Cognition and Brain Sciences Unit Cambridge.

7 -- Priming of word web

Page 60: Basic Bits of Neuronal Grammar Friedemann Pulvermüller MRC Cognition and Brain Sciences Unit Cambridge.

8 get Primed ignition ofword web

Page 61: Basic Bits of Neuronal Grammar Friedemann Pulvermüller MRC Cognition and Brain Sciences Unit Cambridge.

9 -- Priming of SDBackward ignition

Page 62: Basic Bits of Neuronal Grammar Friedemann Pulvermüller MRC Cognition and Brain Sciences Unit Cambridge.

10 -- Priming of SDBackward ignition

Page 63: Basic Bits of Neuronal Grammar Friedemann Pulvermüller MRC Cognition and Brain Sciences Unit Cambridge.

11 -- Backward ignition

Page 64: Basic Bits of Neuronal Grammar Friedemann Pulvermüller MRC Cognition and Brain Sciences Unit Cambridge.

12 -- --

Page 65: Basic Bits of Neuronal Grammar Friedemann Pulvermüller MRC Cognition and Brain Sciences Unit Cambridge.

At time step 12, not all of the 3 string acceptance criteria were met:

• 2 out of the 3 activated word webs were visible (i.e., reverberated at the highest reverberation level).

• Only 1 out of 3 word webs were satisfied (i.e., their set of sequence detectors reverberated at a high level).

• Only 2 out of the 3 word webs were synchronized (I.e., participated in a continuous wave of ignitions).