Lecture 24. Sequence Learning Reading Assignment: Reprint

19
1 Michael Arbib CS564 - Brain Theory and Artificial Intelligence, USC, Fall 2001. Lecture 24. Sequence Learning Michael Arbib: CS564 - Brain Theory and Artificial Intelligence University of Southern California, Fall 2001 Lecture 24. Sequence Learning Reading Assignment: Reprint Dominey, P.F., Arbib, M.A., and Joseph, J.-P., 1995, A Model of Corticostriatal Plasticity for Learning Associations and Sequences, J. Cog. Neurosci., 7:311-336.

description

Michael Arbib: CS564 - Brain Theory and Artificial Intelligence University of Southern California, Fall 2001. Lecture 24. Sequence Learning Reading Assignment: Reprint - PowerPoint PPT Presentation

Transcript of Lecture 24. Sequence Learning Reading Assignment: Reprint

Page 1: Lecture  24. Sequence Learning Reading Assignment: Reprint

1Michael Arbib CS564 - Brain Theory and Artificial Intelligence, USC, Fall 2001. Lecture 24. Sequence Learning

Michael Arbib: CS564 - Brain Theory and Artificial Intelligence

University of Southern California, Fall 2001

Lecture 24. Sequence Learning

Reading Assignment:ReprintDominey, P.F., Arbib, M.A., and Joseph, J.-P., 1995, A Model of Corticostriatal Plasticity for Learning Associations and Sequences, J. Cog. Neurosci., 7:311-336.

Page 2: Lecture  24. Sequence Learning Reading Assignment: Reprint

2Michael Arbib CS564 - Brain Theory and Artificial Intelligence, USC, Fall 2001. Lecture 24. Sequence Learning

Page 3: Lecture  24. Sequence Learning Reading Assignment: Reprint

3Michael Arbib CS564 - Brain Theory and Artificial Intelligence, USC, Fall 2001. Lecture 24. Sequence Learning

Page 4: Lecture  24. Sequence Learning Reading Assignment: Reprint

4Michael Arbib CS564 - Brain Theory and Artificial Intelligence, USC, Fall 2001. Lecture 24. Sequence Learning

Page 5: Lecture  24. Sequence Learning Reading Assignment: Reprint

5Michael Arbib CS564 - Brain Theory and Artificial Intelligence, USC, Fall 2001. Lecture 24. Sequence Learning

Visual Input

Posterior Parietal CxV4

FEF

Superior Colliculus

Thalamus (MD)

Caudate

SNr

Inferior Temporal Cortex

Noise

Reward

Behavior

Modifiable Synapses

"What"

Pathways leading to DA release

by SNc

"Where"

Page 6: Lecture  24. Sequence Learning Reading Assignment: Reprint

6Michael Arbib CS564 - Brain Theory and Artificial Intelligence, USC, Fall 2001. Lecture 24. Sequence Learning

Page 7: Lecture  24. Sequence Learning Reading Assignment: Reprint

7Michael Arbib CS564 - Brain Theory and Artificial Intelligence, USC, Fall 2001. Lecture 24. Sequence Learning

Page 8: Lecture  24. Sequence Learning Reading Assignment: Reprint

8Michael Arbib CS564 - Brain Theory and Artificial Intelligence, USC, Fall 2001. Lecture 24. Sequence Learning

Page 9: Lecture  24. Sequence Learning Reading Assignment: Reprint

9Michael Arbib CS564 - Brain Theory and Artificial Intelligence, USC, Fall 2001. Lecture 24. Sequence Learning

Page 10: Lecture  24. Sequence Learning Reading Assignment: Reprint

10Michael Arbib CS564 - Brain Theory and Artificial Intelligence, USC, Fall 2001. Lecture 24. Sequence Learning

Page 11: Lecture  24. Sequence Learning Reading Assignment: Reprint

11Michael Arbib CS564 - Brain Theory and Artificial Intelligence, USC, Fall 2001. Lecture 24. Sequence Learning

Visual-Oculomotor Conditional Learning

plus local peak of disinhibition

yields

from which winner-take-all selects the corresponding target

(a)

Page 12: Lecture  24. Sequence Learning Reading Assignment: Reprint

12Michael Arbib CS564 - Brain Theory and Artificial Intelligence, USC, Fall 2001. Lecture 24. Sequence Learning

But what if target positions are not fixed?

Page 13: Lecture  24. Sequence Learning Reading Assignment: Reprint

13Michael Arbib CS564 - Brain Theory and Artificial Intelligence, USC, Fall 2001. Lecture 24. Sequence Learning

Page 14: Lecture  24. Sequence Learning Reading Assignment: Reprint

14Michael Arbib CS564 - Brain Theory and Artificial Intelligence, USC, Fall 2001. Lecture 24. Sequence Learning

Visual Input

Posterior Parietal Cx

FEF

Simulation Environment

Reward

Behavior

Randomized trials

Prefrontal Cortex

Noise

Superior Colliculus

Thalamus (VA-MD)

Caudate

SNr Modifiable Synapses

Page 15: Lecture  24. Sequence Learning Reading Assignment: Reprint

15Michael Arbib CS564 - Brain Theory and Artificial Intelligence, USC, Fall 2001. Lecture 24. Sequence Learning

Page 16: Lecture  24. Sequence Learning Reading Assignment: Reprint

16Michael Arbib CS564 - Brain Theory and Artificial Intelligence, USC, Fall 2001. Lecture 24. Sequence Learning

Page 17: Lecture  24. Sequence Learning Reading Assignment: Reprint

17Michael Arbib CS564 - Brain Theory and Artificial Intelligence, USC, Fall 2001. Lecture 24. Sequence Learning

Page 18: Lecture  24. Sequence Learning Reading Assignment: Reprint

18Michael Arbib CS564 - Brain Theory and Artificial Intelligence, USC, Fall 2001. Lecture 24. Sequence Learning

Page 19: Lecture  24. Sequence Learning Reading Assignment: Reprint

19Michael Arbib CS564 - Brain Theory and Artificial Intelligence, USC, Fall 2001. Lecture 24. Sequence Learning