Biologically-Inspired Control in Problem Solving · Biologically-Inspired Control in Problem...
Transcript of Biologically-Inspired Control in Problem Solving · Biologically-Inspired Control in Problem...
![Page 1: Biologically-Inspired Control in Problem Solving · Biologically-Inspired Control in Problem Solving Thad A. Polk, Patrick Simen, Richard L. Lewis, & Eric Freedman ... – Represents](https://reader030.fdocuments.us/reader030/viewer/2022040523/5e8578217889153d58302352/html5/thumbnails/1.jpg)
1
Biologically-Inspired Control in Problem Solving
Thad A. Polk, Patrick Simen,
Richard L. Lewis, & Eric Freedman
![Page 2: Biologically-Inspired Control in Problem Solving · Biologically-Inspired Control in Problem Solving Thad A. Polk, Patrick Simen, Richard L. Lewis, & Eric Freedman ... – Represents](https://reader030.fdocuments.us/reader030/viewer/2022040523/5e8578217889153d58302352/html5/thumbnails/2.jpg)
2
Computational Models of Control
� Challenge: Develop computationally explicit theories of control deficits in complex problem solving– Where control deficits are often most apparent
� Symbolic models (production systems)– E.g., ACT-R, Soar, Epic, ... – Natural model of flexible, goal-driven behavior and therefore easier
to apply to complex problem solving
– But harder to map onto the brain and patients
� Neural networks– E.g., Cohen, Levine, Dehaene, Braver, O’Reilly, ...
– Neural mechanism for control (modulation) and therefore easier to map onto the brain and patients
– But harder to apply to complex problem solving
![Page 3: Biologically-Inspired Control in Problem Solving · Biologically-Inspired Control in Problem Solving Thad A. Polk, Patrick Simen, Richard L. Lewis, & Eric Freedman ... – Represents](https://reader030.fdocuments.us/reader030/viewer/2022040523/5e8578217889153d58302352/html5/thumbnails/3.jpg)
3
Major Points
1. Natural & explicit mapping from goal-driven production systems onto neural computation
– Makes it possible to build plausible neural models of complex problem solving
2. Mapping leads to explicit hypothesis about the role of DLPFC in problem solving:
– Represents internally generated subgoals that modulate among choices
3. Applying to TOL accurately simulates human behavior– Intact model simulates normals, even on hardest problems
– Lesioning subgoal net simulates prefrontal deficits
![Page 4: Biologically-Inspired Control in Problem Solving · Biologically-Inspired Control in Problem Solving Thad A. Polk, Patrick Simen, Richard L. Lewis, & Eric Freedman ... – Represents](https://reader030.fdocuments.us/reader030/viewer/2022040523/5e8578217889153d58302352/html5/thumbnails/4.jpg)
4
Plan
� Symbolic models of control
� A simple model of neural computation
� Mapping symbolic control onto neural nets
� Network model of Tower of London– Intact behavior– Damaged behavior
![Page 5: Biologically-Inspired Control in Problem Solving · Biologically-Inspired Control in Problem Solving Thad A. Polk, Patrick Simen, Richard L. Lewis, & Eric Freedman ... – Represents](https://reader030.fdocuments.us/reader030/viewer/2022040523/5e8578217889153d58302352/html5/thumbnails/5.jpg)
5
Goal-Driven Production Systems
� Almost all models of complex cognition based on production systems (ACT-R, Soar, Epic)– Set of symbolic IF-THEN rules that match against memory
and take actions and/or change memory:
� Production systems proposed as control theory (Newell, 1973):– Allow behavior to be flexible, opportunistic, interruptible– Next step chosen dynamically based on what’s in
memory/world– Goals/subgoals modulate/control decisions
![Page 6: Biologically-Inspired Control in Problem Solving · Biologically-Inspired Control in Problem Solving Thad A. Polk, Patrick Simen, Richard L. Lewis, & Eric Freedman ... – Represents](https://reader030.fdocuments.us/reader030/viewer/2022040523/5e8578217889153d58302352/html5/thumbnails/6.jpg)
Example
Initial
Goal
•(External) Goal-driven control: Pick move to achieve ‘blue’ goal
•And so on...
Decompose problem intothree component goals
Set ‘blue’ goal
•Set goal to switch green & red
•Set (internal) subgoal: get ‘red’ off
•Achieve ‘get red off’subgoal
•Data-driven productions: Consider both legal moves
•Data-driven productions: Consider all legal moves
•(Internal) Goal-driven control: Pick move to ‘get red off’
![Page 7: Biologically-Inspired Control in Problem Solving · Biologically-Inspired Control in Problem Solving Thad A. Polk, Patrick Simen, Richard L. Lewis, & Eric Freedman ... – Represents](https://reader030.fdocuments.us/reader030/viewer/2022040523/5e8578217889153d58302352/html5/thumbnails/7.jpg)
7
Key Features of Symbolic Control
� Data-driven production rules– Asymmetric associations between symbols
– Allows flexible behavior that reacts to current state
– E.g., Recognizing legal moves in current TOL state
� Top-down control from current goal/subgoal– Constrains data-driven processing– Both external goals and internally generated subgoals can control
– E.g., preferring moves that satisfy current subgoal over others
![Page 8: Biologically-Inspired Control in Problem Solving · Biologically-Inspired Control in Problem Solving Thad A. Polk, Patrick Simen, Richard L. Lewis, & Eric Freedman ... – Represents](https://reader030.fdocuments.us/reader030/viewer/2022040523/5e8578217889153d58302352/html5/thumbnails/8.jpg)
8
Plan
� Symbolic models of control
� A simple model of neural computation
� Mapping symbolic control onto neural nets
� Network model of Tower of London– Intact behavior– Damaged behavior
![Page 9: Biologically-Inspired Control in Problem Solving · Biologically-Inspired Control in Problem Solving Thad A. Polk, Patrick Simen, Richard L. Lewis, & Eric Freedman ... – Represents](https://reader030.fdocuments.us/reader030/viewer/2022040523/5e8578217889153d58302352/html5/thumbnails/9.jpg)
9
Neural Computation: Assumptionsfor Present Model
1. Neural processing is recurrent
2. Neural representations are distributed
3. Neural learning is correlation-based (Hebbian)
![Page 10: Biologically-Inspired Control in Problem Solving · Biologically-Inspired Control in Problem Solving Thad A. Polk, Patrick Simen, Richard L. Lewis, & Eric Freedman ... – Represents](https://reader030.fdocuments.us/reader030/viewer/2022040523/5e8578217889153d58302352/html5/thumbnails/10.jpg)
10
Emergent Property:Attractors (Discrete Stable States)(Hopfield, 1982; 1984)
If distributed patternsoccur frequently, theybecome discrete stablestates for the network...
…and the network willconverge on them givenany similar patterns...
![Page 11: Biologically-Inspired Control in Problem Solving · Biologically-Inspired Control in Problem Solving Thad A. Polk, Patrick Simen, Richard L. Lewis, & Eric Freedman ... – Represents](https://reader030.fdocuments.us/reader030/viewer/2022040523/5e8578217889153d58302352/html5/thumbnails/11.jpg)
11
Emergent Property:Attractors (Discrete Stable States)(Hopfield, 1982; 1984)
If these patterns occurfrequently, then theybecome discrete stablestates for the network.
And the network willconverge on them givenany similar patterns...
![Page 12: Biologically-Inspired Control in Problem Solving · Biologically-Inspired Control in Problem Solving Thad A. Polk, Patrick Simen, Richard L. Lewis, & Eric Freedman ... – Represents](https://reader030.fdocuments.us/reader030/viewer/2022040523/5e8578217889153d58302352/html5/thumbnails/12.jpg)
12
Emergent Property:Attractors (Discrete Stable States)(Hopfield, 1982; 1984)
If these patterns occurfrequently, then theybecome discrete stablestates for the network.
And the network willconverge on them givenany similar patterns...
![Page 13: Biologically-Inspired Control in Problem Solving · Biologically-Inspired Control in Problem Solving Thad A. Polk, Patrick Simen, Richard L. Lewis, & Eric Freedman ... – Represents](https://reader030.fdocuments.us/reader030/viewer/2022040523/5e8578217889153d58302352/html5/thumbnails/13.jpg)
13
Emergent Property:Attractors (Discrete Stable States)(Hopfield, 1982; 1984)
If these patterns occurfrequently, then theybecome discrete stablestates for the network.
And the network willconverge on them givenany similar patterns...
![Page 14: Biologically-Inspired Control in Problem Solving · Biologically-Inspired Control in Problem Solving Thad A. Polk, Patrick Simen, Richard L. Lewis, & Eric Freedman ... – Represents](https://reader030.fdocuments.us/reader030/viewer/2022040523/5e8578217889153d58302352/html5/thumbnails/14.jpg)
14
Emergent Property:Attractors (Discrete Stable States)(Hopfield, 1982; 1984)
If these patterns occurfrequently, then theybecome discrete stablestates for the network.
And the network willconverge on them givenany similar patterns...
![Page 15: Biologically-Inspired Control in Problem Solving · Biologically-Inspired Control in Problem Solving Thad A. Polk, Patrick Simen, Richard L. Lewis, & Eric Freedman ... – Represents](https://reader030.fdocuments.us/reader030/viewer/2022040523/5e8578217889153d58302352/html5/thumbnails/15.jpg)
15
Emergent Property:Attractors (Discrete Stable States)(Hopfield, 1982; 1984)
If these patterns occurfrequently, then theybecome discrete stablestates for the network.
And the network willconverge on them givenany similar patterns...
![Page 16: Biologically-Inspired Control in Problem Solving · Biologically-Inspired Control in Problem Solving Thad A. Polk, Patrick Simen, Richard L. Lewis, & Eric Freedman ... – Represents](https://reader030.fdocuments.us/reader030/viewer/2022040523/5e8578217889153d58302352/html5/thumbnails/16.jpg)
16
Emergent Property:Attractors (Discrete Stable States)(Hopfield, 1982; 1984)
If these patterns occurfrequently, then theybecome discrete stablestates for the network.
And the network willconverge on them givenany similar patterns...
These “attractors” arediscrete & stable likesymbols.
![Page 17: Biologically-Inspired Control in Problem Solving · Biologically-Inspired Control in Problem Solving Thad A. Polk, Patrick Simen, Richard L. Lewis, & Eric Freedman ... – Represents](https://reader030.fdocuments.us/reader030/viewer/2022040523/5e8578217889153d58302352/html5/thumbnails/17.jpg)
17
Plan
� Symbolic models of control
� A simple model of neural computation
� Mapping symbolic control onto neural nets
� Network model of Tower of London– Intact behavior– Damaged behavior
![Page 18: Biologically-Inspired Control in Problem Solving · Biologically-Inspired Control in Problem Solving Thad A. Polk, Patrick Simen, Richard L. Lewis, & Eric Freedman ... – Represents](https://reader030.fdocuments.us/reader030/viewer/2022040523/5e8578217889153d58302352/html5/thumbnails/18.jpg)
18
Mapping Productions Onto Attractors
� Attributes = attractor nets/layers� Values = attractor patterns in the specified layer� Productions = associations between layers
IFLetter T
THENNumber 7
IFLetter L
THENNumber 1 Letter Number
Blue Production
Red Production
![Page 19: Biologically-Inspired Control in Problem Solving · Biologically-Inspired Control in Problem Solving Thad A. Polk, Patrick Simen, Richard L. Lewis, & Eric Freedman ... – Represents](https://reader030.fdocuments.us/reader030/viewer/2022040523/5e8578217889153d58302352/html5/thumbnails/19.jpg)
19
Mapping Productions Onto Attractors
IFLetter T
THENNumber 7
IFLetter L
THENNumber 1 Letter Number
Blue Production
Red Production
� Attributes = attractor nets/layers� Values = attractor patterns in the specified layer� Productions = associations between layers
![Page 20: Biologically-Inspired Control in Problem Solving · Biologically-Inspired Control in Problem Solving Thad A. Polk, Patrick Simen, Richard L. Lewis, & Eric Freedman ... – Represents](https://reader030.fdocuments.us/reader030/viewer/2022040523/5e8578217889153d58302352/html5/thumbnails/20.jpg)
20
Mapping Productions Onto Attractors
IFLetter T
THENNumber 7
IFLetter L
THENNumber 1 Letter Number
Blue Production
Red Production
� Attributes = attractor nets/layers� Values = attractor patterns in the specified layer� Productions = associations between layers
![Page 21: Biologically-Inspired Control in Problem Solving · Biologically-Inspired Control in Problem Solving Thad A. Polk, Patrick Simen, Richard L. Lewis, & Eric Freedman ... – Represents](https://reader030.fdocuments.us/reader030/viewer/2022040523/5e8578217889153d58302352/html5/thumbnails/21.jpg)
21
Mapping Productions Onto Attractors
IFLetter T
THENNumber 7
IFLetter L
THENNumber 1 Letter Number
Blue Production
Red Production
� Attributes = attractor nets/layers� Values = attractor patterns in the specified layer� Productions = associations between layers
![Page 22: Biologically-Inspired Control in Problem Solving · Biologically-Inspired Control in Problem Solving Thad A. Polk, Patrick Simen, Richard L. Lewis, & Eric Freedman ... – Represents](https://reader030.fdocuments.us/reader030/viewer/2022040523/5e8578217889153d58302352/html5/thumbnails/22.jpg)
22
Mapping Productions Onto Attractors
IFLetter T
THENNumber 7
IFLetter L
THENNumber 1 Letter Number
Blue Production
Red Production
� Attributes = attractor nets/layers� Values = attractor patterns in the specified layer� Productions = associations between layers
![Page 23: Biologically-Inspired Control in Problem Solving · Biologically-Inspired Control in Problem Solving Thad A. Polk, Patrick Simen, Richard L. Lewis, & Eric Freedman ... – Represents](https://reader030.fdocuments.us/reader030/viewer/2022040523/5e8578217889153d58302352/html5/thumbnails/23.jpg)
23
Mapping Productions Onto Attractors
IFLetter T
THENNumber 7
IFLetter L
THENNumber 1 Letter Number
Blue Production
Red Production
� Attributes = attractor nets/layers� Values = attractor patterns in the specified layer� Productions = associations between layers
![Page 24: Biologically-Inspired Control in Problem Solving · Biologically-Inspired Control in Problem Solving Thad A. Polk, Patrick Simen, Richard L. Lewis, & Eric Freedman ... – Represents](https://reader030.fdocuments.us/reader030/viewer/2022040523/5e8578217889153d58302352/html5/thumbnails/24.jpg)
24
Goal-Driven Control → Attractors
� Goals bias competition among attractors– A kind of conflict resolution
IFLetter1 T
THENResponse 7
IFLetter2 L
THENResponse 1
Letter2
Letter1
Initially, allpossibilitiesactivated…
Response
![Page 25: Biologically-Inspired Control in Problem Solving · Biologically-Inspired Control in Problem Solving Thad A. Polk, Patrick Simen, Richard L. Lewis, & Eric Freedman ... – Represents](https://reader030.fdocuments.us/reader030/viewer/2022040523/5e8578217889153d58302352/html5/thumbnails/25.jpg)
25
Goal-Driven Control → Attractors
� Goals bias competition among attractors– A kind of conflict resolution
IFLetter1 T
THENResponse 7
IFLetter2 L
THENResponse 1
Letter2
Letter1
…but attractorscompete…
Response
![Page 26: Biologically-Inspired Control in Problem Solving · Biologically-Inspired Control in Problem Solving Thad A. Polk, Patrick Simen, Richard L. Lewis, & Eric Freedman ... – Represents](https://reader030.fdocuments.us/reader030/viewer/2022040523/5e8578217889153d58302352/html5/thumbnails/26.jpg)
26
Goal-Driven Control → Attractors
� Goals bias competition among attractors– A kind of conflict resolution
IFLetter1 T
THENResponse 7
IFLetter2 L
THENResponse 1
Letter2Response
Letter1
…and eventuallyone wins.
Winner dependson associationstrengths & noise
![Page 27: Biologically-Inspired Control in Problem Solving · Biologically-Inspired Control in Problem Solving Thad A. Polk, Patrick Simen, Richard L. Lewis, & Eric Freedman ... – Represents](https://reader030.fdocuments.us/reader030/viewer/2022040523/5e8578217889153d58302352/html5/thumbnails/27.jpg)
27
Goal-Driven Control → Attractors
� Goals bias competition among attractors– A kind of conflict resolution
IFLetter1 T
THENResponse 7
IFLetter2 L
THENResponse 1
Letter2
Letter1
But a goal canbias competitionfor/against certainattractors...
Response
![Page 28: Biologically-Inspired Control in Problem Solving · Biologically-Inspired Control in Problem Solving Thad A. Polk, Patrick Simen, Richard L. Lewis, & Eric Freedman ... – Represents](https://reader030.fdocuments.us/reader030/viewer/2022040523/5e8578217889153d58302352/html5/thumbnails/28.jpg)
28
Goal-Driven Control → Attractors
� Goals bias competition among attractors– A kind of conflict resolution
IFLetter1 T
THENResponse 7
IFLetter2 L
THENResponse 1
Letter2
Letter1
But a goal canbias competitionfor/against certainattractors...
Response
![Page 29: Biologically-Inspired Control in Problem Solving · Biologically-Inspired Control in Problem Solving Thad A. Polk, Patrick Simen, Richard L. Lewis, & Eric Freedman ... – Represents](https://reader030.fdocuments.us/reader030/viewer/2022040523/5e8578217889153d58302352/html5/thumbnails/29.jpg)
29
Goal-Driven Control → Attractors
� Goals bias competition among attractors– A kind of conflict resolution
IFLetter1 T
THENResponse 7
IFLetter2 L
THENResponse 1
Letter2
Letter1
But a goal canbias competitionfor/against certainattractors...
Response
![Page 30: Biologically-Inspired Control in Problem Solving · Biologically-Inspired Control in Problem Solving Thad A. Polk, Patrick Simen, Richard L. Lewis, & Eric Freedman ... – Represents](https://reader030.fdocuments.us/reader030/viewer/2022040523/5e8578217889153d58302352/html5/thumbnails/30.jpg)
30
Mapping Productions To Attractors
� Attributes = attractor nets/layers� Values = attractor patterns in the specified layer� Productions = associations between layers
� We’ve implemented this mapping in Lisp/Perl:• Input: Simplified production rules• Output: Matlab code that implements attractor nets that
(often!) behave like the production system
� Can thus use the attractor architecture for some higher cognitive tasks
![Page 31: Biologically-Inspired Control in Problem Solving · Biologically-Inspired Control in Problem Solving Thad A. Polk, Patrick Simen, Richard L. Lewis, & Eric Freedman ... – Represents](https://reader030.fdocuments.us/reader030/viewer/2022040523/5e8578217889153d58302352/html5/thumbnails/31.jpg)
31
Plan
� Symbolic models of control
� A simple model of neural computation
� Mapping symbolic control onto neural nets
� Network model of Tower of London– Intact behavior– Damaged behavior
![Page 32: Biologically-Inspired Control in Problem Solving · Biologically-Inspired Control in Problem Solving Thad A. Polk, Patrick Simen, Richard L. Lewis, & Eric Freedman ... – Represents](https://reader030.fdocuments.us/reader030/viewer/2022040523/5e8578217889153d58302352/html5/thumbnails/32.jpg)
32
Modeling Tower of London
Move
Goal(External)
Subgoal(Internal)
Current State
![Page 33: Biologically-Inspired Control in Problem Solving · Biologically-Inspired Control in Problem Solving Thad A. Polk, Patrick Simen, Richard L. Lewis, & Eric Freedman ... – Represents](https://reader030.fdocuments.us/reader030/viewer/2022040523/5e8578217889153d58302352/html5/thumbnails/33.jpg)
33
Modeling Tower of London
Move
Goal(External)
Subgoal(Internal)
Current State
![Page 34: Biologically-Inspired Control in Problem Solving · Biologically-Inspired Control in Problem Solving Thad A. Polk, Patrick Simen, Richard L. Lewis, & Eric Freedman ... – Represents](https://reader030.fdocuments.us/reader030/viewer/2022040523/5e8578217889153d58302352/html5/thumbnails/34.jpg)
34
Modeling Tower of London
Move
Goal(External)
Subgoal(Internal)
Current State
![Page 35: Biologically-Inspired Control in Problem Solving · Biologically-Inspired Control in Problem Solving Thad A. Polk, Patrick Simen, Richard L. Lewis, & Eric Freedman ... – Represents](https://reader030.fdocuments.us/reader030/viewer/2022040523/5e8578217889153d58302352/html5/thumbnails/35.jpg)
35
Modeling Tower of London
Move
Goal(External)
Subgoal(Internal)
Current State
![Page 36: Biologically-Inspired Control in Problem Solving · Biologically-Inspired Control in Problem Solving Thad A. Polk, Patrick Simen, Richard L. Lewis, & Eric Freedman ... – Represents](https://reader030.fdocuments.us/reader030/viewer/2022040523/5e8578217889153d58302352/html5/thumbnails/36.jpg)
36
Modeling Tower of London
Move
Goal(External)
Subgoal(Internal)
Current State
Knowledge
Legal Moves to consider
![Page 37: Biologically-Inspired Control in Problem Solving · Biologically-Inspired Control in Problem Solving Thad A. Polk, Patrick Simen, Richard L. Lewis, & Eric Freedman ... – Represents](https://reader030.fdocuments.us/reader030/viewer/2022040523/5e8578217889153d58302352/html5/thumbnails/37.jpg)
37
Modeling Tower of London
Move
Goal(External)
Subgoal(Internal)
Current State
Knowledge
Legal Moves to considerTry to achieve goals
![Page 38: Biologically-Inspired Control in Problem Solving · Biologically-Inspired Control in Problem Solving Thad A. Polk, Patrick Simen, Richard L. Lewis, & Eric Freedman ... – Represents](https://reader030.fdocuments.us/reader030/viewer/2022040523/5e8578217889153d58302352/html5/thumbnails/38.jpg)
38
Modeling Tower of London
Move
Goal(External)
Subgoal(Internal)
Current State
Knowledge
Legal Moves to considerTry to achieve goalsSet subgoals to remove blockers
![Page 39: Biologically-Inspired Control in Problem Solving · Biologically-Inspired Control in Problem Solving Thad A. Polk, Patrick Simen, Richard L. Lewis, & Eric Freedman ... – Represents](https://reader030.fdocuments.us/reader030/viewer/2022040523/5e8578217889153d58302352/html5/thumbnails/39.jpg)
39
Modeling Tower of London
Move
Goal(External)
Subgoal(Internal)
Current State
Knowledge
Legal Moves to considerTry to achieve goalsSet subgoals to remove blockersTry to achieve subgoals
![Page 40: Biologically-Inspired Control in Problem Solving · Biologically-Inspired Control in Problem Solving Thad A. Polk, Patrick Simen, Richard L. Lewis, & Eric Freedman ... – Represents](https://reader030.fdocuments.us/reader030/viewer/2022040523/5e8578217889153d58302352/html5/thumbnails/40.jpg)
40
Move
Goal(External)
Subgoal(Internal)
DLPFC
Hypothesis: DLPFC represents internal subgoals– Modulates competition among posterior attractors– Note: Not needed for externally provided goals
Current State
The Role of DLPFC
![Page 41: Biologically-Inspired Control in Problem Solving · Biologically-Inspired Control in Problem Solving Thad A. Polk, Patrick Simen, Richard L. Lewis, & Eric Freedman ... – Represents](https://reader030.fdocuments.us/reader030/viewer/2022040523/5e8578217889153d58302352/html5/thumbnails/41.jpg)
41
The Function of DLPFC SubgoalsCurrent Goal
100 120 140 160 180 200 2200
0.01
0.02
0.03
0.04
0.05
0.06
0.07
0.08
% M
axim
al A
ctva
tion
Simulation Cycle
MoveCurrent
Goal(External)
Subgoal(Internal)
Time
Act
ivat
ion
When subgoal net damaged,noise can overwhelm weakinput from subgoal leadingwrong move to be chosen.
“Correct” subgoal move(e.g., Red to peg 3) loses
“Incorrect” legal move(e.g., Red to peg 1) wins
![Page 42: Biologically-Inspired Control in Problem Solving · Biologically-Inspired Control in Problem Solving Thad A. Polk, Patrick Simen, Richard L. Lewis, & Eric Freedman ... – Represents](https://reader030.fdocuments.us/reader030/viewer/2022040523/5e8578217889153d58302352/html5/thumbnails/42.jpg)
42
Human Data
0
2
4
6
8
10
12
1 2 3 4 5 6 7 8
Problem Complexity(Min # Moves)
MinimumHuman MeanHuman Median
42 undergraduates (Intact?)18 TOL problems varying in minimum number of moves
![Page 43: Biologically-Inspired Control in Problem Solving · Biologically-Inspired Control in Problem Solving Thad A. Polk, Patrick Simen, Richard L. Lewis, & Eric Freedman ... – Represents](https://reader030.fdocuments.us/reader030/viewer/2022040523/5e8578217889153d58302352/html5/thumbnails/43.jpg)
43
Intact Simulation
0
2
4
6
8
10
12
1 2 3 4 5 6 7 8
Problem Complexity(Min # Moves)
MinimumHuman AvgHuman MedianPrediction
![Page 44: Biologically-Inspired Control in Problem Solving · Biologically-Inspired Control in Problem Solving Thad A. Polk, Patrick Simen, Richard L. Lewis, & Eric Freedman ... – Represents](https://reader030.fdocuments.us/reader030/viewer/2022040523/5e8578217889153d58302352/html5/thumbnails/44.jpg)
44
Prefrontal Data
0
1
2
3
2 3 4 5
FrontalsControls
2
4
6
8
2 to 3 4 to 5
Owen et al. (1990) Carlin et al. (2000)
Problem Complexity(Minimum Number of Moves)
Group x Difficulty interaction:Prefrontal deficit is more apparent on harder problems
![Page 45: Biologically-Inspired Control in Problem Solving · Biologically-Inspired Control in Problem Solving Thad A. Polk, Patrick Simen, Richard L. Lewis, & Eric Freedman ... – Represents](https://reader030.fdocuments.us/reader030/viewer/2022040523/5e8578217889153d58302352/html5/thumbnails/45.jpg)
45
Prefrontal Simulations
0
1
2
3
4
5
6
7
8
1 2 3 4 5
Intact20% Lesion40% Lesion60% Lesion
![Page 46: Biologically-Inspired Control in Problem Solving · Biologically-Inspired Control in Problem Solving Thad A. Polk, Patrick Simen, Richard L. Lewis, & Eric Freedman ... – Represents](https://reader030.fdocuments.us/reader030/viewer/2022040523/5e8578217889153d58302352/html5/thumbnails/46.jpg)
46
Problems with Prepotent Responses
0
2
4
6
8
10
12
14
16
Prepotent Correct Prepotent Incorrect
MinimumIntact20% Damage30% Damage
Initial Goal GoalInitial
![Page 47: Biologically-Inspired Control in Problem Solving · Biologically-Inspired Control in Problem Solving Thad A. Polk, Patrick Simen, Richard L. Lewis, & Eric Freedman ... – Represents](https://reader030.fdocuments.us/reader030/viewer/2022040523/5e8578217889153d58302352/html5/thumbnails/47.jpg)
47
Issues Raised by the Mapping� A number of features of production systems DON’T
map easily:– Variables– Independence/modularity of different productions– All-or-none matching
� Possible responses:– Neural nets lack critical functionality for modeling cognition
• Need to work on increasing their functionality
– Production systems have too much functionality• Might use less powerful production systems that map more
naturally
– Both are probably reasonable
![Page 48: Biologically-Inspired Control in Problem Solving · Biologically-Inspired Control in Problem Solving Thad A. Polk, Patrick Simen, Richard L. Lewis, & Eric Freedman ... – Represents](https://reader030.fdocuments.us/reader030/viewer/2022040523/5e8578217889153d58302352/html5/thumbnails/48.jpg)
48
Summary
1. Natural & explicit mapping from goal-driven production systems onto neural computation
– Makes it possible to build plausible neural models of complex problem solving
2. Mapping leads to explicit hypothesis about the role of DLPFC in problem solving:
– Represents internally generated subgoals that modulate among choices
3. Applying to TOL accurately simulates human behavior– Intact model simulates normals, even on hardest problems
– Lesioning subgoal net simulates prefrontal deficits