The Evolution of Cooperationsmaldino.com/wp/wp-content/uploads/2017/08/SmaldinoABM_Day3.… · •...
Transcript of The Evolution of Cooperationsmaldino.com/wp/wp-content/uploads/2017/08/SmaldinoABM_Day3.… · •...
![Page 1: The Evolution of Cooperationsmaldino.com/wp/wp-content/uploads/2017/08/SmaldinoABM_Day3.… · • Some games have no ... can be transmitted (either genetically or through social](https://reader036.fdocuments.us/reader036/viewer/2022070920/5fb9364dda5f0625982339c9/html5/thumbnails/1.jpg)
Paul Smaldino
Day 3
The Evolution of Cooperation
Computational Modeling of Social Behavior
![Page 2: The Evolution of Cooperationsmaldino.com/wp/wp-content/uploads/2017/08/SmaldinoABM_Day3.… · • Some games have no ... can be transmitted (either genetically or through social](https://reader036.fdocuments.us/reader036/viewer/2022070920/5fb9364dda5f0625982339c9/html5/thumbnails/2.jpg)
Outline of the day
• Morning ‣ Cooperation and the Prisoner’s Dilemma ‣ Paths to cooperation: Positive assortment
• Afternoon‣ Modeling agent interactions and exploring
assumptions
![Page 3: The Evolution of Cooperationsmaldino.com/wp/wp-content/uploads/2017/08/SmaldinoABM_Day3.… · • Some games have no ... can be transmitted (either genetically or through social](https://reader036.fdocuments.us/reader036/viewer/2022070920/5fb9364dda5f0625982339c9/html5/thumbnails/3.jpg)
The Problem of Cooperation
Individual organisms helping others at a cost
How does cooperation emerge in a population?
Once present, how do cooperators maintain an advantage over non-cooperators?
What factors facilitate more or less cooperation?
![Page 4: The Evolution of Cooperationsmaldino.com/wp/wp-content/uploads/2017/08/SmaldinoABM_Day3.… · • Some games have no ... can be transmitted (either genetically or through social](https://reader036.fdocuments.us/reader036/viewer/2022070920/5fb9364dda5f0625982339c9/html5/thumbnails/4.jpg)
The Prisoner’s Dilemma
Cooperate Defect
Cooperate R = 3 S = 0
Defect T = 5 P = 1Play
er 1
Player 2The archetypal model for altruistic cooperation
T > R > P > SR > (T + S)/2
(Note: payoff is to Player 1)
![Page 5: The Evolution of Cooperationsmaldino.com/wp/wp-content/uploads/2017/08/SmaldinoABM_Day3.… · • Some games have no ... can be transmitted (either genetically or through social](https://reader036.fdocuments.us/reader036/viewer/2022070920/5fb9364dda5f0625982339c9/html5/thumbnails/5.jpg)
Stag Hunt Game
Snowdrift Game
![Page 6: The Evolution of Cooperationsmaldino.com/wp/wp-content/uploads/2017/08/SmaldinoABM_Day3.… · • Some games have no ... can be transmitted (either genetically or through social](https://reader036.fdocuments.us/reader036/viewer/2022070920/5fb9364dda5f0625982339c9/html5/thumbnails/6.jpg)
Nash Equilibrium• Game solution in which no
player can benefit by unilaterally changing his or her strategy
• Some games have no Nash Equilibrium, some have several
• In one-shot PD game, Nash equilibrium is Defect
John Nash 1928–2015
![Page 7: The Evolution of Cooperationsmaldino.com/wp/wp-content/uploads/2017/08/SmaldinoABM_Day3.… · • Some games have no ... can be transmitted (either genetically or through social](https://reader036.fdocuments.us/reader036/viewer/2022070920/5fb9364dda5f0625982339c9/html5/thumbnails/7.jpg)
Evolutionary game theory
• Instead of considering optimal strategic decision makers, assume that strategies acts as traits that can be transmitted (either genetically or through social learning)
• Added realism: Not just what strategy is best, but how can we get from one population structure to another
![Page 8: The Evolution of Cooperationsmaldino.com/wp/wp-content/uploads/2017/08/SmaldinoABM_Day3.… · • Some games have no ... can be transmitted (either genetically or through social](https://reader036.fdocuments.us/reader036/viewer/2022070920/5fb9364dda5f0625982339c9/html5/thumbnails/8.jpg)
Natural SelectionTraits:
Fitness of green > fitness of oranget1
t2
t3
![Page 9: The Evolution of Cooperationsmaldino.com/wp/wp-content/uploads/2017/08/SmaldinoABM_Day3.… · • Some games have no ... can be transmitted (either genetically or through social](https://reader036.fdocuments.us/reader036/viewer/2022070920/5fb9364dda5f0625982339c9/html5/thumbnails/9.jpg)
How could cooperative strategies evolve?
• Inclusive fitness (“kin selection”)- If I help close relatives, I’m helping my genes to
survive, even if they’re not my genes - Altruism can evolve if its directed toward relatives
• Reciprocal altruism- If we’re likely to meet often, we can build up
expectations of reciprocal cooperation
![Page 10: The Evolution of Cooperationsmaldino.com/wp/wp-content/uploads/2017/08/SmaldinoABM_Day3.… · • Some games have no ... can be transmitted (either genetically or through social](https://reader036.fdocuments.us/reader036/viewer/2022070920/5fb9364dda5f0625982339c9/html5/thumbnails/10.jpg)
![Page 11: The Evolution of Cooperationsmaldino.com/wp/wp-content/uploads/2017/08/SmaldinoABM_Day3.… · • Some games have no ... can be transmitted (either genetically or through social](https://reader036.fdocuments.us/reader036/viewer/2022070920/5fb9364dda5f0625982339c9/html5/thumbnails/11.jpg)
Evolutionary Stable Strategy (ESS)
• In an evolutionary game, Strategy A is an ESS against Strategy B if a rare mutant of type B cannot invade a population where A is common.
![Page 12: The Evolution of Cooperationsmaldino.com/wp/wp-content/uploads/2017/08/SmaldinoABM_Day3.… · • Some games have no ... can be transmitted (either genetically or through social](https://reader036.fdocuments.us/reader036/viewer/2022070920/5fb9364dda5f0625982339c9/html5/thumbnails/12.jpg)
ALLD is an ESS against ALLC• Assume all games continue for another round with
probability w.
• Payoff to ALLD vs. ALLD = P + wP + w2P + …
• Payoff to ALLC vs. ALLD = S + wS + w2S + …
P > S, so ALLC cannot invade
Iterated games
![Page 13: The Evolution of Cooperationsmaldino.com/wp/wp-content/uploads/2017/08/SmaldinoABM_Day3.… · • Some games have no ... can be transmitted (either genetically or through social](https://reader036.fdocuments.us/reader036/viewer/2022070920/5fb9364dda5f0625982339c9/html5/thumbnails/13.jpg)
ALLC can be invaded by ALLD
• Assume all games continue for another round with probability w.
• Payoff to ALLC vs. ALLC = R + wR + w2R + …
• Payoff to ALLD vs. ALLC = T + wT + w2T + …
T > R, so ALLD can always invade
Iterated games
![Page 14: The Evolution of Cooperationsmaldino.com/wp/wp-content/uploads/2017/08/SmaldinoABM_Day3.… · • Some games have no ... can be transmitted (either genetically or through social](https://reader036.fdocuments.us/reader036/viewer/2022070920/5fb9364dda5f0625982339c9/html5/thumbnails/14.jpg)
Axelrod & Hamilton’s Tournament
• Iterated prisoner’s dilemma: game played for multiple rounds
• Contestants submitted strategies that could learn and adapt
• All strategies paired in round robin tournament with game length of 200 moves
• Tournament 1: 14 entries + random
• Tournament 2: 62 entries
• The winner both times: TIT FOR TAT - Plays Cooperate on first move and then copies opponent’s previous move - TFT is nice, retaliatory, forgiving, and clear
Axelrod & Hamilton (1981) Science
![Page 15: The Evolution of Cooperationsmaldino.com/wp/wp-content/uploads/2017/08/SmaldinoABM_Day3.… · • Some games have no ... can be transmitted (either genetically or through social](https://reader036.fdocuments.us/reader036/viewer/2022070920/5fb9364dda5f0625982339c9/html5/thumbnails/15.jpg)
TFT can resist invasion by ALLD
• Assume all games continue for another round with probability w.
• Payoff to TFT vs. TFT = R + wR + w2R + …
• Payoff to ALLD vs. TFT = T + wP + w2P + …
T > R, but R > P. So, if games go on long enough, maybe TFT can be an ESS against ALLD…
![Page 16: The Evolution of Cooperationsmaldino.com/wp/wp-content/uploads/2017/08/SmaldinoABM_Day3.… · • Some games have no ... can be transmitted (either genetically or through social](https://reader036.fdocuments.us/reader036/viewer/2022070920/5fb9364dda5f0625982339c9/html5/thumbnails/16.jpg)
When can TFT resist invasion by ALLD?
V (TFT |TFT ) = R+ wR+ w2R+ w3R+ . . .
= R(1 + w + w2 + w3 + . . . )
x = 1 + w + w
2 + w
3 + . . .
= 1 + w(1 + w + w
2 + w
3 + . . . )
= 1 + wx
x = 1 + wx
x� wx = 1
x(1� w) = 1
x =1
1� w
V (TFT |TFT ) =R
1� w
![Page 17: The Evolution of Cooperationsmaldino.com/wp/wp-content/uploads/2017/08/SmaldinoABM_Day3.… · • Some games have no ... can be transmitted (either genetically or through social](https://reader036.fdocuments.us/reader036/viewer/2022070920/5fb9364dda5f0625982339c9/html5/thumbnails/17.jpg)
When can TFT resist invasion by ALLD?
V (ALLD|TFT ) = T + wP + w2P + w3P + . . .
= T + P (w + w2 + w3 + . . . )
z = w + w
2 + w
3 + . . .
= w(1 + w + w
2 + . . . )
= wx
=w
1� w
V (ALLD|TFT ) = T +wP
1� w
When is V (TFT |TFT ) > V (ALLD|TFT )?
![Page 18: The Evolution of Cooperationsmaldino.com/wp/wp-content/uploads/2017/08/SmaldinoABM_Day3.… · • Some games have no ... can be transmitted (either genetically or through social](https://reader036.fdocuments.us/reader036/viewer/2022070920/5fb9364dda5f0625982339c9/html5/thumbnails/18.jpg)
When can TFT resist invasion by ALLD?
R
1� w> T +
wP
1� w
R� wP
1� w> T
R� wP > T � wT
R� T > wP � wT
R� T > w(P � T )
neg
w >R� T
P � T
neg
neg
w >T �R
T � P
C D
C b – c –c
D b 0
Hamiltonian payoffs:
w >b� (b� c)
b� 0
w >c
b
wb > c
![Page 19: The Evolution of Cooperationsmaldino.com/wp/wp-content/uploads/2017/08/SmaldinoABM_Day3.… · • Some games have no ... can be transmitted (either genetically or through social](https://reader036.fdocuments.us/reader036/viewer/2022070920/5fb9364dda5f0625982339c9/html5/thumbnails/19.jpg)
![Page 20: The Evolution of Cooperationsmaldino.com/wp/wp-content/uploads/2017/08/SmaldinoABM_Day3.… · • Some games have no ... can be transmitted (either genetically or through social](https://reader036.fdocuments.us/reader036/viewer/2022070920/5fb9364dda5f0625982339c9/html5/thumbnails/20.jpg)
Roads to Cooperation“Five rules for the evolution of cooperation”
Nowak MA (2006) Science
![Page 21: The Evolution of Cooperationsmaldino.com/wp/wp-content/uploads/2017/08/SmaldinoABM_Day3.… · • Some games have no ... can be transmitted (either genetically or through social](https://reader036.fdocuments.us/reader036/viewer/2022070920/5fb9364dda5f0625982339c9/html5/thumbnails/21.jpg)
Roads to Cooperation“Five rules for the evolution of cooperation” One rule for the evolution of
cooperation:
Positive assortment
![Page 22: The Evolution of Cooperationsmaldino.com/wp/wp-content/uploads/2017/08/SmaldinoABM_Day3.… · • Some games have no ... can be transmitted (either genetically or through social](https://reader036.fdocuments.us/reader036/viewer/2022070920/5fb9364dda5f0625982339c9/html5/thumbnails/22.jpg)
Structure Instead of Strategy
• Pure strategies only (C or D)
• Rigid spatial structure: 2D square lattice with Moore neighborhoods
• Game play: All agents spatial neighbors
• Evolution: After each round, each agent copies the strategy of its neighbor with the highest total payoff (itself included)
![Page 23: The Evolution of Cooperationsmaldino.com/wp/wp-content/uploads/2017/08/SmaldinoABM_Day3.… · • Some games have no ... can be transmitted (either genetically or through social](https://reader036.fdocuments.us/reader036/viewer/2022070920/5fb9364dda5f0625982339c9/html5/thumbnails/23.jpg)
Cooperate Defect
Cooperate R = 1 S = 0
Defect T = b P = 0Play
er 1
Player 2
b > 1
Only one free game parameter: b
![Page 24: The Evolution of Cooperationsmaldino.com/wp/wp-content/uploads/2017/08/SmaldinoABM_Day3.… · • Some games have no ... can be transmitted (either genetically or through social](https://reader036.fdocuments.us/reader036/viewer/2022070920/5fb9364dda5f0625982339c9/html5/thumbnails/24.jpg)
C from C
D from D
C from D
D from C
t t – 1
![Page 25: The Evolution of Cooperationsmaldino.com/wp/wp-content/uploads/2017/08/SmaldinoABM_Day3.… · • Some games have no ... can be transmitted (either genetically or through social](https://reader036.fdocuments.us/reader036/viewer/2022070920/5fb9364dda5f0625982339c9/html5/thumbnails/25.jpg)
![Page 26: The Evolution of Cooperationsmaldino.com/wp/wp-content/uploads/2017/08/SmaldinoABM_Day3.… · • Some games have no ... can be transmitted (either genetically or through social](https://reader036.fdocuments.us/reader036/viewer/2022070920/5fb9364dda5f0625982339c9/html5/thumbnails/26.jpg)
![Page 27: The Evolution of Cooperationsmaldino.com/wp/wp-content/uploads/2017/08/SmaldinoABM_Day3.… · • Some games have no ... can be transmitted (either genetically or through social](https://reader036.fdocuments.us/reader036/viewer/2022070920/5fb9364dda5f0625982339c9/html5/thumbnails/27.jpg)
synchronous updating asynchronous updating
![Page 28: The Evolution of Cooperationsmaldino.com/wp/wp-content/uploads/2017/08/SmaldinoABM_Day3.… · • Some games have no ... can be transmitted (either genetically or through social](https://reader036.fdocuments.us/reader036/viewer/2022070920/5fb9364dda5f0625982339c9/html5/thumbnails/28.jpg)
asynchronous updating
![Page 29: The Evolution of Cooperationsmaldino.com/wp/wp-content/uploads/2017/08/SmaldinoABM_Day3.… · • Some games have no ... can be transmitted (either genetically or through social](https://reader036.fdocuments.us/reader036/viewer/2022070920/5fb9364dda5f0625982339c9/html5/thumbnails/29.jpg)
synchronous updating
![Page 30: The Evolution of Cooperationsmaldino.com/wp/wp-content/uploads/2017/08/SmaldinoABM_Day3.… · • Some games have no ... can be transmitted (either genetically or through social](https://reader036.fdocuments.us/reader036/viewer/2022070920/5fb9364dda5f0625982339c9/html5/thumbnails/30.jpg)
![Page 31: The Evolution of Cooperationsmaldino.com/wp/wp-content/uploads/2017/08/SmaldinoABM_Day3.… · • Some games have no ... can be transmitted (either genetically or through social](https://reader036.fdocuments.us/reader036/viewer/2022070920/5fb9364dda5f0625982339c9/html5/thumbnails/31.jpg)
![Page 32: The Evolution of Cooperationsmaldino.com/wp/wp-content/uploads/2017/08/SmaldinoABM_Day3.… · • Some games have no ... can be transmitted (either genetically or through social](https://reader036.fdocuments.us/reader036/viewer/2022070920/5fb9364dda5f0625982339c9/html5/thumbnails/32.jpg)
![Page 33: The Evolution of Cooperationsmaldino.com/wp/wp-content/uploads/2017/08/SmaldinoABM_Day3.… · • Some games have no ... can be transmitted (either genetically or through social](https://reader036.fdocuments.us/reader036/viewer/2022070920/5fb9364dda5f0625982339c9/html5/thumbnails/33.jpg)
![Page 34: The Evolution of Cooperationsmaldino.com/wp/wp-content/uploads/2017/08/SmaldinoABM_Day3.… · • Some games have no ... can be transmitted (either genetically or through social](https://reader036.fdocuments.us/reader036/viewer/2022070920/5fb9364dda5f0625982339c9/html5/thumbnails/34.jpg)
![Page 35: The Evolution of Cooperationsmaldino.com/wp/wp-content/uploads/2017/08/SmaldinoABM_Day3.… · • Some games have no ... can be transmitted (either genetically or through social](https://reader036.fdocuments.us/reader036/viewer/2022070920/5fb9364dda5f0625982339c9/html5/thumbnails/35.jpg)
![Page 36: The Evolution of Cooperationsmaldino.com/wp/wp-content/uploads/2017/08/SmaldinoABM_Day3.… · • Some games have no ... can be transmitted (either genetically or through social](https://reader036.fdocuments.us/reader036/viewer/2022070920/5fb9364dda5f0625982339c9/html5/thumbnails/36.jpg)
Models of cooperation used to study dynamics related to
• Reciprocity
• Reputation
• Punishment
• Monitoring
• Group competition
• Social markers
• Mobility
• Network structure
• Etc.
![Page 37: The Evolution of Cooperationsmaldino.com/wp/wp-content/uploads/2017/08/SmaldinoABM_Day3.… · • Some games have no ... can be transmitted (either genetically or through social](https://reader036.fdocuments.us/reader036/viewer/2022070920/5fb9364dda5f0625982339c9/html5/thumbnails/37.jpg)
Moving toward greater biologically realism
• Cellular automata models are elegant, but highly constrained
• Some minimal properties of biologically realistic agents ‣ Embodiment ‣ Mobility ‣ Costly reproduction ‣ Long lifespan relative to
interaction time
C Dvs.
![Page 38: The Evolution of Cooperationsmaldino.com/wp/wp-content/uploads/2017/08/SmaldinoABM_Day3.… · • Some games have no ... can be transmitted (either genetically or through social](https://reader036.fdocuments.us/reader036/viewer/2022070920/5fb9364dda5f0625982339c9/html5/thumbnails/38.jpg)
Questions about implementation
• Some minimal properties of biologically realistic agents ‣ Embodiment‣ How does embodiment affect interactions?
‣ Mobility‣ How do they move?
‣ Costly reproduction‣ Do offspring disperse?
‣ Long lifespan relative to interaction time‣ What affects their survival?
![Page 39: The Evolution of Cooperationsmaldino.com/wp/wp-content/uploads/2017/08/SmaldinoABM_Day3.… · • Some games have no ... can be transmitted (either genetically or through social](https://reader036.fdocuments.us/reader036/viewer/2022070920/5fb9364dda5f0625982339c9/html5/thumbnails/39.jpg)
![Page 40: The Evolution of Cooperationsmaldino.com/wp/wp-content/uploads/2017/08/SmaldinoABM_Day3.… · • Some games have no ... can be transmitted (either genetically or through social](https://reader036.fdocuments.us/reader036/viewer/2022070920/5fb9364dda5f0625982339c9/html5/thumbnails/40.jpg)
![Page 41: The Evolution of Cooperationsmaldino.com/wp/wp-content/uploads/2017/08/SmaldinoABM_Day3.… · • Some games have no ... can be transmitted (either genetically or through social](https://reader036.fdocuments.us/reader036/viewer/2022070920/5fb9364dda5f0625982339c9/html5/thumbnails/41.jpg)
![Page 42: The Evolution of Cooperationsmaldino.com/wp/wp-content/uploads/2017/08/SmaldinoABM_Day3.… · • Some games have no ... can be transmitted (either genetically or through social](https://reader036.fdocuments.us/reader036/viewer/2022070920/5fb9364dda5f0625982339c9/html5/thumbnails/42.jpg)
![Page 43: The Evolution of Cooperationsmaldino.com/wp/wp-content/uploads/2017/08/SmaldinoABM_Day3.… · • Some games have no ... can be transmitted (either genetically or through social](https://reader036.fdocuments.us/reader036/viewer/2022070920/5fb9364dda5f0625982339c9/html5/thumbnails/43.jpg)
• Remainder of today: - Attempt today’s Modeling Challenge
• Tomorrow: - Model validity and empirical data - Networks - Coda