Game EvolGameTheory
-
Upload
anubha-gupta -
Category
Documents
-
view
65 -
download
1
Transcript of Game EvolGameTheory
![Page 1: Game EvolGameTheory](https://reader036.fdocuments.us/reader036/viewer/2022081602/547f5d58b4af9fbe158b5ac5/html5/thumbnails/1.jpg)
An Introduction to... Evolutionary Game
Theory
By Jin Xiao,Jeff Thomas,Jeff Westwell
![Page 2: Game EvolGameTheory](https://reader036.fdocuments.us/reader036/viewer/2022081602/547f5d58b4af9fbe158b5ac5/html5/thumbnails/2.jpg)
How would game theory view this?
![Page 3: Game EvolGameTheory](https://reader036.fdocuments.us/reader036/viewer/2022081602/547f5d58b4af9fbe158b5ac5/html5/thumbnails/3.jpg)
What will we discuss?
• Brief History of Game Theory
• Payoff Matrix
• Types of Games
• Basic Strategies
• Evolutionary Concepts
• Limitations and Problems
![Page 4: Game EvolGameTheory](https://reader036.fdocuments.us/reader036/viewer/2022081602/547f5d58b4af9fbe158b5ac5/html5/thumbnails/4.jpg)
Brief History of Game Theory• 1913 - E. Zermelo provided the first theorem of game theory
asserts that chess is strictly determined
• 1928 - John von Neumann proved the minimax theorem
• 1944 - John von Neumann / Oskar Morgenstern’s wrote
"Theory of Games and Economic Behavior”
• 1950-1953, John Nash describes Nash equilibrium
• 1972 - John Maynard Smith wrote
“Game Theory and The Evolution of Fighting”
![Page 5: Game EvolGameTheory](https://reader036.fdocuments.us/reader036/viewer/2022081602/547f5d58b4af9fbe158b5ac5/html5/thumbnails/5.jpg)
RationalityAssumptions:
• humans are rational beings
• humans always seek the best alternative in a set of possible choices
Why assume rationality?
• narrow down the range of possibilities
• predictability
![Page 6: Game EvolGameTheory](https://reader036.fdocuments.us/reader036/viewer/2022081602/547f5d58b4af9fbe158b5ac5/html5/thumbnails/6.jpg)
Utility Theory
Utility Theory based on:
• rationality
• maximization of utility
It is a quantification of a person's preferences with respect to certain objects.
![Page 7: Game EvolGameTheory](https://reader036.fdocuments.us/reader036/viewer/2022081602/547f5d58b4af9fbe158b5ac5/html5/thumbnails/7.jpg)
What is Game Theory?
Game theory is a study of how to mathematically determine the best strategy for given conditions in order to optimize the outcome
![Page 8: Game EvolGameTheory](https://reader036.fdocuments.us/reader036/viewer/2022081602/547f5d58b4af9fbe158b5ac5/html5/thumbnails/8.jpg)
Game Theory
• Finding acceptable, if not optimal, strategies in conflict situations.
• Abstraction of real complex situation
• Game theory is highly mathematical
• Game theory assumes all human interactions can be understood and navigated by presumptions.
![Page 9: Game EvolGameTheory](https://reader036.fdocuments.us/reader036/viewer/2022081602/547f5d58b4af9fbe158b5ac5/html5/thumbnails/9.jpg)
Why is game theory important?
• All intelligent beings make decisions all the time.
• AI needs to perform these tasks as a result.
• Helps us to analyze situations more rationally and formulate an acceptable alternative with respect to circumstance.
![Page 10: Game EvolGameTheory](https://reader036.fdocuments.us/reader036/viewer/2022081602/547f5d58b4af9fbe158b5ac5/html5/thumbnails/10.jpg)
The Payoff Matrix
Player #1
Player #2
Strategy #1 Strategy #2
Strategy #1
Strategy #2
Payoff (1,1) Payoff (1,2)
Payoff (2,1) Payoff (2,2)
![Page 11: Game EvolGameTheory](https://reader036.fdocuments.us/reader036/viewer/2022081602/547f5d58b4af9fbe158b5ac5/html5/thumbnails/11.jpg)
Types of Games
• Sequential vs. Simultaneous moves
• Single Play vs. Iterated
• Zero vs. non-zero sum
• Perfect vs. Imperfect information
• Cooperative vs. conflict
![Page 12: Game EvolGameTheory](https://reader036.fdocuments.us/reader036/viewer/2022081602/547f5d58b4af9fbe158b5ac5/html5/thumbnails/12.jpg)
Zero-Sum Games
• The sum of the payoffs remains constant during the course of the game.
• Two sides in conflict
• Being well informed always helps a player
![Page 13: Game EvolGameTheory](https://reader036.fdocuments.us/reader036/viewer/2022081602/547f5d58b4af9fbe158b5ac5/html5/thumbnails/13.jpg)
Non-zero Sum Game
• The sum of payoffs is not constant during the course of game play.
• Players may co-operate or compete
• Being well informed may harm a player.
![Page 14: Game EvolGameTheory](https://reader036.fdocuments.us/reader036/viewer/2022081602/547f5d58b4af9fbe158b5ac5/html5/thumbnails/14.jpg)
Games of Perfect Information
• The information concerning an opponent’s move is well known in advance.
• All sequential move games are of this type.
![Page 15: Game EvolGameTheory](https://reader036.fdocuments.us/reader036/viewer/2022081602/547f5d58b4af9fbe158b5ac5/html5/thumbnails/15.jpg)
Imperfect Information
• Partial or no information concerning the opponent is given in advance to the player’s decision.
• Imperfect information may be diminished over time if the same game with the same opponent is to be repeated.
![Page 16: Game EvolGameTheory](https://reader036.fdocuments.us/reader036/viewer/2022081602/547f5d58b4af9fbe158b5ac5/html5/thumbnails/16.jpg)
Key Area of Interest
• chance
• strategy
![Page 17: Game EvolGameTheory](https://reader036.fdocuments.us/reader036/viewer/2022081602/547f5d58b4af9fbe158b5ac5/html5/thumbnails/17.jpg)
Prisoner’s Dilemma
![Page 18: Game EvolGameTheory](https://reader036.fdocuments.us/reader036/viewer/2022081602/547f5d58b4af9fbe158b5ac5/html5/thumbnails/18.jpg)
Prisoner’s Dilemma
![Page 19: Game EvolGameTheory](https://reader036.fdocuments.us/reader036/viewer/2022081602/547f5d58b4af9fbe158b5ac5/html5/thumbnails/19.jpg)
Games of Conflict
• Two sides competing against each other
• Usually caused by complete lack of information about the opponent or the game
• Characteristic of zero-sum games
![Page 20: Game EvolGameTheory](https://reader036.fdocuments.us/reader036/viewer/2022081602/547f5d58b4af9fbe158b5ac5/html5/thumbnails/20.jpg)
Games of Co-operation
Players may improve payoff through
• communicating
• forming binding coalitions & agreements
• do not apply to zero-sum games
Prisoner’s Dilemma
with Cooperation
![Page 21: Game EvolGameTheory](https://reader036.fdocuments.us/reader036/viewer/2022081602/547f5d58b4af9fbe158b5ac5/html5/thumbnails/21.jpg)
Prisoner’s Dilemma with Iteration
• Infinite number of iterations– Fear of retaliation
• Fixed number of iteration– Domino effect
![Page 22: Game EvolGameTheory](https://reader036.fdocuments.us/reader036/viewer/2022081602/547f5d58b4af9fbe158b5ac5/html5/thumbnails/22.jpg)
Basic Strategies
1. Plan ahead and look back
2. Use a dominating strategy if possible
3. Eliminate any dominated strategies
4. Look for any equilibrium
5. Mix up the strategies
![Page 23: Game EvolGameTheory](https://reader036.fdocuments.us/reader036/viewer/2022081602/547f5d58b4af9fbe158b5ac5/html5/thumbnails/23.jpg)
Plan ahead and look back
![Page 24: Game EvolGameTheory](https://reader036.fdocuments.us/reader036/viewer/2022081602/547f5d58b4af9fbe158b5ac5/html5/thumbnails/24.jpg)
If you have a Dominating strategy, use it
Use strategy 1
![Page 25: Game EvolGameTheory](https://reader036.fdocuments.us/reader036/viewer/2022081602/547f5d58b4af9fbe158b5ac5/html5/thumbnails/25.jpg)
Eliminate any Dominated strategy
Eliminate strategy 2 as it’s dominated by strategy 1
![Page 26: Game EvolGameTheory](https://reader036.fdocuments.us/reader036/viewer/2022081602/547f5d58b4af9fbe158b5ac5/html5/thumbnails/26.jpg)
Look for any equilibrium
• Dominating Equilibrium
• Minimax Equilibrium
• Nash Equilibrium
![Page 27: Game EvolGameTheory](https://reader036.fdocuments.us/reader036/viewer/2022081602/547f5d58b4af9fbe158b5ac5/html5/thumbnails/27.jpg)
Maximin & Minimax Equilibrium
• Minimax - to minimize the maximum loss (defensive)
• Maximin - to maximize the minimum gain (offensive)
• Minimax = Maximin
![Page 28: Game EvolGameTheory](https://reader036.fdocuments.us/reader036/viewer/2022081602/547f5d58b4af9fbe158b5ac5/html5/thumbnails/28.jpg)
Maximin & Minimax Equilibrium Strategies
![Page 29: Game EvolGameTheory](https://reader036.fdocuments.us/reader036/viewer/2022081602/547f5d58b4af9fbe158b5ac5/html5/thumbnails/29.jpg)
Definition: Nash Equilibrium
“If there is a set of strategies with the property that no player can benefit by changing her strategy while the other players keep their strategies unchanged, then that set of strategies and the corresponding payoffs constitute the Nash Equilibrium. “
Source: http://www.lebow.drexel.edu/economics/mccain/game/game.html
![Page 30: Game EvolGameTheory](https://reader036.fdocuments.us/reader036/viewer/2022081602/547f5d58b4af9fbe158b5ac5/html5/thumbnails/30.jpg)
Is this a Nash Equilibrium?
![Page 31: Game EvolGameTheory](https://reader036.fdocuments.us/reader036/viewer/2022081602/547f5d58b4af9fbe158b5ac5/html5/thumbnails/31.jpg)
Cost to press button = 2 units
When button is pressed, food given = 10 units
Boxed Pigs Example
![Page 32: Game EvolGameTheory](https://reader036.fdocuments.us/reader036/viewer/2022081602/547f5d58b4af9fbe158b5ac5/html5/thumbnails/32.jpg)
Decisions, decisions...
![Page 33: Game EvolGameTheory](https://reader036.fdocuments.us/reader036/viewer/2022081602/547f5d58b4af9fbe158b5ac5/html5/thumbnails/33.jpg)
Mixed Strategy
![Page 34: Game EvolGameTheory](https://reader036.fdocuments.us/reader036/viewer/2022081602/547f5d58b4af9fbe158b5ac5/html5/thumbnails/34.jpg)
Mixed Strategy Solution
Value in Safe
Probability of being Guarded
Expected Loss
Safe 1 10,000$ 1 / 11 9,091$ Safe 2 100,000$ 10 / 11 9,091$ Both 110,000$
![Page 35: Game EvolGameTheory](https://reader036.fdocuments.us/reader036/viewer/2022081602/547f5d58b4af9fbe158b5ac5/html5/thumbnails/35.jpg)
Evolutionary Game Theory
• Natural selection replaces rational behavior
• Survival of the fittest
• Why use evolution to determine a strategy?
![Page 36: Game EvolGameTheory](https://reader036.fdocuments.us/reader036/viewer/2022081602/547f5d58b4af9fbe158b5ac5/html5/thumbnails/36.jpg)
Hawk / Dove Game
![Page 37: Game EvolGameTheory](https://reader036.fdocuments.us/reader036/viewer/2022081602/547f5d58b4af9fbe158b5ac5/html5/thumbnails/37.jpg)
Evolutionary Stable Strategy
• Introduced by Maynard Smith and Price (1973)
• Strategy becomes stable throughout the population
• Mutations becoming ineffective
![Page 38: Game EvolGameTheory](https://reader036.fdocuments.us/reader036/viewer/2022081602/547f5d58b4af9fbe158b5ac5/html5/thumbnails/38.jpg)
![Page 39: Game EvolGameTheory](https://reader036.fdocuments.us/reader036/viewer/2022081602/547f5d58b4af9fbe158b5ac5/html5/thumbnails/39.jpg)
![Page 40: Game EvolGameTheory](https://reader036.fdocuments.us/reader036/viewer/2022081602/547f5d58b4af9fbe158b5ac5/html5/thumbnails/40.jpg)
![Page 41: Game EvolGameTheory](https://reader036.fdocuments.us/reader036/viewer/2022081602/547f5d58b4af9fbe158b5ac5/html5/thumbnails/41.jpg)
![Page 42: Game EvolGameTheory](https://reader036.fdocuments.us/reader036/viewer/2022081602/547f5d58b4af9fbe158b5ac5/html5/thumbnails/42.jpg)
Where is game theory currently used?
– Ecology
– Networks
– Economics
![Page 43: Game EvolGameTheory](https://reader036.fdocuments.us/reader036/viewer/2022081602/547f5d58b4af9fbe158b5ac5/html5/thumbnails/43.jpg)
Limitations & Problems
• Assumes players always maximize their outcomes
• Some outcomes are difficult to provide a utility for
• Not all of the payoffs can be quantified
• Not applicable to all problems
![Page 44: Game EvolGameTheory](https://reader036.fdocuments.us/reader036/viewer/2022081602/547f5d58b4af9fbe158b5ac5/html5/thumbnails/44.jpg)
Indiana Jones Scenario
![Page 45: Game EvolGameTheory](https://reader036.fdocuments.us/reader036/viewer/2022081602/547f5d58b4af9fbe158b5ac5/html5/thumbnails/45.jpg)
Summary• What is game theory?
– Abstraction modeling multi-person interactions
• How is game theory applied?– Payoff matrix contains each person’s utilities for
various strategies
• Who uses game theory?– Economists, Ecologists, Network people,...
• How is this related to AI?– Provides a method to simulate a thinking agent