Key Topics
- Multi-stage games
- Extensive-form games
- Markov state games
Review of Previous Lecture
In practice, games often involve sequential rather than simultaneous moves:
- Normal-form game: Players move simultaneously
- Extensive-form game: Players move sequentially
While any extensive-form game can be represented as a normal-form game, this conversion fails to preserve sequential properties.
Example: In Stackelberg games, converting to normal-form obscures the leader's explicit strategy revelation to followers.
Information Sets
Key concept: An information set groups nodes indistinguishable to a player.
Example: Penny-matching game
- In normal-form games, simultaneous actions imply players have no information about others' moves.
- Extensive-form representation uses information sets to encode this uncertainty.
Extensive-Form Game Definition
An extensive-form game is defined by:
- Players: Finite set
- Game tree:
- Nodes with terminal nodes
- Payoff functions for each player
- Node properties :
- : Player acting at node
- : Action space at
- : Successor node when action is taken
- : Information set containing
- Perfect information: (singleton information sets)
- Subgame: A node with all its descendants in the game tree
Strategies and Equilibria
Pure Strategy Profile
A collection of functions where each maps information sets to actions.
Subgame-Perfect Equilibrium (SPE)
A strategy profile that constitutes a Nash Equilibrium (NE) in every subgame.
Solution method: Backward Induction
Multistage Games and SPE Analysis
Observed-Action Multistage Games
- players
- Stages
- History : Sequence of actions up to stage
- Strategy : Maps history to action
- Payoff:
SPE Characterization
A strategy profile is SPE iff and :
- The restricted profile forms a NE for the subgame starting at
- Payoff dominance:
One-Step Deviation Principle
A strategy profile is SPE if and only if no player can benefit by deviating at exactly one stage-history pair .
Formally, for any alternative strategy differing from at only one :
This principle allows verification of SPE by checking local optimality at every decision point.