Skip to main content

Welcome to a Grasp lesson

Create a free account to keep studying and create your own study path.

Lesson 18

Backward Induction and Subgame Perfect Nash Equilibrium

Recommended resources

Introduction

Welcome to your next lesson on sequential games. In our previous session, you learned to define Subgame Perfect Nash Equilibrium (SPNE) as a powerful refinement of the Nash Equilibrium concept. We established that an SPNE is a strategy profile that remains a Nash Equilibrium in every subgame, thereby eliminating the "implausible" equilibria that rely on non-credible threats.

Today, we move from the what to the how. Your learning objective is to apply the algorithm of backward induction to find the SPNE in games of perfect information. This is the primary mechanical tool for solving such games. The logic is elegant and powerful: to decide the best first move, you must first determine the best last move. This method has a strong theoretical foundation, which we'll explore briefly, that guarantees it will find the unique SPNE in any finite game of perfect information (assuming no ties in payoffs).

For someone with your interest in physics and mathematics, the logic of backward induction might resonate with how you solve certain problems, such as integrating from a known future boundary condition back to the present.


1. The Theoretical Foundation: Zermelo's Theorem

Before we dive into the algorithm, let's appreciate its theoretical underpinnings. In 1913, Ernst Zermelo proved a theorem stating that any finite, two-player game of perfect information where the outcomes are win, lose, or draw (like chess or tic-tac-toe) has a determined outcome. This means either Player 1 can force a win, Player 1 can force a draw, or Player 2 can force a win.

The genius of Zermelo's theorem is not just its conclusion, but its proof. The proof itself is an argument by induction, which is the very logic that powers the backward induction algorithm. Given your interest in mathematical rigor, seeing this connection between a foundational theorem and a practical algorithm is insightful.

15. Backward induction: chess, strategies, and credible threats

Professor Ben Polak from Yale University provides an excellent explanation of Zermelo's theorem and then walks through the proof by induction. This proof is the 'why' behind the 'how' of backward induction. It demonstrates that by solving the end of the game first, you can logically deduce the solution to the whole game.

Please watch the segment from 10:12 to 29:03. Focus on how the inductive step works: if we assume all games of length N have a solution, we can show that a game of length N+1 must also have a solution because the first move simply leads to a game of length N.


2. The Algorithm of Backward Induction

The inductive proof you just watched provides the blueprint for a practical algorithm. We can solve any finite game of perfect information by working backward from the end.

The procedure is as follows:

  1. Identify the final subgames: Start at the decision nodes just before the terminal nodes (the final outcomes).
  2. Determine the optimal final moves: For each of these final decision nodes, find the optimal action for the player whose turn it is by comparing their payoffs. A rational player will choose the action that leads to their highest payoff.
  3. Prune the tree: "Prune" or eliminate the branches corresponding to the non-optimal actions. You can now treat the decision node as if it leads directly to the outcome of the optimal choice. Replace that node with the payoff vector associated with that optimal action.
  4. Iterate backwards: Move to the now-penultimate (second-to-last) decision nodes and repeat the process, taking the determined outcomes from the next stage as given.
  5. Continue to the beginning: Repeat this process until you have worked all the way back to the initial node of the game. The sequence of optimal actions you have identified forms the SPNE path.

Let's see this in action.

Game Tree with Backward Induction
This game tree illustrates the pruning process of backward induction. The red lines cross out branches that a rational player would not choose at a given decision node. By working from right to left (from the end of the game to the beginning), we can find the optimal path.

Let's apply the algorithm to the game in the image:

  • Final Nodes (Celine's moves):
    • At node c, Celine chooses between "Sports" (payoff 2) and "Comedy" (payoff 4). She will choose Comedy. We prune the "Sports" branch. The outcome at node 'c' is effectively (4, 4).
    • At node d, Celine chooses between "Sports" (payoff 3) and "Comedy" (payoff 1). She will choose Sports. We prune the "Comedy" branch. The outcome at node 'd' is effectively (3, 3).
  • Previous Node (Bob's move):
    • At node b, Bob anticipates Celine's choices. If he chooses "Sports", he knows the game proceeds to node 'c' where Celine will choose "Comedy", giving him a payoff of 4. If he chooses "Comedy", the game goes to node 'd' where Celine will choose "Sports", giving him a payoff of 3. He prefers 4, so he will choose Sports. We prune the "Comedy" branch from node 'b'.
  • Initial Node (Bob's move):
    • At node a, Bob chooses between "Sports", giving him a payoff of 2, or "Comedy", which leads to node 'b'. He knows that if the game reaches node 'b', he will choose "Sports" and get a payoff of 4. He prefers 4 over 2, so he will choose Comedy. We prune the "Sports" branch from node 'a'.

The path we have traced is the Backward Induction Outcome: Bob chooses Comedy, then Bob chooses Sports, then Celine chooses Comedy. The final payoff is (4, 4).


3. Finding and Stating the SPNE

The backward induction outcome is the path that will actually be played. The Subgame Perfect Nash Equilibrium (SPNE) is the full strategy profile that supports this outcome. Remember, a strategy is a complete plan of action for every decision node a player might face.

To state the SPNE, we list the optimal action we found for every single decision node, even those on paths that were pruned.

For the game above, the SPNE is:

  • Bob's Strategy: {Choose Comedy at node a, Choose Sports at node b}
  • Celine's Strategy: {Choose Comedy at node c, Choose Sports at node d}

The actions for the pruned nodes (like Bob choosing 'Sports' at node 'a') are the credible threats (or promises) that make the equilibrium path hold.

5. Backward Induction, Subgame Perfect Nash Equilibrium & Nash Equilibrium (Game Theory Playlist 6)

This video provides a very clear, step-by-step application of backward induction on a slightly more complex tree. Crucially, it shows how to assemble the full strategy profile (the SPNE) from the results of the algorithm.

Watch from 03:43 to 11:59. First, follow the step-by-step process of solving the tree from end to beginning. Then, pay close attention to how the presenter constructs the complete SPNE strategy profile for each player by collecting the optimal action for each of their decision nodes.


4. Practice Problem

Now it's your turn. Use the backward induction algorithm to find the SPNE of the game shown in the tree below.

Game Tree for SPNE Calculation
Apply the backward induction algorithm to this game tree. First find the outcome path, then write out the complete strategy profile for the SPNE.

Take a moment to work through it on your own before revealing the solution.

Click here for the step-by-step solution
  1. Final Decision Nodes:

    • At the node after Player 2 chooses 'd' (P2's subgame), Player 2 chooses between 'g' (payoff 7) and 'h' (payoff 9). Optimal action: h.
    • At the node after Player 1 chooses 'f' (P1's subgame), Player 1 chooses between 'g' (payoff 7) and 'h' (payoff 5). Optimal action: g. Wait, the image LINK labels the players at the nodes. Let's re-do this correctly based on the image labels.

    Corrected Solution Walkthrough:

    1. Final Decision Nodes:

      • At Player 1's node after (a, c), P1 chooses between 'g' (payoff 7) and 'h' (payoff 5). Optimal Action: g.
      • At Player 2's node after (b, f), P2 chooses between 'g' (payoff 8) and 'h' (payoff 9). Optimal Action: h.
    2. Second-to-Last Decision Nodes:

      • At Player 2's node after 'a', P2 anticipates P1's next move. If P2 chooses 'c', P1 will choose 'g', and P2's payoff will be 7. If P2 chooses 'd', the payoff is 6. P2 prefers 7, so Optimal Action: c.
      • At Player 1's node after 'b', P1 anticipates P2's next move. If P1 chooses 'e', P1's payoff is 8. If P1 chooses 'f', P2 will choose 'h', and P1's payoff will be 4. P1 prefers 8, so Optimal Action: e.
    3. Initial Decision Node:

      • At Player 1's initial node, P1 anticipates the entire sequence. If P1 chooses 'a', P2 will choose 'c', and P1 will choose 'g', yielding a payoff of 7 for P1. If P1 chooses 'b', P1 will choose 'e', yielding a payoff of 8. P1 prefers 8, so Optimal Action: b.

    Backward Induction Outcome: (b, e), with payoffs (8, 9).

    Subgame Perfect Nash Equilibrium (SPNE):

    • Player 1's Strategy: {b at initial node, e at node after b, g at node after (a,c)}
    • Player 2's Strategy: {c at node after a, h at node after (b,f)}

Conclusion

You have now mastered backward induction, the fundamental algorithm for analyzing finite sequential games of perfect information. This method operationalizes the concept of SPNE, allowing you to systematically discard non-credible threats and find the unique, rational outcome.

Key Takeaways:

  • Backward induction is a recursive algorithm that solves a game by starting at the terminal nodes and working backward.
  • At each decision node, you determine the optimal action by assuming all future actions will also be optimal.
  • The algorithm identifies a unique path, the backward induction outcome, and a complete Subgame Perfect Nash Equilibrium (SPNE) strategy profile.
  • The SPNE must specify an action for every decision node, including those off the equilibrium path, as these actions are what make the path credible.

In the next lesson, we will apply this tool to analyze a classic economic scenario: an incumbent firm deciding whether to fight or accommodate a new entrant. This will allow you to use subgame perfection to formally distinguish between credible and non-credible threats in a strategic business context.