Study Notes on Game Theory and the Prisoner’s Dilemma

Game theory is relevant to various contexts, from international conflicts to everyday situations like roommates managing chores.
Key focus: the implications of game strategies can influence significant outcomes such as war, peace, and environmental destruction.

Date: 09/03/1949
An American weather monitoring plane detected radioactive particles over Japan.
Navy detected cerium 141 and yttrium 91 isotopes in rainwater samples from various locations globally.
Isotope half-lives: cerium 141 (1 month), yttrium 91 (2 months).
Conclusion: Isotopes must have originated from a recent nuclear explosion; an implication of Soviet nuclear capabilities.
U.S. military supremacy post-Manhattan Project was threatened, escalating tension in Western Europe and the prospect of conflict.

Some military leaders suggested conducting a preemptive nuclear strike against the Soviets to maintain U.S. dominance.
John von Neumann's perspective: if military action is on the table, act sooner rather than later.
1950: RAND Corporation began researching solutions through game theory.

The Prisoner's Dilemma involves two players making decisions to either cooperate or defect.
Scenario:
- If both cooperate: each receives 3 coins.
- If one defects while the other cooperates: defector receives 5 coins; cooperator gets 0.
- If both defect: each receives 1 coin.
Outcome Analysis:
- If opponent cooperates, defecting gives the highest reward (5 coins).
- If opponent defects, defecting is also preferable (1 coin vs. 0 coins).
- Rational behavior leads to mutual defection, resulting in both players receiving only 1 coin instead of a total of 6 coins (3 each if cooperating).

The U.S. and the Soviet Union both created vast arsenals of nuclear weapons, exceeding necessary levels for mutual destruction.
Cost incurred: approximately $10 trillion on nuclear development due to competition.
The irony of mutual defection led to worse outcomes for both sides, supporting the conclusion of the Prisoner's Dilemma.

Impalas must cooperate for mutual grooming to maintain health, yet face costs for grooming another (saliva loss, time, danger from predators).
Single interaction encourages defection, but repeated encounters allow for cooperative strategies.
Impalas engage in repeated prisoner dilemmas, affecting grooming behavior and outcomes.

Robert Axelrod organized a computer tournament in 1980 to analyze strategies in repeated prisoner's dilemmas.
Contest: 14 strategies were submitted plus an additional random strategy, focusing on 200-round matchups.
Gameplay example:
- Simple strategy involved cooperating at the start and only defecting after two consecutive defections.
- Each strategy was pitted against all others and itself.
Key Example Strategies:
- Friedman: defects after one defection.
- Joss: cooperates but mimics opponent's last action with occasional defection.
- Grass camp: similar to Joss but defects strategically (the 50th round).

Most effective strategy identified was Tit for Tat, which cooperates initially and mimics the opponent's last move thereafter.
Outcomes of Tit for Tat:
- Established cooperation with other strategies, yielding high scores.
- Against Friedman (always cooperative), both scored perfectly by sustaining cooperation.
- Versus Joss, initiated a negative cycle of defections after Joss’s initial betrayal.
Axelrod's findings on qualities of high-performing strategies:
- Niceness: Not initiating defection first.
- Forgiveness: The ability to retaliate without holding grudges.
- Retaliation: Immediate response to defections, preventing exploitation.
- Clarity: Clear patterns encourage cooperation, complex strategies hinder trust.

Second tournament addressed effects of unknown match lengths on strategy performance.
Tournament dynamics and the updated submissions reflected learned insights from the first.
Results confirmed cooperative strategies consistently performed better, with Tit for Tat achieving high success rates.

Strategies evolution similar to natural selection without mutations; successful strategies propagated while unsuccessful ones faded.
Tit for Tat demonstrated its relevance across various settings, similarly to cooperation found in nature (like cleaning symbiosis in animals).

Real-world implications include response to misinterpretations or errors as seen in the 1983 Soviet scare.
Noise adjusts perception of cooperation, leading to retaliatory cycles when misinterpretations occur.
Solution: Introduce slight forgiveness into cooperation to break cycles of defection resulting from noise (Tit for Tat with 10% forgiveness).

Tit for Tat effectively illustrates a winning strategy among rivals, offering pathways to cooperation.
Evolving cooperation among self-interested players raises a nuanced perspective on altruism vs. self-interest.
The importance of constructing win-win scenarios for mutual benefit highlights the broader applications of game theory in international relations and biological systems.

The game of life reflects the critical choices we make, affecting both our journey and that of others around us. Identifying effective strategies requires critical thinking and innovative solutions, as exemplified by Axelrod's tournaments.