Taking Stock of Naturalistic Decision Making

Reproduction License Notice

  • Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.
  • Source: Journal of Behavioral Decision Making; Dec 2001; 14, 5; ABI/INFORM Global

Introduction

  • The paper reviews the naturalistic decision-making (NDM) framework developed over the past decade.
  • Focus Areas:
    • Historical Sketch of NDM
    • Essential Characteristics
    • Critiques of Theoretical Bases, Methodology, and Contributions
    • Key Areas of Focus:
    • Recognition-prime Decisions
    • Coping with Uncertainty
    • Decision Errors
    • Team Decision Making
    • Decision Aiding and Training
    • Future Directions

Historical Context of NDM

  • NDM framework originated in 1989 during a conference sponsored by the Army Research Institute in Dayton, Ohio.
  • Participants: Approximately 30 behavioral scientists from academia and industry.
  • Key Themes Identified:
    • Time pressure, uncertainty, ill-defined goals, high personal stakes in real-world decision-making situations.
    • Importance of studying people with expertise, as high-stakes tasks were often overlooked in favor of novices.
    • The significance of how individuals assess situations (Klein, 1993), as opposed to merely selecting among alternatives.

Conferences and Developments in NDM

  • Following the initial 1989 conference, subsequent meetings furthered NDM research:
    • 1994: Second conference attended by approximately 100 researchers (Zsambok and Klein).
    • 1996: Third conference in Aberdeen, Scotland (Flin et al., 1997).
    • 1998: Fourth conference in Warrenton, Virginia (Salas and Klein, in press).
  • Publications Emerging from Conferences:
    • Edited volumes and works discussing critical incident management, NDM features in military and aviation environments, etc.
  • Formation of technical groups within professional societies focusing on cognitive engineering and decision-making emphasized the growth of NDM interest.

Essential Characteristics of NDM

  • NDM aims to understand how decisions are made in meaningful, familiar contexts.
  • Five Key Characteristics:
    1. Proficient Decision Makers:
    • Focus on skilled individuals who utilize their experience for effective decision-making.
    1. Situation-Action Matching Decision Rules:
    • Decisions framed as: "Do A because it is appropriate for situation S".
    1. Context-Bound Informal Modeling:
    • Models are developed based on specific contexts and expertise rather than abstract principles.
    1. Process Orientation:
    • Focus on cognitive processes of decision-makers rather than solely on the output of decision choices.
    1. Empirical-Based Prescription:
    • Development of practical models derived from observations of expert performance in realistic settings.

Comparison of CDM and NDM

  • NDM positions itself as a successor to traditional Cognitive Decision Making (CDM).
  • Key Differences:
    • CDM emphasized extensive information search, formal models, and comprehensive choice, whereas NDM focuses on matching, informal models, and descriptive processes.

Evolution of NDM Definitions

  • Definitions of NDM have shifted from initial context considerations to prioritizing expertise:
    • Early emphasis on context features (Orasanu and Connolly, 1993).
    • By the second conference, expertise was recognized as the primary driver (Zsambok, 1997).
    • Main Insight: Handling subjects' prior experience is essential for identifying NDM frameworks.

Proficient Decision Makers and NDM Characteristics

  1. Process Orientation: NDM focuses on understanding the cognitive processes rather than predicting outcomes.
  2. Situation-Action Matching Rules: Emphasizes how decisions are made through matching versus active choices. Examples include expert chess players and organizational decision-making.
  3. Context-Bound Modeling: Emphasizes that expert knowledge is often domain-specific.
  4. Empirical-Based Prescription: Models prescriptions based on expert-level descriptions to improve decision-making in practical environments.

Recognition-Primed Decision Making (RPD) Model

  • The RPD model stems from studies of decision-making in high-pressure environments, such as firefighting.
  • Variations of the RPD Model including:
    1. Simple Variation: Decisions made based on first feasible option perceived.
    2. Story-Building Strategy: When situations are unclear, decision-makers construct mental narratives.
    3. Mental Simulation: Decision makers use simulations to foresee the outcomes of actions.
  • Maintaining proficiency over time reinforces the effectiveness of decision-making strategies.

Coping with Uncertainty

  • Naturalistic contexts introduce uncertainty, affecting decision quality.
  • Strategies identified for managing uncertainty:
    • Reduction (gathering more information).
    • Assumption-based reasoning (filling knowledge gaps).
    • Weighing pros and cons.
    • Forestalling (prepare for contingencies).
    • Suppressing uncertainty (ignoring or rationalizing).
  • RAWFS Heuristic: This model correlates types of uncertainty with coping strategies, providing a framework for understanding decision-making under stress.

The Concept of Error

  • Decision errors examined from a behavioral decision theory (BDT) lens focus on adherence to normative models. - In NDM, errors signal opportunities for improvement rather than merely quantifying bad choices.
  • NDM critics argue that without a normative foundation, defining and assessing errors can be challenging.

NDM Contributions to Team Decision-Making

  • NDM emphasizes the importance of teams in high-stakes environments. - Concepts introduced:
    • Team situation awareness
    • Shared mental models
    • Team coordination and effectiveness
  • Methodologies focus on observing teams’ performance in natural settings.

Methodology and Rigor in NDM

  • NDM uses a variety of methods to study decision-making in context, including:
    • Field studies (observations, interviews).
    • Cognitive task analysis (CTA) to capture expert decision-making processes.
    • Simulation methods to create realistic task environments.
    • Laboratory studies to validate NDM concepts.

Conclusion: Future Challenges in NDM

  • NDM needs to address the need for empirical rigor while maintaining practical relevance. - Suggested pathways include:
    1. Combine qualitative and quantitative empirical research.
    2. Focus on developing methods for rigorous observation.
    3. Consolidate applications and evaluate effectiveness.

Acknowledgments

  • Thanks to Professor Robert Hoffman for comments.

References

  • Extensive appendix of referenced works by significant authors in the field include:
    • Simon, Kahneman, Tversky, and various studies on cognitive and behavioral theories.