mm

Medical Education Error Management Training and Adaptive Expertise

Abstract

• Importance and Rationale:

  • Adaptive Expertise: This refers to the capacity of physicians to apply acquired skills and knowledge to novel or unfamiliar clinical scenarios. It is critical for minimizing preventable medical errors.

  • Error Management Training (EMT): While EMT has proven effective for procedural skill acquisition, its utility in developing cognitive skills—such as diagnostic interpretation—has remained largely unexplored in medical education.

• Objective:

  • To determine if EMT, specifically through difficult training cases, enhances adaptive expertise more effectively than traditional error avoidance strategies during head computed tomography (CT) interpretation training.

• Design, Setting, and Participants:

  • Study Type: Multi-arm randomized clinical trial conducted between July 8, 2022, and March 30, 2023.

  • Cohorts: Emergency medicine residents across Postgraduate Years (PGY) 1-4 from seven diverse residency programs. Participants were masked to the specific research hypothesis to prevent bias.

• Interventions:

  • Participants were randomized into three distinct groups:

  1. Difficult EMT: Engaged with complex cases without prior instruction, leading to high error rates.

  2. Easy EMT: Engaged with simpler cases without prior instruction, resulting in fewer errors.

  3. Error Avoidance Training (EAT) Control: Received traditional didactic instruction focused on identifying correct findings and avoiding mistakes.

• Main Outcomes and Measures:

  • Primary Outcome: Adaptive expertise, quantified by performance on novel, complex posttest cases.

  • Secondary Outcomes: Routine expertise (performance on familiar cases), the mediation effect of training errors on final performance, and the interaction between training strategy and the resident’s experience level (PGY).

Results

• Enrollment and Completion:

  • 212 residents were randomized (mean age: $28.8$ years; $50.5\%$ male).

  • Allocation: Difficult EMT ($n = 70$), Easy EMT ($n = 71$), EAT ($n = 71$).

  • Posttest Completion: 150 participants ($70.8\%$) completed the final assessment.

• Key Performance Data:

  • Adaptive Expertise: The Difficult EMT cohort significantly outperformed both the Easy EMT and EAT groups ($60.6\%$ vs $45.2\%$ vs $40.9\%$, respectively; P < .001).

  • Effect Size: A large effect size was observed ($\eta^2 = 0.19$).

  • Routine Expertise: No significant difference was found across cohorts for routine cases, suggesting EMT does not compromise the acquisition of basic skills.

  • Mediation Analysis: Errors made during training were predictive of better posttest scores. Mediation analysis showed that errors explained $87.2\%$ of the improvement in adaptive expertise score ($P = .01$).

  • PGY Interaction: The training was particularly effective for residents earlier in their training (PGY 1-2), showing an even larger effect size ($\eta^2 = 0.25; P = .002$).

Introduction and definitions

• Medical Error Mitigation: Error reduction is a pillar of modern medical education. Traditional models emphasize "errorless learning," but this may fail to prepare doctors for real-world ambiguity.

• Adaptive Expertise Definition: Defined as the ability to leverage existing knowledge structures to solve new, complex problems ($Reference 3-6$).

• EMT Philosophy: Unlike passive learning, EMT encourages active exploration and self-directed error correction. This process is thought to trigger deeper cognitive processing.

Detailed Methodology

• Study Oversight: A multicenter trial approved by the Stanford University Institutional Review Board, adhering to CONSORT standards for clinical trial reporting.

• Learning Environment:

  • Used Pacsbin, a web-based radiology platform that simulates the interface used by radiologists in emergency settings.

  • This allowed residents to scroll through CT slices, adjust windows, and interact with imaging as they would in clinical practice.

• Posttest Structure:

  • Consisted of 23 questions based on 18 unique head CT cases.

  • Questions were split between testing Routine Expertise (cases similar to those in training) and Adaptive Expertise (novel cases requiring the transfer of concepts).

Discussion and Educational Implications

• Cognitive Restructuring: Encouraging errors allows learners to recognize knowledge gaps. This cognitive dissonance forces a "restructuring" of mental models, leading to more robust knowledge.

• Challenging the Paradigm: These findings challenge the traditional medical education preference for errorless instruction. The data suggests that struggle during the learning phase is a "desirable difficulty" that pays off in clinical versatility.

• Limitations: The study relied on voluntary posttest completion, which might introduce selection bias. Results from emergency medicine residents may not generalize to all medical specialties without further research.

Conclusions

• EMT is a powerful pedagogical tool for developing adaptive expertise in high-stakes cognitive tasks like radiology interpretation.

• Deliberate exposure to errors helps bridge the gap between theoretical knowledge and the practical challenges of evolving clinical cases.

• Trial Registration: NCT05284838.