Longitudinal Reliability of Milestones Learning Trajectories During Anesthesiology Residency

• In Event: Defining Competence: Milestones and Skills Assessment

Abstract

We leverage a national cohort of 4976 anesthesiology residents across 140 programs between 2014 to 2020 to investigate the longitudinal reliability of Milestones data and identify patterns in learning trajectories that can inform targeted interventions. Growth rate reliability (mean[SD], .58[0.03]) suggested a moderate capability of Milestones to detect individual differences in growth. Growth curve reliability estimates (mean[SD], .76[0.02]) suggested acceptable overall reliability of Milestones across all the six assessment points. Significant variability was observed at both the program and learner levels (P < .001). We identified 3-4 latent groups of learners with distinct learning trajectories across the 25 subcompetencies. The findings underscore the importance of using a multi-faceted approach to assessment and providing individualized learning plans to support resident development.

Authors

• Ting Sun, University of Utah

• Yoon Soo Park, University of Illinois at Chicago

• Fei Chen, University of North Carolina - Chapel Hill

• Sean O. Hogan, Accreditation Council for Graduate Medical Education

• Pedro Tanaka, Stanford University