Applicant Factors and Residency Performance: A Meta Analysis with Implications for Holistic Review

• In Event: AERA Roundtable Session Saturday 7:45 am - Gold 4
  In Roundtable Session: Admissions in Focus: Equity, Predictive Insights, and Holistic Review

Abstract

Research predicting resident performance has often reached conflicting conclusions which cloud evidence-based, holistic selection practices. A meta-analysis on 151 studies with a total listwise sample of 84,421 residents was conducted to examine the associations between applicant factors and performance indicators in residency. Current knowledge predictors of resident performance yield moderate to strong correlations with knowledge and skill measures of performance. Interview and recommendation letters are less useful and are under researched given their prominence in selection for evaluating communication and interpersonal skills. Findings generally support the use of several applicant factors in selection decisions. Understanding the association between application factors and residency outcomes can help inform the optimal selection and weighting of those factors in making selection decisions.

Authors

• Nathan Kuncel, University of Minnesota

• Monica M. Cuddy, NBME

• Isaac M Bazian,, University of Minnesota

• Michael Hazboun, University of Minnesota

• Ming Him Tai, Pennsylvania State University

• Christopher Feddock, National Board of Medical Examiners