The Predictive Validity of the American Board of Family Medicine's In-Training Examination

• In Event: 63.084 - Roundtable Session 22
  In Roundtable Session: 63.084-20 - Division I Roundtable B: Use of Exams for Education in the Professions

Abstract

The purpose of this study is to examine the ability of the In-Training Examination (ITE) to predict an examinees’ performance on their next ITE or certification examination. This study employed a repeated measures design across three program years of medical residency program with 3 different cohorts. In total, 25,161 residents from roughly 450 residency programs were included. The results indicated that the ITE has a high level of specificity, but a moderate level of sensitivity. The Pearson correlations ranged from .67 to .75, suggesting that the ITE score is a reasonably good predictor of future performance on the ITE and certification examinations. The growth analysis indicates more residents showed improvement from the previous program year to the later program year.

Authors

• Zijia Li, University of Kentucky

• Thomas R. O'Neill, American Board of Family Medicine

• Michael Peabody, American Board of Family Medicine

• Kenneth Royal, North Carolina State University