Exploring the Utility of Profile Band Feedback Failing Examinees on a Repeat Attempt

• In Event: Issues Related to Certification and Licensure Testing

Abstract

Profile bands detailing performance in content sub-areas have become commonplace on high-stakes assessments, though their usefulness has been challenged as they can be difficult to interpret and potentially present unreliable or redundant information. The present study investigates whether providing detailed profile band feedback on score reports for a high-stakes medical licensing examination can lead to meaningful score gains on a repeat attempt. ANCOVA was used to determine the effect of feedback provision (the independent variable) on the overall score on the following test attempt (the dependent variable), controlling for the first attempt score. There was a statistically significant difference in the scores on the second administration between the two groups with higher scores among those receiving profile band feedback.

Authors

• Amanda Clauser, National Board of Medical Examiners

• Yooyoung Park, University of Massachusetts - Amherst