Assessment of Clinical Reasoning: Effect of Case Characteristics on Raters

• In Event: Measurement Issues in Medical Licensure and Certification

Abstract

The purpose of the current investigation was to examine the relationship between time spent rating post-encounter exercises and characteristics of the cases used in a standardized patient (performance-based) assessment of clinical skills.
Data from the rating of 282,955 notes scored in 2010 was collected. A univariate analysis of covariance (ANCOVA) was conducted with rating time as the dependent variable, case characteristics as the independent variables, and rater experience at the case level as the covariate.
The features of the case did not account for much of the variance in time spent rating, after controlling for rater experience on the case.
Despite variation in case content, there is no adverse effect on the time needed to review and score the post-encounter exercise.

Authors

• Danette Waller McKinley, Foundation for Advancement of International Medical Education and Research

• Thomas Rebbecchi, Educational Commission for Foreign Medical Graduates