Evaluating Score Report Prototypes for a Licensure Examination

• In Event: Poster Session 9
  In Poster Session: New Developments in Psychometrics, Measurement, and Assessment: Poster Session 1

Abstract

Score reports are an important part of the validity argument for credentialing examinations. This paper describes the design and evaluation process of score report prototypes for a medical licensure exam with an emphasis on the evaluation of whether users are making correct interpretations about scores. Prototypes were evaluated through a series of surveys, focus groups, and cognitive interviews to establish not only which samples provided the necessary information, but also could be interpreted accurately. Design features that support accurate interpretations and overall design considerations are discussed.

Authors

• Amanda Clauser, National Board of Medical Examiners

• Francis Rick, University of Massachusetts - Amherst