Revisiting Measurement Construct Definitions in High-Stakes Assessments in the Professions: Necessary Challenges and Practical Strategies

• In Event: 58.082 - Roundtable Session 25
  In Roundtable Session: 58.082-11 - Roundtable Session: Methods and Measures

Abstract

The purpose of this descriptive paper is to discuss the importance of developing, periodically revisiting and refining the definition of measurement constructs associated with high-stakes assessments in the professions. The authors describe the challenges they faced in the refinement activities they undertook for the computer-based case simulation section of Step 3 of the United States Medical Licensing Examination (USMLE®) as well as the iterative processes by which they reviewed current construct definitions in light of changing practice patterns. Practical strategies are discussed to aid test developers and future researchers in this essential activity.

Authors

• Ulana A. Luciw-Dubas, National Board of Medical Examiners

• Monica M. Cuddy, National Board of Medical Examiners

• Polina Harik, National Board of Medical Examiners