Augmenting Physician Examiner Scoring in Objective Structured Clinical Examinations: A Pilot for Including the Standardized Patient Perspective

• In Event: Poster Session 9
  In Poster Session: Education and Assessment in the Professions

Abstract

While SP scoring is common in some contexts, OSCEs in Canada traditionally rely solely on PE scoring. This pilot study explores benefits of adding SP to PE scoring in a high-stakes national OSCE.
SPs were consulted to develop rating scales for Listening, Communication Empathy/Rapport, plus a station global. Forty-three SPs from one site of a national OSCE trained and rated sixty candidates along with PEs. SP scoring was examined using descriptive statistics and correlations. Combinations of SP and PE scoring were assessed using pass-rates, reliability, and decision consistency and accuracy indices.
SP ratings differed somewhat from examiner ratings and we argue assess performance from a different perspective, thereby increasing the available data and overall reliability of scores and pass decisions.

Authors

• Marguerite Roy, Medical Council of Canada

• Josée Wojcik

• Ilona E. Bartman, Medical Council of Canada

• Sydney M. Smee, Medical Council of Canada