Validity Evidence on Standard Setting in Admission Interviews

• In Event: 34.049 - Selection and Prediction

Abstract

Drawing on psychometric research and theory this study applies a standard setting methodology to better inform medical school admissions interview selection process. Interview pass/fail cut-off scores across three raters from six cohorts of medical school admissions interview applicants were estimated using borderline regression method (BRM). Results highlight the applicability and reliability of the standard method to assign defendable pass/fail cut-off scores. Our findings show that the BRM pass rate for matriculates was high across raters as well as cohorts. However, there remains a small percentage of matriculated applicants each year with scores below the standard. Overall, this study offers an innovated approach to setting standards for performance-assessment measures within admission interviews to better inform applicant selection and decision-making procedures.

Authors

• Cassandra Barber, Maastricht University

• Tisha Joy, The University of Western Ontario

• Robert Hammond, The University of Western Ontario

• Saad Chahine, University of Western Ontario