Outcome and Psychometric Comparability of Live Remote–Proctored and Test Center–Proctored Credentialing Examinations

• In Event: AERA Virtual Poster Session
  In Virtual Poster Session: SIG-Accreditation, Assessment, and Program Evaluation in Education Preparation Virtual Poster Session

Abstract

Many testing programs use both live remote proctoring (LRP) and test center proctoring (TCP) to deliver examinations. However, as a relatively recent phenomenon in the testing industry, there is a lack of empirical evidence to support the validity and comparability of high-stakes examinations delivered via LRP. This study employs a multimethod approach to evaluate the comparability of test outcomes and psychometric properties. We compare pass rates, decision accuracy and consistency, test time, and item performance between the two delivery modes. The analyses are replicated across 14 multiple-choice tests from eight credentialing programs in healthcare, security, and energy sectors. Using a variety of statistical and psychometric approaches, we provide strong evidence of comparability for high-stakes examinations administered through TCP and LRP.

Authors

• Michelle Y. Chen, Prometric
  Presenting Author

• Gemma M. Cherry, University of Liverpool
  Presenting Author

• Michael O'Leary, Dublin City University
  Non-Presenting Author

• Li-Ann Kuan, Prometric
  Non-Presenting Author

• Linda Waters, Prometric
  Non-Presenting Author