Comparing Outcomes From Examinations Proctored tn Test Centers and Online Using Live Remote Proctoring Technology

• In Event: Dismantling Assessment Data Demands, Design, and Administration in Educator Preparation

Abstract

The onset of the COVID-19 pandemic brought with it the closure of many bricks-and-mortar testing centres and a concomitant move to the remote (online) proctoring of many credentialing exams that were scheduled to take place throughout 2020. In response to a dearth of research in the area, the study described in this paper uses data from eleven professional licensure examinations taken by 14,097 candidates across four US States to compare outcomes for tests proctored either in Test Centres or remotely in real-time using Live Remote Proctoring software. Candidate outcomes were compared using average percent correct and passing rates. Test psychometric properties were compared using measures of reliability, decision consistency, item difficulty, item discrimination and time taken to complete tests.

Authors

• Gemma M. Cherry, Dublin City University

• Michael O'Leary, Dublin City University

• Linda Waters, Prometric

• Li-Ann Kuan, Prometric