Ongoing Validity Evidence for the Use of Casper in Occupational Therapy Program Admissions Decisions

• In Event: Simulation and Its Effects in Professions Education

Abstract

Casper, an online situational judgement test, is used in admissions to health professions programs. This study explored the incremental validity and relative importance of Casper over GPA for predicting student performance within an occupational therapy program. Data from one cohort (2019-2021) whose program was impacted by the COVID-19 pandemic was analyzed. Multiple regression analysis results indicate that Casper improves the prediction of performance over and above GPA (Adj. R2 change = 2%). Regression tree analysis results show that Casper versus GPA is the more important variable for predicting fieldwork performance for most placements. Results are discussed in relation to an earlier study based on a different cohort and consider context in the interpretation of validity evidence.

Authors

• Mary Roduta Roberts, University of Alberta
  Presenting Author

• Cecilia Brito Alves, Medical Council of Canada
  Non-Presenting Author

• Fu Chen, University of Macau
  Non-Presenting Author