Examining the Impact of Accessing References on a Maintenance of Certification Examination

• In Event: 44.068 - How Test Takers Prepare for and Take Professional Licensure and Certification Examinations

Abstract

Increasing criticism of using closed-book standardized examinations to demonstrate a physicians’ minimum competency in the Maintenance of Certification (MOC) process has prompted certifying boards to explore alternative assessments formats. This study explores the impact of introducing access to approved references during an otherwise traditional MOC examination as a way to address this criticism. Preliminary research suggests that test takers with access to references perform better than those testing in previous cohorts without references. However, while performance improved, test takers believed they were not given sufficient time to complete the examination. Applications of this study for improving MOC assessment are discussed with concern for how allowing references ultimately modifies the construct that the examination was intended to assess.

Authors

• Richard A. Feinberg, National Board of Medical Examiners

• Daniel Pacheco Jurich, National Board of Medical Examiners

• Lauren Foster, National Board of Medical Examiners