Using Response Times to Detect Aberrant Response Patterns in Computerized Adaptive Testing

• In Event: Roundtable Session 14
  In Roundtable Session: Effects of Aberrant Response Patterns on Test Scores

Abstract

The purpose of this study is to detect aberrances in examinee behavior using response times and responses for a particular large-scale computerized adaptive licensure examination. Specifically, two different types of aberrances are detected: item pre-knowledge and loss of motivation due to fatigue. Results showed that there was no evidence of item pre-knowledge for this licensure examination and the loss of motivation due to fatigue is minimal, with four examinees out of 4675 showing indications of rapid guessing towards the end of test due to the long test. The study showed that response times can be useful to detect various kinds of aberrant patterns which concern the particular testing program most.

Authors

• Hong Qian, National Council of State Boards of Nursing

• Mark D. Reckase, Michigan State University

• Ada Woo, National Council of State Boards of Nursing