Comparison of Computerized Adaptive Test and Computerized Adaptive Multistage Test

• In Event: Roundtable Session 18
  In Roundtable Session: Factors Influencing the Accuracy of Multistage Testing Results

Abstract

Inconsistent comparative results between the caMST and the CAT existed in the literature, which inspires the present study to conduct a comprehensive and systematic comparison. Two operational item pools and seven different computer-based testing designs (i.e., one CAT, four caMST, and two linear on-the-fly tests) are considered in this study. Based on simulations, these test designs are compared in terms of estimation accuracy, pass/fail decision accuracy, item exposure, and item pool usage. Preliminary results suggested that although the CAT outperformed the caMST, the well-constructed caMST designs showed great balance between psychometric efficiency and operational convenience. Final results of this study are expected to assist practitioners to make an informed decision about the test design selection for their examinations.

Authors

• Xiao Luo, National Council of State Boards of Nursing

• Ada Woo, National Council of State Boards of Nursing