Incorporating Response Time Into On-the-Fly Multistage Adaptive Testing for PISA

• In Event: Item Response Theory

Abstract

Multistage adaptive testing (MST) has become one of the most popular test designs for large-scale testing. However, it has some weaknesses such as a larger estimation bias compared to computerized adaptive testing (CAT). On-the-fly multistage adaptive testing (OMST) can balance the advantages and limitations of CAT and MST. Several CAT item selection methods that incorporate RT have been proposed. However, incorporating RT into OMST to select items was rarely studied. The study explored the possibility of applying OMST with RT to the large-scale test to solve the issue of large estimation bias and improve test efficiency. A simulation study was conducted, and results suggested that OMST incorporating RT was more accurate and efficient in estimating examinees’ abilities than MST.

Authors

• Xiuxiu Tang, Purdue University
  Presenting Author

• Yi Zheng, Arizona State University
  Non-Presenting Author

• Hua-Hua Chang, Purdue University
  Non-Presenting Author