New Conditional Item Selection Procedures for an Adaptive Test Based on the Testlet Response Theory Model

• In Event: Issues in Computerized Adaptive, Computer-Based, and Tailored Testing

Abstract

The major challenge of conditional selection procedures is that they require complicated and time-consuming simulations to determine the exposure control parameters prior to CAT administrations and they my encounter convergence problems with the control parameter for a small item pool. The item-eligibility (IE), conditional item-eligibility (CIE) and full conditional item-eligibility (FCIE) procedures are viable alternatives because their control parameters can be easily updated on-the-fly and can be adjusted across estimated ability levels. Results suggested that the FCIE procedure was capable of providing the optimal balance between the measurement precision and exposure control properties across tests that were predominantly testlets, tests that contained equal percentages of discrete dichotomous items and testlets, and tests that were predominantly discrete dichotomous items.

Authors

• Tsung-Han Ho, ETS

• Zhan Shu, ETS