Paper Summary
Share...

Direct link:

Comparisons of Item Response Theory Proficiency Estimation Methods Under Adaptive Multistage Testing

Sun, April 6, 10:35am to 12:05pm, Convention Center, Floor: Terrace Level, Terrace IV

Abstract

The inquiry is an investigation of the accuracy of IRT proficiency estimators under multistage testing (MST). We chose a 2-stage MST design that includes four modules (one at Stage 1, three at Stage 2) and three paths (Low, Middle, High). We assembled various 2-stage MST panels by manipulating two assembly conditions such as difficulty level and item usage in each module. For each panel, we investigated the accuracy of examinees’ proficiency levels derived from five IRT proficiency estimators. Under MST, the between-stage adaptation to match examinee proficiency to modules consisting of items of corresponding difficulty is crucial to the precise estimation of examinee proficiency. Thus we also evaluated the performance of the five estimators with respect to their routing accuracy.

Authors