New Item Types and Test-Taking Effort

• In Event: Item Development

Abstract

New item types have been developed for various reasons (i.e., simulating realistic situations, examining critical-thinking or problem-solving skills). These items may be more complex and challenging than the traditional multiple-choice (MC.1) items and may discourage test engagement on low-stakes assessments, which will diminish score validity. Using empirical data, we investigated association between special new item types (variants of selected response items) and test engagement. Results show that these new item types were generally harder and more time consuming, but they may have limited impact on test-taking effort. However, item position had a dominating influence on non-effortful responses in a cumulative fashion.

Authors

• Hongwen Guo, ETS

• Joseph A. Rios, University of Minnesota - Twin Cities