Evaluating the Dimensionality of Tests Comprising Traditional and Technology-Enhanced Items

• In Event: 34.079 - Roundtable Session 14
  In Roundtable Session: 34.079-10 - Innovative Research on Factor Analysis and Dimensionality

Abstract

The development and use of technology enhanced items (TEI) in educational assessments has recently grown. TEIs are typically scaled on the same dimension as the other test items using item response theory (IRT), where unidimensionality of the construct measured is assumed. However, the degree to which TEIs measure the same dimension is unknown. Therefore, appraisal of the dimensionality of tests comprising traditional items and TEIs is needed to understand and interpret test scores. In this study, we examine the dimensionality of nationally-administered mathematics and reading high school equivalency exams, using classical multidimensional scaling (CMDS, Kruskal & Wish, 1978). Findings suggest that the TEIs do not require an additional dimension relative to the other item formats used on the exam.

Authors

• Michelle Boyer, University of Massachusetts - Amherst

• Stephen G. Sireci, University of Massachusetts - Amherst