Construct Validity and Measurement Invariance of Computerized Adaptive Testing:

• In Event: Issues in Computerized Adaptive, Computer-Based, and Tailored Testing

Abstract

The purposes of this study are twofold, first, to investigate the construct or factorial structure of computerized adaptive testing (CAT) of Measures of Academic Progress (MAP) Reading and Mathematics tests at different grades, academic terms, states, and secondly, to investigate the invariance of test factorial structure across different grades, academic terms and states. Because of uniqueness of CAT data (different student receive different items), traditional factor analysis based on fixed form data is no longer practically possible at item level. This study illustrates how to overcome the difficulty of applying factor analysis in CAT data and study results provide evidences for valid interpretation MAP tests scores across grades at different academic terms for different states.

Authors

• Shudong Wang, NWEA

• Marty McCall, Smarter Balanced Assessment Consortium

• Hong Jiao, University of Maryland

• Gregg Harris, Northwest Evaluation Association