Computerized Adaptive Testing’s Alignment With Assessment Guidelines: A Systematic Literature Review

• In Event: Refining Computerized Testing: Precision, Validity, and Innovation in Educational Measurement

Abstract

Assessing Computerized Adaptive Tests in STEM education requires emphasizing higher-order cognitive skills, high-fidelity assessments, and ensuring validity, reliability, and fairness. Following AERA Standards, comprehensive validation strategies gather evidence from test content, response processes, internal structure, relations to other variables, and testing consequences. This literature review examines how Computerized Adaptive Testing aligns with high-quality assessment criteria in STEM education. The systematic literature review demonstrates CAT’s efficacy in measuring constructs like ability and content knowledge through robust item development and validation, emphasizes user-friendly interfaces, system stability, clear instructions, fairness, inclusivity, and socio-cultural considerations, evaluates diagnostic accuracy and remedial support, and identifies implementation challenges and best practices, showing that well-designed CAT systems enhance valid, reliable, and equitable educational assessments.

Authors

• Amirezza Mehrabi, Purdue University

• Jason W Morphew, Purdue University