A Close Examination of the Test of Relational Reasoning Junior Version Under the Multidimensional–Item Response Theory Framework

• In Event: Psychometrics and Educational Measurement Poster Session 1

Abstract

We examined the psychometric properties for the Test of Relational Reasoning-Junior under a multidimensional IRT framework. Under the best fitting model (bifactor model), eight items (mostly items representing antithetical reasoning) were found to function differently for students in primary and middle school. Specifically, the latent relational reasoning ability estimates were higher and there was more variability for the middle school students than for those in primary school. The antithesis scale differentiated relational reasoning ability well for the middle school students only, whereas the other scales discriminated well for both age groups. The reliability of specific scores suggested it was necessary to report the MIRT specific scores for the antithesis scale with the primary scores, but not for the other scales.

Authors

• Hongyang Zhao, University of Maryland - College Park

• Patricia A. Alexander, University of Maryland - College Park

• Yuting Sun, University of Maryland - College Park