Psychometric Evaluation of Test Item Reading Load Scale Using the Multidimensional Rasch Model Approach

• In Event: AERA Roundtable Session Sunday 9:45 am - Gold 4
  In Roundtable Session: Applications of the Rasch Model in Education

Abstract

Test item reading load plays a crucial role in students’ educational outcomes. It potentially influences the validity and reliability of educational measures, leading to construct-irrelevant variances. Addressing the challenges related to test item reading load is instrumental for test item development. To supplement more traditional methods based on text analysis and expert panel review, which have not been effective in evaluating test item reading load, we investigated students’ perceptions related to test item reading load by designing the Test Item Reading Load Scale (TIRLS). We used exploratory factor analysis and the multidimensional Rasch model approach to examine the psychometric properties of the scale. The results demonstrated acceptable internal structure and psychometric properties for the TIRLS, supporting its interpretation and use.

Authors

• Christopher Adah Ocheni, University of Alabama

• Emmanuel Agada Onoja, University of Alabama