Test Irregularity Analysis: An Investigation of i-Ready BOY 2020–21 Diagnostic Assessment

• In Event: AERA Roundtable Session 8
  In Roundtable Session: Impact of Accountability Systems on Teachers and Teaching

Abstract

Due to the COVID-19 pandemic, more than half of an urban school district in Florida students chose to learn, study and take tests remotely. Students who took tests remotely may potentially be associated with irregular testing behaviors. This study aims to identify students with irregular academic growth from i-Ready MOY 2019-20 to i-Ready BOY 2020-21. An extremely higher than expected academic growth could indicate that the student’s performance does not measure the student’s true knowledge or capability, which may be a result of irregular testing behaviors. This study found that the irregularity of students’ scores are associated with test modalities. Findings suggest that teacher evaluations may need to take into account test modalities and irregular testing behaviors.

Authors

• Meng Fan, Human Resources Research Organization

• Xiaogeng Sun, Orange County Public School

• Chen An, Orange County Public Schools

• Jennifer Sasser, Orange County Public Schools