A K-12 Testing Program’s Journey of Hybrid Automated and Manual Test Assembly

• In Event: AERA Poster Session Wednesday 1:45pm
  In Poster Session: Poster Session II -- AERA Division D Section 1: Measurement, Psychometrics, and Assessment

Abstract

Driven by the pandemic, a large provincial K-12 testing agency modernized their Grade 3 Mathematics assessment from paper-and-pencil to online assessment, by adopting the computerized multi-stage adaptive model (Yan, Lewis & von Davier, 2014). It takes extensive item field testing and time to build a large enough pre-calibrated item bank for Automated Test Assembly (ATA) of all operational panels for each test administration, so this K-12 testing program needed to work with practical constraints of the item bank. This study describes the three phases where different hybrid approaches of ATA and manual test assembly were explored, while highlighting the challenges that are often faced by operational testing programs in order to best serve the needs of all the students.

Authors

• Su Zhang, Ontario Education Quality and Accountability Office

• Jennifer Hove, Education Quality and Accountability Office

• Zhimei Gu, Education Quality and Accountability Office