An Investigation of Factors Affecting Educators' Interpretation of Score Reports (Poster 10)

• In Event: AERA Poster Session Two
  In Poster Session: Measurement Theory and Application 1

Abstract

Individual score reports for state assessments play an important role in supporting valid interpretation of test results and appropriate educational decisions. The topic of effectively conveying uncertainty in students’ classification level warrants more research efforts. The present study aims to examine how the design of a score report affects educators’ understanding of uncertainty in test results. Six modes of score reports which vary in the manner of communicating uncertainty in classification level were randomly assigned to educators. Multilevel logit models are fitted to analyze the online survey data. Score report mode has significant effects in terms of logit on confidence in classification, intention of collecting evidence, and degree of surprise at disagreement in classification between test results and other evidence.

Authors

• Zhaopeng Ding, University of California - Los Angeles
  Presenting Author

• Mark Hansen, University of California - Los Angeles
  Presenting Author