Where the "Rubber Hits the Road": A User Validity Perspective on Principals’ and Teachers’ (Mis)Conceptions of School Performance Feedback Reports

• In Event: Friday Roundtable Session 11:25 am
  In Roundtable Session: Global Insights: School Assessments and Stakeholders’ Feedback (Table 29)

Abstract

School performance feedback can be a tool for school improvement. However, when educational professionals do not comprehend the data they are provided with, they will not arrive at valid inferences and correct diagnoses. We interviewed 23 Flemish primary school teachers and principals, asking them to explain authentic feedback from a national assessment. Framework analysis of think-aloud data reveals that participants’ comprehension of typical concepts is clouded by a range of misconceptions. We observed that that visual, verbal and mathematical building blocks in the report can become stumbling blocks. These findings have important implications for data providers, considering they have a responsibility to cater to the interpretability of the data they provide.

Authors

• Evelyn Goffin, University of Antwerp

• Jan Vanhoof, Antwerp University

• Rianne Janssen, KU Leuven