Teachers as Raters: Investigation of a Long-Term Writing Assessment Program

• In Event: Marriott Roundtable Session 59
  In Roundtable Session: Teacher Input and Influence in Public School Classroom Assessments

Abstract

In 2010, the Norwegian Writing Centre (NWC) was commissioned by the Norwegian Directorate for Education and Training to set up a national panel of raters (NPR), consisting of teachers, with the purpose of 1) establishing a strong interpretive community and 2) reliably rate the NSBWT. The first reliability estimates from the autumn of 2010 indicated large variation.
The present study investigated potential variation among a sub-sample of NPR members 6 years later, using multiple data sources. The data consisted of one quantitative dataset of ratings and one qualitative dataset based on semi-structured interviews and live ratings. The quantitative investigation showed large variation among the raters, as did the investigation using qualitative data. The results are discussed in depth.

Authors

• Gustaf Bernhard Uno Skar, Norwegian University of Sceince and Technology

• Lennart Jølle, Norwegian University of Science and Technology