Features of Mathematics Performance Tasks Associated With the Accuracy of Human Scoring

• In Event: 29.082 - Roundtable Session 9
  In Roundtable Session: 29.082-13 - Improving the Accuracy of Human Rating and Scoring

Abstract

The accuracy of human scoring is a big concern when using performance tasks (PTs) in a test. Although research has been conducted to examine the effect of rater variables on scoring accuracy, there has been little research into the effect of item characteristics on accurate scoring. This study examines the relationship between the attributes of Mathematics PTs from a state summative assessment and the accuracy of human scoring of these PTs. Score differences will be calculated for each scoring pair and item scoring accuracy will be compared to content coding of the PTs. Item characteristics associated with more accurate scoring as well as implications for test results analysis and reporting activities will be discussed.

Authors

• Jie Chen, The University of Kansas

• Marianne Perie, The University of Kansas

• Zachary Conrad, Kansas State Department of Education

• Wenhao Wang, The University of Kansas