Effect of Characteristics of High Quality Peer Rater on Accuracy of Peer Assessment in Massive Open Online Courses

• In Event: 65.080 - Roundtable Session 24
  In Roundtable Session: 65.080-18 - Reliability: Methods and Application

Abstract

The present study investigates the effect of three characteristics (i.e., content knowledge, assessment skill, and motivation) of peer rater on the reliability and validity of peer assessment in massive open online courses (MOOCs). Completion rate, training participation, and certificate registration are three indicators being used to identify the above three characteristics of the reliable peer raters respectively, and to classify them into different groups. The differences of the reliability and validity between these groups are examined. The author attempts to determine whether reliable peer raters can provide more reliable and more accurate score than their counterparts in MOOCs.

Authors

• Xiuyan Guo, The Pennsylvania State University - University Park

• Yao Xiong, The Pennsylvania State University

• Deborah Goins, The Pennsylvania State University - University Park

• Barton K Pursel, The Pennsylvania State University

• Hoi K. Suen, The Pennsylvania State University