Automated Rater Routing Algorithm for Essays using Unfolding Scale and Topic Models

• In Event: Writing Assessments and Rater Effects

Abstract

This study proposes and demonstrates a new algorithm that predicts the location of essays on an unfolding scale. The predicted unfolding location of an essay is then used to assign raters that are more likely to accurately score the essay. This framework increases the validity and fairness of human-scored essays.

Authors

• Jordan M. Wheeler, UNIVERSITY OF GEORGIA

• George Engelhard, UGA

• Jue Wang, University of Science and Technology of China