The Promises of Automated Essay Scoring: Teacher Perceptions of Scoring Consistency and Feedback

• In Event: Assessing Teachers and Technologies for Reforming Classrooms and Schools

Abstract

Based on a pilot study, this qualitative case study will take place fall 2011. This study (N = 7) will examine teacher perceptions of the promises of Automated Essay Scoring (AES) technology. Specifically, is AES scoring consistency as good or better than human scoring consistency; and does AES, in combination with Automated Writing Evaluation (AWE), provide more detailed feedback than human scoring? Interview data will be collected from seven teachers who have used or are currently using an AES program with seventh and eight grade students. Preliminary findings indicate that teachers do not believe that scoring consistency and feedback live up to the promises make by AES proponents. Teachers also voiced concern over their lack of knowledge regarding AES technology.

Author

• Bridget Mahoney, University of South Florida