The Online Rater Training System

• In Event: National English Ability Test in Korea

Abstract

The National English Ability Test (NEAT) which is supposed to replace the English section of the Korea college entrance exam adopts an online rating and rater training system. On the online system a large number of speaking and writing data are scored by the group of English teachers who have been trained at the online KICE rater training programme. Chief raters grade all the samples which will be used during the online training in order to compare the trainees' scores for the first and second pilot ratings with their scores. The trainees are certified by passing the final rating test at the end of the online program. In the 2010-2011 NEAT pilot tests the certified raters showed significantly reliable results. That is, it has been proved that the rater training program was effective. Finally, it was also proved that the on-line rater training program is more effective. It may make it easier for us to train a large number of trainees.

Authors

• Dongkwang Shin, Korea Institute for Curriculum and Evaluation

• Youn-Hee Kim, McGill University

• Kyung-Ae Jin, Korea Institute for Curriculum and Evaluation