Conduct Inter-Rater Reliability Tests in Instructional Technology Research: Methods and Cautions

• In Event: SICET - Quantitative Research Development

Short Description

In instructional technology research, outcome variables, test variables or characteristics variables are often measured and coded by researchers with criteria set in standard inventories, or instruments designed for a study. In variable rating or coding, the interrater/intrarater reliability needs to be measured, tested and reported. This article introduces the concepts of interrater/intrarater reliability, variables and coding, three methods and tests to measure the interrater/intrarater reliability, and all the specific information that needs to be reported.

Author

• Contributor: Leping Liu, University of Nevada, Reno