Comparing Interrater Reliability Assessment Methods Using Simulation

• In Event: Electronic Board Session III

Abstract

Intraclass correlations (ICC) are often applied to assess interrater reliability. Pan and Yin (2023) suggested using Theil-index ratios. This study compares their performances using simulation. The results show the Theil-index ratios tend to be close to true ICC values and their estimates, and ICC tend to underestimate the interrater reliability.

Author

• Tianshu Pan, PEARSON