Effects of Weighting Schemes on the Composite Scores Under the Multivariate Proficiency Distribution Using Item Response Theory

• In Event: Roundtable Session 117
  In Roundtable Session: Item Response Theory

Abstract

This study explored the effects of the various weighting methods on the composite scores developed in the multivariate proficiency context using Kolen and Wang’s IRT modeling. The purpose was to further examine Kolen and Wang’s procedure and to understand the impact that weighting models would have on the composites with the consideration that correlations existed among the examinees’ proficiencies. The three weighting schemes of the equally-weighted, the SD weighting, and the error of measurement weighting were evaluated. This study also incorporated the no-correlation distribution for comparison. Overall, the weighting schemes did not make apparent impact on the composite scores. Results from this study have helped to shed more light on the IRT-based approaches for the explorations of the composite scores.

Authors

• Shun-Wen Chang, National Taiwan Normal University

• Shin Teng, National Yang Ming University

• Chia-Feng Lu, National Yang Ming University