A G-Theory Approach to Evaluating Reliability and Validity of Scores From Music-Related Assessments

• In Event: 43.055 - Evaluating Music Teaching and Assessing Music Learning

Abstract

Coefficient alpha is the most common used index to report reliability for the music related measures. However, this coefficient along with other conventional reliability indices (test-retest, split-half, etc.) do not account for all sources of measurement error. In the research reported here, reliability and validity of scores from the Music Self-Perception Inventory were investigated using conventional and generalizability theory (G-theory) approaches. Results underscored the shortcomings of conventional procedures and how they can be overcome using G-theory. Readers can readily apply the demonstrated techniques to enhance evidence of the reliability and validity of scores from measures both within and outside of music.

Authors

• Murat Kilinc, University of Iowa

• Walter Peter Vispoel, University of Iowa

• Mingqin Zhang, The University of Iowa