Investigating Adjudicator Bias in Concert Band Evaluations: An Application of the Many-Facets Rasch Model

• In Event: 75.051 - Music Education in Middle Schools

Abstract

This study applied Rasch modeling to investigate the potential influence of adjudicators at large ensemble festivals. A Many-Facets Rasch Model (MFRM) analysis of adjudication forms from a junior high school concert band festival revealed several trends. First, adjudicators provided relatively similar ratings for conceptually distinct criteria, which could be evidence of a halo effect. Second, although all judges demonstrated relatively lenient ratings overall, one judge provided more severe ratings as compared to peers. Finally, results of an exploratory interaction analysis indicated the presence of a significant interaction among judges and bands, signifying differential rater functioning. Implications for music educators and ensemble adjudicators are discussed, and a measurement framework that can be applied to other aspects of music education is introduced.

Authors

• D. Gregory Springer, University of South Carolina

• Kelly D. Bradley, University of Kentucky