Using Rasch Measurement Theory for Program Evaluation

• In Event: Program Evaluation Methods: Implementation and Impact Measurements

Abstract

This study discusses and demonstrates the importance of Rasch Measurement Theory (RMT) in program evaluation when outcome measures need to be constructed from scratch. The paper introduces typical measure validation methods presented in standard program evaluation texts and discusses room for improvement. The study then illustrates how the seamless transitions from program theory, to ethnographic observation, to item generation, to measure analysis, to effect-size estimation are all possible under one framework using the Rasch model. The program evaluated in the present study focuses on increasing retention of students in the biology major at a large, public university. The results presented balance the pragmatics and technical requirements of program evaluation.

Authors

• Albert Anthony Clairmont, University of California- Santa Barbara

• Daniel Katz, University of California - Santa Barbara

• Mike Wilton, University of California - Santa Barbara