Evaluative Criteria in Peer-Reviewed Evaluation Studies: Findings From a Systematic Review

• In Event: Research on Evaluation SIG Session 2

Abstract

Evaluative criteria define a “successful” intervention and shape evaluation questions, guide data collection, and provide the basis for evaluative conclusions. We examined the criteria evident in multidisciplinary sample of 141 peer-reviewed evaluations. Emerging findings indicate that criteria focused on a variety of different definitions of success—related to intervention outcomes, design, costs, reach, and sustainability, as well as interventions’ relevance to participant needs and participants’ experience with the interventions. A large majority of the studies investigated multidimensional definitions of success by addressing two or more different types of criteria. Ongoing analysis aims to illuminate how evaluations were structured to address multiple criteria types, clarify how equity was investigated as a criterion, and provide recommendations for improved reporting of evaluative criteria.

Authors

• Rebecca M. Teasdale, University of Illinois at Chicago

• Mikayla Strasser, University of Illinois at Chicago

• Ceily Moore, University of Illinois at Chicago

• Kara Graham, The Ohio State University