Exploring the Methodological Quality of Education Intervention Meta-Analyses: A Meta-Review

• In Event: Advancing Meta-Analytic Methods

Abstract

This paper reports on a meta-review of 247 meta-analyses of education interventions published between 2011 and 2023. Inclusion criteria for the eligible meta-analyses included: (a) general populations of students in K–12; (b) effects of school-based academic interventions on student academic achievement; (c) studies using group designs (i.e., randomized controlled trials, quasi-experimental designs), and (d) English-language manuscripts published in a journal. We coded the use of best practice methods of systematic review and meta-analysis modeling in all 247 included meta-analyses. While many meta-analyses conform to guidelines for systematic review methods, more attention is needed in applying modern meta-analysis modeling strategies, coding for critical appraisal/risk of bias of eligible studies and using open science practices.

Authors

• Terri D. Pigott, Georgia State University

• Marta Pellegrini, University of Cagliari

• Caroline Sutton Chubb, Georgia State University

• Natalie Pruitt, Georgia State University

• Hannah F. Scarbrough, Georgia State University