Challenges in Implementing Randomized Controlled Trials in Policing: Discussions from the Field

• In Event: Translating Police Research to Policy and Practice: Initial Work of the IACP/UC Center for Police Research and Policy

Abstract

A growing number of randomized controlled trials (RCT) have been conducted in policing over the past 25 years. RCTs have been described as providing the “gold standard” for causal inference in program evaluations. Despite the methodological rigor of these evaluations, several challenges can arise when implementing RCT research designs for policing research. We focus our discussion on how the use of random allocation of treatment conditions narrows the possible interventions that police departments can ethically, statistically, and feasibly implement. Descriptions and preliminary results of three RCTs conducted by the IACP/UC Center for Police Research and Policy are used to inform this discussion. We argue that while the use of RCTs in policing offers the advantage of a strong claim of internal validity, the practical limitations of implementing this research design most often outweigh this benefit. As a result RCTs in policing may be much closer to the “bronze standard” (see Berk, 2005) and should not be implemented at the expense of other needed research in policing.

Authors

• Cory Schnell, University of Cincinnati

• Robin S. Engel, University of Cincinnati