The Real Gold Standard: Measuring Counterfactual Worlds that Matter Most to Social Science and Policy

• In Event: Causality is Not a Method - A Forum

Abstract

The randomized experiment has achieved the status of the gold standard for estimating causal effects in criminology and the social sciences more generally. Although causal identification is indeed important and observational data present numerous challenges to causal inference, we argue that conflating causality with the method used to identify it leads to a cognitive narrowing that diverts attention from what matters most—the difference between counterfactual worlds that emerge as a consequence of their being subjected to different universal treatment regimes over a sustained period of time. To address this system-level and long-term challenge, we develop an analytic framework for integrating causality and policy inference that accepts the mandate of causal rigor but that is conceptually rather than methodologically driven. We then apply our framework to two substantive areas that have generated high-visibility experimental research and that have considerable policy influence– 1) hotspots policing, and 2) the use of housing vouchers to reduce concentrated disadvantage and thereby crime. After reviewing the research in these two areas in light of our framework, we propose a research path forward and conclude with implications for the interplay of theory, data, and causal understanding in criminology.

Authors

• Daniel Nagin, Carnegie Mellon University

• Robert J. Sampson, Harvard University