How to Implement Causal Impact Evaluations Using Strategies to Interrogate, Illuminate, and Reduce Racial Inequalities

• In Event: Community-Based Research as Consequential Research

Abstract

The fourth paper, authored by Wendy Castillo and Rebecca Maynard is titled, How to Implement Causal Impact Evaluations Using Strategies to Interrogate, Illuminate, and Reduce Racial Inequalities. The paper aims to give researchers concrete strategies and new methodologies on ‘how to’ implement causal impact evaluations intentionally toward justice by being conscious that they occur within a racialized and racist society. Randomized Controlled Trials (RCTs) have long been recognized in the scientific community as the gold standard for causal inference research. Second to RCTs, Quasi-Experimental Designs (QED) are considered a favorable alternative method to emulate randomization mechanisms. The authors aim to improve the quality of causal inference research produced by social scientists by recommending strategies anchored on the QuantCrit framework. The authors adopt a position of principled ambivalence, neither rejecting RCTs nor falling into traps of judging them to have outsized status, superior value, or neutrality vis a vis other evaluation methods.
Until recently, the calls for proposals from the Institute of Education Sciences (IES) did not explicitly emphasize attention to issues of racial equity in calls for proposals and the review process (Zilberstein 2022). This paper uses the What Works Clearinghouse (WWC) repository from IES to review and identify recent RCTs/QEDs and examine their alignment with various foci: community-centered, practitioner-centered, youth-centered, racial/ethnic-centered, or participatory approach. Thus, the goal is for this paper to serve as a starting point for researchers to reference when they desire to implement racially conscious RCT/QED. We recognize that this process is iterative, and although this paper may lay the foundation, we must continue to refine, unlearn, and relearn. We also recognize that applying any framework and set of practices will not dismantle systemic racism; however, as a field, we are developing tools and strategies to begin reimagining the role that research and data can play in an anti-racist society.

Authors

• Wendy Castillo, Princeton University
  Presenting Author

• Rebecca A. Maynard, University of Pennsylvania
  Non-Presenting Author