Discussions on Validity Threats in Empirical Regression Discontinuity Design Studies

• In Event: Educational Learning Posters

Abstract

Previous empirical regression discontinuity design (RDD) studies revealed various validity threats due to methodological limitations. This article discussed major validity threats that should be considered in RDD studies and how they can be adequately addressed. The RDD study conducted by Tuckwiller et al. (2010) was used as an example, which was published in a journal article titled "The use of the regression discontinuity design in tiered intervention research: A pilot study exploring vocabulary instruction for at-risk kindergarteners." Different types of validity threats were discussed, including statistical conclusion validity threats, external validity threats, internal validity threats, and construct validity threats, and how Tuckwiller et al. (2010) addressed these validity threats were evaluated using the checklist developed by Johnson and Christensen (2017) according to Standards for Educational and Psychological Testing published by American Educational Research Association (AERA), American Psychological Association (APA), and National Council on Measurement in Education (NCME) (2014). We hope to provide implications for educational researchers using RDD in their studies on ways to address validity threats and build stronger validity. This article can also provide insights to other researchers on how to examine various threats in an organized and detailed way.

Authors

• Yuqing Zou, University of Iowa

• Chunrui Zou, University of Pennsylvania