Reconstructing Measurement Tools in Survey Research Using Justice-Oriented Antiracist Validity in a High School Sample

• In Event: Analyzing Elements of Survey Design: Examinations of Validity and Response Options

Abstract

An important aspect of the scale validation process includes determining whether items work identically across multiple groups so that derived scores are equivalent across subpopulations. The justice-oriented antiracist validity (JAV) attempts to disrupt racism in measurement tools. We assessed differential item functioning to determine racial biases on two measurement tool in high schoolers (n = 3011). Both uniform and non-uniform DIF was found between all groups for both scales albeit for several items. The JAV framework allows us to think through whether items are racially charged. Giving us the ability to reconstruct scales/items removing biases, but from a critical lens. Through this research we impress upon readers to consider the rationale for the inclusion of race/ethnicity in their surveys.

Authors

• Marvin Powell, George Mason University

• Laura Laclede, George Mason University

• Beth Boesche-Taylor, Out Teach

• Hind Behayaa

• Liz Bergeron, New Tech Network