An R Shiny App for Calculating Consequential Validity Ratio with Continuous and Binary Criterion

• In Event: Innovations in Validity Evaluation and Measurement Development

Abstract

The consequential aspect of validity addresses the actual and potential social consequences of assessment use and score interpretation. To quantify this, the Consequential Validity Ratio (CVR) has been introduced, measuring the extent to which criterion variance is attributable to test scores versus construct-irrelevant demographic factors. This metric is available for both continuous outcomes (CVR_C) and binary outcomes (CVR_B). However, there is a lack of accessible and intuitive software tools for feasibly calculating CVRs. Thus, this study addresses that gap by introducing an R Shiny application that streamlines CVR computation and supports simultaneous calculation of multiple CVR metrics. Two empirical demonstrations using educational and psychological datasets are included illustrates the app’s utility.

Authors

• Kushmakar Baral, University of Denver

• Yixiao Dong, University of California - Santa Barbara