How Much Does the Size of Validity Coefficients Matter? Perspectives From the GRE General Test

• In Event: Topics in Validity Evaluation

Abstract

Stakeholders familiar with predictive validity mainly in the form of zero-order correlation coefficients might automatically interpret the usefulness of an assessment through the prism of Cohen’s (1988) guidelines for judging effect sizes and without regard to a larger context. Reliance on these guidelines can lead to ill-advised decisions about the value of an assessment. This study uses validation of the GRE test to illustrate this risk. By employing multivariate and innovative approaches to conceptualize and measure GRE predictive validity and utility within a larger context, our investigation reveals that the GRE test, including its relatively new Analytical Writing section, provides considerable value for predicting graduate school grades even when zero-order correlation coefficients are small to moderate in size.

Authors

• David Marc Klieger, Educational Testing Service

• Frederick A. Cline, ETS

• Steven L. Holtzman, ETS

• Jennifer Minsky, Educational Testing Service

• Florian Lorenz, ETS