Inclusion of the Conventions, Practices, and Values of Multiple Stakeholders in a Validity Framework

• In Event: Validity in Systems of Data Use

Abstract

Multiple stakeholders are concerned with or are affected by the interpretation and use of test scores. The consequence of multiple stakeholders, each evaluating the validity framework through the lens of their own value systems, is that different stakeholders may arrive at conflicting conclusions with regard to validity. The decision to support any test score interpretation and use will likely be public and contentious. Potential contention means less certainty and greater costs associated with test development. We recommend a participatory evaluation approach to validity that acknowledges and accommodates the different values and perspectives stakeholders bring to evaluating validity.

Authors

• Paul D. Nichols, ACT, Inc.

• Emily R. Lai, Pearson