Exploring Unintended or Inappropriate Interpretations, Uses, and Consequences of Test Scores

Session Submission Type: Symposium

Abstract

Tests are commonly designed for a particular purpose and their scores have a pre-conceived set of interpretations and uses. Although test developers can foresee some alternative interpretations and uses that may lead to unintended consequences, reality often is more complex than we imagine. Test developers are usually too familiar with the test to be able to easily envision the range of creative interpretations, inappropriate uses and unplanned consequences of the test. To strengthen the test development and validation processes, we need methods that can help explore these alternative realms. This symposium presents various theoretical and practical issues regarding the collection and analysis of evidence about the actual and unintended interpretations, uses and consequences of a test.

Sub Unit

• Division D - Measurement and Research Methodologies / Section 1: Educational Measurement, Psychometrics, and Assessment

Chair

• Stephen G. Sireci, University of Massachusetts - Amherst

Papers

• Validating Inferences Under High-Stakes Conditions: Addressing Unintended but Expected Consequences of Accountability - Daniel M. Koretz, Harvard University

• (Un)intended Uses of the SAT - Krista D. Mattern, The College Board; Jeffrey Nagle Wyatt, The College Board

• Using Public Opinion to Inform the Validation of Test Scores - Tzur M. Karelitz, National Institute for Testing & Evaluation

• Consequences and Side Effects of Testing: Their Role in Validity and the Meaning of Test Scores - Bruno D. Zumbo, The University of British Columbia; Anita M. Hubley, The University of British Columbia

• Exploring Unintended or Inappropriate Interpretations, Uses, and Consequences of a Test - Gregory J. Cizek, University of North Carolina - Chapel Hill

Discussant

• Michael T. Kane, ETS