The Science of Measurement: Using Testing Standards to Increase Research Validity

Session Type: Invited Speaker Session

Abstract

The last decade has witnessed enormous attention to increasing the rigor of educational research through scientific design and sophisticated data analysis methodologies. Emerging technologies have provided new assessment tools for measuring a wider range of research processes and outcomes. Interestingly, however, the quality of the measures used in research, a potentially fatal flaw in the validity of research findings, has received relatively little attention. This symposium reviews research on the quality of research measures and presents the Standards for Educational and Psychological Testing as a key resource for strengthening practice. The session highlights validity and fairness standards that are particularly important for research instruments and considers implications for research policy and practice.

Sub Unit

• AERA Sessions

Chair

• Joan L. Herman, University of California - Los Angeles

Papers

• The Quality of Existing Measures: The Case for Standards' Relevance - Joan L. Herman, University of California - Los Angeles

• The Need for Test Validity Evidence in Research: Examples From the Literature - Frank C. Worrell, University of California - Berkeley

• Developing and Selecting Quality Instruments for Research: The Role of the Fairness Standards - Linda L. Cook, Educational Testing Service

Discussants

• Peggy G. Carr, National Center for Education Statistics/IES, U.S. Department of Education

• Larry V. Hedges, Northwestern University