How Can the the Standards for Educational and Psychological Testing Better Guide Practitioners Doing Operational and Applied Measurement in Education?

Session Type: Invited Speaker Session

Abstract

Abstract
The purpose of the Standards (2014) is to “promote the sound and ethical use of tests” (Plake & Wise, 2014, p. 2) with the target audience defined as measurement professionals “who specify, develop, or select tests (AERA et al., 2014, p. 1).”
As the next version of the Standards is on the horizon, we ask: How can the Standards better guide the testing industry professionals? Application of the Standards to operational testing situations has never been more important as the field is fighting the public distrust of tests used for K-12 accountability and college admissions. Abiding by the Standards is essential in ensuring this trust. Consequently, it is imperative that the Standards be useful and practical in an operational setting.
Summary
The purpose of the Standards for Educational and Psychological Testing (American Educational Research Association[AERA], American Psychological Association [APA], & National Council of Measurement in Education[NCME], 2014) is to: “promote the sound and ethical use of tests and to provide a basis for evaluating the quality of testing practices…by providing criteria for evaluating tests, testing practices and the effects of test use….[and] information to test developers, publishers and users about key elements of a testing program that should inform the development, selection and use of tests” (Plake & Wise, 2014, p. 2). The target audience for the Standards has traditionally been measurement professionals defined as those “who specify develop or select tests and …those who interpret or evaluate the technical quality of test results” (AERA et al., 2014, p. 1).”
An important question that must be addressed is: How can the Standards better guide practitioners who are doing work that is focused on operational and applied measurement? Application of the Standards to operational testing situations has never been more important. The negative attitude of the public toward testing, exacerbated by the pandemic, has never been stronger. Key to the survival of important tests such as admissions or k-12 accountability tests is public trust. The Standards are essential in ensuring this trust. Consequently, it is imperative that the Standards be useful and practical in an operational setting.
The purpose of this interactive session is to explore how the utility/usability of the Standards could be increased in a variety of operational settings and provide stronger and clearer guidance for test development and use.
Three prominent practitioners experienced in the day-to-day operations of licensing, admissions and k-12 assessments will respond to questions regarding the usefulness of the Standards for operational purposes. Following the panelists comments the session will be open for a dialogue between the panelists and the audience. Information gathered in this session will be used to directly influence the next revision of the Standards.

Sub Unit

• AERA Related Activities

Chair

• Kristen Huff, Curriculum Associates

Panelists

• Ye Tong, National Board of Medical Examiners

• Wayne J. Camara, Law School Admission Council

• Vincent M Verges, Florida Department of Education