Subscores: A Practical Guide for Their Production and Consumption

Session Type: Coordinated Paper Session

Abstract

This coordinated session highlights the contents of the just-published book entitled, “Subscores: A Practical Guide for Their Production and Consumption”. The book synthesizes research on the most salient topics and questions related to subscores so that a broad range of stakeholders can have a coherent and complete source of practical advice when considering test design and score interpretation decisions. In this session, we will provide an overview of the main themes of the book including: (1) historical context and application with the U.S. Census and Armed Services Vocational Aptitude Battery (ASVAB) as illustrative examples, (2) what subscores look like in practice and considerations for score report design, (3) how to tell which subscores add value and hence are worth reporting, and (4) how often subscores add value in practice and what credible options are available when they don’t. We will also include recommendations for communicating subscore challenges and opportunities to facilitate a productive dialogue in the likely scenario that subscores lack sufficient psychometric properties to support their desired purposes. Beyond the book content, this session also includes survey feedback from parents, educators, and leaders that provide insight into how subscore information is used and factors contributing to increased demand.

Sub Unit

• Individual Papers, Innovation Demonstrations, Coordinated Sessions, or Organized Discussions

Session Organizers

• Rich Feinberg, National Board of Medical Examiners

• Shelby Joel Haberman

Individual Presentations

• Historical context for subscore use with the U.S. Census as an illustrative example - Howard Wainer, NATIONAL BOARD OF MEDICAL EXAM

• How do various stakeholders use subscore information? - Chris Domaleski, CENTER FOR ASSESSMENT

• How subscores are reported, design considerations, and how to quantify subscore value - Rich Feinberg, National Board of Medical Examiners

• How often subscores add value and what can be done when they don’t - Sandip Sinharay, EDUCATIONAL TESTING SERVICE

Discussant

• David Thissen, UNIVERSITY OF NORTH CAROLINA