NAEP Process Data and the Many Hats It Wears

• In Event: Discussion and Demonstration of the Uses and Affordances of NAEP Digitally Based Assessments

Abstract

This presentation discusses the many roles of process data in the National Assessment of Educational Progress (NAEP) digitally based assessment (DBA). We begin by providing necessary background regarding the type of data collected in NAEP DBA. We provide operational definitions of these data and briefly discuss their use and structure.

Next, we move to the main the focus of the presentation: a discussion of how process data have been used in NAEP. Here we use recent examples from NAEP as guides to discuss how process data have been used to ensure data quality prior to analysis, provide insights and feedback to the assessment design cycle, and enhance reporting in DBAs. We use specific examples from NAEP math, reading and science DBA to do this. Where necessary, analogs to actual items will be used in place of sensitive material.

We close with a brief discussion of the current challenges for which process data may be employed in meaningful ways and with a question of what additional benefits end users of NAEP data might reap from process data. We strongly encourage attendees to contribute to the discussion here and as well as during the question and answer period.

Author

• Christopher Agard, Educational Testing Service