Search
Program Calendar
Browse By Day
Browse By Time
Browse By Person
Browse By Room
Browse By Unit
Browse By Session Type
Search Tips
Personal Schedule
Sign In
Session Type: Coordinated Paper Session
The old aphorism, “If you want to know what a test measures, look at the items,” rings true because it is impossible to have a high-quality test without high-quality items. This session presents the results of three efforts to examine item quality. The first presentation discusses a project designed to assess item quality outside the standard content and bias reviews typically conducted by vendors. The evaluation criteria, which are publicly available, can be applied to a broad array of assessment types and designs including state summative, interim, and curriculum-embedded assessments. The second presentation describes a tool and process designed to support an independent evaluation of commercial interim assessments. The process includes the review of operational test items by teams of educators against a detailed set of item quality expectations. Finally, we discuss a protocol developed to help districts make informed assessment procurement decisions. In this case, item quality is evaluated through the review of vendor documentation supporting claims of item quality and appropriateness. In sharing these efforts, we hope to motivate more extensive discussions about the quality of items we offer to students to support inferences about student learning.
Extending the Evaluation of Item Quality in New Hampshire - Erika Landl, Center for Assessment; Brian Gong, CENTER FOR ASSESSMENT
Evaluating the Implementation of New Hampshire's Item Quality Criteria - Becky Kelley, University of Massachusetts Amherst; Erika Landl, Center for Assessment; Scott Marion, National Center for the Improvement of Educational Assessment
Piloting the District Assessment Procurement Protocal - Susan Lyons, Lyons Assessment Consulting; Erika Landl, Center for Assessment
Evaluating Item Quality within the Interim Assessment Evaluation Toolkit - Michael Briscoe, Ed Reports