Assessment and Instruction Coherence for Dynamic Measurement of Student Proficiency

Session Type: Coordinated Paper Session

Abstract

Interactions with digital lessons represent great opportunities for measurement; this data could be used to update reports, track student growth, and evaluate the effectiveness of instruction, all within the context of student learning. In this session, we will share research connecting data from a large-scale digital assessment to data from digital lessons.

The first paper will examine the content alignment between assessment items and lesson quiz items in two domains and grade levels. The second and third papers explore the various context effects surrounding the lesson quiz items and seek to understand how these effects contribute to item performance. For the second paper, we administered lessons to students under a variety of conditions, some with instruction and some without, to examine the effect of instruction and feedback on estimation of IRT parameters. The third study attempts to estimate item parameters from lessons as they are administered naturally in students’ lesson path and attempts to account for the effects of preceding instruction and restriction of range in the sample in estimating parameters. Finally, pulling together the previous papers, we apply a tracking algorithm (Glicko) to students’ assessment and lesson data to track students’ learning in mathematics throughout the academic year.

Sub Unit

• Individual Papers, Innovation Demonstrations, Coordinated Sessions, or Organized Discussions

Session Organizer

• Logan Rome, CURRICULUM ASSOCIATES

Individual Presentations

• Alignment of Digital Assessment and Instruction Items - Amanda Brice, Curriculum Associates

• The Effect of Instruction and Feedback on IRT Parameter Estimation - Erin Banjanovic, CURRICULUM ASSOCIATES; Nathan Minchen, CURRICULUM ASSOCIATES, LLC; Ted Daisher, CURRICULUM ASSOCIATES; Logan Rome, CURRICULUM ASSOCIATES

• Item Parameter Estimation from Students’ Lesson Paths - Sanford R Student, University of Delaware; Erin Banjanovic, CURRICULUM ASSOCIATES; Logan Rome, CURRICULUM ASSOCIATES

• Tracking Student Learning Through Digital Instruction - Ted Daisher, CURRICULUM ASSOCIATES; Erin Banjanovic, CURRICULUM ASSOCIATES; Matthew Myers, University of Delaware; Sanford R Student, University of Delaware; Logan Rome, CURRICULUM ASSOCIATES

Discussant

• Ying Cheng, UNIVERSITY OF NOTRE DAME