Culturally Responsive and Sustaining Approaches to Constructed Response Scoring in Assessment

Session Type: Coordinated Paper Session

Abstract

Purposeful action to reduce majority bias is required throughout a scoring system to ensure valid and fair score interpretations for all students. The four papers in this session weave together recommendations for scoring essays in large-scale assessment from a panel of diverse voices and perspectives. Authors will provide a path that leads to a culturally responsive scoring system: focusing on item and rubric development; prioritizing the representation of diverse groups in the scoring sample; and providing hand- and automated-scoring recommendations designed to be practical to implement and posed to offer an immediate impact. Authors will discuss assumptions that underlie scoring and how bias may encroach into the most well-intentioned scoring system without an active antiracist stance; identify approaches that can lead to more culturally responsive and sustainable scoring processes to promote equitable measurement practices; provide evidence to support their claims; and, encourage large-scale assessment providers to be intentional in applying culturally responsive practices in the development of human and automated scoring systems.

Sub Unit

• Individual Papers, Innovation Demonstrations, Coordinated Sessions, or Organized Discussions

Session Organizer

• Sarah Quesen, WestEd

Individual Presentations

• Culturally Responsive and Sustaining Approaches to Item and Rubric Alignment. - Heather Roeters-Solano, Pearson

• Culturally Responsive and Sustaining Approaches to Sample Representation and Metrics for Evaluation. - Jaylin Nesbitt, WestEd

• Culturally Responsive and Sustaining Approaches to Hand-scoring Processes. - Susan Lottridge, Cambium Assessment, Inc.

• Culturally Responsive and Sustaining Approaches to Automated-scoring Processes - Sarah Quesen, WestEd; Karen Lochbaum, Pearson

Discussant

• Lauren White, Pearson