Putting Research into Practice: Case Studies Developing Reporting Tools with Stakeholder Engagement

Session Type: Coordinated Paper Session

Abstract

Although educational research is often motivated by an interest in improving achievement-score-related measures for stakeholder use, researchers are rarely involved in the translation of that research into practice. This session highlights four case studies in which researchers engaged with diverse groups of stakeholders in rigorous, iterative processes of development and engagement to create digestible reporting tools that avoid misinterpretations and are accessible to a variety of stakeholders. We demonstrate how partnerships with stakeholders via co-design, focus groups, usability studies, surveys, or stakeholder meetings are key to designing reporting tools with equitable access to all intended audiences. We highlight lessons learned about communicating complex concepts and measures to various audiences.

The first presentation focuses on bridging the gap between assessment results and instructional action with classroom-level score reports for a through-year assessment program. The second highlights the process of creating school/district-level summaries of an improved aggregate-level growth score. The third provides a few examples of the development process for tools in the National Assessment of Educational Progress (NAEP) reporting ecosystem, including the recently developed NAEP achievement gap tool. The fourth illustrates the application of the iterative multistep framework in the development of parent/family reports for early learning assessments in one state.

Sub Unit

• Individual Papers, Innovation Demonstrations, Coordinated Sessions, or Organized Discussions

Session Organizer

• Katherine Furgol Castellano, ETS

Chair

• Katherine Furgol Castellano, ETS

Individual Presentations

• What Does this Mean for My Next Unit? A Classroom Reporting Approach - Nathan Dadey, Center for Assessment; E. Caroline Wylie, Center for Assessment

• A State’s Journey of Communicating School/District Summaries of Student Growth - Joseph A. Martineau, EdMetric, LLC; Kimberly Mundhenk, California Department of Education; Katherine Furgol Castellano, ETS

• How stakeholder needs inform an equitable and meaningful Nation’s Report Card - Robert Finnegan, Educational Testing Service; Madeline Goodman, Educational Testing Service; Timothy Shaw, Forum One Communications

• Need for ongoing monitoring after operational deployment: Indiana ISPROUT reports - Priya Kannan, WESTED; Matthew Brunetti, WestEd; Jaylin Nesbitt, WestEd; Lynn Schemel, Indiana Department of Education

Discussant

• Karoline Jarr, Curriculum Associates