Putting Research into Practice: Case Studies Developing Reporting Tools with Stakeholder Engagement
Sat, April 13, 1:15 to 2:45pm, Convention Center, Floor: First, 121BSession Type: Coordinated Paper Session
Abstract
Although educational research is often motivated by an interest in improving achievement-score-related measures for stakeholder use, researchers are rarely involved in the translation of that research into practice. This session highlights four case studies in which researchers engaged with diverse groups of stakeholders in rigorous, iterative processes of development and engagement to create digestible reporting tools that avoid misinterpretations and are accessible to a variety of stakeholders. We demonstrate how partnerships with stakeholders via co-design, focus groups, usability studies, surveys, or stakeholder meetings are key to designing reporting tools with equitable access to all intended audiences. We highlight lessons learned about communicating complex concepts and measures to various audiences.
The first presentation focuses on bridging the gap between assessment results and instructional action with classroom-level score reports for a through-year assessment program. The second highlights the process of creating school/district-level summaries of an improved aggregate-level growth score. The third provides a few examples of the development process for tools in the National Assessment of Educational Progress (NAEP) reporting ecosystem, including the recently developed NAEP achievement gap tool. The fourth illustrates the application of the iterative multistep framework in the development of parent/family reports for early learning assessments in one state.
Sub Unit
Session Organizer
Chair
Individual Presentations
What Does this Mean for My Next Unit? A Classroom Reporting Approach - Nathan Dadey, Center for Assessment; E. Caroline Wylie, Center for Assessment
A State’s Journey of Communicating School/District Summaries of Student Growth - Joseph A. Martineau, EdMetric, LLC; Kimberly Mundhenk, California Department of Education; Katherine Furgol Castellano, ETS
How stakeholder needs inform an equitable and meaningful Nation’s Report Card - Robert Finnegan, Educational Testing Service; Madeline Goodman, Educational Testing Service; Timothy Shaw, Forum One Communications
Need for ongoing monitoring after operational deployment: Indiana ISPROUT reports - Priya Kannan, WESTED; Matthew Brunetti, WestEd; Jaylin Nesbitt, WestEd; Lynn Schemel, Indiana Department of Education