A Debate on the Merits of Embedded Standard Setting

Session Type: Organized Discussion

Abstract

Embedded standard setting (ESS) has emerged as an alternative to the traditional multi-round in-person or online standard setting workshop. Daniel Lewis will argue that when item writers create test items purposefully aligned to carefully crafted performance level descriptors (PLDs), and when empirical data support the alignment of items to PLDs, then cut scores can be estimated directly (as described by Lewis & Cook, 2020 and Lewis, Lee, & Choi; 2022). Marianne Perie has collected data from at least one state that, she will argue, challenge some of the assertions made by Dr. Lewis regarding ESS. She will share those data as well as caveats about the method. In the course of the debate, Drs. Lewis and Perie will have an opportunity to present their respective cases and challenge each other’s arguments. Gregory Cizek will provide commentary on both presentations and ask questions to elicit clarification of points made by each speaker. Following the debate, audience members will have an opportunity to ask questions, comment, or prompt further debate.

Sub Unit

• Individual Papers, Innovation Demonstrations, Coordinated Sessions, or Organized Discussions

Session Organizer

• Michael Brannen Bunch, MEASUREMENT INCORPORATED

Moderator

• Michael Brannen Bunch, MEASUREMENT INCORPORATED

Presenters

• Daniel Lewis, Creative Measurement Solutions LLC

• Marianne Perie, WESTED

Discussant

• Gregory Cizek, UNIVERSITY OF NORTH CAROLINA-C