An Introduction to the Theory of Standard Setting

Session Type: Training Session

Abstract

This training session is designed to give attendees a thorough understanding of the goals for the use of standard setting procedures and the basic components of the standard setting procedures that are commonly in use. The intent is to show how the structure and processes used for setting standards of proficiency on educational tests can be used to support a validity argument for the interpretations that are commonly made about examinee performance relative to standards located on reporting score scales.

The training session is not designed to train participants on a specific standard setting procedure. Examples will be provided of common standard setting procedures with a focus on how to evaluate whether those standard setting procedures are functioning as intended. The examples will include a discussion of the typical steps in a standard setting procedure including panelist selection, training, selection of test items, standard setting tasks, feedback, and final approval of standards. Some statistical methodology will be described and demonstrated for determining the functional characteristics of a standard setting procedure.

The training session is appropriate for anyone who is interested in learning about the conceptual underpinnings of standard setting procedures.

Sub Unit

• Training Sessions

Session Organizer

• Mark Reckase, PSYCHOMETRIC SOLUTIONS