A Research of Heuristic vs. Normative Training for the Angoff Standard-Setting Method

• In Event: 49.088 - Roundtable Session 17
  In Roundtable Session: 49.088-18 - Standard Setting: Issues and Applications

Abstract

This study compared two training interventions for the Angoff standard setting method, Heuristic and Normative, and instruction and practice over feedback, on effectiveness to improve judgments of student performance among teachers in the K-12 educational system. The findings were that the Heuristic training expressed higher satisfaction, provided judgments that were more stable, and substantively meaningful across rounds of judgment. Meanwhile, although judgments-- especially those of the Normative training—showed increasing association with norms provided as feedback, conversely, there appeared declining relationship with the knowledge and skills measured by tests. Therefore, the conclusion is that the Heuristic training is more effective than the Normative, and instruction and practice more effective than feedback.

Authors

• Ifeoma Chika Iyioke, Michigan State University

• Mark D. Reckase, Michigan State University