Exploration of the Psychometric Properties of Formative Assessment Items Developed by Teachers for Teachers

• In Event: Hilton Roundtable Session 1
  In Roundtable Session: Development, Validation, and Psychometric Testing of Assessments

Abstract

This paper describes the process used to assess the quality and relative difficulty of locally-developed test items to judge students’ progress on mastering key concepts from district Power Standards. District administrators desired feedback on whether the items were well written and actually targeted to an appropriate level. The evaluation team compiled pre-post tests that included district-created items and items released from state and national tests as anchors. They then applied a Rasch measurement model to results to judge the relative difficulty and quality of the district-created items. The process serves as a model that other schools or districts could use to build pools of items for classroom assessments that are relatable to a broader context.

Authors

• Shannon O. Sampson, University of Kentucky

• Jie Dai, Amazon

• Lori Hollen