Developing First-Generation Task Models From Operational Exam Items

• In Event: Poster Session 9
  In Poster Session: New Developments in Psychometrics, Measurement, and Assessment: Poster Session 1

Abstract

Assessment Engineering task models are detailed specifications of the components (such as content knowledge, cognitive skill, context, etc.) that drive the complexity of a task, representing a family of assessment items. This study describes the process undertaken by a certification organization to develop first-generation task models. To develop the task models, 100 operational exam items were reviewed by a team of subject matter experts for the pertinent information housed in the item stem, the content knowledge required to respond to the item, the cognitive process undertaken by examinees, and the information density of the item. The results of this process and subsequent validation are described, as well as implications for future task model/test development practices.

Authors

• Robert Thomas Furter, American Board of Pediatrics

• Rachael Jin Bee Tan, Schroeder Measurement Technologies, Inc.