Reinforcing Webb's Depth of Knowledge (DOK): Laterally Extending DOK by Acknowledging Proficiency's Impact on Cognitive Demand

• In Event: Cognition and Assessment

Abstract

Norman Webb’s (2002) Depth of Knowledge is the most commonly used typology of cognitive complexity across the assessment industry. Unfortunately, it is widely misapplied, inflating the reported DOK levels of test items – a problem that is commonly understood but rarely publicly acknowledged. We lay out common misunderstandings/misapplications of DOK and offer a more robust system for classifying items by cognitive complexity by returning to Webb’s original conceptions and descriptions of DOK. This method of classification recognizes the impact of increased proficiency on reducing cognitive load, thus the fact that cognitive complexity is as much a product of test taker proficiency as the tasks given to test takers. We show the feasibility of this approach with a simple interrater reliability study.

Authors

• Marjorie Wine, University of Kansas
  Presenting Author

• Alexander M. Hoffman, AleDev Research
  Presenting Author