Cognitive Complexity and Aspects of Rigor of Accountability Assessment Items

• In Event: AERA Roundtable Session Thursday 7:45 am - Gold 4
  In Roundtable Session: From Data to Understanding: Building Fair and Rigorous Math and Science Assessments

Abstract

This study assesses the levels of cognitive complexity and aspects of rigor of assessment items. The analysis of items was based on the ACHIEVE framework to evaluate cognitive complexity in mathematics assessment. Result revealed that items that target Conceptual and Procedural skills – CP is the largest class in both years, and it dominated the assessment with 37.5% in 2023, and 32.5% in 2024. Moreover, the dominant level of complexity was Level 2. Given the pattern of item distribution, it is crucial to maintain items that balance ACP strand and prioritize a higher-level complexity.

Authors

• Patrick Obot, University of Houston

• Mandana Delavari, University of Houston

• Arpana Manjunath, University of Houston

• Jennifer B. Chauvot, University of Houston