Framework Content Coverage Variation in NAEP: Grade 8 Mathematics and U.S. History

• In Event: Measurement Issues in NAEP and Implications for the Interpretation of Results

Abstract

When a new assessment framework is introduced or a revision is made to the current framework, a decision of whether or not maintain trend needs to be made. From a content perspective, continuity of framework content coverage is essential. The major purpose of this study is to: (1) develop framework coverage measures to quantify the degree of variability of framework coverage; (2) examine variation in framework content coverage across actual NAEP operational assessments using the measures; and (3) evaluate the feasibility of the coverage measures to inform a trend decision. This study analyzed item classification data from five recent grade 8 NAEP mathematics assessments and four U.S. history assessments. Major results are presented and the implications of findings are discussed.

Authors

• Young Yee Kim, American Institutes for Research

• Fei Liu, American Institutes for Research

• Sharyn Rosenberg, National Assessment Governing Board