Using Item Response Theory Model in Survey Item Selection and Scaling

• In Event: Latent Analyses With Surveys in Education Research

Abstract

IRT model was used in the item selection and scaling for the ED School Climate Surveys (EDSCLS). In 2015, data were collected from 50 schools during the pilot test. Based on item fit statistics and other criteria, about one-third of the items were dropped and school climate scales were also created for 15 school climate scales to enable reporting on a topical area rather than individual survey items. These scale scores also enable easy comparison between schools or districts on any specific topical area. In 2016 and 2017, additional data were collected from schools national-wide. Then all scales were recalibrated recently using the three years of data. The estimates are very similar and only one more item was dropped.

Authors

• Yan Wang, American Institutes for Research

• Cong Ye, American Institutes for Research

• Isaiah L O'Rear, National Center for Education Statistics