Characteristics of Insufficient Effort Students and Schools in Large-Scale Low-Stake Educational Surveys (Poster 28)

• In Event: AERA Poster Session Sixteen
  In Poster Session: Performance of Low-Achievement Students in Large-Scale Assessments

Abstract

Data quality is important in surveys, and the detection of insufficient effort responses (IER; including random and careless responses) is critical. Using the large-scale Programme for International Students Assessment (PISA) 2018 data, we evaluated the seriousness of IER and identified the characteristics of students and schools with high IER prevalence. Results showed (a) 33.2% of students were IER (16.6% overly consistent, 9.1% random responses, 7.5% missing); (b) boys were more likely IER; and (c) students and schools with high socioeconomic status, and low achievement were more likely IER; with different IER types. As some student types and certain kinds of schools are more susceptible to IER, targeted efforts are needed to reduce IER and hence improve data quality in surveys.

Authors

• Dan Wang, The Chinese University of Hong Kong
  Presenting Author

• Luyang Guo, Chinese University of Hong Kong
  Non-Presenting Author

• Leifeng Xiao, Chinese University of Hong Kong
  Non-Presenting Author

• Kit-Tai Hau, Chinese University of Hong Kong
  Non-Presenting Author