The Nature of Country Performance Differences via Distractor Analyses: Examining Comparability of International Assessments Outcomes

• In Event: AERA Poster Session 14
  In Poster Session: Division D Section 1 Poster Session 1

Abstract

International assessments explore country standing, the magnitude of differentiation and the extent of separation among countries. This investigation studied whether examinees from different countries made comparable errors regardless of scores attained. The most recent annual data from the three most popular school-based international assessments (PISA, PIRLS, and TIMSS) were each studied. Results and analyses showed that errors within countries were similar regardless of examinee scores attained. However, using multinomial logistic regression for extensive error analyses revealed across country meaningful differences suggesting country instruction is not comparable, or there were test fairness questions across countries that merit our attention. Recommendations for future research and study are provided.

Authors

• John Poggio, The University of Kansas

• Merve Akin-Tas, University of Kansas

• Jiayi Deng, University of Minnesota - Twin Cities

• Cynthia C. Esiaka, The University of Kansas