Psychometrics Oversights: A Systematic Literature Review of Reliability, Validation and Fairness in Reading Self-Concept Measurements

• In Event: Virtual Poster Session
  In Virtual iPresentation Only: SIG-Cognition and Assessment Virtual Poster Session

Abstract

Reading self-concept is a predictor of academic success and lacks consistent psychometrics evaluations. This systematic literature review examined validation, reliability and fairness of reading self-concept measurements. Following PRISMA guidelines, we analyzed 102 studies. Findings revealed critical gaps. No studies used expert reviews for content validity; only one employed cognitive interview. Confirmatory factor analysis was rare (12 studies) with half meeting fit standards. Test-retest (8 studies) and alternate-form reliability were neglected while 86 studies reported internal consistency (α). No studies fully examined measurement invariance or DIF across sexes despite documented sex differences. Terminological inconsistency further obscured comparability. These oversights risk biased interpretations and inequitable assessments. This review calls for standardized terminology, robust validation and bias detection to ensure psychometrically sound assessments.

Authors

• Onur Ramazan, Chinese University of Hong Kong

• Robert W. Danielson, Washington State University - Spokane

• Shenghai Dai, Washington State University

• Chad M. Gotch, Washington State University