Dissecting Reliability and Validity Evidence of Rater-Mediated Subjective Creativity Assessment (Poster 30)

• In Event: AERA Virtual Poster Session 7
  In Poster Session: Giftedness, Creativity, and Talent Development Poster Session

Abstract

This study focuses on subjective creativity assessment (SCA), a popular approach that mainly relies on raters’ subjective definitions of creativity in the assessment. Because no studies have reviewed the psychometric properties of SCA collectively and that there is no clear distinction between reliability and validity evidence of SCA, this study reviews reliability and validity evidence of SCA under the theoretical frameworks of rater-mediated assessment and the 2014 Standards for Educational and Psychological Testing. The results showed that, overall, SCA has adequate reliability and validity; however, many variations exist in different facets of SCA, such as tasks, subjects, and raters. These results can help identify issues related to the reliability and validity of SCA and provide insights for its improvement.

Authors

• Haiying Long, University of Kansas

• Jue Wang, University of Science and Technology of China