Myths and Realities: Effort and Response Distortion in Low-Stakes, Self-Report Assessments of Noncognitive Skills

• In Event: 14.035 - Examining Factors and Characteristics That Influence Assessment Performance and Responses

Abstract

Over the past several decades, educators have become increasingly interested in assessing noncognitive factors. Most tools still rely on self-report (e.g., Likert-type) items to measure these skills and behaviors, yet there are many concerns that arise from anecdotal or hypothetical behaviors. This paper uses data from a national study of college students’ noncognitive skills to examine the extent to which two of these phenomena – low effort and response bias – occur. Although some students fit a profile that suggests potential inaccuracies, data show that such occurrences are rare and these hypothetical behaviors in low-stakes, self-report assessment pose a minimal threat to the validity of their use.

Authors

• Ross Edward Markle, Educational Testing Service

• Javarro Antoine Russell, Educational Testing Service