Evaluating Rater Bias Effects in Constructed-response Scoring in Situational Judgment Tests

• In Event: Situational Judgment Tests

Abstract

We analyzed 10,536 responses to situational judgment test items using the generalized many-facet Rasch model. This study aimed to identify common argument structures and evaluate rater biases in scoring, considering traits like consistency, severity, and restrictiveness. The research provides insights into refining assessment methodologies.

Authors

• Jinnie Shin

• Zeyuan Jing, University of Florida

• Alexander MacIntosh, Acuity Insights