CDMSIB: Differential Item Functioning Detection Procedure in Cognitive Diagnostic Assessment

• In Event: Detecting and Explaining Differential Item Functioning

Abstract

To ensure the validity of the results from cognitive diagnostic models (CDMs), differential item functioning (DIF) in CDMs needs to be investigated. This study proposes an adaptation of the traditional SIBTEST procedure for DIF detection in the context of the DINA model called the CDMSIB procedure. Simulation studies are implemented to evaluate the performance of the proposed procedure and to compare this new procedure to the traditional SIBTEST procedure for detecting DIF in the DINA model. Factors consisting of sample size of the reference and focal groups, reference group item parameter values, DIF size, and proportion of DIF items in the test are considered.

Authors

• Likun Hou, Educational Testing Service

• Ratna Nandakumar, University of Delaware

• Jimmy de la Torre, Rutgers University