Do Items With Paired Response Options Elicit Successful Guessing Behavior on High-Stakes Licensure Examinations?

• In Event: Assessment Using Multiple-Choice Questions

Abstract

We explore whether the item characteristics of four response multiple-choice questions with “paired” (i.e., non-independent) response options differ from those of questions with unpaired response options in an operational licensure exam. We are particularly interested in the effects of response pairing on guessing behavior. Our analyses so far suggest that there are no differences in guessing behavior as a function of response pairing. In the discussion, we explore conditions under which item characteristic differences as a result of response pairing might be more or less likely to be observed and suggest avenues for further research.

Authors

• Joanne Kane, National Conference of Bar Examiners

• Juan Chen, National Conference of Bar Examiners

• Douglas R. Ripkey, National Conference of Bar Examiners