Paper Summary
Share...

Direct link:

A Framework for Validation of Test Score Interpretations Using Examinee Judgments of Intrinsic Item Difficulty

Fri, April 13, 2:15 to 3:45pm, Vancouver Convention Centre, Floor: Second Level, East Room 2&3

Abstract

Proportion correct scores are used in classical test theory and for initialization in item response theory to characterize item difficuty. Intrinsic item difficulty is proposed as a means for determining how examinees view the difficulty of items. These response processes are discussed as a framework for broadening existing views for the validation of test score interpretations. Think-aloud protocols were used with students for ascertaining common misconceptions of basic mathematics problems. Once identified through transcriptions, judgment options were constructed for each item and factor analyzed. The 3PL and M3PL were used to characterize responses to 20 fraction and decimal items and the corresponding judgment options. Results provide for greater specificty of item difficultywhich has implications for curricula and faculty development initiatives..

Author