Leveraging Eye Tracking and Student Think-Aloud Interviews to Examine Sequence of Contextualized Items in Science

• In Event: 30.077 - Applications in Validity Research and Theory

Abstract

Sequence of contextual information refers to the order of descriptions involved in item contexts, such as sequence of events, sequence of intention and action, and sequence of effect and cause. To build on prior findings on how different sequences of contextual information could influence student test scores, we used eye tracking along with student cognitive interviews to further explore the sequence effect. Thirty middle/high school students participated in this study, including 18 for think aloud cognitive interviews, and 12 for an eye tracking lab. We found that students had various explanations of how the sequence of contextual information helped or impeded their thinking process. Eye tracking data evidenced potential connections between the sequence of contextual information and test scores.

Authors

• Ting Wang, Educational Testing Service

• Yuan-Ling Liaw, University of Oslo

• Min Li, University of Washington

• Gary Feng, Educational Testing Service