Utilizing the Cognitive Interviewing Method to Investigate Response Processes to Constructed Response Items

• In Event: 53.081 - Roundtable Session 21
  In Roundtable Session: 53.081-10 - Research on Assessment Design and Development

Abstract

In this study we used cognitive interviews to investigate examinees' response processes while they completed constructed-response items on a science test. Our analyses focused on whether the response processes used by the examinees were consistent with those the items were designed to measure. Using pure think-aloud and conditional probing, we identified the response processes used by examinees and compared them against the processes specified at the item level. We noted some inconsistencies including the misunderstanding of item instructions, and different forms of construct underrepresentation. A schematic understanding of examinees' response processes was developed from our analyses. The results should be useful for improving test construction to develop items that better target the intended cognitive processes.

Author

• Yooyoung Park, University of Massachusetts - Amherst