Conducting Cognitive Interviews in Virtual Spaces: A Case Study for Scale Development

• In Event: AERA Virtual Poster Session 4
  In Poster Session: Poster Session 2

Abstract

When developing self-report survey instruments, utilizing cognitive interview (CI) techniques allows researchers to collect evidence for the validity of their items based on response processes (AERA et al., 2014). While historically conducted in-person, the recent increased utilization of virtual meeting platforms like Zoom presents a new medium through which CIs can be administered. This proposal presents a case study in conducting CIs over Zoom in the service of the creation of a new scale, the Academic Effort Beliefs Scale. Special attention is paid to unique methodological considerations when conducting CIs virtually. The benefits and drawbacks of virtual CIs are discussed in detail; benefits include increased access to diverse populations and high-quality renderings of interviews for evaluation purposes.

Authors

• Ryan Iaconelli, National Center for Education Statistics

• August Masonheimer, The Ohio State University

• Andrew Perry, The Ohio State University - Columbus

• Jacqueline von Spiegel, The Ohio State University