Using Participant Voices to Inform Validity Evidence in the Survey Development Process

• In Event: Innovative Methods in Survey Research

Abstract

This study presents qualitative findings from a larger instrument validation study. Undergraduates and subject matter experts (SMEs) were pivotal in early-stage development of a survey focusing on the four domains of Validation Theory (academic-in-class, academic-out-of-class, interpersonal-in-class, interpersonal-out-of-class). An iterative approach allowed for a more rigorously constructed survey refined through multiple phases. The research team met regularly to determine how feedback from undergraduates and SMEs could improve items and if certain populations were potentially being excluded. To date, the research team has expanded on the original 47 items up to 51 to address feedback provided by SMEs and undergraduate participants. Numerous item wording revisions have been made. Support for content, response process, and consequential validity evidence is strong.

Authors

• Christopher J Fornaro, Drexel University

• Toni A. May (Sondergeld), Drexel University

• Yiyun Fan, Drexel University

• Dara N Bright, Drexel University

• Thomas Heverin, Drexel University