Integration of Validity Evidence in a Mixed-Methods Study to Inform Instrument Refinement

• In Event: Advanced Applications of Mixed-Methods Research: Instrument Development and Crossover Analysis Strategies

Abstract

Program effectiveness are often evaluated using instruments that represent a construct under study. During development and refinement, it is important to ensure that instruments exhibit construct validity. During the iterative cycles of multiphase project implementation, modifications to the intervention program may alter the construct of interest, making it difficult to gauge whether program effectiveness was due to intervention effects or measurement error, particularly if outcomes are measured using instruments developed from a prior iteration. This necessitates the collection of new and ongoing validity evidence that reflects the updated construct. The purpose of this paper is to illustrate the application of mixed methods research to integrate validity evidence and inform subsequent instrument refinement using an iterative process.

Authors

• Carlomagno Panlilio, The Pennsylvania State University

• Matthew T. McCrudden, The Pennsylvania State University

• Benjamin Levi, The Pennsylvania State University