Procedures for the Rapid Coding of Qualitative Data in Evaluation

• In Event: 527 - Regular Session. Qualitative Methodology

Abstract

Qualitative data offer several advantages to evaluators, including rich information about stakeholders’
perspectives, expectations, and experiences. However, the analysis of qualitative data is labor- intensive and slow, conflicting with needs for evaluators to provide ongoing and punctual feedback to their clients. In this method note, we contribute to the growing body of literature on rapid evaluation, assessment, and appraisal by proposing procedures that evaluators can use to expedite the coding and analysis of qualitative semi-structured interview data. Specifically, we outline procedures for direct coding of audio recordings (DCAR), which allow evaluators to code and analyze qualitative data without time-consuming transcription. We illustrate the use and assess the reliability of these rapid coding procedures using qualitative semi-structured interview data from 18 public school administrators on how they locate information about and decide to use instructional, health, and social skills programming in their districts. Finally, we end with advantages and tradeoffs of these rapid coding procedures as well as recommendations for how to apply them in conjunction with other strategies for rapid evaluation.

Authors

• Jennifer Watling Neal, Michigan State University

• Zachary Neal, Michigan State University

• Erika VanDyke, Michigan State University

• Mariah Kornbluh, Michigan State University