Methodological Considerations for Using Gen-AI in Qualitative Text Analysis

• In Event: Qualitative Research and AI

Abstract

Technological progress has revolutionized qualitative research, providing new tools for data collection and analysis. In this study, we explore the applications and limitations of generative AI (Gen-AI) for text analysis, focusing on thematic analysis with a chatbot embedded within a word processing application. Through this methodological study, we demonstrate the tool's capabilities in generating codes inductively, grouping codes into categories, and developing themes. We evaluate and compare its output to human analysis, assessing its adherence to research standards. The study highlights Gen-AI’s potential and constraints, emphasizing the need for researchers to understand its strengths and limitations, particularly in terms of efficiency, transparency, reliability, and support.

Authors

• Nicole Narkiewicz, University of Central Florida

• Audra Skukauskaite, University of Central Florida