Validity Evidence for an AI-Generated Instrument Measuring Perceived Attributes of Innovation for ChatGPT (Poster 38)

• In Event: AERA Poster Session Sunday 8:00 a.m.
  In Poster Session: Design and Technology SIG Poster Session

Abstract

This study explores the integration of ChatGPT, an advanced generative AI (GenAI) language model, into the development of an instrument aimed at measuring perceived innovation attributes related to ChatGPT usage among university students in Taiwan. Drawing upon Rogers’ Diffusion of Innovation framework, the instrument was developed using ChatGPT. Confirmatory factor analysis demonstrated satisfactory psychometric properties for the instrument, with dimensions of Relative Advantage, Compatibility, Ease of Use, Trialability, and Observability significantly related to the usage of ChatGPT among university students in Taiwan. Lastly, the study critically evaluates ChatGPT usage in social science research methodology and highlights ethical considerations. The findings contribute to the potential for methodological integration of GenAI into instrument development.

Authors

• Florian Buelt, National Sun Yat-sen University

• Hsueh-Hua Chuang, National Sun Yat-sen University

• Thomas J. Smith, Northern Illinois University