Undergraduate Students’ Learning Experience With ChatGPT: A Meta-Analysis

• In Event: AERA Roundtable Session Sunday 1:30 pm Four Seasons Ballroom 1
  In Roundtable Session: AI's Transformative Role in Education: Perceptions, Experiences, and Outcomes (Table 8)

Abstract

ChatGPT has gained significant attention in higher education, offering potential benefits for undergraduate students’ learning experiences. We conducted a meta-analysis evaluating the impact of ChatGPT application on undergraduate students’ learning reported from January 1st, 2023, to January 31st, 2024. A search across nine databases identified 1,019 potential studies, of which 15 met pre-defined inclusion criteria for meta-analysis. The meta-analysis, encompassing 28 effect sizes, suggests that ChatGPT applications had a large positive effect (Hedges’ g =1.07) on undergraduate students’ learning across various fields. These findings contribute to the growing body of literature on artificial intelligence (AI) in higher education and provide valuable insights for practitioners and policymakers seeking to enhance undergraduate students' learning experiences by integrating AI technologies such as ChatGPT.

Authors

• Fangfang Mo, Purdue University

• Zafer Ozen, Purdue University

• Yao Yang, Purdue University

• Yukiko Maeda, Purdue University