Human-Generative AI Collaborative Problem-Solving: Critical Thinking Intervention on Reliance Behaviors and Creativity

• In Event: Critical Reflection of AI Integration in Education

Abstract

This study examines the effects of a critical thinking intervention embedded in problem-based learning (PBL) on students’ reliance behaviors on Generative AI and creativity. Participants (N = 226) were assigned to either an experimental condition, which combined authentic instruction, structured dialogue, and AI-supported mentoring to promote students’ critical thinking, or a comparison condition without these components. We collected surveys on trust, critical thinking, and reliance behaviors, and group reports and chat histories. While the intervention did not significantly improve self-reported critical thinking, it reduced thoughtless AI use and adoption of AI-generated content. Importantly, experimental groups produced more creative solutions. These findings underscore how students use AI matters more than whether they use it, highlighting the value of critical thinking interventions.

Authors

• Chenyu Hou, National Institute of Education - Nanyang Technological University

• Gaoxia Zhu, National Institute of Education - Nanyang Technological University

• Vidya Sudarshan, Nanyang Technological University

• Fannie Yifan Zhang, Nanyang Technological University

• Josephine Leng-Leng Chong, Nanyang Technological University