Supporting Teachers to Prepare for Productive Failure Using an AI-Powered Algebra Problem Generator (Poster 11)

• In Event: AERA Poster Session Wednesday 4:20 p.m.
  In Poster Session: Technology, Instruction, Cognition, and Learning (TICL) Poster Session

Abstract

Productive Failure (PF) involves students attempting challenging problems before direct instruction to deepen learning, but creating these problems is time-consuming for educators. This study explores using ChatGPT 4o to create Algebra problems. We developed a rubric to assess PF problems and tested ChatGPT 4o’s effectiveness in assessing and generating these problems. Second, we trained ChatGPT 4o to assess and generate Algebra problems. Finally, we conducted a pilot study to compare the ratings of problems by human experts and ChatGPT 4o. In parallel, we prompt-engineered ChatGPT 4o and generated 30 Algebra items. The results showed high correlation between human and AI assessments of problem quality. Also, we found that on average ChatGPT 4o can generate high quality Algebra problems.

Authors

• Seyedahmad Rahimi, University of Florida

• Salah Esmaeiligoujar, University of Florida

• Ran Gao, University of Florida

• Deniz Ercan, University of Florida

• Hongming Li, University of Florida

• Anthony Botelho, University of Florida