Development of the Compose With AI Platform for Critically Evaluating and Using AI-Generated Content for Academic Purposes

• In Event: Generative AI Tools to Support Literacy

Abstract

This study explored the design and efficacy of Compose With AI, a web-based platform guiding grades 4–8 students in ethically integrating AI-generated content into science-focused writing. Using a Design-Based Implementation Research (DBIR) approach, researchers analyzed student think-aloud protocols and teacher interviews to identify factors enhancing and inhibiting critical AI evaluation. Results demonstrate that Compose With AI's structured, scaffolded approach may improve students' ability to critically evaluate AI-generated content, even with no prior AI experience.

Authors

• Amy Hutchison, University of Alabama

• Lori Bruner, University at Albany

• Erdogan Kaya, George Mason University