AI-Human Collaboration in Teaching: Auto-Generation and Test of Operations Management Education Videos

• In Event: AWARD: Instructional Innovation Award Competition Sponsored by Alpha Iota Delta

Abstract

We use generative AI to develop teaching videos in operations management and compare them with human-generated videos in an online experiment. We assign online participants to a mix of two AI-generated and two human-generated videos and ask them to rate their learning experiences and prove their learning outcomes in an exam (N=105). We find no evidence that human-generated videos provide a better learning experience than AI-generated videos or vice versa. However, we find that participants scored statistically significantly better on the exam for the questions concerning three of the four concepts taught by the human-generated videos compared to AI-generated videos.

Authors

• Torbjørn Netland, ETH Zürich

• Katalin Tesch, ETH Zürich

• Daniel Kwasnitschka, ETH Zürich

• Oliver von Dzengelevski, ETH Zürich