Measuring Student Orientation to AI-Generated Feedback in Tertiary Education: A Validation Study of the AI-FOS

• In Event: AI for Higher Education Assessment

Abstract

As Artificial Intelligence-generated feedback becomes more prevalent in tertiary education, understanding student receptivity is essential for maximizing its value. This study extended the Feedback Orientation Scale (FOS) by developing and validating the AI Feedback Orientation Scale (AI-FOS), measuring students’ orientation toward AI feedback across utility, self-efficacy, and accountability, excluding social awareness as conceptually irrelevant. Psychometric analysis of 178 tertiary students confirmed strong reliability and a robust three-factor structure, with distinct yet interrelated dimensions. The AI-FOS showed significant positive correlations with the original FOS while remaining distinguishable, indicating students’ orientations toward AI- and teacher-generated feedback were related but separable. This validated tool will assist researchers and educators in assessing student readiness and effectively integrating AI and human feedback in curriculum design.

Authors

• Qishuai Zhang, The Education University of Hong Kong

• Lan Yang, Education University of Hong Kong