One Year After GPT-4: How AI Changed Assessments?

Session Type: Organized Discussion

Abstract

At NCME 2023, just a few weeks after the GPT-4 was released, we organized a panel discussion around the potential implications of GPT-4 and other advanced AI tools in educational assessment. With a year having elapsed since the last well-attended session, we propose a new panel discussion to reflect on how the landscape of assessments has been shaped and elevated by the transformative influence of powerful AIs ever since. Our discussion will center around the five key areas of assessment, skills and constructs, item and task development, psychometric methodologies, reimagining assessment administration, and upskilling of psychometric practitioners. We hope this panel discussion can catalyze the exchange of ideas and insights, steering us collectively toward a more cohesive understanding of the transformative potential of AI in assessment.

Sub Unit

• Individual Papers, Innovation Demonstrations, Coordinated Sessions, or Organized Discussions

Session Organizer

• Jiangang Hao, EDUCATIONAL TESTING SERVICE

Moderator

• Alina A. von Davier, Duolingo

Presenters

• Victoria Yaneva

• Susan Lottridge, Cambium Assessment

• Matthias von Davier, BOSTON COLLEGE

• Deborah Harris, University of Iowa