Search
On-Site Program Calendar
Browse By Day
Browse By Time
Browse By Person
Browse By Room
Browse By Unit
Browse By Session Type
Search Tips
Change Preferences / Time Zone
Sign In
X (Twitter)
Session Type: Symposium
Universities increasingly use performance assessments (PAs) to measure students’ complex (meta-)cognitive skills and learning outcomes. Using a holistic criterion-sampling approach, the PAs represent real-life decision-making situations in which critical thinking or other skills are required to meeting academic/professional demands. Technology-based PAs provide new opportunities for valid measuring complex skills like critical reasoning in real online learning environments by collecting multimodal response-process data like log files and conducting mix-methods analyses (incl. process-mining) and learning analytics. However, PAs pose conceptual, methodological and practical challenges in times of ChatGPT because text generating is a key component of the measurement. This symposium discusses frontiers, advances, and research perspectives of technology-based PA approaches of measuring university students’ critical thinking/online reasoning that embrace generative AI developments.
Olga Zlatkin Troitschanskaia, Johannes Gutenberg University of Mainz
Johannes Hartig, DIPF | Leibniz Institute for Research and Information in Education
Assessing Critical Thinking in Times of ChatGPT: Think-Aloud Protocol Analysis as an Alternative Approach - Kai S. Cortina, University of Michigan; Blake Ebright, University of Michigan; Blake Glatley, University of Michigan
A Performance and Response Process Data Triangulation to Identify Online Reasoning Patterns Among Graduates - Andreas Maur, Johannes Gutenberg University of Mainz; Olga Zlatkin Troitschanskaia, Johannes Gutenberg University of Mainz; Lisa Martin de los Santos, Johannes Gutenberg University of Mainz; Kevin Shenavai, Johannes Gutenberg University of Mainz; Jennifer Fischer, Johannes Gutenberg University of Mainz; Marie-Theres Nagel, Johannes Gutenberg University of Mainz; Susanne Schmidt, Johannes Gutenberg University of Mainz
Analyzing Generic Critical Online Reasoning Skills During Practical Training in Medicine, Law, and Teaching - Lisa Martin de los Santos, Johannes Gutenberg University of Mainz; Susanne Schmidt, Johannes Gutenberg University of Mainz; Olga Zlatkin Troitschanskaia, Johannes Gutenberg University of Mainz; Marie-Theres Nagel, Johannes Gutenberg University of Mainz; Jennifer Fischer, Johannes Gutenberg University of Mainz; Andreas Maur, Johannes Gutenberg University of Mainz; Anika Kohmer, Johannes Gutenberg University of Mainz
How to Use ChatGPT: Strategies to Learn With Large Language Models in Physics Education - Stefan Küchemann, Ludwig Maximilian University of Munich; Karina Avila, Technical University of Kaiserslautern; Steffen Steinert, Ludwig Maximilian University of Munich; Jochen Kuhn, Ludwig Maximilian University of Munich; Yavuz Dinc, Ludwig Maximilian University of Munich
Modelling and Analyzing the Online Information Landscape University Students Use for Their Learning - Maxim Konca, Goethe University; Daniel Baumartz, Goethe University; Mevlüt Bagci, Goethe University; Alexander Mehler, Goethe University