Automated and Interactive Game-Based Assessment of Critical Thinking

• In Event: Assessment and Technology

Abstract

We developed an automated and interactive game-based assessment of critical thinking, the Noah Kingdom, to measure students’ critical thinking ability in solving authentic problems. It was based on the Toulmin Model and used rich game tasks to trigger students' critical thinking. The assessment was repeated over two situational stories. We examined the psychometric quality (concurrent validity with a popular critical thinking test; reliabilities), relations to school academic performance, and students’ perception (e.g., interest, engagement) of Noah Kingdom with 187 Chinese senior secondary students. Results showed that the internal consistency Cronbach’s α (.461 to .839) was reasonable, its concurrent validity (.400 with HCTA) was comparable to those in other similar studies, and students found the game assessment interesting and engaging.

Authors

• Dan Wang, The Chinese University of Hong Kong

• Hongyun Liu, Beijing Normal University

• Leifeng XIAO, The Chinese University of Hong Kong

• Luyang Guo, The Chinese University of Hong Kong

• Kit-Tai Hau, Chinese University of Hong Kong