In-Task Assessment Framework: A Framework for Assessing Individual Collaborative Problem-Solving Skills in an Online Environment

• In Event: Poster Session 10
  In Poster Session: Assessment of Learning and Cognition

Abstract

Technological advances have afforded new educational experiences for students to exhibit particular proficiencies in complex, interactive settings through games and simulations. These technologies afford the recording of students’ every action rather than just the answers given, making them useful for assessment purposes. However, there are many challenges in extracting relevant features of student performance from comprehensive log files and opportunities for multiple attempts introduce issues with statistical dependence. We introduce an assessment framework that seeks to address such challenges by combining top-down and bottom-up approaches to extract measures of content understanding from game play itself. We also provide preliminary results in applying the framework to measure collaborative problem solving skills for individuals as they complete a collaborative electronics simulation task.

Authors

• Jessica J Andrews, Educational Testing Service

• Deirdre Song Kerr, Educational Testing Service

• Paul Horwitz, The Concord Consortium

• John Chamberlain, Center for Occupational Research and Development

• Al Koon

• Cynthia McIntyre, The Concord Consortium

• Alina A. Von Davier, Educational Testing Service