Identifying Potentially Problematic Questions in Online Learning for Literacy

• In Event: Friday Roundtable Session 4:55 pm
  In Roundtable Session: Methods of Support for Online Learners (Table 11)

Abstract

Incorporating technology into literacy education can engage students, but it is important to ensure that the materials are effective. We developed methods to evaluate questions by analyzing student performance in a literacy-focused educational game. We clustered logs of student performance to identify questions that may not serve learning or assessment needs so that the questions could be reviewed and improved by teachers. Two set of questions were analyzed by grade level and skill type to identify content that needed improvement. The use of this approach to identify broader concerns among system questions in two datasets demonstrates its potential to enable the continual monitoring and improvement of questions used in online learning settings.

Authors

• Emilia Hidalgo, University of British Columbia

• Carla Hudson Kam, University of British Columbia

• Carrie Demmans Epp, University of Alberta