Optimizing Embedded Assessment in NumberShire Gaming Intervention: Response Time and Accuracy Trade-offs

• In Event: AERA Roundtable Session Sunday 11:45 am - Gold 2
  In Roundtable Session: Technology and Innovation in Special and Education (Table 8)

Abstract

In this paper, we apply a novel approach using the drift-diffusion model to examine potential trade-offs and find balanced performance points that account for both accuracy and response time, using data from an efficacy trial of a mathematics technology gaming intervention, NumberShire, specially designed for first-grade students with or at risk for learning disabilities. Results indicate that accuracy tends to increase as response time decreases, but only to a certain point. Practical implications include that educators should consider both accuracy and response time to intensify and individualize their instruction and take student background into account. We suggest that developing technology-based mathematics interventions and assessments requires careful design and configuration to balance accuracy and response time, thereby enabling adaptive performance thresholds for better understanding and supporting student learning in early mathematical fluency.

Authors

• Sam Choo, University of Minnesota

• Jechun An, University of Minnesota

• Nancy J. Nelson, Boston University

• Derek Kosty, Oregon Research Institute