Paper Summary

Direct link:

Relationship Between Digital Media and Assessments: An Empirical Study Using Telemetry Data

Fri, April 9, 10:40am to 12:10pm EDT (10:40am to 12:10pm EDT), Division C, Division C - Section 3b: Technology-Based Environments Paper and Symposium Sessions 2


The proliferation of digital media has brought about the need to reconceptualize learning, instruction, and assessment. Using telemetry data of a children’s app for fostering science and engineering skills, this study aimed to identify potential variables regarding the relationship between interaction with digital resources and target knowledge and practices measured via external assessments. Results showed the potential of telemetry-based measures to reveal learning processes and conditions under which digital media can influence learning outcomes. Measures reflecting substantive content exposure and content mastery were particularly predictive and explanatory. The results also implied the need to design digital media content to align with features of assessment and to focus on applying target knowledge if they are to be useful for measurement purposes.