Relationship Between Digital Media and Assessments: An Empirical Study Using Telemetry Data

• In Event: Validity of Insights Derived From Learning Technology Log Data

Abstract

The proliferation of digital media has brought about the need to reconceptualize learning, instruction, and assessment. Using telemetry data of a children’s app for fostering science and engineering skills, this study aimed to identify potential variables regarding the relationship between interaction with digital resources and target knowledge and practices measured via external assessments. Results showed the potential of telemetry-based measures to reveal learning processes and conditions under which digital media can influence learning outcomes. Measures reflecting substantive content exposure and content mastery were particularly predictive and explanatory. The results also implied the need to design digital media content to align with features of assessment and to focus on applying target knowledge if they are to be useful for measurement purposes.

Authors

• Yon Soo Suh, University of California - Los Angeles

• Gregory K.W.K. Chung, University of California - Los Angeles

• Elizabeth Redman, UCLA/CRESST

• Charlie Parks, University of California - Los Angeles

• Tianying Feng, National Center for Research on Evaluation, Standards, and Student Testing