Items in Technology-Based Assessments: Examining the Use of Multimedia Stimuli With Post-Primary Test-Takers

• In Event: AERA Roundtable Session 8
  In Roundtable Session: Development Considerations for Assessments Used in Schools

Abstract

Technology-Based Assessments (TBAs) use items that employ a range of stimuli (e.g. animations, text-image). To determine the extent to which different multimedia stimuli can affect test-taker performance, an experiment was conducted with 251 Irish post-primary students using an animated and text-image version of the same TBA of scientific literacy. Eye movement (n=32) and interview data (n=12) was also gathered. The results indicated that, overall, there was no significant difference in test-taker performance when identical test items used animated or text-image stimuli. However, eye movement data revealed that the type of multimedia stimulus used can affect attentional behaviour. The implications of these and other findings, as well as recommendations for policy, practice, and future research will be considered.

Authors

• Paula Lehane, Dublin City University

• Michael O'Leary, Dublin City University

• Darina Scully, Dublin City University