Multimedia Effects in Assessment: Pictures in Multiple-Choice Items Influence Psychometric Test Characteristics

• In Event: Roundtable Session 16
  In Roundtable Session: Cognition and Assessment Roundtable

Abstract

Representational pictures are frequently added to test items, while the impact from pictures on psychometrical parameters and cognitive processes are undetermined. Studies indicate that pictures make items easier (i.e. multimedia-effect) and compensate reading-ability difficulties. In this experiment, we investigated item parameters changes on a test and a single-item level and furthermore explored interactions of pictures with students’ general cognitive and reading abilities. We constructed 48 parallel text-picture and text-only multiple-choice items measuring science-achievement and employed a multi-matrix design. N=286 fifth and sixth grade students participated. A multimedia-effect occurred for item difficulty, but not for discrimination parameters. On an item level, parameter changes were inconsistent. As a conclusion, psychometric multimedia-effects are not easily generalizable. Furthermore, students’ characteristics did not moderate picture-effects.

Authors

• Marlit Annalena Lindner, IPN - Leibniz Institute for Science and Mathematics Education

• Steffani Sass, IPN - Leibniz Institute for Science and Mathematics Education

• Jan Marten Ihme, IPN - Leibniz Institute for Science and Mathematics Education