Analysis of "Rapid-Guessing" Behavior Using Response Times for the Released PISA 2015 Science Items (Poster 1)

• In Event: Extracting Information From Large-Scale Assessments

Abstract

Large international assessments, such as the Programme for International Student Assessment (PISA), are considered low stakes because students have no external motivation to do well on these tests. Low motivation can affect effort on these tests, leading to questions of assessment validity. The advent of computerized testing provides new, relatively straightforward means for indirectly examining motivation. This study examines response time behaviors for the released science items from the 2015 PISA through the identification of ‘rapid-guessing’ behavior, which is an indication of low test-taking motivation. Research questions addressed were: 1) Can ‘rapid-guessing’ and ‘solution’ behaviors be determined for each science item? and 2) What are the differences in these behaviors across items, item difficulty, item type, and item position?

Author

• Lauri Mackelburg-Davis, Western Michigan University