Paper Summary
Share...

Direct link:

Comprehensive Comparison of Answering Behavior Threshold Determination Methods on a Large-Scale, Low-Stakes International Assessment (Poster 3)

Thu, April 13, 4:40 to 6:10pm CDT (4:40 to 6:10pm CDT), Hyatt Regency Chicago, Floor: East Tower - Exhibit Level, Riverside West Exhibition Hall

Abstract

The Programme for International Student Assessment (PISA) is used worldwide to set educational policies. On the PISA, a low-stakes test with little external incentives for students, full effort cannot be assumed. This may affect that claim that the results represent a student's true proficiency. To examine answering behaviors, you must be able to delineate effortful students from non-effortful. On computer-based tests, response times can be used to find a threshold value between these types of answering behaviors. Many threshold determination methods have been proposed, but no thorough comparison has been done. This study examines 15 threshold determination methods to find the most efficacious overall and across 8 language groups and 3 item types, using the 2015 PISA science item data.

Author