An Investigation of Response Time and Response Behavior on PISA Science Assessment

• In Event: Process Data Modeling and Application in Educational Assessments

Abstract

Response Time (RT) data provides valuable information in psychometric research. This paper uses RT data to investigate response behavior using PISA 2015 assessment. For low-stakes assessments, engagement and effort issue is prevalent among test takers because those assessments are aiming to provide aggregated level information to entities rather than individual test takers. Focusing on rapid-guessing behavior, this paper, using Response Time Effort (RTE) and Response Time Fidelity (RTF) measures, found that for the same cluster of science items, the effort received by those items differ when appearing before or after other domain items, that is, for those science items, they received more effort when appearing after reading/math items than appearing before reading/math items.

Author

• Mingjia Ma, University of Iowa