- Browse
Search
On-Site Program Calendar
Browse By Day
Browse By Time
Browse By Person
Browse By Room
Browse By Unit
Browse By Session Type
- Information Menu
Search Tips
- Navigation and Settings Menu
Change Preferences / Time Zone
Sign In
- Social Media Menu
Facebook
X (Twitter)
Assessment in the Advent of Process Data and AI
Sat, April 13, 3:05 to 4:35pm, Philadelphia Marriott Downtown, Floor: Level 4, Room 401Session Type: Invited Speaker Session
Abstract
The purpose of this session is to share recent work at the intersection of assessment, cognition, and computing. Three papers demonstrate how the analysis of response process data gathered in computer-based testing environments can be used in the design, evaluation, interpretation, and improvement of student assessments. As a complement to this, the fourth paper uses principles of cognitive assessment and psychometrics to inform the evaluation of natural language generation models.
Sub Unit
Chair
Papers
Profiling Behavioral Patterns in Interactive Computational Thinking Tasks Across Countries: Sequence Mining With Process Data - Qiwei He, Georgetown University
Evaluating Examinee Engagement Through Modeling the Relation Between Response Time and Item Word Count - Pooya Razavi, Edmentum; Sonya J. Powers, Edmentum
Sequential Mastery Detection of Multiple Attributes With Response Accuracy and Response Time Data - Sangbeak Ye, Florida Atlantic University
Evaluating Natural Language Generation Model Evaluation: A Measurement Theory Perspective - Susu Zhang, University of Illinois at Urbana-Champaign; Ziang Xiao, Johns Hopkins University; Vivian Lai, Visa Research; Vera Q. Liao, Microsoft Research