Search
Program Calendar
Browse By Day
Browse By Time
Browse By Person
Browse By Room
Browse By Unit
Browse By Session Type
Search Tips
What to do in Chicago
Personal Schedule
Sign In
X (Twitter)
Session Type: Structured Poster Session
Conversations with computer agents can be used to gather additional evidence that may be difficult to obtain using traditional assessment approaches. Our work leverages advances made on natural language intelligent tutoring systems, specifically, research on AutoTutor (Graesser, Person, & Harter, 2001). Even though these types of tasks can be used to assess skills such as argumentation, English language and science inquiry, they also impose several challenges including development complexity, scalability, fairness, validity and reliability issues. This structured poster session highlights work on the design and evaluation of conversation-based assessments.
1. Using Conversation-Based Tasks to Diagnose the English Language Skills and Math Knowledge of Middle School English Learners - Alexis Lopez, Educational Testing Service; Danielle Guzman-Orth, Educational Testing Service
2. Assessing Argumentation Skills Using Conversations: Comparing Constrained- and Open-Response Formats in Game-Based Assessment - Yi Song, Educational Testing Service; Jesse R. Sparks, Educational Testing Service; Wyman Brantley, Educational Testing Service; Colleen Foley; Margaret Vezzu, ETS; Tanner Jackson, Educational Testing Service
3. Assessing Mathematical Argumentation and Algebraic Reasoning Through Automated Conversations - Gabrielle Alexis Cayton-Hodges, Educational Testing Service; Malcolm Bauer, ETS; Maria Bertling, Harvard University; Irvin R. Katz, Educational Testing Service; E. Caroline Wylie, ETS
4. Evaluating Conversation Patterns to Elicit Evidence of Students' Science Reasoning Skills - Tanner Jackson, Educational Testing Service; Diego Zapata-Rivera, Educational Testing Service; Lei Liu, Educational Testing Service; Margaret Vezzu, ETS
5. Man vs. Machine: Analyzing Human Responses to Other Humans vs. Artificial Agents in Conversation-based Assessments - Carol McGregor Forsyth, Educational Testing Service; Youngsoon So, ETS; Christine Luce, ETS; Laura Battistini, ETS; Keelan Evanini, ETS; Diego Zapata-Rivera, Educational Testing Service; Jidong Tao, ETS; Tanner Jackson, Educational Testing Service
6. Comparing Trialogue-Based Tasks With Other Assessment Tasks - Haiying Li, The University of Memphis; Diego Zapata-Rivera, Educational Testing Service; Blair Lehman, The University of Memphis; Tanner Jackson, Educational Testing Service
7. Exploring Scalability Issues of Conversation-Based Assessments - Lei Liu, Educational Testing Service; Isaac I. Bejar, ETS; Diego Zapata-Rivera, Educational Testing Service; Tanner Jackson, Educational Testing Service
8. Automated Testing of Conversation-Based Assessments - Irvin R. Katz, Educational Testing Service; Diego Zapata-Rivera, Educational Testing Service; Maria Bertling, Harvard University; Tanner Jackson, Educational Testing Service; Nathan Lederer, ETS; Keith Kisser, ETS