From Fixed Test to Endless Data Systems: Analyzing and Communicating Ongoing Formative Assessment

Session Type: Symposium

Abstract

Current federal, state, and consortia policies emphasize the need to construct and deploy systems that integrate assessment and instruction in ongoing digital learning support environments. Despite this growing need, research on the design of these systems, the analysis of their content, and the reporting of results of interacting with these complex environments is underdeveloped. In this symposium we will bring a combination of psychometric, statistical, content-based, and computer engineering and human-computer interaction (HCI) approaches to recommend methods for analyzing and communicating important aspects of these systems. After the provision of a technological overview paper addressing challenges and opportunities, subsequent papers provide multi-disciplinary perspectives on analyzing inputs, tracking learner trajectories and reporting outputs. Software is demonstrated and discussion facilitated.

Sub Unit

• Division D - Measurement and Research Methodologies / Section 1: Psychometrics, Measurement, and Assessment

Chair

• Thomas McTavish, Pearson

Papers

• Psychometric, Computational, and Interactional Issues in Designing Integrated Assessment and Learning Systems - Quinn Nathaniel Lathrop, University of Notre Dame; John T. Behrens, Pearson

• Network-Based Tools for the Visualization and Analysis of Domain Models - Hua Wei, Pearson

• Leveraging Student Interactivity Data to Inform Instruction and Monitor Learning Progress - Thomas McTavish, Pearson; Johann Ari Larusson, Pearson

• Designing Interactive Assessment Reporting Tools Based on Extended User Feedback - Stephanie E Butler, LightSide Labs; Paul Mandel, Carnegie Mellon University; Auldyn Matthews, Red Privet, LLC; KeVon Ticer, Carnegie Mellon University; Nina Xu, Carnegie Mellon University

Discussant

• Roy Levy, Arizona State University