79.017 - Technology-Enhanced Items in Educational Assessments: Challenges, Findings, and Implications

Session Type: Symposium

Abstract

Many large-scale educational assessments have recently transitioned from paper-based to computer-based delivery platforms. This transition has led to an increasing use of technology-enhanced items (TEI) that involve interactions and responses that go beyond traditional multiple-choice items. However, empirical research on TEIs is only at a preliminary stage. The field of educational assessment is calling for more research on how TEIs affect test takers’ cognition and performance, and the ways to properly interpret assessment outcomes. This symposium features four presentations that discuss major challenges of using TEIs for educational assessments and share recent findings from research on TEIs. The implications of the findings to current and future educational assessments will be discussed as well.

Sub Unit

• Division D - Measurement and Research Methodologies / Division D - Section 1: Educational Measurement, Psychometrics, and Assessment

Chair

• Jung Aa Moon, Educational Testing Service

Papers

• The Effect of Drag-and-Drop Item Type Design on Test-Takers' Performance and Strategy Use - Burcu Arslan, Educational Testing Service; Yang Jiang, Educational Testing Service; Tao Gong, ETS; Madeleine Keehner, Educational Testing Service

• Test-Taker Cognition Under Uncertainty in Grid and Multiple-Select Items - Jung Aa Moon, Educational Testing Service; Sandip Sinharay, Educational Testing Service

• Machine Scoring by Design for New Digitally Based Item Types and Innovative Observations in NAEP - Kathleen Scalise, ETS

• Methods and Issues of Partial Credit Scoring for Multiple Response Items - Shuqin Tao, Curriculum Associates; Daniel F. Mix, Curriculum Associates

Discussant

• Stephen G. Sireci, University of Massachusetts - Amherst