AERA Annual Meeting: Addressing Practical Challenges in the International Performance Assessment of Critical Thinking

Direct link:

Addressing Practical Challenges in the International Performance Assessment of Critical Thinking

Sun, April 24, 4:15 to 5:45pm PDT (4:15 to 5:45pm PDT), Division Virtual Rooms, Division D - Section 1: Educational Measurement, Psychometrics, and Assessment Virtual Paper Session Room

Session Type: Symposium

Abstract

Performance assessment (PA) of critical thinking (CT) comprises a real-world, complex scenario. Each scenario describes a challenge to be addressed and provides documents (e.g., memoranda, reports, charts, blogs, twitter) varying in relevance, trustworthiness, and bias susceptibility that the respondent must consider in addressing the challenge. CT PAs can provide valid and useful information for teaching (formative assessment) and accountability (summative) purposes (e.g., Shavelson et al., 2018). Nevertheless, substantial challenges remain concerning assessment development complexity, score reliability, testing time, scoring, and validity (e.g., Davey et al., 2015; Braun, 2019; Leighton, 2019). This symposium addresses these challenges and discusses possible solutions. We examine potential methods for evaluating and increasing reliability, streamlining scoring and constructing multiple short PAs from a lengthy task.

Sub Unit

Division D - Measurement and Research Methodology / Division D - Section 1: Educational Measurement, Psychometrics, and Assessment

Chair

James W. Pellegrino, University of Illinois at Chicago

Addressing Practical Challenges in the International Performance Assessment of Critical Thinking

Abstract

Sub Unit

Chair

Papers

Discussants