Paper Summary
Share...

Direct link:

Argument-Counterargument Integration and Other Frameworks for Evaluating Arguments

Fri, April 13, 2:15 to 3:45pm, Sheraton Wall Centre, Floor: Third Level, South Pavilion Ballroom B

Abstract

OBJECTIVES AND THEORETICAL FRAMEWORKS. The first presentation will be a conceptual overview by the chair (Michael Nussbaum) on the problem of argument evaluation and some of the frameworks that have been applied in the past. A new framework, argument-counterargument integration, will be presented, and prior research on the framework summarized. The presentation will be only 10 minutes, to allow additional time for discussion at the end of the symposium.

DATA SOURCES. Not applicable, as this is a conceptual overview. I will draw on literature from philosophy and psychology.

CONCLUSIONS. The problem of argument evaluation has traditionally been addressed in a number of ways.

1. Formal logic, and the study of syllogisms and fallacies;
2. Informal logical criteria, specifically relevance, sufficiency, and acceptability (Johnson & Blair, 1977);
3. The Toulmin model, and specifically whether there are warrants and backing for claims (Toulmin, 1958); and
4. Counts of arguments, counterarguments, and rebuttals.

These frameworks are deficient in a number of ways. Arguments produced in everyday discourse rarely have the convoluted structures that make the tools of formal logic useful; also, formal logic does not evaluate the truth of premises. Blair and Johnson’s criteria are extremely general, limiting their usefulness. The Toulmin model does not distinguish between strong and weak warrants and backing; likewise, simply counting the frequency of arguments, counterarguments, and rebuttals does not distinguish between, for example, strong and weak counterarguments.

More contemporary work in philosophy suggests that strong arguments are ones that can withstand objections (Pollock, 1987). This inspired Nussbaum and Schraw (2007) to propose the argument-counterargument integration framework, which proposes that arguments which address counterarguments are generally stronger than those that do not (see also Leitao, 2000). Counterarguments can be addressed in at least three ways, by: refuting them, weighing them, or designing creative solutions that minimize problems identified in the counterarguments. Prior research using the framework (Nussbaum, 2008; Nussbaum, Winsor, Aqui, & Poliquin, 2008) found that while students at different grade levels could be trained to make integrated arguments, they needed additional criteria for weighing arguments against counterarguments. In more recent work, we have drawn on Walton’s (1996) notion of critical questions as providing criteria for evaluating different types of arguments. Nussbaum and Edwards (2011) found that middle-student could, with training, ask some sorts of critical (evaluative) questions, such as “Is one value more important than another?” Furthermore, they documented the development of some psychological structures (i.e., a values weighing schema) which resulted in some transfer effects.

SIGNIFICANCE. We do not propose that the argument-counterargument integration framework, supplemented with critical questions, provides a complete solution to the argument evaluation problem, but it does provide additional tools that can be used by researchers and/or taught to students. Approaches of other researchers in the symposium will also be acknowledged and briefly introduced here. Taken together, these approaches will help advance the field of argumentation in education forward by identifying useful thinking practices that can be taught to students and also utilized by researchers for coding purposes.

Author