The Cognitive Implications of Different Formats in Test Question Design

• In Event: Poster Session 4
  In Poster Session: Assessing Cognitive Ability and Processes

Abstract

The current study investigated how different question formats influence test-taker cognition. Adult participants solved isomorphic math questions in three formats: 1) non-forced-choice options presented in a grid, 2) forced-choice (True-False) options in a grid, and 3) multiple-selection multiple-choice (a type of non-forced choice). We found that participants’ reasoning processes were influenced by the use of a grid question format and forced-choice options. We discuss implications of these results for guiding the selection of appropriate question formats.

Authors

• Jung Aa Moon, Educational Testing Service

• Madeleine Keehner, Educational Testing Service

• Irvin R. Katz, Educational Testing Service