Individual Submission Summary
Share...

Direct link:

Six-Point Response Scales: A New Standard for (Multinational) Survey Research?

Sun, October 3, 6:00 to 7:30am PDT (6:00 to 7:30am PDT), TBA

Abstract

In recent years, Political Science has seen a resurgence of interest in (experimental) public opinion research. While methodologists have made much progress in uncovering best practices for survey design, important questions remain insufficiently theorized and empirically unresolved. Among them is the issue of response scale standards. In practice, survey researchers use a variety of designs: four labeled points, scales from 1 to 10, thermometers from 0 to 100, and so on. This paper explores six-point answer choice scales as a potential new standard for survey research in domestic and international contexts. Theoretically, a six-point scale has several advantages: First, in contrast to often used binary options or five-point scales, the six-point scale allows for differentiation between slight, firm, or strong agreement with each side of a bipolar scale, e.g. support or opposition. Second, the six-point scale does not overwhelm respondents with too many options, which would reduce instrument reliability and validity, e.g. as in the case of 100-point scales which feature an unnecessarily high number of choices. Third, in contrast to seven-point scales prescribed by leading survey methodologists, the six-point scale does not feature a middle response. It thus does not induce survey participants to satisfice, reduces the number of answers that are effectively equivalent to no-opinion responses, and eschews issues with subsequent dichotomization, i.e. when analysts want to collapse the various responses into two categories. Fourth, compared to even-numbered response scales with more choices, six-point response scales make the lack of a middle response evident to respondents. For instance, while many respondents may fail to realize the lack of a middle response on ten-point scales (e.g. erroneously treating 5 as the middle on a scale from 1 to 10), such mistakes are rather rare with six-point scales, where it is clear that there are three points on each sides of a bipolar scale. Fifth and finally, in contrast to response scales with more choices, the six-point scale generally permits intuitive verbal labels in various languages, rendering it suitable for multinational survey research. In order to test the theorized benefits of six-point scales over common alternatives, this paper will report the results of online survey experiments on nationwide samples of citizens across Africa, the Americas, Asia, Europe, the Middle East, and the Pacific region, scheduled for February 2021.

Author