Individual Submission Summary
Share...

Direct link:

Enhancing Model-Based Adjustments of Nonprobability Surveys

Sun, September 3, 10:00 to 11:30am PDT (10:00 to 11:30am PDT), LACC, 303A

Abstract

Nonprobability surveys have become increasingly popular for social science research based on observational data. Since nonprobability samples are based on a non-random (self-)selection of respondents, we need powerful model-based adjustments to reduce selection bias in surveys based on nonprobability samples. However, the auxiliary variables used for adjustments are frequently limited to a small subset of sociodemographic variables. Recent research suggests these variables hardly help minimize bias in nonprobability surveys. One proposed explanation for the often-poor performance of survey adjustments is the weak correlation between survey participation, variables of interest, and the auxiliary variables used for adjustments.
In our study, we argue that survey researchers should select and include questions on auxiliary variables in their surveys based on theoretical assumptions about the links to survey participation and substantive variables of interest. We conducted two (preregistered) studies with data from surveys on political attitudes and behavior in Germany. The respondents for these surveys were selected from a nonprobability opt-in online panel using quotas on sex, age, and education. We included auxiliary variables from different domains for which external benchmark data were available to compute adjustment weights that - from a theoretical perspective - are likely correlated with both 1) substantive political attitudes and behaviors and 2) survey participation. Comparing estimates of electoral behaviors to official statistics on the election outcome across different adjustments, we found that the approach is promising for reducing selection biases in nonprobability surveys.

Author