M) and b path (M->Y) estimated in separate regressions (Preacher & Hayes, 2004), structural equation modeling (SEM) of indirect effects; and the Imai, Keele, and Tingley (2010) method. All four methods produced indications of significant mediation even when none was possible. This is the first empirical demonstration that we know of illuminating the validity of the concerns expressed by critics of mediation who have said that conventional tests can yield false mediation due to correlated residuals (Imai et al., 2010; Imai, Keele, Tingley, & Yamamoto, 2014; Imai & Yamamoto, 2013). The impossible mediation test was implemented using both SEM and the Imai et al. (2010) method. The results suggest that the causal mediation "survives" the impossible mediation test. The impossible mediation test seems to represent an easy-to-implement method for enhancing the value of mediational testing. Reviewers and journal editors can ask for the test when there is reason to wonder about reverse-or joint-causality in the mediator-outcome relationship. Content is hosted by All Academic Inc, a leading provider of online hosting and software solutions for academic conferences supporting submission, peer review, scheduling, invitaions, volunteers, scheduling, web-based programs, advanced bulk email, custom workflows, and more for conferences of scholarly societies since 1999." />
Search
Program Calendar
Browse By Day
Browse By Time
Browse By Person
Browse By Room
Browse By Unit
Browse By Session Type
Search Tips
Annual Meeting Housing and Travel
Personal Schedule
Sign In
X (Twitter)
In much psychology research, mediators are measured, not manipulated. Therefore, the paths from mediators to outcomes—the so-called b paths—can be confounded by omitted variable bias, as in any other correlational analysis. The present research builds on the logic of falsification tests in econometrics and sensitivity analysis in statistics to propose the impossible mediation test, which can quantify the amount of confounded mediation. Researchers can add to an experiment a condition in which the dependent variable is measured first, then the manipulation is implemented, and finally, the posited mediator is measured. This allows for assessment of the spurious association between the dependent variable and the mediator, and statistics can be estimated as if the dependent variable was measured after the manipulation was implemented, to assess whether the spurious association is sufficiently strong to yield the false appearance of mediation. This estimate of "impossible" mediation can be compared to the results obtained from data where the dependent variable is actually measured in the conventional order after the mediator, to determine whether evidence of mediation is stronger in the latter case than the former. Evidence of mediation that survives the impossible mediation test constitutes a strong basis for a claim about mediation of a causal process. The paper illustrates this procedure with a psychology experiment. Participants (N = 3,035) who received the treatment were expected to show increased values of mediator M and lower values of outcome Y. The experimental manipulation variable X was coded such that 1 = Treatment, 0 = Control. We report the results of analyses testing for mediation when the study was conducted in the conventional order and in the impossible mediation condition using common methods used in the social and behavioral sciences: the Baron and Kenny (1986) method, a bootstrapped indirect effect with the a path (X->M) and b path (M->Y) estimated in separate regressions (Preacher & Hayes, 2004), structural equation modeling (SEM) of indirect effects; and the Imai, Keele, and Tingley (2010) method. All four methods produced indications of significant mediation even when none was possible. This is the first empirical demonstration that we know of illuminating the validity of the concerns expressed by critics of mediation who have said that conventional tests can yield false mediation due to correlated residuals (Imai et al., 2010; Imai, Keele, Tingley, & Yamamoto, 2014; Imai & Yamamoto, 2013). The impossible mediation test was implemented using both SEM and the Imai et al. (2010) method. The results suggest that the causal mediation "survives" the impossible mediation test. The impossible mediation test seems to represent an easy-to-implement method for enhancing the value of mediational testing. Reviewers and journal editors can ask for the test when there is reason to wonder about reverse-or joint-causality in the mediator-outcome relationship.