A Cautionary Note on the Use of the Third-Order Polynomial Method in Simulation Studies

• In Event: When Sharp Statistics Meet Complex Data

Abstract

The 3rd order polynomial method to simulate non-normal data is ubiquitously present in computer simulation studies within the educational and psychological sciences. At the crux of this method is a system of polynomial equations whose solution is not unique. The idiosyncratic properties of these solutions are sufficiently extreme as to impact the conclusions from our simulations. I will present both a mathematical framework to describe these solutions and examples from well-cited articles (with over 1000 citations such as Curran, West & Finch, 1996) where using different solutions to generate non-normal data changes and even reverses the conclusions from these publications. Recommendations will be presented for researchers who are interested in running and evaluating published simulation studies.

Author

• Oscar L. Olvera Astivia, University of Washington