An Examination of Replication: A Study Assessing the Exclusion of Key Sample Information

• In Event: Poster Session

Abstract

One of the fundamental components for the advancement of scientific knowledge is the necessity of replication. However, it is an empirical question as to whether research published in today’s journals includes important information sufficient for the replication of the original study. Missing vital descriptive data such as location, age, and sex/gender can hamper attempts at replication, especially if the research is based upon a distinct subject group. In this project we examined such issues using a random sample of research articles published by the two flagship journals for their respective fields: "Evolution and Human Behavior" and "Criminology". We assessed the inclusion of critical information necessary for replication and conducted a comparative analysis of this inclusion between the two journals. The primary focus of the analysis was an examination of missing information about the participants included in various empirical articles and the comparative rates at which the two journals published articles missing key characteristics of their samples. Our results indicate that both journals published articles missing key information about their samples. We discuss the potential reasons for such exclusion, the methodological consequences of such exclusion, and suggestions for authors and editors to avoid missing key information.

Authors

• Ian Silver, University of Cincinnati

• Joseph L. Nedelec, University of Cincinnati