2-207 - The use of Preregistration Tools in Ongoing, Longitudinal Cohorts

Session Type: Conversation Roundtable

Integrative Statement

In the last decade, psychological science has undergone a period of self correction beginning with the joint publications of implausible but empirical evidence for ESP (Bem, 2011) and a report by Simmons and colleagues which showed that hidden flexibility in common analytical strategies in psychological science could elevate false positive rates to 60% (2011). A powerful tool which has emerged to combat questionable research practices is preregistration: the public recording of study rationale, hypotheses, methods, and analysis plan. Preregistration shifts the incentive structure to value “good science” over “good results” (Chambers, 2017). To date, common preregistration templates have focused on laboratory based experimental manipulations which cannot be easily applied to ongoing longitudinal developmental studies with hypotheses that were established before preregistration was commonly available. This roundtable begins discussion around the unique challenges and opportunities afforded by the extension of preregistration to ongoing longitudinal studies, which are critical designs for understanding human development. This will involve the drafting of a new preregistration template, a key deliverable of the roundtable. Challenges to the extension of preregistration to mid-stage investigations include new grant proposals predicated upon existing study aims which cannot be modified, knowledge of prior measurement outcomes when considering future analyses which obscures traditional framing of exploratory vs confirmatory hypothesis framing, and many other issues about which it is crucial for developmental scientists to provide input. Four panelists from a diverse range of academic backgrounds and career stages will provide critical perspectives on preregistration during longitudinal developmental studies. Moderator: Dr. Michelle Byrne

Sub Unit

• Methods, History, Theory

Moderator

• Michelle Byrne, University of Oregon

Panelists

• Beatriz Luna, University of Pittsburgh, Departments of Psychiatry and Psychology, Laboratory of Neurocognitive Development, The Center for the Neural Basis of Cognition

• Andrew Dismukes, Penn State University

• Grace Binion, University of Oregon

• Ece Demir-Lira, University of Iowa