How to Evaluate Journal Implementation of Open Science Standards: The TRUST Process

Session Type: Demonstration/Performance

Abstract

This demonstration focuses on assessing the implementation of open science standards at journals in the educational, social, and behavioral sciences. Our "TRUST Process" involves three new instruments for rating journal instructions to authors, manuscript submission systems, and published articles according to standards in the Transparency and Openness Promotion (TOP) Guidelines. As a demonstration of the TRUST Process, we will present (i) results from an assessment of 340 journals that have published research used to inform evidence-based practice, and (ii) how the TRUST Process was used to update open science standards at a social science journal (Journal of Research on Educational Effectiveness). We will conclude with a live demonstration of the TRUST Process with a journal nominated by an audience member.

Sub Unit

• SIG-Systematic Review and Meta-Analysis

Chair

• Sean Grant, University of Oregon

Papers

• How to Evaluate Journal Implementation of Open Science Standards: The TRUST Process - Sean Grant, University of Oregon