I4R × Psychological Science: A Large-Scale Replication Initiative
December 1, 2023 · Institute for Replication
A large-scale replication initiative in psychology
In 2023, I4R and Psychological Science launched a coordinated effort to reproduce and replicate published findings from the journal. As described in the official announcement, the project brings together teams of PhD students and researchers—many through I4R’s Replication Games—to systematically revisit results from recently published papers.
The goal is both practical and ambitious: verify the computational reproducibility of results, check for coding error, deviations from preregistration and assess their robustness through reproducibility, at scale.
Why does this matter?
Because even in disciplines that have led the way on open science, reproducibility remains limited relative to the volume of published research. By partnering directly with a leading journal, this initiative helps close that gap.
It also creates a bridge between authors, journals, and independent reproducibility teams—turning what has often been an ad hoc process into a systematic one.
What comes next
The Psychological Science–I4R collaboration is designed to produce:
• A large set of reproductions of recent articles
• Structured evaluations of robustness across studies
• Opportunities for PhD students and researchers to contribute to meta-scientific insights
• A scalable model for journal–organization partnerships in psychology and beyond
Beyond the individual studies, the broader goal is to learn about reproducibility itself—what reproduces, what does not, and why.
A call to the community
This effort is inherently collaborative. Researchers, PhD students, and institutions are all invited to participate—whether through Replication Games or by engaging directly with I4R.