torn Institute for Replication

Past & Future Games


Register or Organizing:

Registration to Replication Games: To register for an upcoming Replication Games event, email the following information to Abel Brodeur at abrodeur [at] uottawa.ca: (i) your field of study and research interests, (ii) preferred statistical software, (iii) the specific games you are interested in attending and (iv) if you want to participate in-person or virtually. I4R will assign you to a team based on your research interests. Pre-defined teams are also welcome to participate.

Virtual Participation: Virtual participants are welcome and should collaborate with their teams using appropriate tools and communication platforms. Further instructions for virtual participants will be provided upon registration.

Organizing Replication Games: If you are interested in organizing a Replication Games event at your institution, please reach out to Abel Brodeur at abrodeur [at] uottawa.ca for more information and guidance.

Upcoming Games: Registration Open

Brown Replication Games: April 19th 2024 at Brown University. Social science papers to be reproduced/replicated. Local organizer is Jonathan Roth.

AI Replication Games - Ottawa: May 3rd 2024 at the University of Ottawa, Canada. Register here. Registered participants will be randomly assigned to one of three teams: Skynet, Cyborg or John Connor’s team, and asked to work in groups to evaluate the reproducibility of one quantitative social science paper during a 1-day hybrid workshop. Participants require no previous knowledge of GPT-4 or any other AI-system in order to participate in this workshop. The local organizer is our chair Abel Brodeur.

Madrid Replication Games: May 17th 2024 at ICAE. Social science papers to be reproduced/replicated. Local organizer is Marcello Sartarelli.

Melbourne Replication Games: June 7th, 2024 at Deakin University (Deakin Downtown), Australia. Social science papers to be reproduced/replicated. Local organizer is once again Romain Gauriot.

Sydney Replication Games: June 11th, 2024 at University of Technology Sydney (Business School), Australia. Social science papers to be reproduced/replicated. Local organizer is Jason Collins.

Seattle Replication Games: June 28th, 2024. Social science papers to be reproduced/replicated. This is a collaboration with Seattle University and co-sponsored by WEAI. Local organizer is Nick C. Huntington-Klein.

Upcoming Games: Registration Closed

Northwestern Replication Games: April 15th 2024 at Northwestern University. Social science papers to be reproduced/replicated. Local organizer is Emilio Lehoucq.

Upcoming Games: Registration Not Open Yet

AI Replication Games - Sheffield: June 2024 at the University of Sheffield, UK. Registered participants will be randomly assigned to one of three teams: Skynet, Cyborg or John Connor’s team, and asked to work in groups to evaluate the reproducibility of one quantitative social science paper during a 1-day hybrid workshop. Participants require no previous knowledge of GPT-4 or any other AI-system in order to participate in this workshop. The local organizer is Tom Stafford.

Grenoble Replication Games: June 26th, 2024. Experimental economics papers to be reproduced (and planned replication). The games will be just before the 14th ASFEE conference. Local organizer is Paolo Crosetto.

Innsbruck Replication Games: July 5th, 2024 at the University of Innsbruck, Austria. Social science papers to be reproduced/replicated. Local organizer is Felix Holzmeister.

Polmeth Replication Games (UC Riverside): July 18th (tbc), 2024. Only political science papers to be reproduced/replicated. The event will take place in person during the 41st Annual Meeting of the Society for Political Methodology at UC Riverside (https://polmeth.ucr.edu/).

AI Replication Games (at Cornell University): August 12th, 2024 at Cornell University, sponsored by the ESEM. The event will take place a day before the ESIF Economics and AI+ML Meeting. Registered participants will be randomly assigned to one of three teams: Skynet, Cyborg or John Connor’s team, and asked to work in groups to evaluate the reproducibility of one quantitative social science paper. Participants require no previous knowledge of GPT-4 or any other AI-system in order to participate in this workshop.

EEA-ESEM Replication Games (Rotterdam): August 25th or 26th (tbc), 2024 in Rotterdam. Only economics papers to be reproduced/replicated. The event will take place in person prior to the 39th meeting of the European Economic Association in Rotterdam (https://www.eea-esem-congresses.org/).

Oxford Replication Games: Sep/early October (tbc), 2024, Oxford University, UK. Political science and economics papers to be reproduced/replicated. Local organizers are Edmund Kelly and Angela Odermatt.

AI Replication Games - Tilburg: Fall 2024 at Tilburg University, Netherlands. Registered participants will be randomly assigned to one of three teams: Skynet, Cyborg or John Connor’s team, and asked to work in groups to evaluate the reproducibility of one quantitative social science paper during a 1-day hybrid workshop. Participants require no previous knowledge of GPT-4 or any other AI-system in order to participate in this workshop. The local organizer is Lachlan Deer.

Munich Replication Games: Late October 2024, Munich, Germany. Behavioral and psychology papers to be reproduced/replicated. Local organizer is Mario Gollwitzer.

UK Reproducibility Network Replication Games: December 5th 2024, virtual. Behavioral and psychology papers to be reproduced/replicated. This is an event jointly organized with the UKRN Local Network Leads.

Bergen Replication Games: December 2024 (date tbd), Bergen, Norway. Social science papers to be reproduced/replicated. Local organizer is Lenka Fiala.

Tokyo Replication Games: Date tbd, at the University of Tokyo campus, Japan. Economics and political science papers to be replicated. Local organizers are Yasuyuki Sawada, Chishio Furukawa and Hiroki Kameyama.

Cologne Replication Games: 2024 (date tbd), Cologne, Germany. Economics and political science papers to be replicated. Local organizer is Jörg Peters.

Past Games

Berkeley Replication Games: March 7th 2024 at University of California, Berkeley. Social science papers to be replicated. Local organizers are Edward Miguel and Fernando Fernando Hoces de la Guardia.

Los Angeles Replication Games: February 28th 2024 at University of California, Los Angeles. Demography, economics, politics, psychology and other social science papers were reproduced/replicated. The event was sponsored by the California Center for Population Research.

AI Replication Games - Toronto: February 20th 2024 at the University of Toronto, Canada. Registered participants were randomly assigned to one of three teams: Skynet, Cyborg or John Connor’s team, and asked to work in groups to evaluate the reproducibility of one quantitative social science paper during a 1-day hybrid workshop. Participants require no previous knowledge of GPT-4 or any other AI-system in order to participate in this workshop. The local organizer was once again Rohan Alexander.

London (Management) Replication Games: January 26th, 2024 at the Birkbeck, University of London. Management, finance and economics papers to be reproduced/replicated. Local organizer was Lukas Wallrich.

London (Health) Replication Games: November 7th, 2023 at the Institute for Mathematical and Statistical Sciences at UCL, London. Health and health equity papers were reproduced/replicated. Local organizers were Brieuc Lehmann, Vanessa Rodriguez and Ahwaz Akhtar.

Lyon Replication Games: October 24th, 2023 at ENS de Lyon, France. Economics and political science papers were reproduced/replicated. Local organizers were Mathieu Couttenier and Cedric Chambru.

Stockholm Replication Games: October 26th, 2023 in Stockholm, Sweden. Behavioral science, economics and political science papers were reproduced/replicated. Local organizer was I4R's co-director Anna Dreber.

Brussels Replication Games: October 27th, 2023 at ULB-ECARES, Belgium. Economics and political science papers were reproduced/replicated. Local organizers were Paula Gobbi and Joanne Haddad.

EEA-ESEM Replication Games (Barcelona): August 27th, 2023 in Barcelona. 10 economics papers reproduced/replicated. The event took place in person a day prior to the 38th meeting of the European Economic Association in Barcelona (https://www.eea-esem-congresses.org/).

Bank-Funds Replication Games (DC, co-sponsored by IMF and WB): July 17th, 2023 in Washington DC. 29 papers by IMF and WB staff replicated.

Norwich Replication Games: July 10th, 2023 at the University of East Anglia, UK. 11 economics and political science papers replicated. Local organizer was Farasat Bokhari.

San Diego Replication Games: July 1st, 2023. This was a collaboration with UCSD (Political Science Department) and co-sponsored by WEAI. 14 economics and political science papers replicated. Local organizer was Scott Desposato. The Games took place in a room on the 7th floor in central campus at UCSD with a giant ocean view. Thanks, Scott!

Montreal Replication Games: June 14th, 2023 at the Université du Québec à Montréal, Canada. 17 economics and political science replicated. Local organizer was Marie Connolly.

Melbourne Replication Games: June 2nd, 2023 at Deakin University (Deakin Downtown), Australia. 10 economics papers replicated. Local organizer was Romain Gauriot.

Ottawa Replication Games: May 5th, 2023 at the University of Ottawa, Canada. 15 papers replicated. Organizer was I4R's chair, Abel Brodeur.

Vienna Replication Games: May 5th, 2023 at the Vienna University of Econ and Business, Austria. 12 papers replicated. Organizer was Christoph Huber.

Nottingham Replication Games: March 18th, 2023 at the University of Nottingham School of Economics, UK. 17 papers replicated. Local organizer was Diego Marino Fages.

Toronto Replication Games: February 22nd, 2023 at the University of Toronto, Canada. This was a collaboration with the University of Toronto's Data Sciences Institute. 13 papers replicated. Local organizer was Rohan Alexander.

Calgary Replication Games: November 26th, 2022 at the University of Calgary, Canada. 6 papers replicated. Local organizer was Leonard Goff.

Oslo Replication Games: October 27th, 2022 at the Frisch Centre, Norway. 15 papers replicated. Local organizer was Andreas Kotsadam.