I4R Replication Games coming to Münster! @i4replication.bsky.social @aufdroeseler.bsky.social @fialalenka.bsky.social

1/ The Vertical & Horizontal AI Replication Games debut at the University of Ottawa on Oct 16! This is the first event feeding into our next paper, and all participants will be listed as coauthors. Apply: www.surveymonkey.ca/r/TKRS5HG

Wellington Replication Games — Dec 4, 2025 One-day team challenge to reproduce top social-science studies; co-authorship on a meta-paper; virtual welcome. Researchers, postdocs, PhDs — sign up: www.surveymonkey.ca/r/RB6K73Q #OpenScience #Metascience @i4replication.bsky.social

The Brno Replication Games were a success!🥳 Many thanks to our awesome replicators who spotted a range of coding errors and fixed incorrectly specified models. Many thanks also to @econmuni.bsky.social for having us: you are the reason economists love coming back every year😊

Big thanks to @fialalenka.bsky.social and @i4replication.bsky.social for the replication games in Brno. It was fun. We loved the songs! 🤘

Science faces a replication crisis: billions wasted, progress slowed, policy misled A new idea from @i4replication.bsky.social Brodeur & Barbarioli in @ifp.bsky.social's #LaunchEngine imagines how to build automated replication infrastructure for *better* & *faster* science ifp.org/the-replicat...

#GDRI_rep Update 8a: Major updates coming up over the next few weeks. 1st update: We reproduced "Parent–teacher meetings and student outcomes" some time ago. The paper was then retracted by the editors of the Euro Econ Rev. Additional studies are connected (see diagram) 🧵

The Tilburg Replication Games are over! We had lots of fun and are looking forward to the TIBER symposium starting tomorrow. www.tilburguniversity.edu/research/ins...

Cool event reminder! Please note we now have a number of €200 awards for PhD students travelling to Galway to participate. If you wish to be considered for an award, please get in touch (contact details at end of Matthew’s thread). Reposts welcome! Cc: @i4replication.bsky.social

Only a one week left left to register to the Brno Replication Games on Sept 7th. Virtual participation is possible and coauthorship to a meta paper is granted. Register here: www.surveymonkey.ca/r/Replicatio...

We have our first games ever in Ireland next month. The event will be at the University of Galway as part of CERIS’s Annual Workshop on September 26th. Virtual participation is possible and coauthorship to a meta paper is granted. Register here: www.surveymonkey.ca/r/Replicatio...

🔁 Berlin Replication Games – Call for Participation! 📅 Date: September 30, 2025 📍 Location: Freie Universität Berlin (online participation also available)

Replication Games @i4replication.bsky.social coming to Berlin! @janmarcus.de Register here. www.surveymonkey.ca/r/I4R_Replic...

We are collaborating with the @eeanews.bsky.social for a third year in a row. EEA Replication Games in Bordeaux, France on August 24. Virtual participation is possible and the focus is on economics papers for this event! Register here: www.surveymonkey.ca/r/Replicatio...

Only a couple days left to register to the Tilburg Replication Games on August 21. Virtual participation is possible and coauthorship to a meta paper is granted. Register here: www.surveymonkey.ca/r/Replicatio...

🎙️ New episode of Allegedly Does Not Replicate is out! This time, we talk with Adam Salisbury from GiveWell about funders, transparency, and… ghost data. A thread 🧵👇

We have 8 replication games over the next 13 weeks (Tilburg, Bordeaux, Brno, Galway, Berlin, Paris, Lyon and Ottawa)! Not too late to register to any of these events: i4replication.org/games.html

We have updates concerning this thread. The original article was retracted by the publisher, the author released a new response, the replicators briefly responded, and the author responded to response. 🧵

Help us spread the word about BTSCON 2025! @manyprimates.bsky.social @manydogsproject.bsky.social @manylanguagesc.bsky.social @cos.io @chineseopensci.bsky.social @improvingpsych.org @forrt.bsky.social @i4replication.bsky.social y.social #openscience #teamscience #bigteamscience

Ireland's 1st replication games! In collaboration with the @i4replication.bsky.social, and as part of the annual CERIS Workshop, we are hosting Ireland's first replication games in Galway on September 25-26th.

Last opportunity to reproduce/replicate a study published @nathumbehav.nature.com. This is an official collaboration with NHB. All authors of completed reports will be included as coauthors to our meta-paper to be submitted to NHB this Fall. 🧵

Only a few days left to register to the Amsterdam Replication Games on July 19. Virtual participation is possible and coauthorship to a meta paper is granted. Register: www.surveymonkey.ca/r/Replicatio...

Submit to the Leibniz Open Science Day 2025 taking place on October 27 in Berlin, organized with @leventneyse.bsky.social @jrgptrs.bsky.social @dsiegfried1.bsky.social @macartan.bsky.social @wzb.bsky.social @rwi.bsky.social @diw.de @zbw-leibniz.bsky.social www.zbw.eu/de/ueber-uns... 1/2

We have a new DP. It's actually more a tool than a paper. The Robustness Dashboard provides an at-a-glance visual summary of robustness analysis, distinguishing between confirmatory and negative robustness tests. @i4replication.bsky.social 1/3 www.econstor.eu/bitstream/10...

Join us @rwi.bsky.social & @i4replication.bsky.social as replicator for a meta-reproduction on deforestation. We pay replicators 2,500 EUR. Experience with geocoded data & background in environmental science are assets. 1/2 bit.ly/4ke2p6o

Rejoignez nous pour une édition des Replication Games @ INRIA Paris le 3 octobre 2025 prochain ! Une journée pour répliquer des résultats scientifiques, en équipe, avec @i4replication.bsky.social 📍 INRIA Paris 🕘 9h–16h30 💸 Gratuit, inscription obligatoire #ReplicationGames #OpenScience #I4R

First up: two terms that often get mixed up 👇 🔁 Reproducibility = same data, same code 📦 Replicability = new data, same design We unpacked these (and more) with help from Brodeur et al. (2024): 📖 www.iza.org/publications... 🔥 Pro tip: join a #Replication Game via @i4replication.bsky.social

GiveWell sought an independent check on the evidence supporting >$1 billion it has granted to its top charities. This fall, Alex Cohen asked whether we could obtain the datasets needed to reproduce the underlying RCTs. We said yes; charging only a modest fee to cover our time. 🧵 + 🐀 + blog post!

It is always a pleasure, but also causes some trepidation 😰, when a bunch of motivated junior (and senior!) researchers get together at @i4replication.bsky.social replication games, and I get to observe how others work with the replication packages that we helped prepare! #Montreal

Update: We submitted the comment to the Journal of Population Economics, and today we got a desk reject with this motivation. However, we do not know their conclusion about the main results and why the paper was not retracted. Clearly, they do not hold. 1/4

Dutch academics, please share - replication games are coming to Vrije Universiteit Amsterdam on July 19! If you live in the Netherlands, or want a good reason to visit, come take a day to network, hone your skills, and potentially coauthor a paper. Registration: www.surveymonkey.ca/r/Replicatio...

Registration is open for 7 upcoming replication games: i4replication.org/games.html Looking for researchers in econ/ecology/polsci/psych/pub health San Francisco (June 19) Amsterdam (July 19) Tilburg (Aug 21) Bordeaux (Aug 24) Brno (Sept 7) Paris (Oct 3) Lyon (Oct 9) Short 🧵

I agree that such carelessness is bad. But I have also seen several cases where an IRB forbid researchers to share any data (even cleaned/anonymous) for blanket privacy reasons. That’s bad too. There is a difficult trade-off/conflict between transparency ethics and privacy ethics, needing balancing.

De-identify your data before you share it. De-identify your data before you share it. De-identify your data before you share it. De-identify your data before you share it. De-identif

Looks like one should not only validate results before publishing an article and reproduction material, but screen the material for sensitive information that should be removed #OpenScience

There is an urgent (!) need for more awareness, more skills and more solid advice on how to practice #OpenScience *responsibly* before we see more cases like this 👇🏻

We did not want to start the week like this, but here we are. Yet again our chair’s inbox is filled with messages from replicators who have opened “replication” folders only to find names, Social Insurance Numbers, mental-health diagnoses and incomes of study participants. 🧵

It was educational and fun to participate in the @i4replication.bsky.social UK Replication Games. Our task was pretty smooth thanks to @simonweschle.bsky.social's excellent replication package and code, which could serve as a model example of literate programming. Here’s our replication report:

We have one new reproduction and two replications with new data out as I4R DPs. See below for links to full reports and authors' responses. Thanks to all replicators and original authors fr the back and forth!

🚨 REPLICATION REPORT UPDATE: One year ago, a tweet by John Holbein alerted me, @ollefolke.bsky.social, and @jopieboy.bsky.social to a paper with a shocking result about Sweden’s law criminalizing the purchase of sex.🧵

A re-analysis of Ciacci's (2024) "Banning the purchase of sex increases cases of rape: Evidence from Sweden" Journal of Population Economics reveals major issues. A year ago, reproducers Adema, Folke, and Rickne found coding errors driving the paper's key results. Let's unpack this in a 🧵

4. Final paper: Participating in @i4replication.bsky.social Replication Games and completing a replication report: - ensures students learn how to run their own results without much of my help - teaches students how to fairly write about others' work - shows students how knowledge is produced

We have travel grants (up to 500USD) for PhD students and postdoc fellows to attend the San Francisco Replication Games on June 19th. Econ, pol sci and related fields. You can register to the event here: www.surveymonkey.ca/r/Replicatio... Email I4R to request a travel grant.

We have about 50 new reproduction reports! We will be sharing those over the next few weeks. See here if you cannot wait: ideas.repec.org/s/zbw/i4rdps.... Let's start with four reproductions of articles @nathumbehav.nature.com. A short thread with links to reports and authors' responses.

Good news in the field of development economics to wrap up the week! The journal Economic Development and Cultural Change just implemented a data and code availability policy: www.journals.uchicago.edu/journals/edc... Required to post data/codes/Readme + dataset may be randomly selected for review!

“Among articles stating that data was available upon request, only 17% shared data upon request.”

📌Level Up Research: Replication in Action Teams are hard at work at the Replication Games! Our participants are reproducing published results and testing their robustness, guided by Derek Mikola (@i4replication.bsky.social). Great atmosphere at #dSEA University of Padua! unipd.link/replication-...

Tomorrow our @dsea-unipd.bsky.social will be hosting the replication games (with @i4replication.bsky.social ) Faculty, postdocs, and PhD students all involved in replicating papers in top Econ and Management journals Looking forward to it!

'Level Up Research: Replication in Action' is underway at #dSEA UniPD and continues tomorrow! Two days dedicated to research excellence, rigor & transparency in partnership with @i4replication.bsky.social and UniCredit Foundation. 📷Great discussions and turnout! More info unipd.link/replication-...

The UCL replication games is underway in London! Big thanks to the local organizer @sandyschumann.bsky.social and to all our participants.