#GDRI_rep Update 9: We have been waiting a couple of months to make two announcements. A few journals were in the process of retracting GDRI article. The editors informed the authors and then lawyers got involved. Who knows how long it will take.

Join us for the virtual Replication Games😍🤓 on Nov 13th! (You don't have to be in the UK - join us from wherever you are😉)

🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥

Thought about scientific consensus recently? We have a new DP @i4replication.bsky.social that probes into the famous replication debate between Acemoglu, Johnson & Robinson (AJR) and Albouy - and how experts assess this debate. We find that they disagree. 1/8 www.econstor.eu/bitstream/10...

Come joun us in Münster, it will be awesome😉😎

Excited to finally have my first paper officially published! "How Do Psychology Journals Handle Postpublication Critique?" is now online with AMPPS. Huge thanks to my supervisors @tomhardwicke.bsky.social and @simine.com and co-authors @bethclarke.bsky.social, N Moodie, S Schiavone, and R Thibault ☺️

#GDRI_rep Update 8a: Major updates coming up over the next few weeks. 1st update: We reproduced "Parent–teacher meetings and student outcomes" some time ago. The paper was then retracted by the editors of the Euro Econ Rev. Additional studies are connected (see diagram) 🧵

📢 Come work with us! 🏛️ Faculty of Economics & Statistics, UIBK @econstatuibk.bsky.social‬ @uniinnsbruck.bsky.social‬ ‼️ Three job openings for Full Professor positions - Data Science - Microeconomics - Behavioral Economics Please share! #datascience #economics www.uibk.ac.at/de/info-beru...

Are you a PhD-Candidate, Prae- or Post-Doc interested in open research practices and want to spend a few summer days in beautiful #Innsbruck? 👉 Then the #OpenScience Summer School at @uniinnsbruck.bsky.social might be the perfect match for you! www.uibk.ac.at/en/weiterbil...

A re-analysis of Ciacci's (2024) "Banning the purchase of sex increases cases of rape: Evidence from Sweden" Journal of Population Economics reveals major issues. A year ago, reproducers Adema, Folke, and Rickne found coding errors driving the paper's key results. Let's unpack this in a 🧵

🚨 REPLICATION REPORT UPDATE: One year ago, a tweet by John Holbein alerted me, @ollefolke.bsky.social, and @jopieboy.bsky.social to a paper with a shocking result about Sweden’s law criminalizing the purchase of sex.🧵

also

Great to see our comment now available online in the European Economic Review! (w/ @carlbonander.bsky.social, @nikljako.bsky.social, @flxhlzmstr.bsky.social, Gunther Bensch & Abel Brodeur @i4replication.bsky.social) 🙌

Our proposal for protocolled replicability & robustness assessments is out in Q Open. The main aim is to structure robustness reproductions, but also to extend the scope to external/construct validity as well as pre-specification checks. Comments welcome! academic.oup.com/qopen/advanc...

Do men increase their support for gender equality if they have daughters? Some papers suggest so! Join this meta-science project as a co-author, work with SOEP data and help us all learn more!

🔔 Call for Participation 🔔 Lab² is inviting researchers to take part in a multi-analyst study on the effects of having daughters on various outcomes. Join this metascience project as a co-author and gain the opportunity to work with SOEP data!

Collaborators are looking for participants for a new multi-analyst study using SOEP data. For more information on registration, eligibility criteria, requirements, procedure, and timeline, please visit www.manydaughters.com. Deadline for registration is April 27

#GDRI_rep Update 7: Retraction! Our comment of "Parent–teacher meetings and student outcomes: Evidence from a developing country" has led to the paper being retracted. Our comment is accepted as is. Short 🧵

Many psychological scientists are now calling for a “heterogeneity revolution,” focused on uncovering individual and contextual differences in experimental outcomes.

#GDRI_rep Update 5: We have a new report. We reproduced the paper entitled "Partisan Effects of Information Campaigns in Competitive Authoritarian Elections: Evidence from Bangladesh" by Ahmed, Hodler and Islam published at the Economic Journal. See below for links to report and authors' responses.

Since we started mass reproducing GDRI, we have requested several replication packages. We have not managed to get a single new replication package as of today (excluding updated packages for one article at the request of editors).

In a new @i4replication.bsky.social report we replicate Islam (2019). Main issue: the randomized controlled trial was not randomized. And many other things on top of that. See full report for details. (w/ @carlbonander.bsky.social, @nikljako.bsky.social, @flxhlzmstr.bsky.social, Bensch & Brodeur)

#GDRI_rep Update 4: We have a new report. We reproduced the paper entitled "Parent–teacher meetings and student outcomes" by Islam @ European Economic Review. See below for links to report and author's response.

#GDRI_rep Update 3: The paper "Improving Hygiene and Sanitation through Parental Skill Training" by Asadul Islam, Umair Khalil and Tabassum Rahman was conditionally accepted at Economic Development and Cultural Change. We requested a replication package. It has now been withdrawn

#GDRI_rep Update 1: I4R are now reproducing all published papers that use data from GDRI, or are closely related in other ways. Here is a first update on our work. 🧵

After a long wait, the working paper for the Many-Economists Project: The Sources of Researcher Variation in Economics. We had 146 teams perform the same research three times, each time with less freedom. What source of freedom leads to different choices and results? papers.ssrn.com/sol3/papers....

I4R doing the lord’s work. Hopefully these will be a collective wake up call to be more careful and transparent about complicated studies in applied micro (and elsewhere too)

Disregarding the sadness of this story, it’s been great working with this awesome team! @jrgptrs.bsky.social @fialalenka.bsky.social @jackfitzgerald.bsky.social @flxhlzmstr.bsky.social @nikljako.bsky.social @anderskjelsrud.bsky.social @kotsadam.bsky.social @essieconomist.bsky.social

As a coauthor on the AEJ:AE report, it’s a lot. Oh my god, It’s a lot. In that paper, outcomes are inconsistently handled both in the code and in the field, the paper’s data is connected to a bunch of other experiments, and we find irregularities in the raw survey files.

The MOOB that I host (massive open online bibliography) for #openscience and #metascience literature is approaching 2,000 articles. You can freely have it via @zotero.org www.zotero.org/groups/26082... 🧪

After being alerted about possible misconduct, the I4R are reproducing published papers that use data from a specific NGO (GDRI). This thread releases the first 2 reports and provides more information about the work and responses/statements from authors journals and journals. 🧵

This is based on our work. We will provide more information on Monday. Stay tuned and thanks Ray and Will for your help!

Sunday 9PM ET / Monday 3AM CET / Monday 1PM Melbourne! See you all then :) #EconSky

Abel: I am writing in my capacity as Chair of I4R. Last year, I was contacted by a researcher that alerted me of potential scientific misconduct in a set of papers all using data from a specific NGO.🧵

JBEF is happy to announce that we are now on LinkedIn, following a strategic decision to shift our social media activities away from X. We look forward to keeping you updated with new publications and news from the journal! More about the journal at www.sciencedirect.com/journal/jour...

Did a police training improve officers' behavior during arrests? A forthcoming QJE paper with a flexible pre-registration and key p-values of p=.048 & p=.051 says yes. datacolada.org/122

For those keeping track of replication rates across fields: experimental asset market research is looking at a cool 21.4% replication rate. From @chrhuber.bsky.social & @flxhlzmstr.bsky.social & Michael Kirchler www.econstor.eu/bitstream/10... #metasky #metascisky

How do public policies stack up? Is the impact of two policies larger than the sum of its parts? We look at this in the context of food - labels + price policies - & find they are *extremely* sub-additive. Also, labels do way better than prices. Paper: www.sciencedirect.com/science/arti... 🧵

A group of researchers has attempted to replicate our work on self-control and asset market prices published in the Review of Financial Studies (doi.org/10.1093/rfs/...) and not been able confirm our findings. See doi.org/10.2139/ssrn...

🧵 Excited to share: "Replication Code Availability over Time and Across Fields", was just accepted by #EconomicInquiry! 🚀 Here's what @lukasfink.bsky.social and I uncovered about replication code availability for publications based on the German Socio-Economic Panel #SOEP 📈📉 doi.org/10.1111/ecin...

New in NHB: We systematically replicated 26 of 41 PNAS social science studies that used MTurk. The approach provides a proof-of-concept for using decision markets to select findings to replicate. Replication effect sizes were 45% of original effect sizes. www.nature.com/articles/s41...

Check out the paper for interesting details on the approach, and the findings with application of a variety of indicators of replication success. www.nature.com/articles/s41... Many thanks to @flxhlzmstr.bsky.social, Anna Dreber, and Magnus Johannesson for leading this collaboration!

📢Excited to share our latest publication in @natureportfolio.bsky.social Nature Human Behaviour: "Examining the replicability of online experiments selected by a decision market." Read the full paper here: 🔓https://www.nature.com/articles/s41562-024-02062-9 A short summary...👇 (1/n)

We have a new DP by Auer et al. They computationally reproduce "Motivated Errors" published in the AER by Exley and Kessler. The replicators cannot conduct comprehensive robustness checks. See here for the DP econpapers.repec.org/paper/zbwi4r... and here for the authors' response: osf.io/x29kf/.

🚨Deadline today for the Leibniz open science day: meta perspectives, Berlin www.zbw.eu/de/ueber-uns...

I was lucky to co-author the paper "Heterogeneity in effect size estimates," led by the amazing @flxhlzmstr.bsky.social and together with many other great co-authors, now published in PNAS. www.pnas.org/doi/10.1073/...

📢I'll organize and teach a summer school (5.0 ECTS credits) on *Open Science* @uniinnsbruck (July, 1-5). ℹ️ Further information and a link to the registration page are available at bit.ly/4aX1inb. Please share within your network! Thanks.🙏 #OpenScience #MetaScience #EconSky

New Managing Editor position! COS is conducting a research and development project on a new model of scholarly communication called Lifecycle Journals to evaluate its strengths and weaknesses and suitability for transition into a scalable and sustainable solution. jobs.lever.co/cos/1db59b80...