Towards more reliable research: Today, together with @bihatcharite.bsky.social, we welcomed the 2025 #EinsteinFoundationAward winners: @simine.com, Maximilian Sprang, and the Brazilian Reproducibility Initiative @redebrrepro.bsky.social. A recording will be available soon.

We're thrilled to open registration for the Utrecht Replication Games. The event will be at the at the University of Utrecht on June 4th. Psych, public health, pol sci and econ studies will be reproduced! Register here: www.surveymonkey.ca/r/Replicatio...

Listening to this now (online). Nice to end the week hearing from people who walk the walk

ODISSEI is excited to launch the Early Career Board, an initiative to strengthen the voice and engagement of early career researchers in our community. Please welcome the members of the 2026 Board: @elenacandellone.bsky.social, Oskar Veerhoek, Goan Booij, and Tilbe Atav. Read more about them below 👇

The eye of the mother-in-law strikes again. "the eye of the mother-in-law" is a literal translation of a Romanian idiom used to describe someone who sees even the smallest imperfections, things that most other people wouldn't notice. www.keithcirkel.co.uk/whats-my-jnd...

“We wanted to create a way to celebrate those who have the courage to admit when they’ve made a mistake [...] Correcting the record shouldn’t be seen as a failure, but as a vital part of the scientific process. This award is about recognizing the integrity it takes to prioritize truth over ego”

Unfortunately, an accurate depiction of many data cleaning processes out there

This is awesome! No more (change code -> save plot -> open file)^n just to make sure your plot is readable

For journalists who want to dig into stories about scientific integrity: Here's an exciting new opportunity from two of my favorite science-journalism organizations, @retractionwatch.com and @theopennotebook.bsky.social. I'll be joining a webinar to help kick things off on March 26!

Weird, but I didn't get any party invitations by email. I would like to issue a correction and ask for party invitations to be sent via a GitHub Pull Request. bsky.app/profile/anam...

Maybe of interest: The submission guidelines of Psychological Science now demand an explicit statement on measures taken to reduce the risk of AI-generated responses for all online studies! www.psychologicalscience.org/publications...

Write your experiments and analysis code in such a way that a STAR editor at Psych Science highlights your paper. Hats off to @dillonplunkett.bsky.social who did a great job both on the science and diligently coding & documenting everything. Check out our methods to see our reproducibility approach.

I want to highlight this paper as one of the most smooth repro checks I've done as a STAR editor. There are 7 studies reported in the main paper, so plenty of data and code to work with. The authors had done a great job and the repro package was already quite good at the start of the checks (1/n)

Wrapping up my trilogy on how to put together a replication package: The Return of the Code i4replication.org/a-researcher... #econsky #openscience

Really cool talk

#PSE8 excited for this keynote

#PSE8 Keynote by Vlasta Sikimic

'Science doesn't correct itself. Someone has to do it' Douglas Allchin - a comedy of errors #PSE8

Reading list based on talks at #PSE8 perspectivesonscientificerror2026.wordpress.com

Check out this cool reproducibility / robustness check: osf.io/auyq5/overview for Brody etal 2024 doi.org/10.1177/0956... as part of the i4R & Psychological Science collab

Now available on the OSF as part of a growing collection of preregistration resources, the new EEG & ERP Methods template guides researchers through every stage of ERP study planning. In our Q&A, two of its creators share how the template can help researchers at all stages:

ODISSEI Summer School 2026 is now open for applications📣 8–19 June | @erasmusuniversity.bsky.social | 5 ECTS. Learn to work with high-resolution, sensitive data in a secure environment and apply your skills in group research projects. Deadline: 28 Feb 2026 Participation is free 🔗 edu.nl/3t8pc

Here's a suggestion for a New Year's resolution: If you see influential bad research, say something. One part of the whole replication crisis story is that a lot of psychological researchers privately knew that a lot of stuff was bad, but it wasn't discussed publicly.

I was just reading "5. Taming Gnarly Nested Data With purr::modify_tree". Really cool and useful function that I didn't use before. Check it out!

Do you want to work with me?:) Please spread the word! We are looking for talented Post-doc candidates for a 10-month Junior Fellowship at the Behavioral Science Center, hosted by the Corvinus Institute for Advanced Studies (CIAS). 1/6 www.the-bs-lab.com

Who else received an email asking them to evaluate LLM generated ideas to extend a preprint that they are a co-author of? Did it include the quoted paragraph?

I wrote about Grok's CSAM problem and how journalists keep fumbling the story www.readtpa.com/p/grok-cant-...

It finally happened - I was asked to review a paper that cites Martinovici, A, and B (YYYY). Only that I don't have a paper with A and B. For the love of science - read your own papers before submission and don't copy-paste LLM output without verifying every single comma it generates.

I feel seen. Though on the good side, at least there's data to open!

I am not anti LLM across the board. But if your use case starts with the necessary assumption that the model is a vessel of all human knowledge, then you are consulting an oracle not doing scientific research.

Regular reminder to use R Projects and the `here` package. Future you will be happy tidyverse.org/blog/2017/12...

1. Transparency is necessary for credibility 2. Transparency is hard to change 3. Require transparency* 4. Transparency is not magic 5. Journals are part of problem 6. Expect more from journals 7. Peer review is not magic 8. A crisis can look a lot like „normal“ science 9. Meta-analysis is not magic

The most precious commodity you have is your attention. You don’t have to waste it on poor-faith debates or arguments with strangers if you don’t think they’ll be productive. You can prioritize the things that matter to you and make your life richer.

Are you using mediation analysis? Take a look at this cool paper!

🚀 1 week to go! Dive into the world of computational social science at ODISSEI Conference 2025 – workshops, demos & research projects that spark innovation. ⚡🧠 📍 Utrecht, 4 Nov → odissei-data.nl/event/odisse...

Science!

Open Science Workshop - detecting errors and misconduct in science Dates: 20-22 October Location: Radboud University, Nijmegen, The Netherlands Registration link: tinyurl.com/3xkd8twf ONLY PHYSICAL ATTENDENCE POSSIBLE! NO ONLINE POSSIBILITIES.

Really interesting online event on Aug 27, 2025 08:00AM (Amsterdam time).

Teaching is done, course evaluation survey responses are in. "Clear communication, great content. I acquired not only academic knowledge but also 𝘂𝘀𝗲𝗳𝘂𝗹 𝘀𝗸𝗶𝗹𝗹𝘀 𝗶𝗻𝗰𝗹𝘂𝗱𝗶𝗻𝗴 𝗴𝗶𝘁𝗵𝘂𝗯."

Do you want to go to a metascience conference where AI will not solve all problems, you can ask critical questions, and El$evier is not invited? Sign up for the mailing list for the 8th Perspectives on Scientific Error conference in 2026 in Leiden! perspectivesonscientificerror2026.wordpress.com

I finally got to adding the slides from the SIPS workshop to the OSF project. The GIF below would be an accurate depiction of me in the past days, but only if money were replaced by emails and to-do lists.

Source: Figure 1 Rohrer 2024 @dingdingpeng.the100.ci (compass.onlinelibrary.wiley.com/doi/10.1111/...) The blue line of wishful thinking is my own edit.

I don't care about claims for the link between causal inference knowledge and academic career success, but I sure hope that the arrow from lack of single-minded focus is as causal as it gets. It has to be, right? It's just a tiny arrow, there's nothing in between.

when trump and co say they're seizing control of research because of the reproducibility crisis, it's pretty similar to when they say they're enacting trans bathroom bans and sports bans because of violence and discrimination against women.

I think in part the higher education funding crisis and the LLM-teaching crisis actually strike at the same problem, which is that education doesn't work without a broad, society-wide sense that the *actual content* of education - not the credential - is valuable.

Data Colada has submitted a motion for sanction against Francesca Gino and her former lawyer team. I hope the court rules in their favor. It will be a powerful message that sleuths can expose fake research without fearing legal consequences. storage.courtlistener.com/recap/gov.us...