Good post to read again talyarkoni.org/blog/2018/10...

And please write the pre-registration in past tense. Yes, I know it feels wrong because you describe things that future you will do. But it would be so much easier to compare the prereg against the paper if I can simply compare two pdfs without having hundred changes due to grammatical tense

After our panel with Ivan Oransky, Leif Nelson, and myself in which we talked about Fraud Detection and Prevention, the next speaker is @simine.com with "Lessons from Psychology’s Replication Crisis". Transparency is great! But it is not enough. We need to check and ask questions. #NASEM

🚨 New AI Games round is live 🚨 Our first AI Games paper is now out at a top general interest journal (see preprint here: www.econstor.eu/bitstream/10... So… we’re launching the next stage 👇

Finally a good reason to buy Apple

#rstats Periodic reminder: if you are writing articles / books w/ matrix, vector notation, my {matlib} 📦 has a whole suite of functions to make your life easier. Want a matrix X? --> latexMatrix() |> Eqn() Eqn() renders too in #RStudio Viewer See the vignette: friendly.github.io/matlib/artic...

Check this out if you're interested in measurement, experimentation, and causal inference

"If authors cannot stand by their own descriptions of their methods or data, retraction should be automatic," says @eugenie-reich.bsky.social.

Celebrating science #opensciencenl less than 4 years left. How open is your science?

Join us and our partners at @retractionwatch.com for a free webinar March 26 about our new Research Accountability Reporting Fellowship. The event features Ivan Oransky and @stephaniemlee.bsky.social from the @chronicle.com. Learn more and register here. www.theopennotebook.com/2026/02/26/a...

Towards more reliable research: Today, together with @bihatcharite.bsky.social, we welcomed the 2025 #EinsteinFoundationAward winners: @simine.com, Maximilian Sprang, and the Brazilian Reproducibility Initiative @redebrrepro.bsky.social. A recording will be available soon.

We're thrilled to open registration for the Utrecht Replication Games. The event will be at the at the University of Utrecht on June 4th. Psych, public health, pol sci and econ studies will be reproduced! Register here: www.surveymonkey.ca/r/Replicatio...

Listening to this now (online). Nice to end the week hearing from people who walk the walk

ODISSEI is excited to launch the Early Career Board, an initiative to strengthen the voice and engagement of early career researchers in our community. Please welcome the members of the 2026 Board: @elenacandellone.bsky.social, Oskar Veerhoek, Goan Booij, and Tilbe Atav. Read more about them below 👇

The eye of the mother-in-law strikes again. "the eye of the mother-in-law" is a literal translation of a Romanian idiom used to describe someone who sees even the smallest imperfections, things that most other people wouldn't notice. www.keithcirkel.co.uk/whats-my-jnd...

“We wanted to create a way to celebrate those who have the courage to admit when they’ve made a mistake [...] Correcting the record shouldn’t be seen as a failure, but as a vital part of the scientific process. This award is about recognizing the integrity it takes to prioritize truth over ego”

Unfortunately, an accurate depiction of many data cleaning processes out there

This is awesome! No more (change code -> save plot -> open file)^n just to make sure your plot is readable

For journalists who want to dig into stories about scientific integrity: Here's an exciting new opportunity from two of my favorite science-journalism organizations, @retractionwatch.com and @theopennotebook.bsky.social. I'll be joining a webinar to help kick things off on March 26!

Weird, but I didn't get any party invitations by email. I would like to issue a correction and ask for party invitations to be sent via a GitHub Pull Request. bsky.app/profile/anam...

Maybe of interest: The submission guidelines of Psychological Science now demand an explicit statement on measures taken to reduce the risk of AI-generated responses for all online studies! www.psychologicalscience.org/publications...

Write your experiments and analysis code in such a way that a STAR editor at Psych Science highlights your paper. Hats off to @dillonplunkett.bsky.social who did a great job both on the science and diligently coding & documenting everything. Check out our methods to see our reproducibility approach.

I want to highlight this paper as one of the most smooth repro checks I've done as a STAR editor. There are 7 studies reported in the main paper, so plenty of data and code to work with. The authors had done a great job and the repro package was already quite good at the start of the checks (1/n)

Wrapping up my trilogy on how to put together a replication package: The Return of the Code i4replication.org/a-researcher... #econsky #openscience

Really cool talk

#PSE8 excited for this keynote

#PSE8 Keynote by Vlasta Sikimic

'Science doesn't correct itself. Someone has to do it' Douglas Allchin - a comedy of errors #PSE8

Reading list based on talks at #PSE8 perspectivesonscientificerror2026.wordpress.com

Check out this cool reproducibility / robustness check: osf.io/auyq5/overview for Brody etal 2024 doi.org/10.1177/0956... as part of the i4R & Psychological Science collab

Now available on the OSF as part of a growing collection of preregistration resources, the new EEG & ERP Methods template guides researchers through every stage of ERP study planning. In our Q&A, two of its creators share how the template can help researchers at all stages:

ODISSEI Summer School 2026 is now open for applications📣 8–19 June | @erasmusuniversity.bsky.social | 5 ECTS. Learn to work with high-resolution, sensitive data in a secure environment and apply your skills in group research projects. Deadline: 28 Feb 2026 Participation is free 🔗 edu.nl/3t8pc

Here's a suggestion for a New Year's resolution: If you see influential bad research, say something. One part of the whole replication crisis story is that a lot of psychological researchers privately knew that a lot of stuff was bad, but it wasn't discussed publicly.

I was just reading "5. Taming Gnarly Nested Data With purr::modify_tree". Really cool and useful function that I didn't use before. Check it out!

Do you want to work with me?:) Please spread the word! We are looking for talented Post-doc candidates for a 10-month Junior Fellowship at the Behavioral Science Center, hosted by the Corvinus Institute for Advanced Studies (CIAS). 1/6 www.the-bs-lab.com

Who else received an email asking them to evaluate LLM generated ideas to extend a preprint that they are a co-author of? Did it include the quoted paragraph?

I wrote about Grok's CSAM problem and how journalists keep fumbling the story www.readtpa.com/p/grok-cant-...

It finally happened - I was asked to review a paper that cites Martinovici, A, and B (YYYY). Only that I don't have a paper with A and B. For the love of science - read your own papers before submission and don't copy-paste LLM output without verifying every single comma it generates.

I feel seen. Though on the good side, at least there's data to open!

I am not anti LLM across the board. But if your use case starts with the necessary assumption that the model is a vessel of all human knowledge, then you are consulting an oracle not doing scientific research.

Regular reminder to use R Projects and the `here` package. Future you will be happy tidyverse.org/blog/2017/12...

1. Transparency is necessary for credibility 2. Transparency is hard to change 3. Require transparency* 4. Transparency is not magic 5. Journals are part of problem 6. Expect more from journals 7. Peer review is not magic 8. A crisis can look a lot like „normal“ science 9. Meta-analysis is not magic

The most precious commodity you have is your attention. You don’t have to waste it on poor-faith debates or arguments with strangers if you don’t think they’ll be productive. You can prioritize the things that matter to you and make your life richer.

Are you using mediation analysis? Take a look at this cool paper!

🚀 1 week to go! Dive into the world of computational social science at ODISSEI Conference 2025 – workshops, demos & research projects that spark innovation. ⚡🧠 📍 Utrecht, 4 Nov → odissei-data.nl/event/odisse...

Science!

Open Science Workshop - detecting errors and misconduct in science Dates: 20-22 October Location: Radboud University, Nijmegen, The Netherlands Registration link: tinyurl.com/3xkd8twf ONLY PHYSICAL ATTENDENCE POSSIBLE! NO ONLINE POSSIBILITIES.