Ouch

The package formerly known as papercheck has changed its name to metacheck! We're checking more than just papers, with functions to assess OSF projects, github repos, and AsPredicted pre-registrations, with more being developed all the time. scienceverse.github.io/metacheck/

DEAR FOLLOWERS - LINKEDIN POSTING SURGE REQUESTED

I successfully defended my Habilitation today, and was honoured by the committee’s positive feedback. I am very grateful for my colleagues, collaborators and students at the University of Bern who made this a very rewarding journey.

"We included 608 articles, of which 243 articles were identified as problematic (40.0%)." (bit.ly/3X4PtGF) This finding of so many image-related problems by a team that wanted to do a systemic review, is deeply concerning.

#episky #statsky “The student, now a junior researcher, has learned how to operate the hyp test machinery but not how to feed it with meaningful input” I felt this way when I first learned about DAGs. I could recite the rules, but I was still really confused if I needed to make my own

So (beyond this specific example of anchor-based approaches) I would be happy to see many diverse applied examples on how SESOIs have been reasonably specified in sport and exercise science (if they exist...).

New paper finds that selective reporting remains the most replicable finding in science: journals.sagepub.com/doi/full/10.... I especially like their new exploratory metric 'p-values per participant'. Some papers had 11 p-values per participant! 🤯

There still seems to be a lot of confusion about significance testing in psych. No, p-values *don’t* become useless at large N. This flawed point also used to be framed as "too much power". But power isn't the problem – it's 1) unbalanced error rates and 2) the (lack of a) SESOI. 1/ >

Are you interested in thinking about which studies are worth replicating? Then you have 10 articles to dig into in Meta-Psychology, representing a very wide range of viewpoint on this topic, out now: open.lnu.se/index.php/me...

Which reminds me of this old classic on the Noise Miners. “'Noise mining is a funny thing,' he said. 'When you first see a bit of noise, it doesn’t look so impressive. But as you work it out of the rock, it gets more and more refined.' This process, he explained, is called 'shucking.'"

My paper with @lakens.bsky.social and @annaveer.bsky.social - “Replication value as a function of citation impact and sample size” - has just been published in Meta psychology! open.lnu.se/index.php/me...

Looks like Christmas came early this year 🤩 @vincentab.bsky.social

🎉 @rpsychologist.com 's PowerLMM.js is the online statistics application of the year 2025 🎉 powerlmmjs.rpsychologist.com - Calculate power (etc) for multilevel models - Examine effects of dropout and other important parameters - Fast! (Instant results)

This is an excellent point that generalizes. Researchers often defend suboptimal practices by referring to future studies with better designs. But: Why would anybody run those studies when you can just throw a bunch of variables into a regression and make sweeping "preliminary" claims?

We're pleased to be funding early career researchers to explore how AI is transforming science. The UK Metascience Unit has announced a cohort of 29 researchers that will receive funding through the AI Metascience Fellowship Programme. Read more: www.ukri.org/news/interna...

encountered this article by David Weimer from 1986 (cited by 7) with three good ideas for improving science that just a few short decades later, we've started to implement. Collective Delusion In The Social Sciences: Publishing Incentives For Empirical Abuse doi.org/10.1111/j.15...

New blogpost on @elife.bsky.social's new Replication study type deevybee.blogspot.com/2025/10/prob.... tldr = I think it's doomed. #Replication #Publishing #Reproducibility

I think this is kind of neat and I don't think anyone else has noticed it (I've looked and I can't find anyone who has) osf.io/preprints/so... Maybe I should back off "justification" language, but it's at least a remarkable coincidence. I still think someone else *must* have noticed it...

After submitting a FOIA request UKRI, I obtained success rates by three grant call scheme and I can only say that I am disheartened by the results: - AHRC Responsive Mode 2025: 2% - ESRC New Investigator Grant 2025: 1% - ESRC Research Grant Round 2025: 1%

This fantastic initiative is exactly the type of thing we need to move things forward. Related to @stianwestlake.bsky.social’s discussion of investing in data infrastructure and data merging at the end of this great @worksinprogress.bsky.social interview: podcast.worksinprogress.co/3 (from 39:32)

▶️Our example analysis shows how to use openESM: We estimated within-person correlations between positive and negative affect across 39 datasets (>500K observations) ▶️We find a robust negative correlation (−0.49 [-0.54, -0.42]) and outline ideas for future research building on this

We built the openESM database: ▶️60 openly available experience sampling datasets (16K+ participants, 740K+ obs.) in one place ▶️Harmonized (meta-)data, fully open-source software ▶️Filter & search all data, simply download via R/Python Find out more: 🌐 openesmdata.org 📝 doi.org/10.31234/osf...

Excellent talk, extremely on point and generalises far beyond the causality context. “Translational methodologist” is a brilliant concept IMO and we need many more of them! (I’m biased though because this is probably what @lakens.bsky.social tried to train me to become)

I miss @drprimestein.bsky.social www.psi-chology.com/eudaimonia-d...

The recording is now available so that you can confirm that I indeed have a German accent and color-match my outfits with my Zoom background. youtu.be/YL0co26ng-g?...

If you're interested in #preregistration but don't know where to start, come and join my preregistration workshop at @unicologne.bsky.social in Cologne on Wednesday! We still have open spots. You can register via the link below. ✨ #OpenScience @frederikaust.com

How FAIR is shared data in psychology? We analyzed 11,384 datasets (2013–2024): They're findable, but less reusable! What relates most to differences in FAIRness? #Repository choice. 👉 Preprint: doi.org/10.23668/psy... @mariogollwitzer.bsky.social @kaisassenberg.bsky.social #metascience #SciSci

"Many fields have come up with their own creative ways of making causal claims while maintaining plausible deniability" - @dingdingpeng.the100.ci summarises the problem before offering her tips on how to help bring rigorous causal inference methods into mainstream research!

I'm finally writing a proper paper about faux, and have so many naming & default choices I regret (it was my first solo R package). Which is a better strategy: 1. Add new functions that work the way I wish the old ones did, but keep the old ones 2. Create a faux2 package and retire faux eventually

New hobby: Remaking article abstracts as movie trailers to expose hype and fearmongering.

Important meme update!

PSA: seems like the update broke the ability to directly download files with a link, like osf.io/XXXX/download this lead to an error in one of my R package vignettes, and presumably will break lots of code.

Call For Papers: Journal of Business Economics – Special Issue – Behavioral Ethics Under Review: Replications and Theoretical Foundations Call for Regular Articles & Registered Reports sbeonline.org/2025/10/call...

OpenNeuro @openneuro.bsky.social just hit a huge milestone: 1500 datasets! Congrats to the team on making this project so successful over the last 7 years.

We already know that lagged effects in CLPMs are likely to be upwardly biased, but just how easy is it to find significant effects? Way too easy. I tested CLPMS in 100 randomly selected pairs of correlated variables and found significant effects in 98 of them. New preprint: osf.io/preprints/ps...

Brilliant choice!

Extremely honored to recieve Oslo New University College's science award for 2025. ONH has been a fantastic base to conduct my research at for the past 4 years, and I have an amazing team of colleagues around me to thank for that. From the bottom of my heart, thank you all!

Call for collaborators! 🧵 The TL;DR: we seek collaborators on a #ManyLabs #RegisteredReport about what causes rapid forgetting. In-principle accepted Stage 1: osf.io/ahjn5 Expressions of interest: cardiffunipsych.eu.qualtrics.com/jfe/form/SV_... Further details in the 🧵:

Can large language models stand in for human participants? Many social scientists seem to think so, and are already using "silicon samples" in research. One problem: depending on the analytic decisions made, you can basically get these samples to show any effect you want. THREAD 🧵

Waiting for my preprint to be accepted, so in the meantime a teaser: here's what happens when you try to estimate a between-scale correlation based on LLM-generated datasets of participants, while varying 4 different analytic decisions (blue is the true correlation from human data):

How is that not sci-fi

My impression is that being constitutionally impervious to criticism, always assuming you're the first person to have a thought, and never meaningfully engaging with people who aren't your friends all increase the likelihood that you'll succeed as an academic. That explains some of this phenomenon.

Designers! We're looking to hire a graphic designer and typesetter based in London to oversee and do the production of our upcoming print edition at Works in Progress magazine. If you like this work below, you might be the person for us! More detail: www.worksinprogress.news/p/were-hirin...

Interested in using @cbsstatistiek.bsky.social microdata for your research? 💻 The ODISSEI Microdata Access Grant funds 6 projects per round and offers step-by-step support. Join the Q&A on 23 Sept (15:00–16:00 CET) to learn more & ask questions: odissei-data.nl/event/microd...

New paper out with @boryslaw.bsky.social 🥳 In which we sketch out how to rethink measurement invariance causally for applied researchers. And provide a causal definition of measurement invariance! www.sciencedirect.com/science/arti...

I was thrilled to be invited to contribute to a forthcoming special issue for The Psychologist magazine called "Psychology needs a ... revolution". I wrote about AI and its use in psychology: particularly how we can learn lessons from the past to avoid repeating old mistakes. @psychmag.bsky.social

NEW EPISODE of HARD DRUGS! “5 hours is too long!” some of you said after our first episode. So our second episode is 20 minutes 🤭 @jacobtref.bsky.social and I explore the world of proteins: how proteins fold into complex shapes, why complexity matters, how crowded and dynamic a cell really is.

Ever stared at a table of regression coefficients & wondered what you're doing with your life? Very excited to share this gentle introduction to another way of making sense of statistical models (w @vincentab.bsky.social) Preprint: doi.org/10.31234/osf... Website: j-rohrer.github.io/marginal-psy...