New blog post: Evaluating Dr. Cuddy’s Claim that the Debunking of Power Posing is a Myth. daniellakens.blogspot.com/2026/05/eval... On an AI generated description of a non-existent study, incorrectly citing findings from studies, and the importance of scientific criticism.

One of the arguments put to me re: scientific reform is essentially that it will sort itself (poor science is ignored) but of course things only get sorted if scientists are *constantly* doing the difficult work of evaluating competing claims, so "grey" science doesn't spread.

"If I hated to be the bearer of bad news, I wouldn’t have specialized in research methods."

Immigration make Britain brilliant

Love it

In this enormous meta-research project we put claims in social-science papers to the test and the results from the project have now been published in Nature.

i’ve watched this three times. VERY satisfying.

Last week, I mentioned this in passing in a workshop: In 1938 Enrico Fermi won a Nobel Prize for discovering two new elements of the periodic table. Lise Meitner shortly showed that Fermi was mistaken and instead had produced known lighter elements by fission. She did not win a Nobel prize.

A review of the proceedings from four major computer-science conferences showed that none from 2021, and all from 2025, had fake citations. arxiv.org/abs/2602.058... #AI #LLMs #Hallucinations #Misconduct #ScholComm

Listen to this. Not a penny more for this. Abolish and prosecute anyone who had anything to do with it.

Wow this scoring chaos seems to be an extreme case of what I say about many ad hoc analyses: no derivation of method from a clear scientific theory, no assessment of statistical properties, and decades pass before someone notices. This happens in biology too, so let’s not pick on psychology only

who did this

Associate or full position in energy economics at AU! Link in comment

(Also, icyi, here are the 42 papers citing our non-existent paper which includes a "meta-analysis" - often called the evidence "gold standard" - of "LLM effects" in education 🤮 scholar.google.com.vn/scholar?star...)

Keeping this at hand in case I need to point to it and tap

Some closing thoughts for my students this semester on LLMs and learning #rstats datavizf25.classes.andrewheiss.com/news/2025-12...

🎯 statsepi.substack.com/p/the-review...

“No, we’ve all accepted that the goal is to publish anything and everything and see what sticks. More students. More “collaborations”. So many papers that no human can possibly be paying very much attention to any of it. And we all know where the incentives lie.”

Some comments on PubPeer: pubpeer.com/publications...

"Runctitiononal features"? "Medical fymblal"? "1 Tol Line storee"? This gets worse the longer you look at it. But it's got to be good, because it was published in Nature Scientific Reports last week: www.nature.com/articles/s41... h/t @asa.tsbalans.se

hahahaha just got an email from someone who was using Claude to generate a boilerplate #QuartoPub document and the LLM *used my name* as the author. The computers are literally trying to be me now 😂🤣🙃🫠

I know that at this point it's a subplot in the Epstein files drama, but I feel compelled to point out, once again, that Larry Summers HAS NO BUSINESS teaching students at ANY university ever again! My latest cries into the abyss, in @thenation.com www.thenation.com/article/soci...

A paper critiquing post-publication peer review has numerous made-up references, including a @nature.com article falsely attributed to our Ivan Oransky. link.springer.com/article/10.1...

NEW: Epstein survivors release the most powerful PSA I have ever seen. Make this go viral so every member of the House of Representatives sees it.

TU/e has gained a new research centre: META/e. Daniël Lakens and Krist Vaesen were among the founders of this knowledge hub for metascience—research aimed at improving the practice of science itself. “We want to be a home for every researcher who occasionally wonders: what are we even doing?”

Yes!!

New blog post on Gelman's recent claim that Type S and M errors are intended as a 'rhetorical tool', and if I was wrong to believe they were recommended more routinely in our recent preprint criticizing the idea of Type S and M errors. daniellakens.blogspot.com/2025/09/type...

🚨 New paper alert 🚨 Using LLMs as data annotators, you can produce any scientific result you want. We call this **LLM Hacking**. Paper: arxiv.org/pdf/2509.08825

More examples of faked institutional email addresses from @deevybee.bsky.social here deevybee.blogspot.com/2022/10/what...

"OpenAI is making “small steps that are good, but I don’t think we’re anywhere near where we need to be”, says Mark Steyvers, a cognitive science and AI researcher at UC Irvine. “It’s not frequent enough that GPT says ‘I don’t know’.”" www.nature.com/articles/d41...

➡️ Deadline approaching—only one month left to send in your papers and presentation proposals for #CDSM2025! 🚨 𝗖𝗮𝗹𝗹 𝗳𝗼𝗿 𝗣𝗮𝗽𝗲𝗿𝘀: 𝗖𝗮𝘂𝘀𝗮𝗹 𝗗𝗮𝘁𝗮 𝗦𝗰𝗶𝗲𝗻𝗰𝗲 𝗠𝗲𝗲𝘁𝗶𝗻𝗴 𝟮𝟬𝟮𝟱 🚨 📅 𝗡𝗼𝘃 𝟭𝟮–𝟭𝟯, 𝟮𝟬𝟮𝟱 (𝗩𝗶𝗿𝘁𝘂𝗮𝗹) 📥 Submission Deadline: 𝗦𝗲𝗽𝘁 𝟯𝟬, 𝟮𝟬𝟮𝟱

Ever stared at a table of regression coefficients & wondered what you're doing with your life? Very excited to share this gentle introduction to another way of making sense of statistical models (w @vincentab.bsky.social) Preprint: doi.org/10.31234/osf... Website: j-rohrer.github.io/marginal-psy...

"Being Bayesian in a Frequentist World" New post on "Bayesian dynamic borrowing" in R 📚 Link 👇

If you are preparing your bachelor statistics course and would like to add optional material for students to better understand statistics on a conceptual level (see topics in the screenshot) my free textbook provides a state of the art overview. lakens.github.io/statistical_...

My video about how LLMs are not search engines has led to many, MANY comments telling me that I should be using Perplexity. Some insisting that Perplexity does not hallucinate. Out of a list of 26 papers it just provided me (in "Research" mode) 4 were real. FOUR. 85% hallucination rate.

TIL the original paper describing CRISPR, by Francisco Mojica, was rejected by 4 journals and took 2 years to be published

Just in case there was any doubt, ChatGPT 5.0 still makes up completely random citations that don't exist and should not be used for literature search.

‼️Cool new paper‼️ Finds that journal data policies in psychology boost sharing statements to ~100%, but only about half of datasets are complete, understandable, reusable. Open: open.lnu.se/index.php/me...

5. Most frequentist methods are just *fine* and there's no need to always go full luxury bayesian in every application.

When power is derived from lies, data become the enemy. www.nytimes.com/2025/08/01/b...

Inspiring PDW on using sensitivity analysis in empirical management research. My contribution is to present the sensemakr package by Cinelli & Hazlett (2020) for observational designs. Thanks a lot to the organizers for putting this fantastic session together. #AOM2025

In my latest (and last!) column for Science’s Expert Voices series, I write about the reasons behind AI chatbots’ “deceptive” behaviors (and why Claude threatened a fictional CEO with blackmail). www.science.org/doi/10.1126/...

This is fascinating: www.reddit.com/r/OpenAI/s/I... Someone “worked on a book with ChatGPT” for weeks and then sought help on Reddit when they couldn’t download the file. Redditors helped them realized ChatGPT had just been roleplaying/lying and there was no file/book…

The people call and I answer. Here are my thoughts on that developer RCT and the "AI slows down developers" claim. www.fightforthehuman.com/are-develope...

Using time series graphs to make causal claims be like

Thick vs thin causality

After all these reports of authors adding language instructions for LLM reviews in their papers I wanted to check this myself and I downloaded the .tex source from one of these papers. Here is an example. (I will not share the identity of the paper)

Very excited to publicly share news about a new tool, Papercheck, that @debruine.bsky.social and me started to develop more than a year ago! In an introductory blog post, we explain our philosophy to automatically check scientific papers for best practices. daniellakens.blogspot.com/2025/06/intr...

Venn (1866) described the problem with the "sharpshooter fallacy": 🎯 painting the bullseye on the spot where a bullet hits a door. In psychology, we call this "HARKing" — Hypothesizing After Results Are Known.

Possibly the best thing I've read about ChatGPT yet. h/t @melaniemitchell.bsky.social amandaguinzburg.substack.com/p/diabolus-e...