New post! "Making Sense of Replications (and Some Nonsense about the Replication Crisis)," in which I suggest a journal club reading list of new papers on replication, and push back on claims that the replication crisis is fake. getsyeducated.substack.com/p/making-sen...

Our lab loved this paper when it came out as it combined two of our interests, technology effects and schmeasurement. Plus: Registered report, open data. We read it for our journal club and found issues in the Slovak sample that we now posted to PubPeer: pubpeer.com/publications...

🧵 New PubPeer comment. @cskay.bsky.social & Vlasceanu (2026) propose ECLAIR, an item battery to catch AI-driven bots. We read the preprint in our journal club & found it very interesting, but our read raised several concerns that we posted to PubPeer. pubpeer.com/publications...

The paper "The Bots Ruining Social Science Are Not Bots at All" by Jaffe et al. got a lot of attention when it came out in Perspectives on Psychological Science. We read it in our journal club and have a few comments that we now posted to PubPeer pubpeer.com/publications...

Can questionable research practices make almost anything look statistically significant? @ephemeralidea.bsky.social explores p-hacking, false positives, and how seemingly small analytical decisions can dramatically influence research findings. Register free; open to all. tinyurl.com/3wbx9tmr

Psychology researchers: Got questions about what kinds of submissions we’re looking for at Psych Science (the journal)? (Short answer: empirical research in any area of psychology!) If you’re at #APS26BCN, stop by the APS booth in the exhibit hall between 4-5pm today to chat with me!

Should automated tools for peer review come with a "nutritional label" for validity?🥪 And if so, what should be on it? Join my workshop on June 5th @ the META/e Conference on Transparency, Technology and AI in Peer Review in Eindhoven! Results will inform our FAIR validation framework. Details >>

New blog post: Evaluating Dr. Cuddy’s Claim that the Debunking of Power Posing is a Myth. daniellakens.blogspot.com/2026/05/eval... On an AI generated description of a non-existent study, incorrectly citing findings from studies, and the importance of scientific criticism.

Austin et al. (2026) advocated for AI in hypothesis-driven scale validation research. In this preprint, led by @wchiggins.bsky.social, we (@malte.the100.ci @bethclarke.bsky.social) sketch out several weaknesses in this paper, and offer recommendations for avoiding them. osf.io/preprints/ps... 1/🧵

Are you in the process of preregistering your study or thinking about performing it in future? The final workshop of this academic year at PMGS is exactly focusing on this. @denolmo.bsky.social will cover core principles of preregistration and common mistakes, and gives a hands-on guide for it.

Attending #APS26BCN? Come along to our three interactive sessions: SIPS at APS: Advances in Peer Review and Scholarly Publishing 1️⃣ Thursday, 28 May 2026, 4:30 PM - 5:30 PM 2️⃣ Friday, 29 May 2026, 5:30 PM - 6:30 PM 3️⃣ Saturday, 30 May 2026, 5:30 PM - 6:30 PM @improvingpsych.org

Who do you review for? Should you boycott commercial publishers? Should you boycott specific publishers? Does it matter for your career? We are orgainizing a one-hour session with lightning talks and an open discussion. Join us on May 26th 12-13 CEST online. Registration at t1p.de/wdirf

I'm excited to co-host these sessions with @priyasilverstein.com! Come say hi and work together with APS attendees and editors to propose publishing innovations at APS journals! #PsychSciSky #SciPub

Come join me and others at this year’s interdisciplinary and international metascience summer school (Aug 23-28, deadline May 22)! Looking forward to collaborate! 🤓

Good news everyone 🥳 Our (w @vincentab.bsky.social) primer on models as prediction machines (with the marginaleffects package) is finally officially published!> journals.sagepub.com/doi/10.1177/...

Our #RegisteredReport investigating the restrictiveness of #preregistrations based on the PRP-QUANT Template, is now published in AMPPS!🎉 DOI: doi.org/10.1177/2515... @pci-regreports.bsky.social @zpid.bsky.social #OpenScience

This is why we (@jamiecummins.bsky.social @bethclarke.bsky.social and I) have developed RegCheck, a tool that automatically checks for potential deviations. regcheck.app

1/ "Silicon samples" are becoming more and more common in research and polling. One problem: depending on the analytic decisions made, you can basically get these samples to show any effect you want. The updated version of this preprint is now online! THREAD🧵 arxiv.org/abs/2509.13397

I’m hiring a PhD student! The candidate will work alongside @zefreeman.bsky.social, who is joining our research group as postdoc. jobs.unibe.ch/job-vacancie...

We are inviting applications for a two-year postdoctoral position in a collaborative meta-science project on the effectiveness of data and code sharing policies in research-performing organizations. www.tue.nl/en/working-a...

New post on The 100% CI: Science needs downvotes. www.the100.ci/2026/04/13/s... In which I make the case that grant funders should add funding lines that include a module for bug bounties.

🧵1/ Our first meta-science paper (with 350+ coauthors) is published today in Nature. It presents one of the largest-ever reproducibility projects in economics & political science. Here’s what we found 👇

SCORE, a collaboration of 865 researchers, is now released as three papers in Nature, six preprints, and a lot of data (cos.io/score/). SCORE examined repeatability of findings from the social-behavioral sciences and tested whether human and automated methods could predict replicability.

Be sure to submit nominations for the 2026 #EinsteinFoundationAward by April 30. The award program honors researchers, institutions, and #EarlyCareerResearchers from around the globe working to promote quality in #research and #openscience. Learn more at plos.io/4ro3GLD. @einsteinberlin.bsky.social

What an issue! RegCheck is among some excellent company here 👏 www.sci-integrity.com/reach-januar...

🏆 @simine.com, psychologist at @psychunimelb.bsky.social / @unimelb.bsky.social and Editor-in-Chief of Psychological Science (@psychscience.bsky.social) is a leading voice in the reform movement in psychology - and is now being honored with the €150K Individual Award. Huge congratulations! 🎉

I build a feed for european grant funding that's updated daily and (IMO) far more transparent then the official EU fundign website: michelnivard.github.io/eu-grants-fe... (inspired by the NIH equivalent @sashagusevposts.bsky.social build yesterday)

Has transparency improved in clinical psychology? New cross sectional study from us (Bianca Kotoulas, Justine Blackwell & me). Adoption of transparent research practices has increased between 2012, 2018, & 2024, but aside from coi and funding disclosures, they remain uncommon osf.io/preprints/ps...

Excited and nervous for this event tomorrow. Come in person in Berlin, or join online! www.einsteinfoundation.de/en/insights/...

We are pleased to announce that the Paul Meehl Graduate School is launching the PMGS Dissertation Award, recognizing outstanding PhD dissertations that advance meta-research. See the eligibility criteria and apply before June 1st, 2026 at: paulmeehlschool.github.io/award/

#SPSP2026 join us at 12:30 to answer all your questions about registered reports!

You need to bring in the same toolkit as in studies that try to establish causality without randomization. I know it sounds unfair, but I don’t make the rules. These situations are instances of post-treatment bias, if you want to read up on it as a psychologist:

Our institute is hiring 1. an assistant professor (with TT) for Social Psychology (focus: environmental psychology) ohws.prospective.ch/public/v1/jo... 2. an assistant lecturer (with TT) for Experimental Personality Psychology ohws.prospective.ch/public/v1/jo...

Join ReproducibiliTea Melbourne journal club this Thursday 4pm AEDT, to discuss "Oversight of Research Outputs by Public Organisations as a Threat to Research Integrity” by C. Brandenburg & @aidybarnett.bsky.social Zoom: uni-sydney.zoom.us/j/83909186903 #ResearchIntegrity @reproducibilitea.org

Just an aside: 41 of the 100 meta analyses published in Psych Bull between 2023 and 2025 do not include *any* quality screening of identified studies. To the degree that those literatures include bad studies, they are being laundered together with the good ones.

New paper, on a worrying trend in meta-science: the practice of anonymising datasets on, e.g., published articles. We argue that this is at odds with norms established in research synthesis, explore arguments for anonymisation, provide counterpoints, and demonstrate implications and epistemic costs.

We at Works in Progress are hosting a series of lightning talks on the future of science R&D in Europe! Come along for the ideas, conversations and meet us! 2nd March, Brussels. Register here: luma.com/08rnunqw

📅 Mark your calendars for #SIPS2027! The 2027 SIPS conference, organized in collaboration with the Association for Interdisciplinary Meta-Research and Open Science @aimosinc.bsky.social, will be held in November at the University of Melbourne, Australia. We are looking forward to seeing you there!

Our preprint has evolved! v2 of “Digital Behaviourism” is out now with a new title, new co-authors, and a deeper dive into the behavioural concepts that shape our online lives. It’s time to move beyond “screen time” and focus on function of online behaviours. osf.io/preprints/ps...

Thrilled to share our new paper introducing “validity potential” versus “realised validity” as a key distinction for psychological measurement, with @davidmkaplanx.bsky.social, Alexander Gillett, @suttonprofessor.bsky.social, and @robert-m-ross.bsky.social www.sciencedirect.com/science/arti...

How many versions of the Iowa Gambling Task (IGT) exist? And how much does this affect research using the IGT? More than you might think. 🧵

Some people bring up (1) the cost of criticism and (2) that a lot of criticism has already been voiced but ignored. Both points are valid, so here are some suggestion for (1) reducing backlash and (2) increasing impact (from this talk of mine: juliarohrer.com/wp-content/u...

RegCheck V2 is out! Try it out yourself: regcheck.app Read more about it: arxiv.org/abs/2601.13330 Check out the codebase: github.com/JamieCummins...

Finally, @bjoernhommel.bsky.social's and my paper introducing the SurveyBot3000 is officially out in AMPPS. It's a fine-tuned language model that guesstimates correlations between survey items from text alone. Not perfectly, but useful for search, for example. journals.sagepub.com/doi/10.1177/...

Project Implicit gives you feedback when you complete an IAT, and the IAT literature has aspired to individual level measurement since its inception. In this article, we quantify the individual level uncertainty around these estimates and show that IAT effects can say very little about individuals.

Just published in Behavior Research Methods: The individual-level precision of implicit measures w/ @ianhussey.mmmdata.io 🧵👇 link.springer.com/article/10.3...

1. Transparency is necessary for credibility 2. Transparency is hard to change 3. Require transparency* 4. Transparency is not magic 5. Journals are part of problem 6. Expect more from journals 7. Peer review is not magic 8. A crisis can look a lot like „normal“ science 9. Meta-analysis is not magic

🚨 SynthNet is out 🚨 Researchers propose new constructs and measures faster than anyone can track. We (@anniria.bsky.social @ruben.the100.ci) built a search engine to check what already exists and help identify redundancies; indexing 74,000 scales from ~31,500 instruments in APA PsycTests. 🧵1/3

METRICS is accepting applications for the 2026–27 postdoctoral fellowship in meta-research at Stanford. Deadline: Feb 15, 2026. Start date will be around Oct 1, 2026 (+/- 2 month flexibility). See: metrics.stanford.edu/postdoctoral... #MetaResearch #postdoc