Who do you review for? Should you boycott commercial publishers? Should you boycott specific publishers? Does it matter for your career? We are orgainizing a one-hour session with lightning talks and an open discussion. Join us on May 26th 12-13 CEST online. Registration at t1p.de/wdirf

I'm excited to co-host these sessions with @priyasilverstein.com! Come say hi and work together with APS attendees and editors to propose publishing innovations at APS journals! #PsychSciSky #SciPub

Come join me and others at this year’s interdisciplinary and international metascience summer school (Aug 23-28, deadline May 22)! Looking forward to collaborate! 🤓

Good news everyone 🥳 Our (w @vincentab.bsky.social) primer on models as prediction machines (with the marginaleffects package) is finally officially published!> journals.sagepub.com/doi/10.1177/...

Our #RegisteredReport investigating the restrictiveness of #preregistrations based on the PRP-QUANT Template, is now published in AMPPS!🎉 DOI: doi.org/10.1177/2515... @pci-regreports.bsky.social @zpid.bsky.social #OpenScience

This is why we (@jamiecummins.bsky.social @bethclarke.bsky.social and I) have developed RegCheck, a tool that automatically checks for potential deviations. regcheck.app

1/ "Silicon samples" are becoming more and more common in research and polling. One problem: depending on the analytic decisions made, you can basically get these samples to show any effect you want. The updated version of this preprint is now online! THREAD🧵 arxiv.org/abs/2509.13397

I’m hiring a PhD student! The candidate will work alongside @zefreeman.bsky.social, who is joining our research group as postdoc. jobs.unibe.ch/job-vacancie...

We are inviting applications for a two-year postdoctoral position in a collaborative meta-science project on the effectiveness of data and code sharing policies in research-performing organizations. www.tue.nl/en/working-a...

New post on The 100% CI: Science needs downvotes. www.the100.ci/2026/04/13/s... In which I make the case that grant funders should add funding lines that include a module for bug bounties.

🧵1/ Our first meta-science paper (with 350+ coauthors) is published today in Nature. It presents one of the largest-ever reproducibility projects in economics & political science. Here’s what we found 👇

SCORE, a collaboration of 865 researchers, is now released as three papers in Nature, six preprints, and a lot of data (cos.io/score/). SCORE examined repeatability of findings from the social-behavioral sciences and tested whether human and automated methods could predict replicability.

Be sure to submit nominations for the 2026 #EinsteinFoundationAward by April 30. The award program honors researchers, institutions, and #EarlyCareerResearchers from around the globe working to promote quality in #research and #openscience. Learn more at plos.io/4ro3GLD. @einsteinberlin.bsky.social

What an issue! RegCheck is among some excellent company here 👏 www.sci-integrity.com/reach-januar...

🏆 @simine.com, psychologist at @psychunimelb.bsky.social / @unimelb.bsky.social and Editor-in-Chief of Psychological Science (@psychscience.bsky.social) is a leading voice in the reform movement in psychology - and is now being honored with the €150K Individual Award. Huge congratulations! 🎉

I build a feed for european grant funding that's updated daily and (IMO) far more transparent then the official EU fundign website: michelnivard.github.io/eu-grants-fe... (inspired by the NIH equivalent @sashagusevposts.bsky.social build yesterday)

Has transparency improved in clinical psychology? New cross sectional study from us (Bianca Kotoulas, Justine Blackwell & me). Adoption of transparent research practices has increased between 2012, 2018, & 2024, but aside from coi and funding disclosures, they remain uncommon osf.io/preprints/ps...

Excited and nervous for this event tomorrow. Come in person in Berlin, or join online! www.einsteinfoundation.de/en/insights/...

We are pleased to announce that the Paul Meehl Graduate School is launching the PMGS Dissertation Award, recognizing outstanding PhD dissertations that advance meta-research. See the eligibility criteria and apply before June 1st, 2026 at: paulmeehlschool.github.io/award/

#SPSP2026 join us at 12:30 to answer all your questions about registered reports!

You need to bring in the same toolkit as in studies that try to establish causality without randomization. I know it sounds unfair, but I don’t make the rules. These situations are instances of post-treatment bias, if you want to read up on it as a psychologist:

Our institute is hiring 1. an assistant professor (with TT) for Social Psychology (focus: environmental psychology) ohws.prospective.ch/public/v1/jo... 2. an assistant lecturer (with TT) for Experimental Personality Psychology ohws.prospective.ch/public/v1/jo...

Join ReproducibiliTea Melbourne journal club this Thursday 4pm AEDT, to discuss "Oversight of Research Outputs by Public Organisations as a Threat to Research Integrity” by C. Brandenburg & @aidybarnett.bsky.social Zoom: uni-sydney.zoom.us/j/83909186903 #ResearchIntegrity @reproducibilitea.org

Just an aside: 41 of the 100 meta analyses published in Psych Bull between 2023 and 2025 do not include *any* quality screening of identified studies. To the degree that those literatures include bad studies, they are being laundered together with the good ones.

New paper, on a worrying trend in meta-science: the practice of anonymising datasets on, e.g., published articles. We argue that this is at odds with norms established in research synthesis, explore arguments for anonymisation, provide counterpoints, and demonstrate implications and epistemic costs.

We at Works in Progress are hosting a series of lightning talks on the future of science R&D in Europe! Come along for the ideas, conversations and meet us! 2nd March, Brussels. Register here: luma.com/08rnunqw

📅 Mark your calendars for #SIPS2027! The 2027 SIPS conference, organized in collaboration with the Association for Interdisciplinary Meta-Research and Open Science @aimosinc.bsky.social, will be held in November at the University of Melbourne, Australia. We are looking forward to seeing you there!

Our preprint has evolved! v2 of “Digital Behaviourism” is out now with a new title, new co-authors, and a deeper dive into the behavioural concepts that shape our online lives. It’s time to move beyond “screen time” and focus on function of online behaviours. osf.io/preprints/ps...

Thrilled to share our new paper introducing “validity potential” versus “realised validity” as a key distinction for psychological measurement, with @davidmkaplanx.bsky.social, Alexander Gillett, @suttonprofessor.bsky.social, and @robert-m-ross.bsky.social www.sciencedirect.com/science/arti...

How many versions of the Iowa Gambling Task (IGT) exist? And how much does this affect research using the IGT? More than you might think. 🧵

Some people bring up (1) the cost of criticism and (2) that a lot of criticism has already been voiced but ignored. Both points are valid, so here are some suggestion for (1) reducing backlash and (2) increasing impact (from this talk of mine: juliarohrer.com/wp-content/u...

RegCheck V2 is out! Try it out yourself: regcheck.app Read more about it: arxiv.org/abs/2601.13330 Check out the codebase: github.com/JamieCummins...

Finally, @bjoernhommel.bsky.social's and my paper introducing the SurveyBot3000 is officially out in AMPPS. It's a fine-tuned language model that guesstimates correlations between survey items from text alone. Not perfectly, but useful for search, for example. journals.sagepub.com/doi/10.1177/...

Project Implicit gives you feedback when you complete an IAT, and the IAT literature has aspired to individual level measurement since its inception. In this article, we quantify the individual level uncertainty around these estimates and show that IAT effects can say very little about individuals.

Just published in Behavior Research Methods: The individual-level precision of implicit measures w/ @ianhussey.mmmdata.io 🧵👇 link.springer.com/article/10.3...

1. Transparency is necessary for credibility 2. Transparency is hard to change 3. Require transparency* 4. Transparency is not magic 5. Journals are part of problem 6. Expect more from journals 7. Peer review is not magic 8. A crisis can look a lot like „normal“ science 9. Meta-analysis is not magic

🚨 SynthNet is out 🚨 Researchers propose new constructs and measures faster than anyone can track. We (@anniria.bsky.social @ruben.the100.ci) built a search engine to check what already exists and help identify redundancies; indexing 74,000 scales from ~31,500 instruments in APA PsycTests. 🧵1/3

METRICS is accepting applications for the 2026–27 postdoctoral fellowship in meta-research at Stanford. Deadline: Feb 15, 2026. Start date will be around Oct 1, 2026 (+/- 2 month flexibility). See: metrics.stanford.edu/postdoctoral... #MetaResearch #postdoc

Job opportunity — Junior Professorship in Psychological Metascience @zpid.bsky.social leibniz-psychology.onlyfy.jobs/job/10kku5n7 h/t @bethclarke.bsky.social

Hey folks! We're running a big repliCATS workshop in Melbourne on 16 Dec, evaluating of replicability of published papers. 🐈 metascience, psych, med, health, education, sociol, quant methods, stats ECRs welcome 💰 AU$200 🎫 + travel subsidies ℹ️ forms.gle/9JvoRBKCzYyY... Re-posts appreciated 🌈

Congratulations to @simine.com well deserved winner of the Einstein Foundation Individual Award for Promoting Quality in Research 2025 🎉 www.einsteinfoundation.de/en/media/pre...

Thanks to everyone who came to Sydney for #AIMOS2025! I can't wait to see you in Wellington, NZ next year!

Want to support PCI Psychology? You can register for an account to make it easier for recommenders to find you and invite you as a reviewer! Register here psych.peercommunityin.org/default/user... and carefully fill out the "Areas of Expertise" box. #PsychSciSky #SciPub

Make an effect size prediction! @jamiecummins.bsky.social and I are replicating Balcetis & Dunning's (2010) "chocolate is more desirable than poop" (Cohen's d = 4.52) Let us known in the replies what effect size you think we'll find. Details of the study in the thread below.

Public appreciation post for @juliabottesini.com! The community doesn't know the great lengths Julia has gone to restabilize operations at PsyArXiv. We're all incredibly lucky to have her. Many, many hours and a great deal of thought/care have gone into the task. Thank you, Julia!

Can large language models stand in for human participants? Many social scientists seem to think so, and are already using "silicon samples" in research. One problem: depending on the analytic decisions made, you can basically get these samples to show any effect you want. THREAD 🧵

Excited to finally have my first paper officially published! "How Do Psychology Journals Handle Postpublication Critique?" is now online with AMPPS. Huge thanks to my supervisors @tomhardwicke.bsky.social and @simine.com and co-authors @bethclarke.bsky.social, N Moodie, S Schiavone, and R Thibault ☺️

PsyArXiv's amazing team of 100+ moderators has now approved all preprints that meet the requirements outlined in the updated PsyArXiv policies (is.gd/paxpolicy). Thank you to everyone who volunteered, this was a true community effort! #PsychSciSky

www.medrxiv.org/content/10.1... INSPECT-SR: A tool for assessing trustworthiness of randomised controlled trials.

How do the discussion sections of paper mill articles in cancer research differ from similar literature? Drop by my poster to hear me over explain this graph in person today and tomorrow ✨ @peerreviewcongress.bsky.social #PRC10