Replication, robustness reproducibility of results across the behavioural + social sciences www.nature.com/articles/s41... www.nature.com/articles/s41... www.nature.com/articles/s41... www.nature.com/articles/s41... @balazsaczel.bsky.social @szaszibarnabas.bsky.social @briannosek.bsky.social

📄Published Today in Nature: 500 researchers reproduced 100 studies across the social & behavioral sciences to assess their analytical robustness (led by @balazsaczel.bsky.social & @szaszibarnabas.bsky.social). Article: www.nature.com/articles/s41... Preprint: osf.io/preprints/me... TLDR: 1/11

Really excited to see this published! I contributed a small part by doing one of the "robustness replications" as my econ friends call it. Stellar coordination effort by @balazsaczel.bsky.social, @szaszibarnabas.bsky.social et al.!

Preprint alert: Simulation-based validation of Bayes Factor computation with @paulbuerkner.com and S. Stroppel. We bring lessons learned in SBC to validation of BFs. arxiv.org/abs/2508.11814 The idea is simple: simulate data from the models, fit and see if the inferences are calibrated. 1/10

Our lab has the capacity to test ~500 uni students each semester If you’re a researcher in cognitive psychology or metascience and need data collection support, we’d love to collaborate. We can help collect high-quality data from a large student sample. Get in touch to discuss potential projects!

Our lab has the capacity to test ~500 uni students each semester If you’re a researcher in cognitive psychology or metascience and need data collection support, we’d love to collaborate. We can help collect high-quality data from a large student sample. Get in touch to discuss potential projects!

See you in Melbourne in Nov 2027, SIPSers and AIMOSers! #metascience

Many analysts are not always equal analysts "Should every analyst's contribution be weighted equally?" From "Ten Strategies To Improve Many-Analysts Studies" by Alexandra Sarafoglou, @balazsaczel.bsky.social et al. Preprint: osf.io/preprints/ps... #MetaSci

Published today: One of the biggest #science #communication studies to date. We asked 71,922 people in 68 countries how they #engage with information about #science and combined the data with several country-level factors: journals.sagepub.com/doi/10.1177/... #OpenAccess

📚 Core principles of responsible generative AI usage in research link.springer.com/article/10.1...

Make an effect size prediction! @jamiecummins.bsky.social and I are replicating Balcetis & Dunning's (2010) "chocolate is more desirable than poop" (Cohen's d = 4.52) Let us known in the replies what effect size you think we'll find. Details of the study in the thread below.

@mikemorrison.bsky.social will be sharing how #scientists and #SciComm folks can combine design and psychology principles to create engaging visual science communication tools. Join this Friday, Oct 17 @ 2pm ET for this FREE webinar. Sign up for Zoom link. waterwhys.org/seminar/fall...

I am happy to announce the publication of our new work on the impact of arbitrary analytical choices on type I and type II error rates. We simulated reaction time data in a conflict task and analyzed the notable CSE effect in a multiverse manner. Worrying results: link.springer.com/article/10.3...

We are live! Introducing the "Journal of Robustness Reports" – a Diamond Open-Access journal dedicated to publishing short reanalyses of empirical findings. Check out our website and blog post about the journal: 🌐 scipost.org/JRobustRep 📄 www.bayesianspectacles.org/introducing-...

The Journal of Robustness Reports is here. Diamond open access. A model for #openscience and #metascience. @balazsaczel.bsky.social scipost.org/JRobustRep.0... 🧪

Love the idea scipost.org/JRobustRep "We hope that the Journal of Robustness Reports will help make reanalyses of published findings the norm across the empirical sciences." #diamondOA scipost.org/JRobustRep/a... @fbartos.bsky.social @balazsaczel.bsky.social @ejwagenmakers.bsky.social

Author copy arrived yesterday. It really was a joy working with @ejwagenmakers.bsky.social and Johnny (is he on here?) on this @jaspstats.bsky.social version of the book.

Two journals tried paying peer reviewers and found increased acceptance, earlier reports, and no change in quality. WHAT A SURPRISE! www.nature.com/articles/d41... @balazsaczel.bsky.social was cited from Eötvös L. Uni. Hungary (where I also teach)

🚀Very excited to finally see our paper on nonsignificance misinterpretations published! 📈 Together, @smurphee.bsky.social, Aurelio Fernández, Linda Reimann and I investigated the prevalence of "p > .05 = absence of an effect" interpretations. (1/4) doi.org/10.1098/rsos...

Don't forget to register to #SIPS2025 ! Early-bird deadline is March 15. www.improvingpsych.org/SIPS2025/

PSA Around the World online conference with focus on Central n Eastern Europe is in November (6, 14, 22). The abstracts are due March 31st. Open to anyone around the world and on any #philsci topic, but especially on the history and the present of the field in the region. Thanks to the organisers!

We outline how such a computational psychology of science can contribute to #metascience. Our findings suggest that collective efforts, tailored to group characteristics, may foster behavior change interventions in science, @balazsaczel.bsky.social 👉 doi.org/10.23668/psy... 🧵4/4

🚨 Is the peer review system broken? Our new PNAS paper dives into the biases, inefficiencies, and inconsistencies plaguing scientific publishing. Can transparency, training, and AI fix it? Evolution or revolution for peer review? 🔗 Read more: www.pnas.org/doi/10.1073/... @balazsaczel.bsky.social

Mark your calenders. The dates and topics of the upcoming workshops of the Paul Meehl Graduate School are announced. Stay tuned for more information paulmeehlschool.github.io/2025-02-10-s...

After my first year as EiC of Collabra: Psychology, I wrote an editorial with my reflections so far. Featured are some observations about submission triage, author geolocation data, and a registered revisions experiment. @collabrapsychology.bsky.social @improvingpsych.org doi.org/10.1525/coll...

The present and future of peer review: Ideas, interventions, and evidence www.pnas.org/doi/10.1073/...

How can we make sound replication decisions? www.pnas.org/doi/10.1073/...

How should the advancement of large language models affect the practice of science? www.pnas.org/doi/10.1073/...

Scientific publishing cannot be free but an annual $2.5 billion seems excessive to me

This is an enjoyable read on the problem of paper mills, but I also came away from it worried that we haven't really got a clue how bad the problem even is, let alone how to solve it. www.nature.com/articles/d41...

ICYM SIPS 2025 Pre-Conference Discussion: 'What went wrong? How can we do it better?' don't worry; we've got you covered! The recording is now available on YouTube! Enjoy the discussion and join us for #SIPS2025! https://buff.ly/4gVwdnB @simine.com @briannosek.bsky.social @balazsaczel.bsky.social

So, who is coming to #SIPS2025? Don't miss it! It will be the 10th SIPS, so we will come together to evaluate the reform and gather new momentum to improve science. Day 0: Sightseeing, hiking dinner: on a boat on the Danube Let others know that you are coming to Budapest so they can meet you!

THE CALL FOR SUBMISSIONS TO SIPS 2025 IS STILL OPEN! To submit your session, please visit the designated online submission portal: ONLINE SIPS 2025 pretalx.com/sips2025-onl... & IN-PERSON SIPS 2025 pretalx.com/sips2025-bud... Hosts: @improvingpsych.org & @balazsaczel.bsky.social

📚 Opening the black box of article retractions: exploring the causes and consequences of data management errors royalsocietypublishing.org/doi/10.1098/...

Hello Bluesky! We are ICSSI: The 2025 International Conference on the Science of Science and Innovation Save the date! 🗓️ JUNE 16-18, 2025 ✍️ in beautiful Copenhagen, Denmark www.icssi.org

Has the scientific reform achieved its goal? Did it go too far? Not far enough? Register and join us this Wednesday in the #SIPS Early-reformers discussion where I will chat with Simine Vazire, Brian Nosek, Dorothy Bishop, Joe Simmons, and Leif Nelson about these questions. bsky.app/profile/impr...

would you pay to find out why you shouldn't pay...?

Writing a grant is great for developing ideas, but does your proposal actually affect whether or not you get funded? Turns out, your full proposal does not affect your ranking much! Whaat? 😯 Simsek et al. 2024: link.springer.com/article/10.1...

THE CALL FOR SUBMISSIONS TO SIPS 2025 IS NOW OPEN! To submit your session, please visit the designated online submission portal: ONLINE SIPS 2025 pretalx.com/sips2025-onl... & IN-PERSON SIPS 2025 pretalx.com/sips2025-bud.... Hosts: @improvingpsych.org @balazsaczel.bsky.social

I really enjoyed reading this world view in Nature about the importance of exploratory research in the social sciences by @balazsaczel.bsky.social and am wondering what people think. Do you generally agree with his point? 🧪@natureportfolio.bsky.social www.nature.com/articles/d41...

My latest writing on why we need more #exploratory research. I'm curious what people think about it. rdcu.be/d1Fkj

'The psychology of data analysis' osf.io/preprints/ps...

In celebration of SIPS's 10th annual meeting, please join us for a virtual warm-up event on December 18, 2024! Early reformers will discuss challenges and improvements in psychological science. Find out more and register: improvingpsych.org/sips-2025-pr...

How can we responsibly use AI in research? Guidelines quickly get out of date without fundamental principles. Our consensus describes the fundamental principles required for responsible AI usage. Please RT osf.io/preprints/ps...