New paper, now out in Behavior Research Methods. "Multiverse simulation to explore the impact of analytical choices on type I and type II errors in a reaction time study" link.springer.com/article/10.3...

✨ LUCKY COINCIDENCES ✨ Have you ever come across a surprising, accidental discovery that felt meaningful and motivated you to further engage with it? In our new paper now out in JASP (doi.org/10.1111/jasp...), we explore such serendipitous experiences in museums and beyond. 1/5 🧵

"The proof established by the test must have a specific form, namely, repeatability." (Dunlap, 1926). And researchers have more and more done so. Read why replications are important and how the last years have seen a strong rise of replications in our open handbook: forrt.org/replication_...

UN Scientific Advisory Board Adopts Landmark Statement on Open #Science (via #isc) https://council.science/blog/un-scientific-advisory-board-adopts-landmark-statement-on-open-science/ #OpenScience

Join us on October 7 at 1 PM ET for a webinar. There will be a panel discussion with library and research experts. This panel will explore ways to improve shared understanding. They will also work on creating a new view of open science on campus. Register here 👉 cos-io.zoom.us/webin...

Our preprint on our translations of CRediT into 36 languages. We've come a long way with this project! osf.io/preprints/me... If you know of non-English academic journals that don't have a policy on saying who did what, get in touch - CRediT may be part of the answer.

Excited to finally have my first paper officially published! "How Do Psychology Journals Handle Postpublication Critique?" is now online with AMPPS. Huge thanks to my supervisors @tomhardwicke.bsky.social and @simine.com and co-authors @bethclarke.bsky.social, N Moodie, S Schiavone, and R Thibault ☺️

Great to see this out! Only ~23% of psychology journals have a post-publication critique format (e.g., letter to the editor). Some impose strict limits (e.g., 400 words & 4 weeks to submit). Critiques are rarely published — in two random samples of 101 empirical articles we found only 1 critique.

I'm on @nature.com's podcast talking to @nickpetrichowe.bsky.social about the role that journalists can play in combating research misconduct. Honored to appear alongside @jamesheathers.bsky.social, @abalkina.bsky.social, @richvn.bsky.social and many others: www.nature.com/articles/d41...

To prevent Ps from pasting (GPT-generated) responses to your text entry Qualtrics question, disable pasting. Add this code to the OnReady section of your question's javascript: jQuery("#"+this.questionId+" .InputText").on("cut copy paste",function(e) { e.preventDefault(); }); Enjoy!

We often hear from reviewers: "what about demand effects?" So we developed a method to eliminate them. Something weird happened during testing: We couldn’t detect demand effects in the first place! (1/8)

New newsletter. I cross the #DecisionMaking and #Metascience streams and write about recent work we've been doing at the @RoRInstitute https://open.substack.com/pub/tomstafford/p/distributed-peer-review It's the academic equivalent of those video […] [Original post on mastodon.online]

This paper grew out of my undergrad seminar: students collaborated on the replication project (Study 2) & all earned co-authorship—it was a rare opportunity for undergrads to engage in journal-quality empirical work in the classroom & it’s a win for open science www.sciencedirect.com/science/arti...

This paper grew out of my undergrad seminar: students collaborated on the replication project (Study2) & all earned co-authorship—it was a rare opportunity for undergrads to engage in journal-quality empirical work in the classroom & it’s a win for open science www.sciencedirect.com/science/arti...

A new paper on Bayesian equivalence testing in JASP, by Henk Kiers and Jorge Tendeiro. Cool stuff. Blog post/teaser: jasp-stats.org/2025/09/12/n...

First Cooperation Colloquium of the semester! Doruk İriş @dorukiris.bsky.social: Normative expectations of reciprocal negotiators Friday Sep 12, 14:00 UTC+2 (Vienna) / 8 am NYC Sign up: list.ku.dk/postorius/li...

The first colloquium will take place in four hours, at 14:00 CEST.

🌍Do all nations believe they’re superior—or do some feel inferior? Western social sciences claimed the first. But Fanon & Memmi argued colonization by the West left many in the Global South with colonial mentality—internalized oppression. 🧵Findings from our 45-country study:

For potential grad students: if you're interested in this kind of work on assessing and improving close relationships measures, our group just got a grant to do five more years of it. Join our team!

This is schmeasurement's Dead Salmon fMRI study: A cautionary tale of how standard research practices can produce misleading results. I love it. Immediately putting it on my reading lists.

In a new paper, my colleagues and I set out to demonstrate how method biases can create spurious findings in relationship science, by using a seemingly meaningless scale (e.g., "My relationship has very good Saturn") to predict relationship outcomes. journals.sagepub.com/doi/10.1177/...

Accepted for publication at Royal Society Open Science: "Using prediction markets and forecasting surveys to predict 28 replication outcomes of classic articles in social psychology and judgment and decision making" Going meta-science on our CORE team replications Details👇🧵

At the FORRT Replication Hub, our mission is to support researchers who want to replicate previous findings. We have now published a big new component with which we want to fulfill this mission: An open access handbook for reproduction and replication studies: forrt.org/replication_...

The Item Response Warehouse is a new data resource for psychometricians interested in developing methods using bigger and more diverse sets of instruments: itemresponsewarehouse.org New paper out now at BRM: doi.org/10.3758/s134...

It's unreal there's no official qualtrics support for batch backups. Wish I had this script months ago!

The new journal "Experimental Philosophy" is now on BlueSky. @xphijournal.bsky.social bsky.app/profile/xphi... Please share!

Just came across a new tutorial paper on the Bayesian t-test in JASP, in the Journal of Advanced Nursing (!). It looks really good. The paper (open access) is at onlinelibrary.wiley.com/doi/epdf/10...., and an ultra-short blog post is at jasp-stats.org/2025/09/06/n....

Want to know what a sample of 200+ editorial board members think about citing practices in psychology? That and much more in this AMPPS article. We had a lot of fun pulling it together. journals.sagepub.com/doi/10.1177/...

🚨 New paper now out in Nature Climate Change! 🎉 Climate change belief systems across 110 countries and territories. Climate change beliefs don’t stand in isolation, they’re connected to one another in a belief system. 1/x

We are about a month away from releasing a complete refresh of the OSF user interface. The team has been working on this for a very long time, and we are very excited to be able to share it soon. A preview picture:

Don't claim "full mediation". journals.sagepub.com/doi/full/10....

Navigating Open Research: A Guide for Early Career Researchers. Great work from the CONUL Research Group. Free to download zenodo.org/records/1702... #irishResearch #openResearch

First day of teaching, starting with our Metascience course. 73 master students (up from 42 last year) is a lot, but hopefully also a lot of fun! Today we discussed what metascience is, and summarize the concerns metascientists have raised in the last decade.

Do you sometimes feel torn when making decisions, like whether to eat unhealthy food or recycle? This is called felt ambivalence: a psychological discomfort from having mixed feelings about something. Check out our new work to know how people resolve such conflicts: doi.org/10.1016/j.je... 🧠💥 1/10

Another warning is that not all licenses come with an API. When I enquired at my institution, I was told our license did not include this, so I was left doing this manually,... .

Nice R way to backup your Qualtrics.

Back up your data! This seems like a very useful function!

Need to backup your Qualtrics? I needed this urgently given a revocation of my Qualtrics account with my former affiliation. Found William Ryan's R code, but it didn't work for me, so I made some tweaks, and it works now. Hope it's helpful to others: github.com/giladfeldman...

New newsletter! https://tomstafford.substack.com/p/decoy-effects-in-the-purchase-of #cogsci #bias #economics

New study on #BlueSky for #SciComm. “Bluesky posts demonstrate substantially higher levels of interaction (likes, reposts, replies, and quotes) and greater textual originality than previously reported for X, suggesting both stronger interactive and more interpretive engagement.” 🦋🦫🌱🐋🧪 #philsci

Final call for global collaborators on this replication collaboration on @bioxphi studies — moral psychologists and x-phi researchers wanted! especially based in SOUTHERN HEMISPHERE! global-bioXphi | moral science lab www.mscilab.com/globalbioxphi/

the Association for Interdisciplinary Metaresearch and Open Science always welcomes new people doing or curious about metaresearch!

“This simple experiment gives objective evidence for Stroud’s perceptual moment theory.” It does no such thing, and now, the article has been RETRACTED. We called for its retraction in a letter we wrote to the Attention Perception & Psychophysics editor in 2023, and now posted on PubPeer.

Join us for the Melbourne @reproducibilitea.org journal club happening today at 4pm AEST. This week, we discuss a recent preprint on replicating drosophila immunity studies, article linked below. Zoom link: unimelb.zoom.us/j/8289083982...

New post. Why we so often focus on personal behavior—eating less meat, flying less, shorter showers—while systemic solutions to environmental issues quietly fall out of view? rolfzwaan.substack.com/p/social-sci...

I've spent the past weeks publishing my flankr package on CRAN for R. Users who've only installed the first version will notice SIGNIFICANT improvements in model fit speed. Plus, I made a hex sticker for it. CRAN: cran.r-project.org/web/packages... Github (dev version): github.com/JimGrange/fl...

10 years ago?! Holy smokes.

🍎 Teacher workload & mental health A new study of nearly 5,000 Australian teachers finds high rates of depression, anxiety, and stress. Heavy workloads link to poorer mental health and turnover. 🔗 link.springer.com/article/10.1... #SciComm 🧪 #MentalHealth #Education

New paper out! A monumental systematic review and meta-analysis lead by the amazing Ghassani Swaryandini. Open access link: rdcu.be/eCtnM

as editor, I'm actually signing the petition myself :) == Adopt Registered Reports at Psychological Methods - Sign the Petition! chng.it/wszLWM4KPX == e.g., look forward to exploring options for preregistration for the journal @apajournals.bsky.social @akmontoya.bsky.social