"the replication findings reinforce lessons that I have slowly been learning over the years ...'the issue needing to be solved is overconfidence..We tend to act as if published findings are replicable without actually assessing whether they are.'” www.bloomberg.com/opinion/arti...

www.sciencedirect.com/science/arti... very nice paper on a mice model of blindsight i'm not sure if i'm fully convinced by their saliency control, but maybe i'm just picking hair let me explain: (a thread to follow)

…Speaking of null results, I only just discovered this fascinating paper. Seems that we (social science researchers) systematically overestimate the effect sizes likely to be operating, so we underpower our studies I’m v curious abt how much this reflects sheer wishful thinking vs substantive error

Very excited to announce that the #BayesianWorkflow book by @statmodeling.bsky.social, @avehtari.bsky.social, @rmcelreath.bsky.social et al publishes in June! routledge.com/9780367490140 #RStats #DataScience #Bayesian

How do experiences reshape our internal representations of the world? @bstaresina.bsky.social &co show that learning sequential experiences reshapes how the #brain represents what we see; a post-learning nap strengthens these predictive changes @plosbiology.org 🧪 plos.io/4dJGwMC

Want to join the Multilingual Minds and Machines Meeting, June 22-23 in Nijmegen? Registration is open until 1 May! mmmm2026.github.io

New preprint from my lab! We study how reinforcement learning & selective attention interact. To do so, we built a set of models describing different ways that value & reward prediction error can modulate top-down attention. We compare model outcomes to monkey data from a color value learning task

“Our findings suggest that although respondents believe that questionable research practices should not be used, they conceded there are systemic reasons some use them.” Open Acc: doi.org/10.1098/rsos... BSky authors: @sarahcaroleo.bsky.social, @jesse-fleming.bsky.social, @bryancook.bsky.social

"you could - by careful choice of an existing scoring method from the literature - find any effect, or nothing, or the reverse of any effect you choose. This is bonkers. ... so extreme as to be farcical." This is the sentiment we were hoping people would come away with! w/@anniria.bsky.social

What can large-scale studies tell us about reproducibility? In our webinar on April 16, researchers from COS, I4R, and META-REP will discuss findings from three papers—one from the recently published SCORE effort—and insights on reproducibility, transparency, and credibility cos-io.zoom.us/webin...

Kern et al. estimate that a "replay" signal in MEG would need to be unrealistically strong/frequent to be statistically detectable using temporally delayed linear modelling (TDLM). #sleeppeeps (love this "experiment visualization" format)

“Still WEIRD, still underreported: An updated benchmark for psychological science” doi.org/10.1037/amp0...

I'm sorry but it's going to be one of those posts

97% (positive results) vs 80%(null results) chance of reviewer recommending acceptance

Many folk are surprised to discover thay Risk of Bias assessment tools tend not to interrogate the question “Did this study actually happen? And are its results trustworthy enough to believe?” Jack’s Cochrane endorsed INSPECT-SR checks have done a lot to mainstream such Trustworthiness Assessment.

What makes behavioral interventions work beyond the psychological theory they implement? Their format, level of engagement, delivery modality? In a new paper analyzing 274 interventions from 15 megastudies (4.1M+ participants), we tested 19 features: www.sciencedirect.com/science/arti... 1/2

== Effect Size and Confidence Intervals (ESCI) check == Lots improved. Has a revamped website and R package on CRAN. Works like statcheck, also checks effect sizes and calculates confidence intervals. Tricky countless edge cases, but after testing it on 1000s of articles, seems pretty decent.

Big Team Science version of no real transfer of effects

Ideologically rating social science academic article abstracts (using a fixed contemporary ideological scale) finds that 90% lean left & all disciplines showed leftward movement from 1990-2024, especially on cultural issues. link.springer.com/article/10.1...

250 participants, 33 models: we have preliminary winners of our machine-learning competition to forecast depression onset! We're now looking into variable importance & will write up the paper. Preliminray results here (click "Development & Testing" left side). www.codabench.org/competitions...

How do we know if research is credible? In Abatayo et al., 86 of us combined evidence across the SCORE program including replicability, reproducibility, robustness, human and machine assessments to understand relationships among many potential credibility measures. 1/ Paper: osf.io/preprints/me...

Come join us! We have two research coordinator positions open with the Stanford IRISS predoctoral program, a program designed to mentor students for graduate study: LEVANTE: careersearch.stanford.edu/jobs/iriss-p... BabyView: careersearch.stanford.edu/jobs/iriss-p... (deadline 5/1)

Three recent papers examined reproducibility of a large sample of findings. Join this webinar to discuss them and explore where the findings converge and differ. 1. SCORE: www.nature.com/articles/s41... 2. I4R: www.nature.com/articles/s41... 3. Meta-Rep: royalsocietypublishing.org/rsos/article...

This is a belated post about our paper in @poqjournal.bsky.social. We analyzed 100 survey experiments fielded by TESS (tessexperiments.org), using only information from the proposals to identify intended hypotheses. Here are some of the things we learned:

Interested in the latest evidence on reproducibility across social and behavioral research? 📑 Don’t miss this opportunity to learn from these researchers and large-scale initiatives shaping the future of open science.

Issue 39 of #rdmweekly is out! 📬 It includes: ➡️ Working Smarter with {dplyr} 1.2.0 @ivelasq3.bsky.social ➡️ Computational Reproducibility: A Primer from @ukrepro.bsky.social ➡️ SCORE: Systematizing Confidence in Open Research and Evidence @cos.io and more! rdmweekly.substack.com/p/rdm-weekly...

Bumblebees surprise scientists by showing a sense of rhythm www.newscientist.com/article/2522...

Finally, here is a press release that is our briefest summary of the program and findings. Go here if you want to spend <5 minutes on SCORE: www.cos.io/about/news/l...

So very excited to see the SCORE papers finally put in @nature.com with @cos.io led by @briannosek.bsky.social and colleagues. Working on SCORE was gruelling but has been tremendously rewarding. Special props to team leaders that we worked with, like Andrew Tyner! www.science.org/content/arti...

These are essential questions to be asking right now. Ignoring the power of these models (which are only getting smarter by the month) is a recipe for professional obsolescence for one's self and their students.

Can published findings be reproduced from the same data + same analysis? As part of SCORE, Miske and 127 co-authors tested this across social and behavioral science papers from 2009–2018. www.nature.com/articles/s41... OA: osf.io/preprints/me... 1/

🚨Two weeks away!🚨 Reminder that our first workshop of the year will happen in two weeks featuring @russpoldrack.org. 🧠 Better Code, Better Science 📅22 April 2026 🔗Register: forms.gle/WRUdGQEpd5is... #OHBM #OpenScience

Majestic, well done @rickcarlsson.bsky.social

📣 Exciting news: As we've been unable to decide which is the best open-source package for psychology (PsychoPy, Open Sesame or jsPsych) @peircej.bsky.social, @cogsci.nl and @joshdeleeuw.bsky.social have agreed to resolve this once and for all, in a live-streamed, three-way.....arm wrestle!

🚨 We're hiring! 🚨 I'm looking for a postdoctoral researcher to join my ERC-funded project on fetal brain development in multilingual contexts. 🧠 🤰🗣️ 📍Aix-en-Provence/Marseille, France 📅 Start: September 2026 Full ad: olgakepinska.com/wp-content/u... Please reach out with any questions!

Dense sampling of a few people to study intra-individual variability. Results show that nucleus accumbens BOLD response to reward has low test-retest reliability. Contributing factors are mood and alertness (variability is meaningful). V. cool!🤩 I was reading the introduction and intensely nodding!

Recognizing reproducibility and reusability in times of fast science www.nature.com/articles/s42...

Periodic reminder that citation ethics are “a crucial, though underappreciated, part of academic reading and writing” osf.io/preprints/ps...

🚨new lab preprint; brain fingerprinting entirely revisited: Can we differentiate individuals from just seconds of neurophysiological recordings with machine learning, without resorting to black-box approaches? In this work, Maxence Lapatrie says 'yes'. www.biorxiv.org/content/10.6...

🚨Our new preprint, driven by @xiaoboliu.bsky.social and @alexwiesman.bsky.social. @theneuro.bsky.social @crchum.bsky.social

Thank you to @aaas.org for the opportunity to lead a new editorial pod at Science Advances on Systems, Computational, Neuro-AI & Neurotechnology (SCANN). Top opportunity to highlight outstanding work at the intersection of neuroscience, computation, and emerging technologies. Send your papers now!

Visual #workingmemory peeps, you're going to love this. This is super challenging - might give you pause on how we are measuring color memory... My color memory is a 40.4/50. Please do worse so I feel better. dialed.gg?c=3PCHDE

𝗥𝗲𝗽𝗿𝗲𝘀𝗲𝗻𝘁𝗮𝘁𝗶𝗼𝗻𝘀 𝗶𝗻 𝗺𝗮𝗰𝗵𝗶𝗻𝗲 𝗹𝗲𝗮𝗿𝗻𝗶𝗻𝗴 𝗮𝗻𝗱 𝗯𝗿𝗮𝗶𝗻𝘀 Great paper discussing the challenges of understanding brain representations and the models-brain correspondence #neuroskyence t.co/9l1VU6Pox1

Becoming a parent is much more detrimental to women’s academic careers than it is to men’s Read the full story: go.nature.com/4v4rxmQ

Super excited to see the first paper from my PhD out! 🐭 Very satisfying to get to build an interpretable model of how the brain does a thing. A nice palette cleanser in the current sea of LLMs and deep ML.

Is "big-team science" more generalizable? These authors argue it creates an illusion of generalizability. For what it's worth, these critiques apply to my work too! www.nature.com/articles/s41... @hcp4715.bsky.social

CodaNote: Collaborative Markdown/Quarto/Rmarkdown People were looking for collaborating on MD family files with knit rendering... I built this tool for CORE team, works like Google Docs. Opened it to all from internal use so everyone can use it. Feedback welcome! Try: codanote.vercel.app

🎉 ggauto is now on CRAN 🎉 An #RStats package that selects better chart types, and provides more accessible styling for #ggplot2 plots 📊 Blog post explaining why I made it and how it works: nrennie.rbind.io/blog/introdu... #DataViz