Interpretable compositional computation with recurrent neural networks https://www.biorxiv.org/content/10.64898/2026.06.23.733979v1

Woooooo!!! 🔥🔥🔥

Episode #41 in #TheoreticalNeurosciencePodcast: On functional effects of neuronal heterogeneity – with David Dahmen theoreticalneuroscience.no/thn41 While network modelers often assume all neurons to be the same, biology says different. Can this hetereogeneity be a good thing?

Do RL agents really need to replan from scratch for every new goal? Why do rodents "preplay" goals they haven't pursued? We think these questions share a candidate answer.

Now in PRE: "Transient dynamics of associative memory models." I argue that the "blackout catastrophe" is not catastrophic when viewed from an out-of-equilibrium, dynamical perspective. Journal: journals.aps.org/pre/abstract/10.1103/42y2-bsh1 PDF: dclark.io/media/clark-...

Super excited to (finally!) show our work on identifying cell types! Now in press www.nature.com/articles/s41.... We show how to identify cell types from ephys recordings *without* optotagging. This opens the study of not just individual cell types, but the interacting neural circuit during behavior

New preprint out 🚨 “Predictive pursuit emerges in high-dimensional recurrent neural networks”! This was an awesome collaboration with co-first author @fatihdinc.bsky.social , @andyalexander.bsky.social, @xiaoxiao-lin.bsky.social, and May Chen biorxiv.org/content/10.6... 1/

New preprint: "Linear equivalence of nonlinear recurrent neural networks." For large nonlinear (potentially chaotic) RNNs with random connectivity, the full N×N covariance matrix takes the same form as that of a ~linear~ network with the same couplings, driven by independent noise.

📢🔥 My lab is recruiting a PhD student - join us! Apply before April 29 🧠💻🇳🇴 www.jobbnorge.no/en/available...

Applications are open for the Junior Theoretical Neuroscientists Workshop which will take place July 21-24, 2026 at the Center for Computational Neuroscience, @flatironinstitute.org Travel, lodging, and meals will be covered for accepted participants. Application deadline: April 15, 2026

What do moonwalking flies teach us about fear, avoidance, and the brain? Come to my short talk and lab visit in #nyc @zuckermanbrain.bsky.social @columbiauniversity.bsky.social next Tues 7pm to find out! www.eventbrite.com/e/late-night...

Cosyne invited me to give a long tutorial (4 hours!) on methods to quantify differences high-d neural recordings across animals, brain regions, deep neural nets, etc. The recording is up on youtube. I hope it inspires more research on this fundamental topic! www.youtube.com/watch?v=n44x...

In Lisbon for @cosynemeeting.bsky.social 2026! ☀️☀️☀️☀️☀️ I'm very excited about the following posters, each associated with a preprint.

🔥

I have just arrived at @cosynemeeting.bsky.social ! During my flight, as I thought about opening remarks (and had a glass of wine), I got to reflect on why I love neuroscience. Maybe other folks are doing the same and would like to read or add, so I thought I'd do something unusual and share!

🤯

New paper hot off the (pre-)press! We dig into the evolutionary origins of neural computations for behavioral control across mice, monkeys, and humans: www.biorxiv.org/content/10.6.... As our lab's first foray into comparative analysis of neural dynamics, I’m super excited about this work! 1/18

Very clear & interesting blog post from @annhuang42.bsky.social and @kanakarajanphd.bsky.social on their paper!

Excited to share our new paper to be published in Neuron! With Valentin Schmutz @bio-emergent.bsky.social and Wulfram Gerstner @gerstnerlab.bsky.social, we explore how circuit structure in RNNs shapes network computation and single-neuron responses. www.sciencedirect.com/science/arti...

NEW: #Kempner researchers develop a mean-field theory of task-trained RNNs that bridges random and learned connectivity—and find macaque motor cortex is best captured by an intermediate, task-specific recurrent structure. Read the blog post 👇 🔗 bit.ly/47f3Ldl

I am totally pumped about this new work . "Task-trained RNNs" are a powerful and influential framework in neuroscience, but have lacked a firm theoretical footing. This work provides one, and makes direct contact with the classical theory of random RNNs: www.biorxiv.org/content/10.6...

With this one in print, I think I finally earned that PhD... 😅 Presented for the first time at the cosyne when the world ended (March 2020). I'll bring over a summary thread from twitter when it was still twitter... www.sciencedirect.com/science/arti...

The cerebellum supports high-level language?? Now out in @cp-neuron.bsky.social, we systematically examined language-responsive areas of the cerebellum using precision fMRI and identified a *cerebellar satellite* of the neocortical language network! authors.elsevier.com/a/1mUU83BtfH... 1/n 🧵👇

By the way, if you’re interested in working together on problems like this, I’m starting my lab at UCSF this summer. Get in touch if you’re interested in doing a postdoc! More info here: wj2.github.io/postdoc_ad (7/7)

Excited to be giving the van Vreeswijk Theoretical Neuroscience Seminar this Wednesday, Jan 14, where I'll talk about "Computation Through Neuronal-Synaptic Dynamics"! www.wwtns.online

1/n: A new collaborative preprint from the lab to start the year: "A multi-ring shifter network computes head direction in zebrafish" together with Siyuan Mei, Martin Stemmler and Andreas Herz from the LMU, Munich.

Excited and honored to be speaking at this ICLR workshop on associative memory in Rio!

Bichan Wu (@bichanw.bsky.social) & I wrote a tutorial paper on Reduced Rank Regression (RRR) — the statistical method underlying "communication subspaces" from Semedo et al 2019 — aimed at neuroscientists. arxiv.org/abs/2512.12467

Very excited about this new work from the omnipotent Owen, with me and Ashok Litwin-Kumar! Can we reconcile low- and high-dimensional activity in neural circuits by recognizing that these circuits ~multitask~? (Plausibly, yes 😊)

📍Excited to share that our paper was selected as a Spotlight at #NeurIPS2025! arxiv.org/pdf/2410.03972 It started from a question I kept running into: When do RNNs trained on the same task converge/diverge in their solutions? 🧵⬇️

Our work on training biophysical models with Jaxley is now out in @natmethods.nature.com. Led by @deismic.bsky.social, with @philipp.hertie.ai, @ppjgoncalves.bsky.social & @jakhmack.bsky.social et al. Paper: www.nature.com/articles/s41...

🆒

The term “manifold” comes from “Mannigfaltigkeit,” which is German for “variety” or “multiplicity.” www.quantamagazine.org/what-is-a-ma...

This was a lot of fun! From my side, it started with a technical Q: what's the relation between two-side cavity and path integrals? Turns out it's a fluctuation correction - and amazingly, this also enable the "O(N) rank" theory by @david-g-clark.bsky.social and @omarschall.bsky.social. 🤯

Can confirm this was a fun project! My favorite takeaway is that the (low-but-extensive) rank of a network can be used as a knob for controlling dimensionality while leaving single-neuron properties unchanged.

Simultaneous detection and estimation in olfactory sensing https://www.biorxiv.org/content/10.1101/2025.11.01.686013v1

Now in PRX: Theory linking connectivity structure to collective activity in nonlinear RNNs! For neuro fans: conn. structure can be invisible in single neurons but shape pop. activity For low-rank RNN fans: a theory of rank=O(N) For physics fans: fluctuations around DMFT saddle⇒dimension of activity

I did a QA with Quanta about interpretability and training dynamics! I got to talk about a bunch of research hobby horses and how I got into them.

I’m super excited to finally put my recent work with @behrenstimb.bsky.social on bioRxiv, where we develop a new mechanistic theory of how PFC structures adaptive behaviour using attractor dynamics in space and time! www.biorxiv.org/content/10.1...

🎉 "High-dimensional neuronal activity from low-dimensional latent dynamics: a solvable model" will be presented as an oral at #NeurIPS2025 🎉 Feeling very grateful that reviewers and chairs appreciated concise mathematical explanations, in this age of big models. www.biorxiv.org/content/10.1... 1/2

A great reading list for historical+recent RNN theory

One for the books

I'm excited to share that my new postdoctoral position is going so well that I submitted a new paper at the end of my first week! www.biorxiv.org/content/10.1... A thread below

(1/26) Excited to share a new preprint led by grad student Albert Wakhloo, with me and Larry Abbott: "Associative synaptic plasticity creates dynamic persistent activity." www.biorxiv.org/content/10.1...

Wanted to share a new version (much cleaner!) of a preprint on how connectivity structure shapes collective dynamics in nonlinear RNNs. Neural circuits have highly non-iid connectivity (e.g., rapidly decaying singular values, structured singular-vector overlaps), unlike classical random RNN models.

Very happy about my former mentor Sara Solla having received the Valentin Braitenberg Award for her lifelong contributions to computational neuroscience! Sara will be giving a lecture at the upcoming @bernsteinneuro.bsky.social meeting which you shouldn't miss. bernstein-network.de/en/newsroom/...

Coming March 17, 2026! Just got my advance copy of Emergence — a memoir about growing up in group homes and somehow ending up in neuroscience and AI. It’s personal, it’s scientific, and it’s been a wild thing to write. Grateful and excited to share it soon.

Cool!

#KempnerInstitute research fellow @andykeller.bsky.social and coauthors Yue Song, Max Welling and Nicu Sebe have a new book out that introduces a framework for developing equivariant #AI & #neuroscience models. Read more: kempnerinstitute.harvard.edu/news/kempner... #NeuroAI