🧵Excited to present our latest work at #Neurips25! Together with @avm.bsky.social, we discover 𝐜𝐡𝐚𝐧𝐧𝐞𝐥𝐬 𝐭𝐨 𝐢𝐧𝐟𝐢𝐧𝐢𝐭𝐲: regions in neural networks loss landscapes where parameters diverge to infinity (in regression settings!) We find that MLPs in these channels can take derivatives and compute GLUs 🤯

This was a lot of fun! From my side, it started with a technical Q: what's the relation between two-side cavity and path integrals? Turns out it's a fluctuation correction - and amazingly, this also enable the "O(N) rank" theory by @david-g-clark.bsky.social and @omarschall.bsky.social. 🤯

Lab members are at the Bernstein conference @bernsteinneuro.bsky.social with 9 posters! Here’s the list: TUESDAY 16:30 – 18:00 P1 62 “Measuring and controlling solution degeneracy across task-trained recurrent neural networks” by @flavioh.bsky.social

New in @pnas.org: doi.org/10.1073/pnas... We study how humans explore a 61-state environment with a stochastic region that mimics a “noisy-TV.” Results: Participants keep exploring the stochastic part even when it’s unhelpful, and novelty-seeking best explains this behavior. #cogsci #neuroskyence

🎉 "High-dimensional neuronal activity from low-dimensional latent dynamics: a solvable model" will be presented as an oral at #NeurIPS2025 🎉 Feeling very grateful that reviewers and chairs appreciated concise mathematical explanations, in this age of big models. www.biorxiv.org/content/10.1... 1/2

🧠 “You never forget how to ride a bike”, but how is that possible? Our study proposes a bio-plausible meta-plasticity rule that shapes synapses over time, enabling selective recall based on context

So happy to see this work out! 🥳 Huge thanks to our two amazing reviewers who pushed us to make the paper much stronger. A truly joyful collaboration with @lucasgruaz.bsky.social, @sobeckerneuro.bsky.social, and Johanni Brea! 🥰 Tweeprint on an earlier version: bsky.app/profile/modi... 🧠🧪👩‍🔬

Attending #CCN2025? Come by our poster in the afternoon (4th floor, Poster 72) to talk about the sense of control, empowerment, and agency. 🧠🤖 We propose a unifying formulation of the sense of control and use it to empirically characterize the human subjective sense of control. 🧑‍🔬🧪🔬

Is it possible to go from spikes to rates without averaging? We show how to exactly map recurrent spiking networks into recurrent rate networks, with the same number of neurons. No temporal or spatial averaging needed! Presented at Gatsby Neural Dynamics Workshop, London.

Excited to present at the PIMBAA workshop at #RLDM2025 tomorrow! We study curiosity using intrinsically motivated RL agents and developed an algorithm to generate diverse, targeted environments for comparing curiosity drives. Preprint (accepted but not yet published): osf.io/preprints/ps...

Stoked to be at RLDM! Curious how novelty and exploration are impacted by generalization across similar stimuli? Then don't miss my flash talk in the PIMBAA workshop (tmr at 10:30, E McNabb Theatre) or stop by my poster tmr (#74)! Looking forward to chat 🤩 www.biorxiv.org/content/10.1...

Our new preprint 👀

Interested in high-dim chaotic networks? Ever wondered about the structure of their state space? @jakobstubenrauch.bsky.social has answers - from a separation of fixed points and dynamics onto distinct shells to a shared lower-dim manifold and linear prediction of dynamics.

Episode #22 in #TheoreticalNeurosciencePodcast: On 50 years with the Hopfield network model - with Wulfram Gerstner theoreticalneuroscience.no/thn22 John Hopfield received the 2024 Physics Nobel prize for his model published in 1982. What is the model all about? @icepfl.bsky.social

A cool EPFL News article was written about our recent neurotheory paper on spikes vs rates! Super engaging text by science communicater Nik Papageorgiou. actu.epfl.ch/news/brain-m... Definitely more accessible than the original physics-style, 4.5-page letter 🤓 journals.aps.org/prl/abstract...

Super excited to see my PhD thesis featured by EPFL! 🎓 actu.epfl.ch/news/learnin... P.S.: There's even a French version of the article! It feels so fancy! 😎 👨‍🎨 🇫🇷 actu.epfl.ch/news/apprend...

New round of spike vs rate? The concentration of measure phenomenon can explain the emergence of rate-based dynamics in networks of spiking neurons, even when no two neurons are the same. This is what's shown in the last paper of my PhD, out today in Physical Review Letters 🎉 tinyurl.com/4rprwrw5

Pre-print 🧠🧪 Is mechanism modeling dead in the AI era? ML models trained to predict neural activity fail to generalize to unseen opto perturbations. But mechanism modeling can solve that. We say "perturbation testing" is the right way to evaluate mechanisms in data-constrained models 1/8