Cengiz Pehlevan
@cpehlevan.bsky.social
📤 1131
📥 354
📝 12
theory of neural networks for natural and artificial intelligence
https://pehlevan.seas.harvard.edu/
pinned post!
We collected lecture notes and blog posts by group members about recent topics in deep learning theory here. Hope it is useful!
pehlevan.seas.harvard.edu/resources-0
over 1 year ago
1
44
14
reposted by
Cengiz Pehlevan
Kempner Institute at Harvard University
3 days ago
📢 Just announced! Join us for the
#KempnerInstitute
workshop “Learning Dynamics in Natural and Artificial Intelligence: Evolution, Adaptation, and the Foundations of Efficient Learning.” Learn more, register, or submit an abstract 👉
bit.ly/3QwJlHR
loading . . .
Learning Dynamics in Natural and Artificial Intelligence - Kempner Institute
This workshop will convene researchers from artificial intelligence, neuroscience, cognitive science, and related disciplines to examine the principles governing learning and training dynamics across ...
https://bit.ly/3QwJlHR
1
11
5
reposted by
Cengiz Pehlevan
Jacob Zavatone-Veth
12 days ago
Tremendously excited to announce that I will be joining
@rockefeller.edu
as an Assistant Professor and Head of Lab starting in January 2027! My group will be broadly focused on theoretical neuroscience, and mathematical problems in neural computation in the large.
9
96
19
Congratulations, Jacob! We’ve been extremely lucky to have you at Harvard. Can’t wait to see the exciting science that comes out of your lab.
add a skeleton here at some point
11 days ago
1
9
0
reposted by
Cengiz Pehlevan
Kempner Institute at Harvard University
11 days ago
New blog post: Jailbreak Scaling Laws for
#LLMs
Prompt-injection attacks can boost jailbreak success from slow polynomial to exponential growth as inference-time samples increase. New on the Deeper Learning blog:
bit.ly/4eK3ZfC
#AI
@cpehlevan.bsky.social
loading . . .
Jailbreak Scaling Laws for Large Language Models: Polynomial–Exponential Crossover - Kempner Institute
We find that adversarial prompt-injection attacks on large language models can amplify attack success rate from the slow polynomial growth observed without injection to exponential growth with the num...
https://bit.ly/4eK3ZfC
0
2
1
reposted by
Cengiz Pehlevan
David G. Clark
2 months ago
New preprint: "Linear equivalence of nonlinear recurrent neural networks." For large nonlinear (potentially chaotic) RNNs with random connectivity, the full N×N covariance matrix takes the same form as that of a ~linear~ network with the same couplings, driven by independent noise.
loading . . .
Linear equivalence of nonlinear recurrent neural networks
Large nonlinear recurrent neural networks with random couplings generate high-dimensional, potentially chaotic activity whose structure is of interest in neuroscience, machine learning, ecology, and o...
https://arxiv.org/abs/2604.23489
1
53
22
reposted by
Cengiz Pehlevan
Kempner Institute at Harvard University
2 months ago
🚀 Starting Day 1 of
#ICLR2026
with an exciting lineup of presentations from researchers at the
#KempnerInstitute
! Take a look at the full list of today’s Kempner talks 👇
@iclr-conf.bsky.social
#AI
#NeuroAI
@satpreetsingh.bsky.social
@kanakarajanphd.bsky.social
@annhuang42.bsky.social
1
14
3
reposted by
Cengiz Pehlevan
Kempner Institute at Harvard University
3 months ago
🧠👃A new study by
#KempnerInstitute
associate faculty member Venkatesh Murthy & collaborators shows that maximizing information recreates an olfactory design shared by multiple species. Out now in
@pnas.org
:
bit.ly/4uQ6Omw
@neurovenki.bsky.social
@jzv.bsky.social
#neuroscience
loading . . .
New AI-based Framework Could Explain Why Evolution Gave So Many Species the Same Smell Circuit - Kempner Institute
Why do the smell circuits of flies, mice, and humans look so remarkably alike? A new study from Harvard researchers offers a possible explanation: this shared design may be the […]
https://bit.ly/4uQ6Omw
0
16
3
reposted by
Cengiz Pehlevan
Kempner Institute at Harvard University
4 months ago
NEW:
#Kempner
researchers develop a mean-field theory of task-trained RNNs that bridges random and learned connectivity—and find macaque motor cortex is best captured by an intermediate, task-specific recurrent structure. Read the blog post 👇 🔗
bit.ly/47f3Ldl
2
24
9
reposted by
Cengiz Pehlevan
David G. Clark
4 months ago
I am totally pumped about this new work . "Task-trained RNNs" are a powerful and influential framework in neuroscience, but have lacked a firm theoretical footing. This work provides one, and makes direct contact with the classical theory of random RNNs:
www.biorxiv.org/content/10.6...
2
92
36
reposted by
Cengiz Pehlevan
Aran Nayebi
4 months ago
Looking forward to presenting on "How behavior shapes recurrent circuits across sensory systems and species: from vision to touch" at the University of Chicago Neuroscience and ML workshop on Wednesday! Details below 👇🧵
1
16
5
reposted by
Cengiz Pehlevan
Mohammad Yaghoubi
6 months ago
I’m deeply thankful to my supervisor, Mark Brandon (
@markbrandonlab.bsky.social
) for his patience, guidance, and constant support throughout this project, and to our collaborators in the Cengiz Pehlevan (
@cpehlevan.bsky.social
) lab at Harvard for their thoughtful and generous contributions.
0
2
1
reposted by
Cengiz Pehlevan
M Ganesh Kumar
6 months ago
All theory is wrong until verified by data. Greatly indebted to
@mhyaghoubi.bsky.social
,
@markbrandonlab.bsky.social
,
@douglasresearch.bsky.social
for finding the hippocampus encoding reward prediction! Grateful to my advisor
@cpehlevan.bsky.social
,
@kempnerinstitute.bsky.social
.
#RL
#hippocampus
add a skeleton here at some point
0
32
10
Delighted to have contributed to this work. Huge kudos to everyone involved.
add a skeleton here at some point
6 months ago
1
14
2
reposted by
Cengiz Pehlevan
Mark Brandon
6 months ago
I’m very happy to share the latest from my lab published in @Nature Hippocampal neurons that initially encode reward shift their tuning over the course of days to precede or predict reward. Full text here:
rdcu.be/eY5nh
2
106
34
reposted by
Cengiz Pehlevan
David G. Clark
7 months ago
Very excited about this new work from the omnipotent Owen, with me and Ashok Litwin-Kumar! Can we reconcile low- and high-dimensional activity in neural circuits by recognizing that these circuits ~multitask~? (Plausibly, yes 😊)
add a skeleton here at some point
0
31
4
reposted by
Cengiz Pehlevan
Kempner Institute at Harvard University
8 months ago
Congratulations to
#KempnerInstitute
community members
@msalbergo.bsky.social
and
@mweber.bsky.social
— recipients of
@schmidtsciences.bsky.social
AI2050 Fellowships! 🎉 Discover their innovative research shaping the future of AI 👉
bit.ly/47Do4R3
#AI
loading . . .
Schmidt Sciences Awards Early Career Fellowships to Michael Albergo, Melanie Weber - Kempner Institute
Two Kempner Institute community members have received AI2050 Fellowships from Schmidt Sciences, a nonprofit organization aimed at accelerating scientific knowledge and breakthroughs. The AI2050 Progra...
https://bit.ly/47Do4R3
0
13
4
reposted by
Cengiz Pehlevan
Paul Masset
8 months ago
First paper from the lab! We propose a model that separates estimation of odor concentration and presence and map it on olfactory bulb circuits Led by
@chenjiang01.bsky.social
and
@mattyizhenghe.bsky.social
joint work with
@jzv.bsky.social
and with
@neurovenki.bsky.social
@cpehlevan.bsky.social
add a skeleton here at some point
2
39
14
reposted by
Cengiz Pehlevan
David G. Clark
8 months ago
Now in PRX: Theory linking connectivity structure to collective activity in nonlinear RNNs! For neuro fans: conn. structure can be invisible in single neurons but shape pop. activity For low-rank RNN fans: a theory of rank=O(N) For physics fans: fluctuations around DMFT saddle⇒dimension of activity
loading . . .
Connectivity Structure and Dynamics of Nonlinear Recurrent Neural Networks
The structure of brain connectivity predicts collective neural activity, with a small number of connectivity features determining activity dimensionality, linking circuit architecture to network-level...
https://journals.aps.org/prx/abstract/10.1103/2jt7-c8cq
2
60
18
reposted by
Cengiz Pehlevan
David G. Clark
8 months ago
scipost.org/SciPostPhysL...
loading . . .
SciPost: SciPost Phys. Lect. Notes 105 (2025) - Simplified derivations for high-dimensional convex learning problems
SciPost Journals Publication Detail SciPost Phys. Lect. Notes 105 (2025) Simplified derivations for high-dimensional convex learning problems
https://scipost.org/SciPostPhysLectNotes.105
0
9
2
reposted by
Cengiz Pehlevan
Blake Bordelon
9 months ago
Applying to do a postdoc or PhD in theoretical ML or neuroscience this year? Consider joining my group (starting next Fall) at UT Austin! POD Postdoc:
oden.utexas.edu/programs-and...
CSEM PhD:
oden.utexas.edu/academics/pr...
1
32
11
reposted by
Cengiz Pehlevan
arXiv q-bio.NC Neurons and Cognition
9 months ago
William Qian, Cengiz Pehlevan: Discovering alternative solutions beyond the simplicity bias in recurrent neural networks
https://arxiv.org/abs/2509.21504
https://arxiv.org/pdf/2509.21504
https://arxiv.org/html/2509.21504
0
7
3
reposted by
Cengiz Pehlevan
Data on the Brain & Mind @NeurIPS2025
10 months ago
⏳ Less than 1 day left until the Brain & Mind Workshop submission deadline! 🔍 Submit to our Finding or Tutorials track on OpenReview. Findings track submission:
openreview.net/group?id=Neu...
Tutorial track submission:
openreview.net/group?id=Neu...
More info:
data-brain-mind.github.io
loading . . .
NeurIPS 2025 Workshop DBM Findings
Welcome to the OpenReview homepage for NeurIPS 2025 Workshop DBM Findings
https://openreview.net/group?id=NeurIPS.cc/2025/Workshop/DBM/Findings
0
3
1
reposted by
Cengiz Pehlevan
Jacob Zavatone-Veth
10 months ago
Since I'm back on BlueSky - with
@frostedblakess.bsky.social
and
@cpehlevan.bsky.social
we wrote a brief perspective on how ideas about summary statistics from the statistical physics of learning could potentially help inform neural data analysis... (1/2)
loading . . .
Frontiers | Summary statistics of learning link changing neural representations to behavior
How can we make sense of large-scale recordings of neural activity across learning? Theories of neural network learning with their origins in statistical phy...
https://www.frontiersin.org/journals/neural-circuits/articles/10.3389/fncir.2025.1618351/full
1
34
9
reposted by
Cengiz Pehlevan
Venki Murthy
10 months ago
Excited to share new computational work, led by
@jzv.bsky.social
, driven by Juan Carlos Fernandez del Castillo + contribution from Farhad Pashakanloo. We recover 3 core motifs in the olfactory system of evolutionarily distant animals using a biophysically-grounded model + efficient coding ideas!
loading . . .
Convergent motifs of early olfactory processing are recapitulated by layer-wise efficient coding
The architecture of early olfactory processing is a striking example of convergent evolution. Typically, a panel of broadly tuned receptors is selectively expressed in sensory neurons (each neuron exp...
https://www.biorxiv.org/content/10.1101/2025.09.03.673748v1
0
24
12
reposted by
Cengiz Pehlevan
Patrick Shafto
10 months ago
Great to have this video about my
@darpa.mil
Artificial Intelligence Quantified (AIQ) program out! Very exciting program with absolutely fantastic teams. Stay tuned for some jaw dropping announcements!
www.youtube.com/watch?v=KVRF...
loading . . .
AIQ: Artificial Intelligence Quantified
YouTube video by DARPAtv
https://www.youtube.com/watch?v=KVRFUBeKnhI
0
7
1
reposted by
Cengiz Pehlevan
M Ganesh Kumar
10 months ago
I am extremely grateful to be awarded the National University of Singapore (NUS) Development Grant, and to be a Young NUS Fellow! Look forward to collaborating with the Yong Loo Lin School of Medicine on exciting projects. This is my first grant and hopefully many more to come!
#NUS
#NeuroAI
1
8
1
reposted by
Cengiz Pehlevan
Simons Foundation
11 months ago
Our new Simons Collaboration on the Physics of Learning and Neural Computation will develop powerful tools from
#physics
,
#math
, computer science and theoretical
#neuroscience
to understand how large neural networks learn, compute, scale, reason and imagine:
www.simonsfoundation.org/2025/08/18/s...
loading . . .
Simons Foundation Launches Collaboration on the Physics of Learning and Neural Computation
Simons Foundation Launches Collaboration on the Physics of Learning and Neural Computation on Simons Foundation
https://www.simonsfoundation.org/2025/08/18/simons-foundation-launches-collaboration-on-the-physics-of-learning-and-neural-computation/
0
21
8
reposted by
Cengiz Pehlevan
Sam Gershman
11 months ago
If you work on artificial or natural intelligence and are finishing your PhD, consider applying for a Kempner research fellowship at Harvard:
kempnerinstitute.harvard.edu/kempner-inst...
loading . . .
Kempner Research Fellowship - Kempner Institute
The Kempner brings leading, early-stage postdoctoral scientists to Harvard to work on projects that advance the fundamental understanding of intelligence.
https://kempnerinstitute.harvard.edu/kempner-institute-research-fellowship/
0
48
31
reposted by
Cengiz Pehlevan
Kempner Institute at Harvard University
11 months ago
Congratulations to
#KempnerInstitute
associate faculty member
@cpehlevan.bsky.social
for joining the new
@simonsfoundation.org
Simons Collaboration on the Physics of Learning and Neural Computation!
www.simonsfoundation.org/2025/08/18/s...
#AI
#neuroscience
#NeuroAI
#physics
#ANNs
loading . . .
Simons Foundation Launches Collaboration on the Physics of Learning and Neural Computation
Simons Foundation Launches Collaboration on the Physics of Learning and Neural Computation on Simons Foundation
https://www.simonsfoundation.org/2025/08/18/simons-foundation-launches-collaboration-on-the-physics-of-learning-and-neural-computation/
0
14
3
reposted by
Cengiz Pehlevan
Surya Ganguli
11 months ago
Very excited to lead this new
@simonsfoundation.org
collaboration on the physics of learning and neural computation to develop powerful tools from physics, math, CS, stats, neuro and more to elucidate the scientific principles underlying AI. See our website for more:
www.physicsoflearning.org
add a skeleton here at some point
4
91
15
reposted by
Cengiz Pehlevan
Data on the Brain & Mind @NeurIPS2025
11 months ago
🚨 Excited to announce our
#NeurIPS2025
Workshop: Data on the Brain & Mind 📣 Call for: Findings (4- or 8-page) + Tutorials tracks 🎙️ Speakers include
@dyamins.bsky.social
@lauragwilliams.bsky.social
@cpehlevan.bsky.social
🌐 Learn more:
data-brain-mind.github.io
0
31
13
reposted by
Cengiz Pehlevan
Kempner Institute at Harvard University
11 months ago
The post is based on a paper written with Yue M. Lu.,
@jzv.bsky.social
, Anindita Maiti and
@cpehlevan.bsky.social
evan. Check it out now at PNAS:
doi.org/10.1073/pnas...
(2/2)
loading . . .
PNAS
Proceedings of the National Academy of Sciences (PNAS), a peer reviewed journal of the National Academy of Sciences (NAS) - an authoritative source of high-impact, original research that broadly spans...
https://doi.org/10.1073/pnas.2502599122
0
2
1
reposted by
Cengiz Pehlevan
Kempner Institute at Harvard University
11 months ago
New in the
#DeeperLearningBlog
: the
#KempnerInstitute's
Mary Letey presents work recently published in PNAS that offers generalizable insights into in-context learning (ICL) in an analytically-solvable model architecture.
bit.ly/4lPK15p
#AI
@pnas.org
(1/2)
loading . . .
Solvable Model of In-Context Learning Using Linear Attention - Kempner Institute
Attention-based architectures are a powerful force in modern AI. In particular, the emergence of in-context learning enables these models to perform tasks far beyond the original next-token prediction...
https://kempnerinstitute.harvard.edu/research/deeper-learning/solvable-model-of-in-context-learning-using-linear-attention/
1
6
4
reposted by
Cengiz Pehlevan
Anirvan Sengupta
12 months ago
At
#ICML2025
, presenting work done at
@flatironinstitute.org
w Matt Smart and
@albertobietti.bsky.social
on in-context denoising (
arxiv.org/abs/2502.05164
). Come to Matt’s oral, Thursday, 4:15-4:30 PM, West Ballroom A, and see us right after at poster
#E-3207
, 4:30-7:00 PM, East Exhibition Hall A-B.
loading . . .
In-context denoising with one-layer transformers: connections between attention and associative memory retrieval
We introduce in-context denoising, a task that refines the connection between attention-based architectures and dense associative memory (DAM) networks, also known as modern Hopfield networks. Using a...
https://arxiv.org/abs/2502.05164
0
5
3
Great to see this one finally out in PNAS! Asymptotic theory of in-context learning by linear attention
www.pnas.org/doi/10.1073/...
Many thanks to my amazing co-authors Yue Lu, Mary Letey, Jacob Zavatone-Veth
@jzv.bsky.social
and Anindita Maiti!
loading . . .
Asymptotic theory of in-context learning by linear attention | PNAS
Transformers have a remarkable ability to learn and execute tasks based on examples provided within the input itself, without explicit prior traini...
https://www.pnas.org/doi/10.1073/pnas.2502599122
12 months ago
1
23
5
reposted by
Cengiz Pehlevan
SfN Journals
about 1 year ago
#eNeuro
: Obeid and Miller identify distinct neural computations in the primary visual cortex that explain how surrounding context suppresses perception of visual figures and features. @harvardseas.bsky.social
vist.ly/3n6tfb2
0
5
2
reposted by
Cengiz Pehlevan
David Lipshutz
about 1 year ago
📣 Grad students and postdocs in computational and theoretical neuroscience: please consider applying for the 2025 Flatiron Institute Junior Theoretical Neuroscience Workshop! All expenses are covered. Apply by April 14.
jtnworkshop2025.flatironinstitute.org
add a skeleton here at some point
0
21
16
reposted by
Cengiz Pehlevan
M Ganesh Kumar
over 1 year ago
New preprint! We trained an RNN using RL to solve a decision making task used to characterize suboptimal decision making by Schizophrenic patients. First project exploring comp psych models, thanks to
@adam-manoogian.bsky.social
@shawnrhoadsphd.bsky.social
@bqian.bsky.social
@cpehlevan.bsky.social
add a skeleton here at some point
1
10
5
reposted by
Cengiz Pehlevan
Paul Masset
over 1 year ago
Honoured to have been selected as a
#SloanFellow
Thankful for all the support from family, mentors, collaborators, colleagues and students along the way!
@sloanfoundation.bsky.social
add a skeleton here at some point
3
48
9
reposted by
Cengiz Pehlevan
David G. Clark
over 1 year ago
(1/30) New preprint! "Symmetries and continuous attractors in disordered neural circuits" with Larry Abbott and Haim Sompolinsky bioRxiv:
www.biorxiv.org/content/10.1...
loading . . .
Symmetries and Continuous Attractors in Disordered Neural Circuits
A major challenge in neuroscience is reconciling idealized theoretical models with complex, heterogeneous experimental data. We address this challenge through the lens of continuous-attractor networks...
https://www.biorxiv.org/content/10.1101/2025.01.26.634933
7
96
36
reposted by
Cengiz Pehlevan
Venki Murthy
over 1 year ago
Theory in neuroscience, you say? How about this preprint by
@david-g-clark.bsky.social
, with a couple of others you might recognize? :-)
#neuroscience
loading . . .
Symmetries and continuous attractors in disordered neural circuits
A major challenge in neuroscience is reconciling idealized theoretical models with complex, heterogeneous experimental data. We address this challenge through the lens of continuous-attractor networks...
https://www.biorxiv.org/content/10.1101/2025.01.26.634933v1
0
35
10
reposted by
Cengiz Pehlevan
M Ganesh Kumar
over 1 year ago
Our preprint with
@frostedblakess.bsky.social
,
@jzv.bsky.social
,
@cpehlevan.bsky.social
is out! We develop a simple reinforcement learning model that recapitulates 3 disparate hippocampal dynamics. With ablation studies, these representations improve the speed and flexibility of policy learning.
3
16
6
reposted by
Cengiz Pehlevan
Jacob Zavatone-Veth
over 1 year ago
The official ad for this postdoc position is now (finally) live, see
academicpositions.harvard.edu/postings/14486
!
loading . . .
Postdoctoral Fellow in Theoretical & Computational Neuroscience
Postdoctoral positions are available in Jacob Zavatone-Veth’s research group at Harvard's Center for Brain Science. We are broadly interested in the theory of neural computation; see jzv.io for more i...
https://academicpositions.harvard.edu/postings/14486
2
10
5
reposted by
Cengiz Pehlevan
Blake Bordelon
over 1 year ago
Come by at Neurips to hear Hamza present about properties of various feature learning infinite parameter limits of transformer models. Poster in Hall A-C #4804 at 11 AM PST Paper
arxiv.org/abs/2405.15712
, code
github.com/Pehlevan-Gro...
Work with Hamza Chaudhry and
@cpehlevan.bsky.social
0
17
3
reposted by
Cengiz Pehlevan
over 1 year ago
Excited to share my
#NeurIPS2024
paper with
@jzv.bsky.social
, @BenjaminSRuben, and
@cpehlevan.bsky.social
on mechanistic mismatches in data-constrained models of neural dynamics! (1/n)
1
37
13
reposted by
Cengiz Pehlevan
David G. Clark
over 1 year ago
(1/5) Fun fact: Several classic results in the stat. mech. of learning can be derived in a couple lines of simple algebra! In this paper with Haim Sompolinsky, we simplify and unify derivations for high-dimensional convex learning problems using a bipartite cavity method.
arxiv.org/abs/2412.01110
loading . . .
Simplified derivations for high-dimensional convex learning problems
Statistical physics provides tools for analyzing high-dimensional problems in machine learning and theoretical neuroscience. These calculations, particularly those using the replica method, often invo...
https://arxiv.org/abs/2412.01110
2
57
17
reposted by
Cengiz Pehlevan
Kempner Institute at Harvard University
over 1 year ago
NEW: we have an exciting opportunity for a tenure-track professor at the
#KempnerInstitute
and the John A. Paulson School of Engineering and Applied Sciences (SEAS). Read the full description & apply today:
academicpositions.harvard.edu/postings/14362
#ML
#AI
0
20
20
reposted by
Cengiz Pehlevan
Venki Murthy
over 1 year ago
Glad to share this theory paper on learning to align neural representations with sparse connectivity. Work led by graduate student
@leo-bo-liu.bsky.social
, in a wonderful collaboration with Yuhai Tu from IBM Research and
@shanq.bsky.social
from Flatiron Institute.
#neuroscience
🧪
loading . . .
One nose but two nostrils: Learning to align with sparse connections between two olfactory cortices
Sparse connectivity between brain hemispheres is sufficient to learn and achieve bilateral alignment based on a realistic local learning rule.
https://journals.aps.org/prxlife/abstract/10.1103/PRXLife.2.043016
1
39
7
reposted by
Cengiz Pehlevan
Venki Murthy
over 1 year ago
We recently found that odor information across the 2 cortical hemispheres is highly coordinated despite the distributed & fragmented sensory representations. Can this alignment arise from biological realistic, continual, correlation-based synaptic plasticity & sparse inter-hemispheric connections?
loading . . .
Bilateral Alignment of Receptive Fields in the Olfactory Cortex
Each olfactory cortical hemisphere receives ipsilateral odor information directly from the olfactory bulb and contralateral information indirectly from the other cortical hemisphere. Since neural proj...
https://www.eneuro.org/content/11/11/ENEURO.0155-24.2024
1
2
1
reposted by
Cengiz Pehlevan
Sam Gershman
over 1 year ago
Some evidence for grokking in piriform cortex:
arxiv.org/abs/2411.03541
joint effort from Tanishq Kumar, Blake Bordelon,
@neurovenki.bsky.social
,
@cpehlevan.bsky.social
.
loading . . .
Do Mice Grok? Glimpses of Hidden Progress During Overtraining in Sensory Cortex
Does learning of task-relevant representations stop when behavior stops changing? Motivated by recent theoretical advances in machine learning and the intuitive observation that human experts continue...
https://arxiv.org/abs/2411.03541
1
19
8
Load more
feeds!
log in