How do tokens evolve as they are processed by a deep Transformer? With José A. Carrillo, @gabrielpeyre.bsky.social and @pierreablin.bsky.social, we tackle this in our new preprint: A Unified Perspective on the Dynamics of Deep Transformers arxiv.org/abs/2501.18322 ML and PDE lovers, check it out!

Machine learning has made incredible breakthroughs, but our theoretical understanding lags behind. We take a step towards unravelling its mystery by explaining why the phenomenon of disentanglement arises in generative latent variable models. Blog post: carl-allen.github.io/theory/2024/...

If few-shot transfer is ur thing!

Just wondering (very neutrally!)… if authors have to review as a condition of submitting themselves, but they then review in *clear bad faith*, should their own submissions be rejected as if they had not reviewed? 🤔 #ICLR2025 @iclr-conf.bsky.social

The Country Land and Business Association says the new £1m cap on agricultural inheritance tax relief will "harm 70,000 farms". That's 1/3 of all farms. What does the actual data show? Less than 500 farms/year will be pay more tax as a result of this change every year. Possibly as few as 100.