Happy Newton’s birthday to those who celebrate

In arxiv.org/abs/2303.00848, @dpkingma.bsky.social and @ruiqigao.bsky.social had suggested that noise augmentation could be used to make other likelihood-based models optimise perceptually weighted losses, like diffusion models do. So cool to see this working well in practice!

This is your monthly reminder that understanding deep learning does not require rethinking generalization, and it never did.

Brilliant talk by Ilya, but he's wrong on one point. We are NOT running out of data. We are running out of human-written text. We have more videos than we know what to do with. We just haven't solved pre-training in vision. Just go out and sense the world. Data is easy.

More a linear algebra meme than a QM meme 😅

Super excited to preprint our work on developing a Biomolecular Emulator (BioEmu): Scalable emulation of protein equilibrium ensembles with generative deep learning from @msftresearch.bsky.social ch AI for Science. www.biorxiv.org/content/10.1...

My former student @msalbergo.bsky.social has beautiful papers describing the approach on the right. “Flow matching” and “stochastic interpolants” were concurrent developments of the same core idea. arxiv.org/abs/2209.15571 arxiv.org/abs/2303.08797

🧵 Today with @polymathicai.bsky.social and others we're releasing two massive datasets that span dozens of fields - from bacterial growth to supernova! We want this to enable multi-disciplinary foundation model research.

A paper a day, episode 15. You liked the matrix cookbook? You’re gonna love this one. 100 statistics inequalities just for your personal enjoyment. As they say in French, moi j’ai Bienaymé cet article ! arxiv.org/abs/2102.07234

For the theoretical side, there’s no better resource than the 2024 book by Blondel and Roulet: arxiv.org/abs/2403.14606 For the practical side, my friend @willtebbutt.bsky.social wrote stellar documentation explaining autodiff with mutation: compintell.github.io/Mooncake.jl/...

We're hiring! Our team at Google DeepMind is looking for a research engineer to join us. More details in the link below. boards.greenhouse.io/deepmind/job...

This video takes pedagogy to a whole new level in teaching the Schrödinger equation! youtu.be/uVKMY-WTrVo?...

Updated periodic table with origin of elements in the Solar System (for boron and lithium at least)