Introducing Celo2: Towards Learned Optimization Free Lunch We show that learned optimizers can generalize to practical tasks like GPT-3 1.3B pretraining and several out-of-distribution vision/RL tasks from limited meta-training (~4.5 GPU hours)! 🧵

DeepMind's RL team is hiring a research scientist: if you're passionate about RL, come work with us! And if you know people who might be interested, please share: job-boards.greenhouse.io/deepmind/job...

Where do some of Reinforcement Learning's great thinkers stand today? Find out! Keynotes of the RL Conference are online: www.youtube.com/playlist?lis... Wanting vs liking, Agent factories, Theoretical limit of LLMs, Pluralist value, RL teachers, Knowledge flywheels (guess who talked about which!)

On my way to #ICML2025 to present our algorithm that strongly scales with inference compute, in both performance and sample diversity! 🚀 Reach out if you’d like to chat more!

New side project! assayer: A simple Python-RQ based tool to automatically monitor and evaluate ML model checkpoints offline during training.

Ever thought of joining DeepMind's RL team? We're recruiting for a research engineering role in London: job-boards.greenhouse.io/deepmind/job... Please spread the word!

Accepted to #ICML2025 See you in Vancouver!

When faced with a challenge (like debugging) it helps to think back to examples of how you've overcome challenges in the past. Same for LLMs! The method we introduce in this paper is efficient because examples are chosen for their complementarity, leading to much steeper inference-time scaling! 🧪

Excited to share our recent work, AuPair, an inference-time technique that builds on the premise of in-context learning to improve LLM coding performance! arxiv.org/abs/2502.18487 🧵

Are there limits to what you can learn in a closed system? Do we need human feedback in training? Is scale all we need? Should we play language games? What even is "recursive self-improvement"? Thoughts about this and more here: arxiv.org/abs/2411.16905