"uv is fast because of what it doesn’t do, not because of what language it’s written in"

Using AI coding for data analysis without personal programming skill fills me with dread. Small errors in the code poisons results in ways that may not be visibly obvious. LLMs are great when people verify outputs; the path to hell is when they don't.

Hi RL Enthusiasts! RLC is coming to Montreal, Quebec, in the summer: Aug 16–19, 2026! Call for Papers is up now: Abstract: Mar 1 (AOE) Submission: Mar 5 (AOE) Excited to see what you’ve been up to - Submit your best work! rl-conference.cc/callforpaper... Please share widely!

Almost 5 years in the making... "Hyperparameter Optimization in Machine Learning" is finally out! 📘 We designed this monograph to be self-contained, covering: Grid, Random & Quasi-random search, Bayesian & Multi-fidelity optimization, Gradient-based methods, Meta-learning. arxiv.org/abs/2410.22854

A practical introduction to (deep) RL, providing intuitions to understand the more recent algorithms (continued). In this second post, I continue from DQN on to the Soft Actor-Critic (SAC) algorithm and its extensions. araffin.github.io/post/rl103/

What a phenomenal talk by @jenson.org. He works in a very different slice of tech than I do, but his ethos toward developing tech deeply matches my own, and he articulates it so well. I highly recommend watching it, regardless of whether you're interested in UX.

antonin has been cooking olala

A practical introduction to (deep) RL, providing intuitions to understand the more recent algorithms (continued). In this second post, I continue from DQN on to the Soft Actor-Critic (SAC) algorithm and its extensions. araffin.github.io/post/rl103/

🚀 We just shipped v0.216.0! Word-level diffing just landed. 🎉 It's been a night-and-day difference for us—seeing exactly what changed within each line.

An intuitive introduction to flow matching, ICLR 2025 best blog post: iclr-blogposts.github.io/2025/blog/fl...

New in Stable-Baselines3 documentation: a full example on how to export a trained RL agent to run in the browser, using ONNX and ONNX Runtime Web (JS). Demo: jonathancoletti.github.io/CarDodgingGym/ Documentation: stable-baselines3.readthedocs.io/en/master/gu...

🎤 Announcing the 3rd workshop on Reinforcement Learning in Mannheim 🎤 We have an amazing lineup of speakers: @Mathieugeist, @gio_ramponi, Theresa Eimer, @SarahKeren_, @araffin2, @c_rothkopf, and @AdrienBolland ⏰ Friday 6th February 📍University of Mannheim

Exciting workshop for RL enthusiasts in Mannheim! 👇 Workshop on Reinforcement Learning 2026, taking place on 𝐅𝐞𝐛𝐫𝐮𝐚𝐫𝐲 𝟔, 𝟐𝟎𝟐𝟔, at the 𝐔𝐧𝐢𝐯𝐞𝐫𝐬𝐢𝐭𝐲 𝐨𝐟 𝐌𝐚𝐧𝐧𝐡𝐞𝐢𝐦, Germany. Participation in the workshop is 𝐟𝐫𝐞𝐞 𝐨𝐟 𝐜𝐡𝐚𝐫𝐠𝐞! Check the program and register: www.wim.uni-mannheim.de/doering/conf...

TMLR (@tmlrorg.bsky.social) is now proud to support interactive HTML-based submissions, going "Beyond PDF" -- check it out! Thanks to Paul Vicol (@paulvicol.bsky.social) for his tireless work on this new option, as well as the OpenReview team.

Wow. The backlash to the 1X Neo announcement has been widespread and *merciless*. This may be a warning to lots of humanoids companies. All your promises don’t matter to the public if your robot looks or acts dumb. youtu.be/b_SNExtznd4?...

Why self-taught engineers often outperform michaelbastos.com/blog/why-sel... #programming #softwaredevelopment #tech #blog

🚨The Formalism-Implementation Gap in RL research🚨 Lots of progress in RL research over last 10 years, but too much performance-driven => overfitting to benchmarks (like the ALE). 1⃣ Let's advance science of RL 2⃣ Let's be explicit about how benchmarks map to formalism 1/X

🚨 New blog post alert! Modern package management for Robotics with Pixi! prefix.dev/blog/reprod... #ROS #ROSCon #ROSCon2025

What if we did a single run and declared victory

A wonderful collection of spurious correlations, correlation is not causation. link: www.tylervigen.com/spurious-cor... found via @stefanjudis.com newsletter

A good video on software refactoring and redesign (about the Audacity audio editing program)

Video recordings of CORL 2025 talks now available! Many interesting orals / keynotes / sponsor talks / early-career talks / poster spotlights. Day 1: www.youtube.com/watch?v=Use5... Day 2: www.youtube.com/watch?v=rh2o... Day 3: www.youtube.com/watch?v=9lzF...

In our little deep dive series we're now exploring how cross-compilation in the Conda ecosystem works: prefix.dev/blog/cross-c.... Back in the days, @conda-forge.org rolled this out widely to support osx-arm64 early on, and now for linux-aarch64/ppc64le.

Rapid RL experimentation is great. But how do you catch silent errors before they slip by? In this post, I share tools and habits that help me move quickly from idea to result without sacrificing reliability.

Ever since I made a video about Fourier Transforms, one of the most requested topics on the channel has been its close cousin, the Laplace Transform. I've been having a lot of fun animating a mini-series about this topic, and the main part is now out. youtu.be/j0wJBEZdwLs

Updated & turned my Big LLM Architecture Comparison article into a video lecture. The 11 LLM archs covered in this video: 1. DeepSeek V3/R1 2. OLMo 2 3. Gemma 3 4. Mistral Small 3.1 5. Llama 4 6. Qwen3 7. SmolLM3 8. Kimi 2 9. GPT-OSS 10. Grok 2.5 11. GLM-4.5/4.6 www.youtube.com/watch?v=rNlU...

Mjlab Isaac Lab API, powered by MuJoCo-Warp, for RL and robotics research. github.com/mujocolab/mj...

SBX (SB3 Jax) v0.23.0 is out =)! I added CNN support for PPO. It turns out that using a shared features extractor (CNN in this case) is important for achieving good performance on Atari games. Perf report: wandb.ai/openrlbenchm... github.com/araffin/sbx

Training a small humanoid robot with reinforcement learning using another robot for reset. by Kaizhe Hu et al. (ToddlerBot Stanford) Project page: robot-trains-robot.github.io

Open-Source Hardware in the Era of Robot Learning Workshop @ CoRL 2025 Website: open-hardware-robots.github.io/CoRL2025/

The CoRL 2025 workshop on Open-Source Hardware in the Era of Robot Learning is starting now! You can join the conversation online via live streaming: https://www.youtube.com/live/ZVPIJzF1df4

📣 Call for Blog Posts at #ICLR2026 @iclr_conf Following the success of the past iterations, we are opening the Call for Blog Posts 2026! iclr-blogposts.github.io/2026/about/#... Please retweet!

A practical introduction to (deep) RL, providing intuitions to understand the more recent algorithms. The plan is to start from tabular Q-learning and work our way up to Deep Q-learning (DQN). In a following post, I will continue on to Soft Actor-Critic (SAC) and its extensions.

Next Saturday, 𝗔𝗻𝘁𝗼𝗶𝗻𝗲 𝗣𝗶𝗿𝗿𝗼𝗻𝗲 will present Pollen Robotics & Hugging Face's open-source robots, including Reachy Mini, the SO-100 arm, the Amazing Hand and the Open Duck Mini. He will discuss the sim2real challenges of making the Open Duck Mini walk, and how […] [Original post on fosstodon.org]

RL102: From Tabular Q-Learning to Deep Q-Learning (DQN) - A Practical Introduction to (Deep) Reinforcement Learning araffin.github.io/post/rl102/

Package building with Pixi is being rolled out! Dive into our latest blog post on crafting C++ packages. And guess what? It’s not just for C++; Pixi plays nice with Python, Rust, ROS, Mojo, and beyond! prefix.dev/blog/pixi-b...

bash tricks permalink: wizardzines.com/comics/bash-... from our zine "Bite Size Command Line": wizardzines.com/zines/bite-s...

This is absolutely true -- this is a superb and much-needed consolidation of so much of modern RL. Kevin, inquiring minds want to understand the process you use to put this artwork together! @sirbayes.bsky.social Perhaps this is also the ultimate benchmark for Gemini Deep Research reports. ;-p

Weekend project: building a (site) search engine www.redblobgames.com/blog/2025-08... just for fun! :)

NeurIPS has decided to do what ICLR did: As a SAC I received the message 👇 This is wrong! If the review process cannot handle so many papers, the conference needs yo split instead of arbitrarily rejecting 400 papers.

Where do some of Reinforcement Learning's great thinkers stand today? Find out! Keynotes of the RL Conference are online: www.youtube.com/playlist?lis... Wanting vs liking, Agent factories, Theoretical limit of LLMs, Pluralist value, RL teachers, Knowledge flywheels (guess who talked about which!)

How astronauts control robots from space (featuring our quadruped Bert 👀) youtu.be/BMFPVCu16SQ

This one's been a long time coming. In this post on Decisions & Dragons I answer "Should we abandon RL?" The answer is obviously no, but people ask because they have a fundamental misunderstanding of what RL is. RL is a problem, not an approach. www.decisionsanddragons.com/posts/should...

📣Registration for EWRL is now open📣 Register now 👇 and join us in Tübingen for 3 days (17th-19th September) full of inspiring talks, posters and many social activities to push the boundaries of the RL community!

If machine learning is a game, it’s Calvinball. Bitter lessons from chess don’t apply.

Join us for the 𝗖𝗼𝗥𝗟 𝟮𝟬𝟮𝟱 𝘄𝗼𝗿𝗸𝘀𝗵𝗼𝗽 𝗼𝗻 𝗢𝗽𝗲𝗻-𝗦𝗼𝘂𝗿𝗰𝗲 𝗛𝗮𝗿𝗱𝘄𝗮𝗿𝗲 𝗶𝗻 𝘁𝗵𝗲 𝗘𝗿𝗮 𝗼𝗳 𝗥𝗼𝗯𝗼𝘁 𝗟𝗲𝗮𝗿𝗻𝗶𝗻𝗴! The day will bring together researchers and makers from both academia and the industry to discuss open-source robot design, integration with reinforcement learning […] [Original post on fosstodon.org]

Which ideas in computer science don't do better with faster computers? And what is a "human inductive bias?" (I never know what anyone means by "inductive bias." It is a term that defies definition.)

Pierre-Luc Bacon: Beyond the Gym Interface RL4RS Workshop @rl-conference.bsky.social

🚀 As we prepare for the next era of space exploration, coordinating intelligent robotic teams will be essential. Surface Avatar lays the groundwork for astronauts and robots to explore the Moon 🌙, Mars 🔴 and beyond 🌌, together 🤝 📖 Read more: blogs.esa.int/exploration/...

🤖 Meet the robots! • Interact: @esa.int's wheeled robotic arm 🦾 • Spot: @esa.int's nimble robot dog 🐕‍🦺 • Justin: @dlr-en.bsky.social's humanoid robot 🤖 • Bert: @dlr-en.bsky.social's small robot dog 🐾 Together, they’re pioneering seamless human-robot collaboration for space exploration 🚀