nice blog post about a humanoid robotics startup failure: ruixu.us/posts/six-th...

The talk i gave about "Recent Advances in RL for Continuous Control" at CERN last year is now online =) www.youtube.com/watch?v=Sb0d...

If you missed this post last week, it explains pretty well how modern frontend works these days. :/ https://paulmakeswebsite...

Q-value overestimation animation for my upcoming talk about "Recent Advances in RL for Continuous Control" at the Mannheim RL Workshop

This is something I talk about in my paper, where I suggest being explicit about {\gamma}_train (some methods use multiple gammas during training) and \gamma_eval. One of my students is empirically investigating this and, as one would expect, it can have a huge impact. arxiv.org/abs/2510.16175

December in Servo… 🎤🧑‍🏫 FOSDEM talks next week! 🤹🪟 multiple windows 🪆🌐 HTTP proxy support 🔐🕵️ more SubtleCrypto algorithms 💽🗃️ new site data & network API servo.org/blog/2026/01...

Dr. Who plays with Docker How : docker.how

HTML preview & export now available in the web app! With HTML export, you can create a website from the same Typst file as your PDFs. This makes it easy to create documents that feel just as at home on the web as they do in print.

This network analyzer is very efficient and allows you to find interesting accounts, eg. people followed by lots of the people you follow (but not you). bsky-follow-finder.theo.io (Reposting this for folks who have joined Bsky more recently)

People wanted our Open Source Organizations starter pack to include many projects, so we decided to give them their own starter pack. go.bsky.app/HvKFRKa

"uv is fast because of what it doesn’t do, not because of what language it’s written in"

Using AI coding for data analysis without personal programming skill fills me with dread. Small errors in the code poisons results in ways that may not be visibly obvious. LLMs are great when people verify outputs; the path to hell is when they don't.

Hi RL Enthusiasts! RLC is coming to Montreal, Quebec, in the summer: Aug 16–19, 2026! Call for Papers is up now: Abstract: Mar 1 (AOE) Submission: Mar 5 (AOE) Excited to see what you’ve been up to - Submit your best work! rl-conference.cc/callforpaper... Please share widely!

Almost 5 years in the making... "Hyperparameter Optimization in Machine Learning" is finally out! 📘 We designed this monograph to be self-contained, covering: Grid, Random & Quasi-random search, Bayesian & Multi-fidelity optimization, Gradient-based methods, Meta-learning. arxiv.org/abs/2410.22854

A practical introduction to (deep) RL, providing intuitions to understand the more recent algorithms (continued). In this second post, I continue from DQN on to the Soft Actor-Critic (SAC) algorithm and its extensions. araffin.github.io/post/rl103/

What a phenomenal talk by @jenson.org. He works in a very different slice of tech than I do, but his ethos toward developing tech deeply matches my own, and he articulates it so well. I highly recommend watching it, regardless of whether you're interested in UX.

antonin has been cooking olala

A practical introduction to (deep) RL, providing intuitions to understand the more recent algorithms (continued). In this second post, I continue from DQN on to the Soft Actor-Critic (SAC) algorithm and its extensions. araffin.github.io/post/rl103/

🚀 We just shipped v0.216.0! Word-level diffing just landed. 🎉 It's been a night-and-day difference for us—seeing exactly what changed within each line.

An intuitive introduction to flow matching, ICLR 2025 best blog post: iclr-blogposts.github.io/2025/blog/fl...

New in Stable-Baselines3 documentation: a full example on how to export a trained RL agent to run in the browser, using ONNX and ONNX Runtime Web (JS). Demo: jonathancoletti.github.io/CarDodgingGym/ Documentation: stable-baselines3.readthedocs.io/en/master/gu...

🎤 Announcing the 3rd workshop on Reinforcement Learning in Mannheim 🎤 We have an amazing lineup of speakers: @Mathieugeist, @gio_ramponi, Theresa Eimer, @SarahKeren_, @araffin2, @c_rothkopf, and @AdrienBolland ⏰ Friday 6th February 📍University of Mannheim

Exciting workshop for RL enthusiasts in Mannheim! 👇 Workshop on Reinforcement Learning 2026, taking place on 𝐅𝐞𝐛𝐫𝐮𝐚𝐫𝐲 𝟔, 𝟐𝟎𝟐𝟔, at the 𝐔𝐧𝐢𝐯𝐞𝐫𝐬𝐢𝐭𝐲 𝐨𝐟 𝐌𝐚𝐧𝐧𝐡𝐞𝐢𝐦, Germany. Participation in the workshop is 𝐟𝐫𝐞𝐞 𝐨𝐟 𝐜𝐡𝐚𝐫𝐠𝐞! Check the program and register: www.wim.uni-mannheim.de/doering/conf...

TMLR (@tmlrorg.bsky.social) is now proud to support interactive HTML-based submissions, going "Beyond PDF" -- check it out! Thanks to Paul Vicol (@paulvicol.bsky.social) for his tireless work on this new option, as well as the OpenReview team.

Wow. The backlash to the 1X Neo announcement has been widespread and *merciless*. This may be a warning to lots of humanoids companies. All your promises don’t matter to the public if your robot looks or acts dumb. youtu.be/b_SNExtznd4?...

Why self-taught engineers often outperform michaelbastos.com/blog/why-sel... #programming #softwaredevelopment #tech #blog

🚨The Formalism-Implementation Gap in RL research🚨 Lots of progress in RL research over last 10 years, but too much performance-driven => overfitting to benchmarks (like the ALE). 1⃣ Let's advance science of RL 2⃣ Let's be explicit about how benchmarks map to formalism 1/X

🚨 New blog post alert! Modern package management for Robotics with Pixi! prefix.dev/blog/reprod... #ROS #ROSCon #ROSCon2025

What if we did a single run and declared victory

A wonderful collection of spurious correlations, correlation is not causation. link: www.tylervigen.com/spurious-cor... found via @stefanjudis.com newsletter

A good video on software refactoring and redesign (about the Audacity audio editing program)

Video recordings of CORL 2025 talks now available! Many interesting orals / keynotes / sponsor talks / early-career talks / poster spotlights. Day 1: www.youtube.com/watch?v=Use5... Day 2: www.youtube.com/watch?v=rh2o... Day 3: www.youtube.com/watch?v=9lzF...

In our little deep dive series we're now exploring how cross-compilation in the Conda ecosystem works: prefix.dev/blog/cross-c.... Back in the days, @conda-forge.org rolled this out widely to support osx-arm64 early on, and now for linux-aarch64/ppc64le.

Rapid RL experimentation is great. But how do you catch silent errors before they slip by? In this post, I share tools and habits that help me move quickly from idea to result without sacrificing reliability.

Ever since I made a video about Fourier Transforms, one of the most requested topics on the channel has been its close cousin, the Laplace Transform. I've been having a lot of fun animating a mini-series about this topic, and the main part is now out. youtu.be/j0wJBEZdwLs

Updated & turned my Big LLM Architecture Comparison article into a video lecture. The 11 LLM archs covered in this video: 1. DeepSeek V3/R1 2. OLMo 2 3. Gemma 3 4. Mistral Small 3.1 5. Llama 4 6. Qwen3 7. SmolLM3 8. Kimi 2 9. GPT-OSS 10. Grok 2.5 11. GLM-4.5/4.6 www.youtube.com/watch?v=rNlU...

Mjlab Isaac Lab API, powered by MuJoCo-Warp, for RL and robotics research. github.com/mujocolab/mj...

SBX (SB3 Jax) v0.23.0 is out =)! I added CNN support for PPO. It turns out that using a shared features extractor (CNN in this case) is important for achieving good performance on Atari games. Perf report: wandb.ai/openrlbenchm... github.com/araffin/sbx

Training a small humanoid robot with reinforcement learning using another robot for reset. by Kaizhe Hu et al. (ToddlerBot Stanford) Project page: robot-trains-robot.github.io

Open-Source Hardware in the Era of Robot Learning Workshop @ CoRL 2025 Website: open-hardware-robots.github.io/CoRL2025/

The CoRL 2025 workshop on Open-Source Hardware in the Era of Robot Learning is starting now! You can join the conversation online via live streaming: https://www.youtube.com/live/ZVPIJzF1df4

📣 Call for Blog Posts at #ICLR2026 @iclr_conf Following the success of the past iterations, we are opening the Call for Blog Posts 2026! iclr-blogposts.github.io/2026/about/#... Please retweet!

A practical introduction to (deep) RL, providing intuitions to understand the more recent algorithms. The plan is to start from tabular Q-learning and work our way up to Deep Q-learning (DQN). In a following post, I will continue on to Soft Actor-Critic (SAC) and its extensions.

Next Saturday, 𝗔𝗻𝘁𝗼𝗶𝗻𝗲 𝗣𝗶𝗿𝗿𝗼𝗻𝗲 will present Pollen Robotics & Hugging Face's open-source robots, including Reachy Mini, the SO-100 arm, the Amazing Hand and the Open Duck Mini. He will discuss the sim2real challenges of making the Open Duck Mini walk, and how […] [Original post on fosstodon.org]

RL102: From Tabular Q-Learning to Deep Q-Learning (DQN) - A Practical Introduction to (Deep) Reinforcement Learning araffin.github.io/post/rl102/

Package building with Pixi is being rolled out! Dive into our latest blog post on crafting C++ packages. And guess what? It’s not just for C++; Pixi plays nice with Python, Rust, ROS, Mojo, and beyond! prefix.dev/blog/pixi-b...

bash tricks permalink: wizardzines.com/comics/bash-... from our zine "Bite Size Command Line": wizardzines.com/zines/bite-s...

This is absolutely true -- this is a superb and much-needed consolidation of so much of modern RL. Kevin, inquiring minds want to understand the process you use to put this artwork together! @sirbayes.bsky.social Perhaps this is also the ultimate benchmark for Gemini Deep Research reports. ;-p

Weekend project: building a (site) search engine www.redblobgames.com/blog/2025-08... just for fun! :)

NeurIPS has decided to do what ICLR did: As a SAC I received the message 👇 This is wrong! If the review process cannot handle so many papers, the conference needs yo split instead of arbitrarily rejecting 400 papers.