Launching the Physical AI AV Dataset! 🚀 huggingface.co/datasets/nvi... One of the largest, most diverse & commercially usable open-source datasets for AVs. - 1727 hours of driving data - Camera, LiDAR, & radar - 25 countries, 2500+ cities This is just the beginning, more features to come!

Congratulations to our PhD student @takerumiyato.bsky.social for winning the Google PhD Fellowship in the category "Machine Learning and ML Foundations". Takeru is pioneering new neural architectures that improve generalization and efficiency. Check out his research: takerum.github.io

🚗 Join us for the RealADSim Workshop @ ICCV 2025! 🗓 Oct 19 morning | 📍 Hawaii Conv. Center, 305A Featuring exciting talks and winner presentations from our challenges (70+ regs, ~30 subs). Don’t miss it! 🎉 #ICCV2025

Announcing the @iccv.bsky.social NAVSIM Challenge! What's new? We're testing not only on real recordings, but also perturbed futures generated from the real ones via pseudo-simulation! $8K in prizes + several $1.5k travel grants. Submit by September 20! opendrivelab.com/challenge2025/ 🧵👇

NeurIPS PCs: Borderline Reject: "Please use sparingly" NeurIPS reviewers: BR go BR BR BR BR BR BR

One concern that I have as an AI researcher when publishing code is that it can potentially be used in dual-use applications. To solve this, we propose Civil Software Licenses. They prevent dual-use while being minimal in the restrictions they impose: civil-software-licenses.github.io

New YouTube playlist category is Relaxing self-driving agents to vibe to

We have released the code for our work, CaRL: Learning Scalable Planning Policies with Simple Rewards. The repository contains the first public code base for training RL agents with the CARLA leaderboard 2.0 and nuPlan. github.com/autonomousvi...

Back in 2023, I worked on rule-based planning for the nuPlan challenge and was skeptical that learned methods could do well on this benchmark. Turns out, RL is the answer. The CaRL code is out now. Also check out this 2h+ demo video of our policy: youtu.be/_godUKkICec

In case you find it as relaxing as we do: Here is a 2h+ video of our autonomous RL driving agent CaRL in action! @danieldauner.bsky.social @bernhard-jaeger.bsky.social @kashyap7x.bsky.social youtube.com/watch?v=_god...

Christina's new work PrITTI generates high-quality, controllable 3D semantic urban scenes in a compact primitive-based representation using a latent diffusion model. This enables applications like scene editing, inpainting, and photo-realistic street view synthesis! raniatze.github.io/pritti/

The 2025 Waymo Challenge results are out! We achieved second place in the End-to-End Driving Challenge with DiffusionLTF and third place in the Scenario Generation Challenge with SHRED. Our approaches prioritized simplicity, and we're preparing to make them publicly available soon.

🚗 Pseudo-simulation combines the efficiency of open-loop and robustness of closed-loop evaluation. It uses real data + 3D Gaussian Splatting synthetic views to assess error recovery, achieving strong correlation with closed-loop simulations while requiring 6x less compute. arxiv.org/abs/2506.04218

EMPERROR is a new generative perception error model for probing self-driving planners. It imitates modern 3D detectors, maintains temporal consistency, and reveals brittleness in IL-based planning - raising collision rates by up to 85%! #RA_L #robotics #AI - lasnik.github.io/emperror/

📣 Excited to share our #CVPR2025 Spotlight paper and my internship project @wayve: SimLingo. A Vision-Language-Action (VLA) model that achieves state-of-the-art driving performance with language capabilities. Code: github.com/RenzKa/simli... Paper: arxiv.org/abs/2503.09594

I've always found the default Alt+Tab behavior in Ubuntu frustrating. Recently, I discovered this plugin for GNOME distros. Personally, it’s a game changer and enables switching windows specific to the application, monitor, and workspaces. Highly recommend! github.com/G-dH/advance...

📢 New paper CVPR 25! Can meshes capture fuzzy geometry? Volumetric Surfaces uses adaptive textured shells to model hair, fur without the splatting / volume overhead. It’s fast, looks great, and runs in real time even on budget phones. 🔗 autonomousvision.github.io/volsurfs/ 📄 arxiv.org/pdf/2409.02482

Waited to finish reading it but I wanted to highlight the nice reward design here, which alleviates many of the failures of reward shaping

Introducing CaRL: Learning Scalable Planning Policies with Simple Rewards We show how simple rewards enable scaling up PPO for planning. CaRL outperforms all prior learning-based approaches on nuPlan Val14 and CARLA longest6 v2, using less inference compute. arxiv.org/abs/2504.17838

⏰ Heads up! The deadline for two #CVPR2025 Autonomous Grand Challenge tracks is May 10th, 2025: 1️⃣ NAVSIM v2 Challenge: huggingface.co/spaces/AGC20... 2️⃣ World Model Challenge by 1X: huggingface.co/spaces/1x-te...

🚀 Never miss a beat in science again! 📬 Scholar Inbox is your personal assistant for staying up to date with your literature. It includes: visual summaries, collections, search and a conference planner. Check out our white paper: arxiv.org/abs/2504.08385 #OpenScience #AI #RecommenderSystems

Announcing the 2025 NAVSIM Challenge! What's new? We're testing not only on real recordings—but also imaginary futures generated from the real ones! 🤯 Two rounds: #CVPR2025 and #ICCV2025. $18K in prizes + several $1.5k travel grants. Submit in May for Round 1! opendrivelab.com/challenge2025/ 🧵👇

🐎 Centaur, our first foray into test-time training for end-to-end driving. No retraining needed, just plug-and-play at deployment given a trained model. Also, theoretically nearly no overhead in latency with some clever use of buffers. Surprising how effective this is! arxiv.org/abs/2503.11650

Building a "human-level" simulated driver that zero-shot generalizes to many benchmarks: a fun interview with @natolambert.bsky.social www.youtube.com/watch?v=2Q66...

🚀 This year, we’re bringing you three thrilling tracks in Embodied AI and Autonomous Driving, with a total prize pool of $100,000! Now get ready and join the competition! Visit the challenge website: opendrivelab.com/challenge2025 And more on #CVPR2025: opendrivelab.com/cvpr2025

Synchronization is ubiquitous in nature and a key mechanism for information processing in the brain. We introduce AKOrN as a dynamical alternative to threshold units, which can be combined with MLPs, CNNs or Transformers. ICLR'25 Oral. Project page: takerum.github.io/akorn_projec...

The NAVSIM challenge will be back in 2025! Stay tuned 🚗 github.com/autonomousvi...

This week we had our winter retreat jointly with Daniel Cremer's group in Montafon, Austria. 46 talks, 100 Km of slopes and night sledding with some occasionally lost and found. It has been fun!

I have switched from X and Facebook to Bluesky. I will delete both my X and Facebook accounts in a little bit.