Launching the Physical AI AV Dataset! 🚀 huggingface.co/datasets/nvi... One of the largest, most diverse & commercially usable open-source datasets for AVs. - 1727 hours of driving data - Camera, LiDAR, & radar - 25 countries, 2500+ cities This is just the beginning, more features to come!

X-mas came earlier this year! Nvidia has just released the huge Physical AI AV Dataset - 1727 hrs of driving data: 310K clips of 20s - sensor rig: 7 cameras, lidar, radar - 25 countries, 2.5K cities from US + Europe Kudos to @kashyap7x.bsky.social et al.! huggingface.co/datasets/nvi...

Hundreds of hours of European driving data from NVIDIA! 1700 hours total

Big day for autonomous driving research. Nvidia just dropped 1700 hours of public driving data on HuggingFace from over 2500 cities: huggingface.co/datasets/nvi...

Launching the Physical AI AV Dataset! 🚀 huggingface.co/datasets/nvi... One of the largest, most diverse & commercially usable open-source datasets for AVs. - 1727 hours of driving data - Camera, LiDAR, & radar - 25 countries, 2500+ cities This is just the beginning, more features to come!

Congratulations to our PhD student @takerumiyato.bsky.social for winning the Google PhD Fellowship in the category "Machine Learning and ML Foundations". Takeru is pioneering new neural architectures that improve generalization and efficiency. Check out his research: takerum.github.io

🚀 The new call for Principal Investigators as Hector Endowed Fellows at the ELLIS Institute Tübingen is now open! These positions offer the exciting possibility of co-appointments with the @mpi-is.bsky.social and the @tuebingen-ai.bsky.social . 📌 Apply here: institute-tue.ellis.eu/en/jobs/PI-c...

Today is the day for our @iccv.bsky.social workshop that we've been cooking with excitement in the past months. Learning to See: Advancing Spatial Understanding for Embodied Intelligence #ICCV2025 Join us! opendrivelab.com/iccv2025/wor...

🚗 Join us for the RealADSim Workshop @ ICCV 2025! 🗓 Oct 19 morning | 📍 Hawaii Conv. Center, 305A Featuring exciting talks and winner presentations from our challenges (70+ regs, ~30 subs). Don’t miss it! 🎉 #ICCV2025

Over the past year, my lab has been working on fleshing out theory + applications of the Platonic Representation Hypothesis. Today I want to share two new works on this topic: Eliciting higher alignment: arxiv.org/abs/2510.02425 Unpaired learning of unified reps: arxiv.org/abs/2510.08492 1/9

CVPR 2026 Workshop Call is officially open! 🎉 📅 Deadline: Nov 3, 2025 cvpr.thecvf.com/Conferences/... We expect to host over 100 workshops this year — and this is where the next breakthroughs begin. 🚀 With Mei Chen,Erik Blasch,Brian Clipp,Sharon Huang,Andreas Savakis @cvprconference.bsky.social

Personal programs for ICCV 2025 are now available at: www.scholar-inbox.com/conference/i...

We're finally out of stealth: percepta.ai We're a research / engineering team working together in industries like health and logistics to ship ML tools that drastically improve productivity. If you're interested in ML and RL work that matters, come join us 😀

We've hired some *fantastic* researchers but our startup is still looking for 2-3 more people with skills in ML/RL/LLMs. If you'd like to work on some transformative applied problems, hit me up. We'll be launching publicly soon too...

We're recruiting our next batch of interns. Come join the team! nvidia.wd5.myworkdayjobs.com/en-US/NVIDIA...

How AI Taught Itself to See Self-supervised learning is fascinating! How can AI learn from images only without labels? In this video, we’ll build the method from first principles and uncover the key ideas behind CLIP, MAE, SimCLR, and DINO (v1–v3). Video link: youtu.be/oGTasd3cliM

Putting the final touches on your submission? Just a few days left to enter the @iccv.bsky.social NAVSIM Challenge! Deadline: September 20. $8K in prizes and several travel grants are on the line!

Found this marvelous little course full of readings to trace the evolution of computer science and its canonical ideas graphics.stanford.edu/courses/cs20...

Our Principal Investigators Antonio Orvieto, Celestine Mendler-Dünner, Maximilian Dax, Rediet Abebe, @shiweiliu.bsky.social, T. Konstantin Rusch, and @wielandbrendel.bsky.social are looking for motivated students interested in internships. Apply here: docs.google.com/forms/d/e/1F...

Announcing the @iccv.bsky.social NAVSIM Challenge! What's new? We're testing not only on real recordings, but also perturbed futures generated from the real ones via pseudo-simulation! $8K in prizes + several $1.5k travel grants. Submit by September 20! opendrivelab.com/challenge2025/ 🧵👇

Announcing the @iccv.bsky.social NAVSIM Challenge! What's new? We're testing not only on real recordings, but also perturbed futures generated from the real ones via pseudo-simulation! $8K in prizes + several $1.5k travel grants. Submit by September 20! opendrivelab.com/challenge2025/ 🧵👇

🎓 Interested in a #PhD in machine learning or #AI? The ELLIS PhD Program connects top students with leading researchers across Europe. The application portal opens on Oct 1st. Curious? Join our info session on the same day. Get all the info 👉

Let's push for the obvious solution: Dear @neuripsconf.bsky.social ! Allow authors to present accepted papers at EurIPS instead of NeurIPS rather than just additionally. Likely, at least 500 papers would move to Copenhagen, problem solved.

🚀 Introducing our new paper, MDPO: Overcoming the Training-Inference Divide of Masked Diffusion Language Models. 📄 Paper: www.scholar-inbox.com/papers/He202... arxiv.org/pdf/2508.13148 💻 Code: github.com/autonomousvi... 🌐 Project Page: cli212.github.io/MDPO/

Introducing DINOv3 🦕🦕🦕 A SotA-enabling vision foundation model, trained with pure self-supervised learning (SSL) at scale. High quality dense features, combining unprecedented semantic and geometric scene understanding. Three reasons why this matters👇

Our paper "CaRL: Learning Scalable Planning Policies with Simple Rewards" has been accepted to the Conference on Robot Learning (CoRL 2025). See you in Seoul at the end of September. Code & Paper: github.com/autonomousvi...

At TRI’s newest division: Automated Driving Advanced Development, we’re building a clean-slate, end-to-end autonomy stack. We're hiring, with open roles in learning, infra, and validation: www.tri.global/careers#open...

1/ Can open-data models beat DINOv2? Today we release Franca, a fully open-sourced vision foundation model. Franca with ViT-G backbone matches (and often beats) proprietary models like SigLIPv2, CLIP, DINOv2 on various benchmarks setting a new standard for open-source research.

Adding a nice way to visualize the PPO objective to the rlhf book. Core for policy-gradient is L is proportional to R*A (R=policy ratio, A = advantage). PPO makes good actions more likely, up to a point. PPO makes bad actions less likely, up to a point.

🚨Job Alert W2 (TT W3) Professorship in Computer Science "AI for People & Society" @saarland-informatics-campus.de/@uni-saarland.de is looking to appoint an outstanding individual in the field of AI for people and society who has made significant contributions in one or more of the following areas:

EurIPS is coming! 📣 Mark your calendar for Dec. 2-7, 2025 in Copenhagen 📅 EurIPS is a community-organized conference where you can present accepted NeurIPS 2025 papers, endorsed by @neuripsconf.bsky.social and @nordicair.bsky.social and is co-developed by @ellis.eu eurips.cc

In an era of billion-parameter models everywhere, it's incredibly refreshing to see how a fundamental question can be formulated and solved with simple, beautiful math. - How should we orient a solar panel ☀️🔋? - Zero AI! If you enjoy math, you'll love this! Video: www.youtube.com/watch?v=ZKzL...

📢 Present your NeurIPS paper in Europe! Join EurIPS 2025 + ELLIS UnConference in Copenhagen for in-person talks, posters, workshops and more. Registration opens soon; save the date: 📅 Dec 2–7, 2025 📍 Copenhagen 🇩🇰 🔗eurips.cc #EurIPS @euripsconf.bsky.social‬

I really like this paper on relative positional encodings using projective geometry for multi-view transformers, by Li et al. (Berkeley/Nvidia/HKU). It is elegant: in special situations, it defaults to known baselines like GTA (if identity intrinsics) and RoPE (same cam). arxiv.org/abs/2507.10496

We have released the code for our work, CaRL: Learning Scalable Planning Policies with Simple Rewards. The repository contains the first public code base for training RL agents with the CARLA leaderboard 2.0 and nuPlan. github.com/autonomousvi...

In case you find it as relaxing as we do: Here is a 2h+ video of our autonomous RL driving agent CaRL in action! @danieldauner.bsky.social @bernhard-jaeger.bsky.social @kashyap7x.bsky.social youtube.com/watch?v=_god...

🏟️But we’re not done yet - our workshop continues at #ICCV2025! And the challenge moves forward too, with more prizes and exciting updates. opendrivelab.com/challenge2025/

Our @matthieucord.bsky.social talked on Driving through Generative video Pretraining: VaVIM-VaVAM. He talked on how we boosted speed & perf. by reducing number of tokens and switching from discrete to continuous tokens

🚗 Excited to announce our RealADSim Workshop & Challenges @ ICCV 2025 — join us! 🏆 Over $40,000 in prizes 🌆 Competition 1: Extrapolated Novel View Synthesis 🚘 Competition 2: Closed-loop Driving in a 3DGS-based Simulator 🎤 Featuring great speakers 🔗 realadsim.github.io/2025/

Consider trying this feed of "Other people also liked" bsky.app/profile/spac... If you like ML related posts then you will find what people who liked the same posts also liked in the last 24 hours. That way you kind of automatically follow people who share your interests.

Hiring a postdoc to scale up and deploy RL-based planning onto some self-driving cars! We'll be building on arxiv.org/abs/2502.03349 and learn what the limits and challenges of RL planning are. Shoot me a message if interested and help spread the word please! Full posting to come in a bit.

Check out the video to learn this new, elegant formulation of generative models! youtu.be/swKdn-qT47Q

The 2025 Waymo Challenge results are out! We achieved second place in the End-to-End Driving Challenge with DiffusionLTF and third place in the Scenario Generation Challenge with SHRED. Our approaches prioritized simplicity, and we're preparing to make them publicly available soon.

The 2025 Waymo Challenge results are out! We achieved second place in the End-to-End Driving Challenge with DiffusionLTF and third place in the Scenario Generation Challenge with SHRED. Our approaches prioritized simplicity, and we're preparing to make them publicly available soon.

Our computer vision textbook is now available for free online here: visionbook.mit.edu We are working on adding some interactive components like search and (beta) integration with LLMs. Hope this is useful and feel free to submit Github issues to help us improve the text!

Driving world models become much easier to control and more effective for practical applications when their training data combines human driving demonstrations with synthetic 'non-expert' data from a simulator. Introducing ReSim: resim-world-model.github.io

🤔 How to reliably simulate future driving scenarios under a wide range of ego behaviors? 😎 Key ingredient: Co-training the world model on heterogeneous data, including real-world data with expert actions and simulated data with non-expert behaviors. See ReSim: arxiv.org/abs/2506.09981

How can we reliably simulate future driving scenarios under a wide range of ego driving behaviors? Check out: ReSim: Reliable World Simulation for Autonomous Driving resim-world-model.github.io

Pseudo-Simulation for Autonomous Driving Pseudo-simulation is a new evaluation paradigm for autonomous vehicles that blends the realism of real-world data with the generalization power of simulation, enabling robust, scalable testing without the need for interactive environments.