Calling all parsimony and learning researchers 🚨🚨 The 3rd annual CPAL will be held in Tübingen Germany March 23–26, 2026! Check out this year's website for all the details cpal.cc

Got a comment I secretly like: “This professor is constructively rude”

Paying for a dinner I wasn’t even at 🤣 — momentum’s strong, keep it up team! www.vita-group.space/team

I really wanna see / do research on using AI to prevent massive shooting …

Perhaps I’m not alone in feeling GPT5 (even pro) is no better than o3-pro… coding and knowledge?

www.linkedin.com/posts/atlas-... Cannot resist enjoying some proud advisor moment

Two fresh tutorials on low-dimensional DL: Sparsity ’23 🔗 vita-group.github.io/SparsityTuto... Low-Rank ’25 🔗 vita-group.github.io/LowrankTutor... Curious about how sparsity and low-rank ideas power modern deep learning? I hope these slide decks & notes are a useful starting point! 🚀

Of all my students’ career achievements, this one makes me proudest: because really, who needs yet another AI professor or scientist alumni when you can boast a professional cat-breeder student? www.bestbritishcats.com To my Bay Area friends: BUY one! Maybe try using my name to get a discount :)

@talkachman.bsky.social caught it faster before I did... but here we go! 🚀 New pre-print dropped lnkd.in/gmQ9hBdf Its first draft won the #DARPA Disruptive Idea award at #NeuS2025. Now my student Peihao Wang has sharpened the theory even more. I’m so excited what it means for AI reasoning 🧩🤖 (1/n)

@atlaswang.bsky.social knocking out of the park again! half a page in and this is a phenomenal read. So much to wrap my head around www.arxiv.org/abs/2506.21797

Feels great relief to report: #Thrilledtoshare (yes, that LinkedIn tone I hate...) we have 0 papers accepted to @iccv.bsky.social ! Surprisingly liberating to step off the number game: I meant it. I’m genuinely proud of the science my students are building, no matter how ICCV reviewers think 🤣

An #AI system that automatically interprets echocardiograms maintained high accuracy across geography and time from complete and limited studies. https://ja.ma/4jYWBgI

Check out #PanEcho, now in @jama.com ✅ open weights ✅ multiview multitask reporting ✅ international validation ✅ works with POCUS Amazing effort @cardslab.bsky.social @giholste.bsky.social @rohankhera.bsky.social + @atlaswang.bsky.social, Márton Tokodi & Attila Kovács #CardioSky #EchoSky

A reflection sparked by Saturday night’s thought-provoking dinner conversation 🥘 www.linkedin.com/pulse/beyond...

Making a new website of my research group, and did a visualization of all our papers from 2018 to present: clustered into 10 topics. One can clearly see how this group evolves its own tastes! … and deeper in my heart: long live optimization!! ❤️

Quoting one slides from @yann-lecun.bsky.social talk… arxiv is filled by papers that treat symptoms (or not even!) without ever diagnosing the disease

Unwelcome idea: I’m extremely tired of seeing one more LLM paper and believe academics shall pivot away from this area. So boring arxiv feeds every day…

This is going to kneecap science in this country for years. www.nature.com/articles/d41...

One of my PhD students got their visa revoked. I know of other cases amongst my AI colleagues. This is not what investing in US leadership in AI looks like. www.aljazeera.com/news/2025/4/...

🚀 Thrilled to announce SPIN-Bench!🚀 We all love seeing how smart LLMs can be-solving complex math, crafting beautiful text, and coding effortlessly. But how well do they handle real-world strategic complexity, cooperation, & social negotiation? Can they play well when things get tricky? Not quite!

Just had a meal that gifted me two rare treasures: 1️⃣ Meeting someone infinitely wiser than me. 2️⃣ They weren’t cold or mean—just gently showed me where I could grow. "To learn truth at dawn, I’d die content by dusk." ✨ Humility tastes better with kindness. #Gratitude #LifeLessons

Good news? SPIN-Bench pinpoints exactly where these models fall short—and illuminates exciting research directions to smarter, socially savvy AI For some extra fun (and detailed, interactive trajectory visualizations!), visit project page： 👉 spinbench.github.io full paper: arxiv.org/pdf/2503.12349

🌍 Diplomacy – The ultimate test！ Models had to negotiate, forge alliances, and occasionally backstab. Result? Even the best LLMs floundered, struggling to juggle complex social interactions and strategic depth.

🎴 Cooperative Games (Hanabi): Coordination among teammates dramatically challenges models, causing their performance to dip sharply as complexity ramps up. Turns out, keeping track of your teammates’ intentions isn’t an easy task—even for GPTs!

Results fascinatingly reveal: 🔹 Classic Planning: LLMs ace simpler puzzles but struggle badly as complexity grows—losing track at longer-term decisions 🔎 Competitive Games: Top chess engines swept every LLM clean. Even simple tactical awareness quickly fades when facing deeper strategic branches

This accidental photo feels distinctly #american —industry and technology advancing, sometimes hesitantly, beneath the weight of religion and firearms

🚀 Thrilled to announce SPIN-Bench!🚀 We all love seeing how smart LLMs can be-solving complex math, crafting beautiful text, and coding effortlessly. But how well do they handle real-world strategic complexity, cooperation, & social negotiation? Can they play well when things get tricky? Not quite!

I think some people hear “grants” and think that without them, scientists and government workers just have less stuff to play with at work. But grants fund salaries for students, academics, researchers, and people who work in all areas of public service. “Pausing” grants means people don’t eat.

Since taking absence from my university role, students thrive even better: consistent conference productivity (NeurIPS ICLR etc basically on autopilot); two new PhD fellowships (NVIDIA, IBM); multiple paper awards; and most recently, several successful job placements including a new professor (HKU)

I love this adorable lady’s narrative and hope it seen by more people 【Asians being seen 第二则-哔哩哔哩】 b23.tv/GZ4h0HO

current price to buy or invest a #GenAI startup: is it already too inflated?

Me: I’m feeling like my life on a busy shaky ferry😭 My junior student: Maybe a busy shaky ferry in new waters is better than a calm ferry always in the same waters #IAmEducated

The not-so-great-yet human intelligence wishes y’all Happy Holidays! 🎁🎄

Hard at work on the AAMAS rebuttals. Yes reviewer 2 we.are looking at you

The not-so-great-yet human intelligence wishes y’all Happy Holidays! 🎁🎄

With o3 rocketing to (kinda) super-intelligence overnight, I’m prepping my fallback gig: selling “hand-crafted” research to anyone nostalgic for the pre-AI era. Turns out boutique history may be the only job left! #FutureProof #AIRevolution

Excellent post about the recent OpenAI o3 results on ARC (& other benchmarks). I don't know how @natolambert.bsky.social manages to write these so quickly! I highly recommend his newsletter. www.interconnects.ai/p/openais-o3... I am (more slowly) writing my own take on all this, coming soon.

@ruisicai.bsky.social was awarded NVIDIA graduate fellowship blogs.nvidia.com/blog/graduat... It marks the 8th PhD fellowship brought back to VITA group in the last 4 years🎇🎆 alongside NSF GRFP, Apple, Amazon, Adobe, IBM, Qualcomm, and Snap When students are too compelling, PI feels useless :(

(5/n, n =5) More cool APOLLO videos for seeing with your own eyes 👀 AdamW with micro-batch size of 4 at 79-80GB memory cost youtu.be/XuNTX7VDViQ APOLLO with micro-batch size of 16 (four times larger!) at 69-70GB memory cost youtu.be/s2WxdBGh99k 🤩 Codes will be fully available soon enough!

(1/n) My favorite "optimizer" work of 2024: 📢 Introducing APOLLO! 🚀: SGD-like memory cost, yet AdamW-level performance (or better!). ❓ How much memory do we need for optimization states in LLM training ? 🧐 Almost zero. 📜 Paper: arxiv.org/abs/2412.05270 🔗 GitHub: github.com/zhuhanqing/A...

Everyone’s saying #GenAI tools ‘unleash human creativity’— the new politically correct mantra! But are they empowering us, or just tricking us into creating better training data for themselves? 🤔 Who’s really learning here? #HumanVsMachine

fortune.com/2024/12/09/n... It’s exciting to see another pitch on neurosymbolic AI by @fortune.com , after one nice by @reuters.com last month I don’t believe we are already in the monotonic deceasing “convex optimization”-like path of AI. It’s always more fun to back & forth like good non-convex!

(1/n) My favorite "optimizer" work of 2024: 📢 Introducing APOLLO! 🚀: SGD-like memory cost, yet AdamW-level performance (or better!). ❓ How much memory do we need for optimization states in LLM training ? 🧐 Almost zero. 📜 Paper: arxiv.org/abs/2412.05270 🔗 GitHub: github.com/zhuhanqing/A...

After using ChatGPT Pro ($200 paid) to help me write an ML data loader for a complex format, I’ve realized one thing: there’s no going back… It’s like having a 24/7 genius intern who doesn’t complain, never sleeps, and somehow gets me. 🤖💻 #AIcoding #GPT

Renaissance Philanthropy and XTX Markets have launched a $9.2 million "AI for Math fund" to support the development of new AI tools as long-term building blocks to advance mathematics. (I have agreed to serve on the advisory board for this fund.) renaissancephilanthropy.org/news-and-ins...

Originally, I was a transformer — fully attending to all inputs. Now, after the baby arrived, I’ve downgraded to an SSM: barely retaining the last few… Wait, what was I saying? #NewParentLife #SleepDeprived

Being faculty these days is really like "hey undergrad, please don't use chatgpt" "hey grad student, please just ask chatgpt"