🚀 𝗞𝗦𝗲𝗿𝘃𝗲 𝘃𝟬.𝟭𝟲 𝗶𝘀 𝗼𝘂𝘁! This release introduces 𝗟𝗟𝗠𝗜𝗻𝗳𝗲𝗿𝗲𝗻𝗰𝗲𝗦𝗲𝗿𝘃𝗶𝗰𝗲, a new CRD that integrates with llm-d and brings scalable, production-grade LLM serving on Kubernetes.

📢 𝗧𝗵𝗲 𝗦𝘁𝗮𝘁𝗲 𝗼𝗳 𝗠𝗼𝗱𝗲𝗹 𝗦𝗲𝗿𝘃𝗶𝗻𝗴 𝗖𝗼𝗺𝗺𝘂𝗻𝗶𝘁𝗶𝗲𝘀: 𝗡𝗼𝘃𝗲𝗺𝗯𝗲𝗿 𝗘𝗱𝗶𝘁𝗶𝗼𝗻 𝗶𝘀 𝗼𝘂𝘁! We recently launched our newsletter publicly after sharing it internally at Red Hat AI for over a year.

🚀 𝗖𝗙𝗣 𝗗𝗲𝗮𝗱𝗹𝗶𝗻𝗲 𝗖𝗼𝗺𝗶𝗻𝗴 𝗨𝗽 𝗦𝗼𝗼𝗻! The Call for Proposals for two exciting AI-focused co-located events at KubeCon Europe is closing this 𝗦𝘂𝗻𝗱𝗮𝘆, 𝗡𝗼𝘃 𝟮𝗻𝗱! 𝗔𝗴𝗲𝗻𝘁𝗶𝗰𝘀 𝗗𝗮𝘆: events.linuxfoundation.org/kubecon-clou... 𝗖𝗹𝗼𝘂𝗱 𝗡𝗮𝘁𝗶𝘃𝗲 𝗔𝗜 𝗗𝗮𝘆: events.linuxfoundation.org/kubecon-clou...

📚✨ 𝗕𝗼𝗼𝗸 𝗦𝗶𝗴𝗻𝗶𝗻𝗴 𝗮𝗻𝗱 𝗘-𝗕𝗼𝗼𝗸 𝗚𝗶𝘃𝗲𝗮𝘄𝗮𝘆 𝗮𝘁 𝗞𝘂𝗯𝗲𝗖𝗼𝗻 𝗡𝗼𝗿𝘁𝗵 𝗔𝗺𝗲𝗿𝗶𝗰𝗮! ✨📚 If you’re attending #KubeCon in Atlanta and have a copy of my book 𝘋𝘪𝘴𝘵𝘳𝘪𝘣𝘶𝘵𝘦𝘥 𝘔𝘢𝘤𝘩𝘪𝘯𝘦 𝘓𝘦𝘢𝘳𝘯𝘪𝘯𝘨 𝘗𝘢𝘵𝘵𝘦𝘳𝘯𝘴, bring it along and I’d love to sign it! 🖊️ And if you’d like your own copy, use code 𝗞𝘂𝗯𝗲𝗖𝗼𝗻𝟮𝟱𝗮𝘂 starting 𝗡𝗼𝘃 𝟵𝘁𝗵 for 45% off.

🚀 𝗪𝗲’𝗿𝗲 𝗛𝗶𝗿𝗶𝗻𝗴 𝗦𝗼𝗳𝘁𝘄𝗮𝗿𝗲 𝗘𝗻𝗴𝗶𝗻𝗲𝗲𝗿𝘀! Our team at 𝗥𝗲𝗱 𝗛𝗮𝘁 𝗔𝗜 is growing, and we’re looking for passionate engineers (at different levels) to help us push the boundaries of 𝗔𝗜 𝗶𝗻𝗳𝗿𝗮𝘀𝘁𝗿𝘂𝗰𝘁𝘂𝗿𝗲 𝗮𝗻𝗱 𝗺𝗼𝗱𝗲𝗹 𝘀𝗲𝗿𝘃𝗶𝗻𝗴.

It was a pleasure to contribute to this video to kick off Community Day at IBM TechXchange! The theme - The Power of Community - truly resonates with me. Open source and tech communities thrive because of the people who collaborate and innovate together. Watch the video here 👉 youtu.be/Q0E8ZNMk1Ac

🎉 𝟭𝟯𝟯𝗞 𝗺𝗲𝗺𝗯𝗲𝗿𝘀 𝗿𝗲𝗮𝗰𝗵𝗲𝗱, 𝟲𝟵𝟰𝗞 𝗶𝗺𝗽𝗿𝗲𝘀𝘀𝗶𝗼𝗻𝘀, 𝗮𝗻𝗱 𝟭𝟲𝗞 𝗳𝗼𝗹𝗹𝗼𝘄𝗲𝗿𝘀 on LinkedIn. I never thought of reaching these numbers when I first started sharing on this platform. I’m deeply grateful that these posts have resonated with so many of you.

Wrapping up another incredible IBM TechXchange! The Community Day continues to be my favorite part of the event. I had the chance to connect in person with so many great collaborators from the open source community.

The Best Choice for AI Inference: vLLM https://medium.com/open-5g-hypercore/episode-xxx-the-best-choice-for-ai-inference-vllm-286b2af2df71

📢 𝗧𝗵𝗲 𝗦𝘁𝗮𝘁𝗲 𝗼𝗳 𝗠𝗼𝗱𝗲𝗹 𝗦𝗲𝗿𝘃𝗶𝗻𝗴 𝗖𝗼𝗺𝗺𝘂𝗻𝗶𝘁𝗶𝗲𝘀: 𝗢𝗰𝘁𝗼𝗯𝗲𝗿 𝗘𝗱𝗶𝘁𝗶𝗼𝗻 𝗶𝘀 𝗼𝘂𝘁! We recently launched our newsletter publicly after sharing it internally at Red Hat AI for over a year.

🎉 𝗞𝗦𝗲𝗿𝘃𝗲 𝗵𝗮𝘀 𝗯𝗲𝗲𝗻 𝗮𝗰𝗰𝗲𝗽𝘁𝗲𝗱 𝗮𝘀 𝗮 𝗖𝗡𝗖𝗙 𝗜𝗻𝗰𝘂𝗯𝗮𝘁𝗶𝗻𝗴 𝗣𝗿𝗼𝗷𝗲𝗰𝘁! 🚀 Just a short time ago, we shared that our application was under public comment.

Today I had the pleasure of finally meeting Josh Bottum - the original Kubeflow Community Manager that every @kubefloworg.bsky.social community member should know. 🙌

Excited to share that I’ll be delivering a 𝗸𝗲𝘆𝗻𝗼𝘁𝗲 𝗮𝘁 𝗞𝘂𝗯𝗲𝗖𝗼𝗻 𝗡𝗼𝗿𝘁𝗵 𝗔𝗺𝗲𝗿𝗶𝗰𝗮 𝗶𝗻 𝗔𝘁𝗹𝗮𝗻𝘁𝗮 𝘁𝗵𝗶𝘀 𝗡𝗼𝘃𝗲𝗺𝗯𝗲𝗿! On the first day of the main conference, I’ll be on stage with Anjali Telang for:

Over the past months, I’ve been sharing thoughts on 𝗼𝗽𝗲𝗻 𝘀𝗼𝘂𝗿𝗰𝗲, 𝗹𝗲𝗮𝗱𝗲𝗿𝘀𝗵𝗶𝗽, 𝗮𝗻𝗱 𝗰𝗼𝗺𝗺𝘂𝗻𝗶𝘁𝘆 𝗯𝘂𝗶𝗹𝗱𝗶𝗻𝗴. Here’s a quick roundup of the themes so far:

📢 The 𝗺𝗼𝗱𝗲𝗹 𝘀𝗲𝗿𝘃𝗶𝗻𝗴 𝘀𝗽𝗮𝗰𝗲 is moving fast: new projects, community events, and major progress are happening every week. It’s tough to keep track of it all!

🚀 𝗪𝗲’𝗿𝗲 𝗛𝗶𝗿𝗶𝗻𝗴 𝗦𝗼𝗳𝘁𝘄𝗮𝗿𝗲 𝗘𝗻𝗴𝗶𝗻𝗲𝗲𝗿𝘀! Our team at 𝗥𝗲𝗱 𝗛𝗮𝘁 𝗔𝗜 is growing, and we’re looking for passionate engineers (at multiple levels) to help us push the boundaries of 𝗔𝗜 𝗶𝗻𝗳𝗿𝗮𝘀𝘁𝗿𝘂𝗰𝘁𝘂𝗿𝗲 𝗮𝗻𝗱 𝗺𝗼𝗱𝗲𝗹 𝘀𝗲𝗿𝘃𝗶𝗻𝗴.

🚀 𝗠𝗮𝗷𝗼𝗿 𝗨𝗽𝗱𝗮𝘁𝗲 𝗳𝗼𝗿 𝗞𝗦𝗲𝗿𝘃𝗲! 🚀 We’ve officially taken the next step toward joining the 𝗖𝗡𝗖𝗙 𝗮𝘀 𝗮𝗻 𝗜𝗻𝗰𝘂𝗯𝗮𝘁𝗶𝗼𝗻 𝗣𝗿𝗼𝗷𝗲𝗰𝘁! 🎉 The CNCF TOCs have completed due diligence and are now sponsoring our application.

💡 𝗔𝗱𝘃𝗶𝗰𝗲 𝗳𝗼𝗿 𝗡𝗲𝘄 𝗖𝗦 𝗚𝗿𝗮𝗱𝘂𝗮𝘁𝗲𝘀 𝗘𝗻𝘁𝗲𝗿𝗶𝗻𝗴 𝘁𝗵𝗲 𝗝𝗼𝗯 𝗠𝗮𝗿𝗸𝗲𝘁 💡 It’s no secret that this year has been especially tough for new grads seeking software engineering roles. Many fall into the trap of endlessly polishing resumes or grinding LeetCode.

📢 𝗧𝗵𝗲 𝗦𝘁𝗮𝘁𝗲 𝗼𝗳 𝗠𝗼𝗱𝗲𝗹 𝗦𝗲𝗿𝘃𝗶𝗻𝗴 𝗖𝗼𝗺𝗺𝘂𝗻𝗶𝘁𝗶𝗲𝘀: 𝗦𝗲𝗽𝘁𝗲𝗺𝗯𝗲𝗿 𝗘𝗱𝗶𝘁𝗶𝗼𝗻 𝗶𝘀 𝗼𝘂𝘁! Last month, we launched our newsletter publicly after sharing it internally at Red Hat AI for over a year — and the response has been incredible.

I’m happy to share that I’m serving as an Industry Mentor - Catalyst Research Lab at Carnegie Mellon University School of Computer Science!

𝗦𝘂𝘀𝘁𝗮𝗶𝗻𝗮𝗯𝗶𝗹𝗶𝘁𝘆 𝗶𝗻 𝗼𝗽𝗲𝗻 𝘀𝗼𝘂𝗿𝗰𝗲 𝗶𝘀𝗻'𝘁 𝗮𝗯𝗼𝘂𝘁 𝗰𝗼𝗱𝗲. 𝗜𝘁'𝘀 𝗮𝗯𝗼𝘂𝘁 𝗰𝗮𝗿𝗲. Open source projects don’t fail because of bad technology. They fail because contributors burn out, communities fracture, or energy fades. Technical debt matters.

View my verified achievement from @linuxfoundation.org www.credly.com/badges/4aaa9... via @credly

View my verified achievement from @linuxfoundation.org www.credly.com/badges/f1bae...

Excited to share that I’ll be serving as a member of the Technical Advisory Council at the LF AI & Data Foundation! @lfaidata.bsky.social @linuxfoundation.org

Excited to share that I'll be speaking at 𝗖𝗹𝗼𝘂𝗱 𝗡𝗮𝘁𝗶𝘃𝗲 𝗞𝟴𝘀 𝗔𝗜 𝗗𝗮𝘆, in addition to KubeCon! Dan Sun and I will be delivering 𝗞𝗦𝗲𝗿𝘃𝗲 𝗡𝗲𝘅𝘁: 𝗔𝗱𝘃𝗮𝗻𝗰𝗶𝗻𝗴 𝗚𝗲𝗻𝗲𝗿𝗮𝘁𝗶𝘃𝗲 𝗔𝗜 𝗠𝗼𝗱𝗲𝗹 𝗦𝗲𝗿𝘃𝗶𝗻𝗴: https://sched.co/28D4J

🚀 𝗣𝗿𝗼𝗴𝗿𝗲𝘀𝘀 𝗨𝗽𝗱𝗮𝘁𝗲: 𝗹𝗹𝗺-𝗱 𝗜𝗻𝘁𝗲𝗴𝗿𝗮𝘁𝗶𝗼𝗻 𝗶𝗻 𝗞𝗦𝗲𝗿𝘃𝗲 🚀 Scaling LLM serving brings challenges far beyond a single deployment or @kubernetes.io’ default autoscaling.

I have 𝟭𝟬 𝗰𝗼𝗺𝗽𝗹𝗶𝗺𝗲𝗻𝘁𝗮𝗿𝘆 𝗳𝘂𝗹𝗹 𝗰𝗼𝗻𝗳𝗲𝗿𝗲𝗻𝗰𝗲 𝗽𝗮𝘀𝘀𝗲𝘀 🎟️ for IBM TechXchange Conference on October 6-9 in Orlando — exclusively for open source project contributors and maintainers.

𝗪𝗲 𝗮𝗿𝗲 𝗵𝗶𝗿𝗶𝗻𝗴 a few full-time software engineer positions at various levels with experience in: Golang, C++, Python, GPU kernels, CUDA, Triton, CUTLASS, PyTorch, vLLM, and Kubernetes. Please EMAIL me your resume if you are interested!

🎉 𝗖𝗡𝗖𝗙 𝘁𝘂𝗿𝗻𝘀 𝟭𝟬 🎉 It’s been an incredible journey watching the cloud native community grow and I’ve been lucky to be part of 8 of those 10 years. Here's to many more years of building together! 🚀 @cncf.io @kubernetes.io #CNCF #CloudNative #OpenSource #Kubernetes

📢 Excited to announce that we have started publishing the 𝗦𝘁𝗮𝘁𝗲 𝗼𝗳 𝗠𝗼𝗱𝗲𝗹 𝗦𝗲𝗿𝘃𝗶𝗻𝗴 𝗖𝗼𝗺𝗺𝘂𝗻𝗶𝘁𝗶𝗲𝘀 newsletter on Substack!

🎤 𝗛𝗲𝗮𝗱𝗶𝗻𝗴 𝘁𝗼 𝗞𝘂𝗯𝗲𝗖𝗼𝗻 𝗡𝗼𝗿𝘁𝗵 𝗔𝗺𝗲𝗿𝗶𝗰𝗮 𝗶𝗻 𝗔𝘁𝗹𝗮𝗻𝘁𝗮 𝘁𝗵𝗶𝘀 𝗡𝗼𝘃𝗲𝗺𝗯𝗲𝗿? I’ll be speaking at a few sessions — would love to see you there! Here’s where you can find me:

Excited to share that I’m starting a new position as Co-Chair and Founding Member - Kubernetes AI Conformance WG! We aim to define a standardized set of capabilities, APIs, and configurations that a Kubernetes cluster must offer to reliably and efficiently run AI/ML workloads.

Great news! Kubeflow Trainer has officially joined the PyTorch Ecosystem! We put together a blog post with all the details. Take a look! pytorch.org/blog/pytorch...

🚀 𝗡𝗲𝘄 𝗥𝗲𝗹𝗲𝗮𝘀𝗲: 𝘴𝘰𝘤𝘪𝘢𝘭-𝘮𝘦𝘥𝘪𝘢-𝘬𝘪𝘵 v0.2.2 is here! Excited to share the latest updates to 𝘀𝗼𝗰𝗶𝗮𝗹-𝗺𝗲𝗱𝗶𝗮-𝗸𝗶𝘁, a lightweight and open source multi-platform social media management tool. 🆕 𝗪𝗵𝗮𝘁’𝘀 𝗻𝗲𝘄:

I’m honored to join the advisory board for an National Science Foundation (NSF)-sponsored project at Purdue Computer Science. Grateful for the opportunity to contribute my small part to the scientific research community!

It’s hard to believe the llm-d project launched just 𝟮 𝗺𝗼𝗻𝘁𝗵𝘀 𝗮𝗴𝗼 — and it's already gaining serious traction across the industry!

🚀 Exciting news: The AI Alliance is now supporting 𝗟𝗹𝗮𝗺𝗮 𝗦𝘁𝗮𝗰𝗸 — a framework that makes building and deploying AI applications with ease and confidence.

🚀 Introducing @kubefloworg.bsky.social Trainer 2.0 — the next evolution in AI model training on @kubernetes.io! We’re excited to announce 𝗞𝘂𝗯𝗲𝗳𝗹𝗼𝘄 𝗧𝗿𝗮𝗶𝗻𝗲𝗿 2.0 — tailored to simplify and scale AI model training in K8s-native environments. 🔍 What’s New in 2.0?

🎤 If you recently discovered Apache Airflow thanks to some unexpected drama at a Coldplay concert... welcome to the world of 𝘄𝗼𝗿𝗸𝗳𝗹𝗼𝘄 𝗼𝗿𝗰𝗵𝗲𝘀𝘁𝗿𝗮𝘁𝗶𝗼𝗻!

🙌 𝗢𝗽𝗲𝗻 𝘀𝗼𝘂𝗿𝗰𝗲 𝗶𝘀 𝗽𝗼𝘄𝗲𝗿𝗲𝗱 𝗯𝘆 𝗽𝗲𝗼𝗽𝗹𝗲 — 𝗻𝗼𝘁 𝗷𝘂𝘀𝘁 𝗰𝗼𝗱𝗲. Behind every release, every merged PR, every answered issue… There’s someone who took the time to care.

🚀 Check out this insightful blog by Erica Hughberg and Alexa Griffith on building a scalable, cloud-native GenAI platform with open-source solutions via Envoy AI Gateway, KServe, and more! 🔗 aigateway.envoyproxy.io/blog/envoy-a...

🎉 𝗜𝗻 𝗼𝗽𝗲𝗻 𝘀𝗼𝘂𝗿𝗰𝗲, 𝘀𝗺𝗮𝗹𝗹 𝘄𝗶𝗻𝘀 𝗮𝗿𝗲 𝘁𝗵𝗲 𝗯𝗶𝗴 𝘄𝗶𝗻𝘀. It’s easy to focus only on major milestones — big releases, new features, or keynote talks. But the real strength of an OSS project lies in the 𝘭𝘪𝘵𝘵𝘭𝘦 𝘮𝘰𝘮𝘦𝘯𝘵𝘴 that often go unnoticed:

🚀 Excited to share my latest open-source project: 𝗦𝗼𝗰𝗶𝗮𝗹 𝗠𝗲𝗱𝗶𝗮 𝗞𝗶𝘁 - A comprehensive tool for managing content across multiple social platforms! 🌟 𝗜𝘁'𝘀 𝗰𝗼𝗺𝗽𝗹𝗲𝘁𝗲𝗹𝘆 𝗳𝗿𝗲𝗲 𝗮𝗻𝗱 𝗼𝗽𝗲𝗻-𝘀𝗼𝘂𝗿𝗰𝗲! Try it out and give it a star if you find it useful: github.com/terrytangyua...

🧩 𝗪𝗮𝗻𝘁 𝘁𝗼 𝗴𝗲𝘁 𝘀𝘁𝗮𝗿𝘁𝗲𝗱 𝗶𝗻 𝗼𝗽𝗲𝗻 𝘀𝗼𝘂𝗿𝗰𝗲? 𝗦𝘁𝗮𝗿𝘁 𝘀𝗺𝗮𝗹𝗹 — 𝗯𝘂𝘁 𝘀𝘁𝗮𝗿𝘁. When people ask how I got involved in open source, they’re often surprised by the answer: 📌 It started with 𝗳𝗶𝗹𝗶𝗻𝗴 𝗮 𝗯𝘂𝗴 𝗼𝗻 𝗚𝗶𝘁𝗛𝘂𝗯.

🧑‍🏫 𝗢𝗽𝗲𝗻 𝘀𝗼𝘂𝗿𝗰𝗲 𝗺𝗲𝗻𝘁𝗼𝗿𝘀𝗵𝗶𝗽 𝗶𝘀𝗻’𝘁 𝗮𝗯𝗼𝘂𝘁 𝗵𝗮𝘃𝗶𝗻𝗴 𝗮𝗹𝗹 𝘁𝗵𝗲 𝗮𝗻𝘀𝘄𝗲𝗿𝘀 — 𝗶𝘁’𝘀 𝗮𝗯𝗼𝘂𝘁 𝗰𝗿𝗲𝗮𝘁𝗶𝗻𝗴 𝘀𝗽𝗮𝗰𝗲 𝗳𝗼𝗿 𝗴𝗿𝗼𝘄𝘁𝗵. I learned about writing good unit tests from a PR review in the pandas Python library (thank you Jeff Reback for your guidance many years ago!) 🧵

💡 𝗜𝗻 𝗼𝗽𝗲𝗻 𝘀𝗼𝘂𝗿𝗰𝗲, 𝘆𝗼𝘂 𝗱𝗼𝗻’𝘁 𝗮𝘀𝘀𝗶𝗴𝗻 𝘁𝗮𝘀𝗸𝘀 — 𝘆𝗼𝘂 𝗶𝗻𝘀𝗽𝗶𝗿𝗲 𝗰𝗼𝗻𝘁𝗿𝗶𝗯𝘂𝘁𝗶𝗼𝗻. 𝗜 𝗺𝗲𝗻𝘁𝗶𝗼𝗻𝗲𝗱 𝘁𝗵𝗶𝘀 𝗶𝗻 𝗺𝘆 𝗽𝗿𝗲𝘃𝗶𝗼𝘂𝘀 𝗽𝗼𝘀𝘁, 𝗯𝘂𝘁 𝗵𝗼𝘄 𝗱𝗼 𝘆𝗼𝘂 𝗶𝗻𝘀𝗽𝗶𝗿𝗲 𝗰𝗼𝗻𝘁𝗿𝗶𝗯𝘂𝘁𝗶𝗼𝗻? 🧵

🧵 Technical leadership in open source isn't about control — it's about stewardship. In OSS, you don’t manage people. You manage trust.

Excited to announce that I'll be co-chairing #CloudNative & #Kubernetes AI Day North America (co-located with #KubeCon), together with @rochaporto.bsky.social, @rajaskakodkar.bsky.social, and Yuzhui Liu! @cncf.io @kubernetes.io #CNK8sAIDay #CloudNativeCon #MLOps #AI #DevOps #K8s

Honored to receive the IBM Tech 2025 Award and attend the incredible conference in San Diego! I'm grateful for the opportunity to celebrate our accomplishments, connect with brilliant minds, learn from inspiring speakers. A big thank you to my amazing colleagues who’ve supported me along the way!

It’s not easy to say goodbye, but it’s been an incredible journey over the past decade working with the TensorFlow community. Technologies may come and go, but the impact this work has had on the field — and on my own growth — will last a lifetime.