We had a BLAST this weekend in Boston for #DevConfUS and the #vLLM meetup talking all things open source and AI 🚀 from LLM compression, distributed model serving on Kubernetes, RAG/Agentic apps and so much more, the community is what drives things forward, and I’m so grateful!

OpenAI’s gpt-oss language model is a beast, and matches models like o3 and o4-mini on coding, tool use, and more 🤯 but how can you run it yourself with zero trust security, in containers + automatic GPU acceleration? The #Ramalama project has you covered: developers.redhat.com/articles/202...

Containers & Kubernetes don’t have to be complicated! Check out our recap of @cedricclyburn.bsky.social’s #Devnexus session “Containers and Kubernetes Made Easy: Deep Dive into Podman Desktop” 👉 devnexus.com/posts/contai... 🎟Get Super Early Bird tickets until Sept 1→ devnexus.com

It’s widely known that LLM’s can be costly and difficult to scale, but in the past few weeks I’ve learned about #llm-d, an open source framework for distributed AI inference on Kubernetes & put together this simple explainer blog ⤵️ What is llm-d & Why Do We Need It: www.redhat.com/en/blog/what...

We keep hearing about open-source AI like GPT-OSS, DeepSeek, Qwen, Llama 🦙 & more: but how do you actually test and scale them? At #Ai4 in Vegas 🎰, we built a Blackjack coaching game to benchmark small language models on both CPU and GPU via #llama.cpp and #vLLM! I’ll link the slides and demo ⬇️

Cedric Clyburn (@cedricclyburn.bsky.social), Senior Developer Advocate for Red Hat, joins us on stage to share their insights. Don't miss "Everything You Need to Know About Running LLMs Locally" at #AllThingsOpen! 2025.allthingsopen.org/sessions/eve...

Couldn’t be happier after a busy few days in Berlin for @wearedevelopers.bsky.social World Congress, catching up with friends & hanging out at the #RedHat stage! I’ll link my own developer & AI engineer focused sessions below, featuring @podmanio.bsky.social #vLLM & Meta’s #LlamaStack!

Happy Monday folks! I’m inbound ✈️ to @devbcn.bsky.social where I’ll be speaking about my favorite open source projects @podmanio.bsky.social & @podman-desktop.io to show how simple it can be for developers to move from containers, to pods, to Kubernetes! Join me on July 9th @ 2:20 in Room 2 :)

Back to my roots! I’m here in the NY IBM Technology studio to record a new whiteboard on @podmanio.bsky.social + @podman-desktop.io and #BootableContainers! It’s always a fun time producing these but Bootc is a uniquely special subject :)

Why rent AI when you can run it? Learn how to deploy open-source LLMs locally, optimize performance & integrate with your data with @cedricclyburn.bsky.social at dev2next. Live demos included! 🚀 www.dev2next.com/speaker/e915... 🎟️ dev2next.com 💥 Code JOIN-CEDRICC-50OFF = discount

📹 Revive la charla «Everything You Need to Know About Running LLMs Locally» por @cedricclyburn.bsky.social, Roberto Carratalá

Discover how to make LLM fine-tuning accessible with InstructLab with this Devoxx UK talk by @cedricclyburn.bsky.social and Legare Kerrison. Learn to refine models for specific use cases on consumer hardware without needing data science expertise. Watch here - www.devoxx.co.uk//talk?id=8092

There’s a ✨ revolution ✨ happening in the open source ecosystem around private and local AI systems, which keep your data secure and your costs low (or free)! Earlier this month I joined #AIFokus and the @jfokus.se community to share how developers can get started, recording 🎥⤵️

Watch @cedricclyburn.bsky.social and Roberto Carratalá’s Devoxx UK session "Everything You Need to Know About Running LLMs Locally" to discover how to deploy your own models, optimise performance, and integrate with unique data for privacy-focused AI solutions. Find it here - buff.ly/71Dh2Jh

It’s day 2️⃣ at #DevConf_CZ where we’ve been talking all things open source, now at the conference evening social (with beautiful weather) to recap a big day! Today’s keynote was on Bootable Containers with @podmanio.bsky.social, plus our @instructlab.bsky.social workshop, and so much more 🥳

We’re LIVE 🎥 here at #DevConf_CZ, the ultimate open source conference learning about the projects, people, and ideas that foster this amazing community! Was honored to help host the keynote (slides below) around open source AI and how devs, ops, and beyond can get involved :)

Yesterday was #KCDNewYork and I’m beyond proud of our work in bringing together 250+ of the cloud-native community in my favorite city to share, network, and build relationships! Love seeing the power of open source at work, and thanks to the incredible team and volunteers 👏

While #RedHatSummit is over, I had an absolute blast and wanted to put together a quick recap to show you the experience 🎥🍿 from running around to talks, recording sessions on #BootableContainers, and catching up with friends, it was a really amazing time! 🔗 youtube.com/shorts/2lGu-...

🎬 We’re LIVE here from #RedHatSummit and the energy has been amazing! So good to catch up with new and old friends, talking all things open source and featuring projects like #vLLM, @podmanio.bsky.social, @instructlab.bsky.social and many more that are building a bright future for AI!

85% of the world’s data is unstructured, so today at @_odsc #ODSCEast in Boston we deep dive’d on advanced document parsing for AI workflows, showing how PDF’s and other valuable data sources can be effectively used in RAG and Agentic AI applications. Slides are linked below 👇

Great turnout!! @cedricclyburn.bsky.social and Roberto giving a talk about running LLMs locally at @devoxx.uk

What a time I had at @devoxx.uk this week, the energy was fantastic and it’s an honor to have attended and spoke at #DevoxxUK for the first time! Thanks to the Red Hat team with @kevindubois.com @danieloh30.bsky.social @myfear.com and many other rockstars for making this happen! 🚀 Slides below :)

This week at #MLPrague I had the opportunity to join some fellow Red Hat rockstars and deliver a 3-hour presentation on infusing your data into a model, with a deep dive on @instructlab.bsky.social, #Docling, #vLLM and beyond for production-ready AI systems for the enterprise!

📣 Been waiting to share this news! I’m honored to be joining DevConf.CZ this year as a keynote speaker, taking place June 12-14th in Brno, Czech Republic. Joined by the wonderful @cybette.bsky.social, our talk “Fine-Tuning Our Way Toward Openness in AI” explores tools, techniques, and collaboration!

Join Roberto Carratalá and @cedricclyburn.bsky.social for "Everything You Need to Know About Running LLMs Locally." Learn to deploy LLMs tailored to your needs, optimise performance, and integrate with private data. Session details 👉 buff.ly/np2oOyl

From #CentOSConnect: Carol Chen and @cedricclyburn.bsky.social talked about using bootable containers to deploy AI workloads. www.youtube.com/watch?v=KDOy... #CentOS #bootc

🚨 The KCD New York 2025 agenda is LIVE! 231 submissions → 1 stacked schedule of deep dives, lightning talks, panels & more. Check it out + grab your ticket 🎟️ 👉 kcdnewyork.com #KCDNewYork #Kubernetes #CloudNative @cncf.bsky.social

20 Days left until the highly anticipated @devoxx.uk Have you started favouriting & building your schedule for the event? Head to bit.ly/3EqWdcg to explore the agenda. Click the star icon at the bottom right to favourite a session. This helps us put popular sessions in the bigger rooms.

Wooo hoo! First #Devoxx completed successfully ✅ I had a fantastic time with the Red Hat team in Paris this week at @devoxx.fr and it blew my mind! 4,500 developers and engineers all tinkering and live demo-ing, including my talk on document processing using #Docling

Quarkus Langchain4J support to MCP Servers - Hands On! buff.ly/YEr9O2i #Java #quarkus #mcp #aiml #devx

🚀 2025 has already been incredible, but now I’m excited to announce upcoming conferences that I’ll be attending & speaking at! Super excited to join incredible friends and colleagues at #Devoxx, #ODSC, and more! If you’ll be around, please let me know and come say hi 👋

👀 Keep an eye out on the Red Hat channels for some new developer content! We just wrapped up my first studio session explaining fundamental AI concepts and covering open source projects (shoutout @podmanio.bsky.social, @instructlab.bsky.social , vLLM + more)

Discover how to make LLM fine-tuning accessible with InstructLab. Join Legare Kerrison and @cedricclyburn.bsky.social for a live demo and learn how to refine models for specific use cases at any skill level. For full details visit buff.ly/NPZg1hh

Ya disponibles las charlas de Borja Pérez, Víctor Carreras, @cedricclyburn.bsky.social, Roberto Carratalá y César Peña en T3chFest 10. https://www.youtube.com/@T3chFest

Don't miss @cedricclyburn.bsky.social's talk at Arc of AI, to dive into the advantages of local LLM deployment, from selecting the right open source model to optimizing performance on consumer hardware 💫 www.arcofai.com/speaker/f596... Code JOIN-CEDRIC-50OFF = discount! 🎟️ arcofai.com

Learn about Synthetic data: a secret ingredient for better language models - and the approach #InstructLab takes, with @cedricclyburn.bsky.social and @cybette.bsky.social www.redhat.com/en/blog/synt...

BIG thanks to the folks at @t3chfest.es for a wonderful and community-first conference this week, we had a blast sharing some open source tools and AI models 🤖 for developers to save on costs and keep your data private! I’ll link the demo repository and slides below 👇

🚀 Speaker Announcement at #AIfokus: @cedricclyburn.bsky.social (Red Hat) Cedric will show how to run LLMs locally—no cloud needed! Learn how to ✔ Choose the right open-source model ✔ Optimize performance on consumer hardware ✔ Integrate LLMs with private data (RAG) ✔ See it all in action !

Speaker POV of our session about #Java and #AI with #LangChain4j and #Quarkus at DevNexus with @danieloh30.bsky.social @quarkus.io @langchain4j.dev @devnexus.bsky.social

We’re out and about at @devnexus.bsky.social in Atlanta today sharing the good word about #OpenSource and AI Model Customization with @instructlab.bsky.social! Come by for some awesome USB Keychain bottle openers :)

Corre tu propio LLM en local 🤖 Aprende cómo optimizar y personalizar modelos en tu propio hardware. Con @cedricclyburn.bsky.social y Roberto Carratalá en T3chFest 10.

Today wraps up DeveloperWeek in Santa Clara, where our Red Hat team was honored to join and keynote the open source path for AI & developer experience with @podmanio.bsky.social, OpenShift, and cloud-native technology! Also honored to receive the #DEVIES award for mobile development innovation 📱🚀

Next up at CentOS Connect (15:45 UTC): @cybette.bsky.social and @cedricclyburn.bsky.social talk about using bootable containers for AI workloads. https://youtube.com/live/pj5pRiDZSwY?feature=share #CentOSConnect

Containers and Kubernetes made easy: Deep dive into Podman Desktop and new AI capabilities https://buff.ly/4go5aQI #DevNationDay @cedricclyburn.bsky.social #PodmanDesktop #AI

A bit late to the @fosdem.bsky.social recap party, but I had SUCH a blast as a first time attendee. Everyone is so kind, helpful, and really technically wise, I felt like it was a developer’s Disneyland 🏰 glad to be able to share my tiny bit of expertise in #AI and see some great friends!

Very very excited to be headed to @fosdem.bsky.social today, where the open source world meets to connect and learn! I’ll be speaking on @podmanio.bsky.social, bootable containers with @centos.org, as well as synthetic data generation this weekend. First time attendee, let’s see what it’s about 🚀

Don't miss @cedricclyburn.bsky.social 's amazing session! #aiml #genai

First time attendee and speaker at #FOSDEM in Brussels next year! I’m really excited to have two sessions accepted for the Low-level AI Engineering & Hacking DevRoom, one on synthetic data generation for Large Language Models and another on the #Podman AI Lab! fosdem.org/2025/schedul...

Since there’s a lot of really useful data tucked away in PDF’s and documents that aren’t easily consumable by LLM’s, the #Docling project uses computer vision models and OCR to parse into Markdown, JSON, and more! I experimented with the CLI and library in this quick video: youtu.be/0vmQ7BmLax8

Hey, #RedHat OSPO (open source practice office) is #hiring folks for several positions in OSS AI/ML. Exceptionally, some of these positions are in #SanFrancisco. Here's the #job listings: redhat.wd5.myworkdayjobs.com/en-US/jobs/j... redhat.wd5.myworkdayjobs.com/en-US/jobs/j... (1/4)