The energy in SF at #AIWorldFair is electric ⚡️ I want to give a big thanks to the team for having me highlight the open source Docling (docling.ai) project & how to turn unstructured data into AI-ready formats like Markdown/JSON (or straight into LangChain and your agents 🤖) 🎥 youtu.be/-x5GEVnkuRw

You might’ve noticed I love open source and the impact that these projects have on the community 👀 that’s why this past week @devbcn.bsky.social I had the coolest opportunity to join my COUSIN who’s a PhD candidate and show open models + cloud-native for multi agent systems for research :)

This year @devoxx.uk we asked a simple question: can we use local models as AI code assistants? 🤔 The answer? Yes… and no! But you should check out the recording though and see what worked (like MCP, Skills.MD, and more) as well as what to know about local LLMs for devs :) 🎥 youtu.be/Lhqp7gKXu2w

@cedricclyburn.com "Shows the 5 Podman Features You Should Know: Kubernetes & Containers Simplified" in this YouTube video: www.youtube.com/watch?v=dEy3.... Can you guess what they are? @opensource #podman

AI coding tools are about to get more expensive, and the @anthropic.com news yesterday is a good indicator of what’s to come ($20 to $100 for Claude Code). Understandable, because GPU compute isn’t cheap 👀 Running models in-house with #vLLM is starting to look quite nice!

Had an AWESOME conversation with the @allthingsopen.bsky.social community about local LLMs on small hardware: model compression can quantize a model from 220 GB → 55 GB with <1% accuracy loss, and inference engines like vLLM help run them fast and efficiently. 🎥 www.youtube.com/watch?v=xGqV...

🔌 Messy data meets LLMs! Join Andy Igdal and Cedric Clyburn (@cedricclyburn.bsky.social) at DevBcn 2026. Learn how Python and AI can tackle residential electrification data in the Big Data & AI track! 📊🤖 📅 June 16-17 🔗 buff.ly/dz1tICU #devbcn26

Self-hosting LLM’s typically includes a set of requirements for our infrastructure, ex: 🏎️ Hardware accelerators ⚙️ System & model configuration 📚 Specific libraries/dependencies That’s why @cern.voxxeddays.ch I was honored to demo Ramalama.ai, a project that containers to safely run AI models 🤖

LLM Inference workloads are becoming monolithic, heavy, & hard to scale. That's where platform engineers can embrace llm_d, a new open-source effort that’s starting to tackle a problem we’re seeing more and more in prod ML stacks!!! 🎧 to @cedricclyburn.com & Christopher Nuland👇 to learn more

Live from #KubeCon Europe in Amsterdam! 🇳🇱 Big announcement from the Red Hat booth: llm-d, a cloud-native way to run AI at scale with major performance & cost savings. + ran a workshop on RAG at scale using KubeFlow & Docling on Kubernetes. Slides below 👇

If you’ve seen my “silly slide” of all the open-source AI projects at past dev conferences, this week at #KubeCon we’re putting them together! Join me & friends for a hands-on workshop: build a sovereign RAG app on K8s with Kubeflow, Knative, Docling & vLLM. Wed 3/25 @ 11am 🚀 🔗 sched.co/2CW1f

Many folks compare whether “Opus 4.6 is better than ChatGPT 5.4” but there’s quietly been TONS of progress in the open source world of AI too (ex. #DeepSeek, #Llama) 🤖 with no rate limits, ads, and 100% local! 📰 Check out the article on @allthingsopen.bsky.social: allthingsopen.org/articles/run...

What does it look like to integrate #MCP into real enterprise workflows? This week at @devnexus.bsky.social we showed how to run, inspect, and scale agentic AI for debugging a Kubernetes clusters, diagnosing Ansible jobs, and much more! Check out the slides below ⬇️ as well as the MCP servers used!

Dev track is deploying heavy artillery. Stop polyfilling frontend and duct-taping backend. Time to build stacks that scale. The engineers: Switch Angel, @tej.as, @abtris.bsky.social, Krasimir Tsonev, @clytaemnestra.bsky.social, @utilitybend.com, @cedricclyburn.com, @ericwbailey.website & more.

With agentic coding tools like #ClaudeCode, #Cursor, and #Codex, how can you get the results you need from an LLM without spending all your time going back and forth about a wrong dependency or missing test cases 😆 well… 🎥 Spec-Driven Development: AI Assisted Coding Explained: youtu.be/mViFYTwWvcM

🤖 AI Agents are awesome… until they aren’t! What just happened with an 🦞 OpenClaw (ClawdBot/MoltBot) agent in the Matplotlib project on GitHub shows the potential challenges with giving AI Agents (LLM + Tools + Reasoning) the ability to act autonomously. It’s why guardrails and auth are important!

Want to build fast? We’ve got the blueprints. 🔹 @lomagnette.bsky.social: Building Interoperable AI Agents in 30 mins. 🔹 @danieloh30.bsky.social, @cedricclyburn.com & Legare Kerrison: A crash course in Open Source AI. 🔹 @marianne-h.bsky.social: Unveiling the math behind it all.

AI sits to your right, but you're the captain - @vilojona.bsky.social: Practical ways to keep AI codegen under control - @vjovanov.bsky.social: Taming GraalVM with AI - @timtebeek.github.io: Deterministic modernization in the AI age - @kevindubois.com @cedricclyburn.com: Local development strategies

Today kicks off @jfokus.se in Stockholm 🇸🇪 and we just delivered our workshop on building with open source AI models using: ⚡️ #vLLM serve local LLM’s as a local API endpoint 🦜 @langchain4j.dev for adding LLM capabilities in our Java application Was a huge hit! Slides ⬇️

Automatizar tu vida con servidores MCP: integraciones, flujos y cómo conectar herramientas para que trabajen por ti ⚙️ Con @cedricclyburn.com en T3chFest 2026

I’m excited to bring #Ramalama, the container-native project to run AI models locally, to @cern.voxxeddays.ch 🙌 We’ll show how fast devs can spin up an open source model using their favorite container engine (shoutout @podmanio.bsky.social) for RAG (Q&A on PDF’s) and Agentic (calling API’s) 🤖

@jfokus.se is BACK for its 20th year and I’m so happy to be hosting a workshop on open source models & how to scale them up on #Kubernetes! We’ll feature projects including #vLLM + @langchain4j.dev + @promptfoo.bsky.social and more for enterprise AI deployment, app dev, and testing 🔥

Really excited to share that our team at Red Hat is HIRING! 🎉 We're looking for excited new graduates with a passion for open source AI, interested in creating content to help developers, and traveling to meetups/conferences! 🔗 AI Developer Advocate: redhat.wd5.myworkdayjobs.com/Jobs/job/Bos...

I found the infamous @cedricclyburn.com 🥳 at AWS re:Invent!

Being a developer today means wearing all the hats 🧢 Dev. Ops. Infra. Admin. At #Devnexus, @cedricclyburn.com shows how he automated his daily dev life using MCP Servers and a local AI agent built with open source tools, and how you can too! 🤖 devnexus.com/events/how-i... 🎟️ Tickets- devnexus.com

We’re BACK to Sweden 🇸🇪 this February! Excited to share that I’ll be joining and speaking at @jfokus.se this Feb 2-4th with the wonderful Stockholm dev community 💻 come by for our Day 1 workshop on building, testing, and deploying Java ☕️ apps using open source AI models and containers/Kubernetes!

Had one of my most fun sessions yet with @allthingsopen.bsky.social on Local LLM’s, showing how developers can setup their own private RAG, Vibe Coding, and Agentic AI apps (thanks to #MCP) without needing 3rd party models! Ft @podmanio.bsky.social + #vLLM 💻 Slides: red.ht/local-llm

⚙️ Deep Dive Monday at #Jfokus — Building with Open Source AI: A Crash Course with @cedricclyburn.com & Legare Kerrisson from Red Hat. Learn how open models, Linux & Kubernetes empower you to forge your own AI path. 🔥 www.jfokus.se #DeveloperConference #AI #OpenSource #RedHat #Kubernetes #LLMs

Thanks to @cedricclyburn.com & Christopher Nuland, I'm pretty much impressed with llm-d.ai: a Kubernetes-native distributed inference stack that brings cache-aware routing and disaggregated serving to LLMs. Watch the full episode to know more: youtu.be/2Wtug1kTwUk

Back to my hometown in Raleigh, NC for @allthingsopen.bsky.social this week 🤩 it’ll be a busy time with my Local LLMs talk tomorrow (Developer Room 1, 3:15pm) but we’ve already started with a #WeLoveOpenSource chat and I’ll be at the #RedHat booth tomorrow doing fun live demos 💻

We had a BLAST this weekend in Boston for #DevConfUS and the #vLLM meetup talking all things open source and AI 🚀 from LLM compression, distributed model serving on Kubernetes, RAG/Agentic apps and so much more, the community is what drives things forward, and I’m so grateful!

OpenAI’s gpt-oss language model is a beast, and matches models like o3 and o4-mini on coding, tool use, and more 🤯 but how can you run it yourself with zero trust security, in containers + automatic GPU acceleration? The #Ramalama project has you covered: developers.redhat.com/articles/202...

Containers & Kubernetes don’t have to be complicated! Check out our recap of @cedricclyburn.bsky.social’s #Devnexus session “Containers and Kubernetes Made Easy: Deep Dive into Podman Desktop” 👉 devnexus.com/posts/contai... 🎟Get Super Early Bird tickets until Sept 1→ devnexus.com

It’s widely known that LLM’s can be costly and difficult to scale, but in the past few weeks I’ve learned about #llm-d, an open source framework for distributed AI inference on Kubernetes & put together this simple explainer blog ⤵️ What is llm-d & Why Do We Need It: www.redhat.com/en/blog/what...

We keep hearing about open-source AI like GPT-OSS, DeepSeek, Qwen, Llama 🦙 & more: but how do you actually test and scale them? At #Ai4 in Vegas 🎰, we built a Blackjack coaching game to benchmark small language models on both CPU and GPU via #llama.cpp and #vLLM! I’ll link the slides and demo ⬇️

Cedric Clyburn (@cedricclyburn.bsky.social), Senior Developer Advocate for Red Hat, joins us on stage to share their insights. Don't miss "Everything You Need to Know About Running LLMs Locally" at #AllThingsOpen! 2025.allthingsopen.org/sessions/eve...

Couldn’t be happier after a busy few days in Berlin for @wearedevelopers.bsky.social World Congress, catching up with friends & hanging out at the #RedHat stage! I’ll link my own developer & AI engineer focused sessions below, featuring @podmanio.bsky.social #vLLM & Meta’s #LlamaStack!

Happy Monday folks! I’m inbound ✈️ to @devbcn.bsky.social where I’ll be speaking about my favorite open source projects @podmanio.bsky.social & @podman-desktop.io to show how simple it can be for developers to move from containers, to pods, to Kubernetes! Join me on July 9th @ 2:20 in Room 2 :)

Back to my roots! I’m here in the NY IBM Technology studio to record a new whiteboard on @podmanio.bsky.social + @podman-desktop.io and #BootableContainers! It’s always a fun time producing these but Bootc is a uniquely special subject :)

Why rent AI when you can run it? Learn how to deploy open-source LLMs locally, optimize performance & integrate with your data with @cedricclyburn.bsky.social at dev2next. Live demos included! 🚀 www.dev2next.com/speaker/e915... 🎟️ dev2next.com 💥 Code JOIN-CEDRICC-50OFF = discount

📹 Revive la charla «Everything You Need to Know About Running LLMs Locally» por @cedricclyburn.bsky.social, Roberto Carratalá

Discover how to make LLM fine-tuning accessible with InstructLab with this Devoxx UK talk by @cedricclyburn.bsky.social and Legare Kerrison. Learn to refine models for specific use cases on consumer hardware without needing data science expertise. Watch here - www.devoxx.co.uk//talk?id=8092

There’s a ✨ revolution ✨ happening in the open source ecosystem around private and local AI systems, which keep your data secure and your costs low (or free)! Earlier this month I joined #AIFokus and the @jfokus.se community to share how developers can get started, recording 🎥⤵️

Watch @cedricclyburn.bsky.social and Roberto Carratalá’s Devoxx UK session "Everything You Need to Know About Running LLMs Locally" to discover how to deploy your own models, optimise performance, and integrate with unique data for privacy-focused AI solutions. Find it here - buff.ly/71Dh2Jh

It’s day 2️⃣ at #DevConf_CZ where we’ve been talking all things open source, now at the conference evening social (with beautiful weather) to recap a big day! Today’s keynote was on Bootable Containers with @podmanio.bsky.social, plus our @instructlab.bsky.social workshop, and so much more 🥳

We’re LIVE 🎥 here at #DevConf_CZ, the ultimate open source conference learning about the projects, people, and ideas that foster this amazing community! Was honored to help host the keynote (slides below) around open source AI and how devs, ops, and beyond can get involved :)

Yesterday was #KCDNewYork and I’m beyond proud of our work in bringing together 250+ of the cloud-native community in my favorite city to share, network, and build relationships! Love seeing the power of open source at work, and thanks to the incredible team and volunteers 👏

While #RedHatSummit is over, I had an absolute blast and wanted to put together a quick recap to show you the experience 🎥🍿 from running around to talks, recording sessions on #BootableContainers, and catching up with friends, it was a really amazing time! 🔗 youtube.com/shorts/2lGu-...

🎬 We’re LIVE here from #RedHatSummit and the energy has been amazing! So good to catch up with new and old friends, talking all things open source and featuring projects like #vLLM, @podmanio.bsky.social, @instructlab.bsky.social and many more that are building a bright future for AI!

85% of the world’s data is unstructured, so today at @_odsc #ODSCEast in Boston we deep dive’d on advanced document parsing for AI workflows, showing how PDF’s and other valuable data sources can be effectively used in RAG and Agentic AI applications. Slides are linked below 👇