Bootstrapped a Private GenAI Startup to $1M revenue, AMA blog.helix.ml/p/bootstrapp...

Thanks Hannah! 💖

Good morning #KubeCon! Come find me if you want to talk running LLM systems like vision RAG in production on Kubernetes today. Email [email protected] or reply here!

Phil setting up a vLLM vision model provider on helix on his nerd phone on the Elizabeth line #kubecon

Catch my talk with Priya Samuel on running LLMs in production on k8s today at #KubeCon at S10A at 3:15pm ✨

Trying (but failing) to be as colourful as @hannahfoxwell.net today!

Oh hello there BlueSky! We've arrived here just in time to share all the highlights of #KubeCon #CloudNativeCon in sunny London! Don't miss @hannahfoxwell.net and @lmarsden.bsky.social at 15:20 today talking about Platform Engineering and Developer Experience For Your On Prem LLM

I looked to define a term that’s being thrown around — #AI-native developer — with the help of @guypo.com @lmarsden.bsky.social and Thoughtworks’ Mike Mason so you can prepare your software teams for the near future. thenewstack.io/what-is-an-a... What’s your definition? Only on @thenewstack.io

Deepseek are clever fuckers. I wrote this about how Deepseek is pushing decision makers in large financial institutions to seriously consider running their own models instead of calling out to Microsoft, Amazon & Google Link below 👇

Speaker @lmarsden.bsky.social of MLOps Consulting will be in our SOOCon25 AI Openness track! 🎤 Join to hear about Production-Ready LLMs on Kubernetes: Patterns, Pitfalls, and Performance.💡https://buff.ly/3HjeQxq #opensource #opensourceai #ai #stateofopencon #soocon25 #opensourcelondon #openuk

I enjoyed Stories of Your Life and Others so much that I'm moving straight to Chiang's other collection: Exhalation.

MS Teams in the UK this morning is the most grim experience imaginable, tons of jitter and bandwidth seems fucked - like trying to do a video call over a highly contended LTE connection - my network connection is fine (per mtr) - is there an outage in some MS data center somewhere?

We shipped a lot over Christmas and I came here to release it: github.com/helixml/heli... - You can now drag'n'drop files directly into knowledge for Helix apps (rather than having to go via the filestore). - Initial support for MCP (more on this coming soon!)

Cancelled my X subscription over all the stupid political interference

Thank you to @dciangot.com for doing the heavy lifting getting HelixML GPU runners running on Slurm HPC infra to take advantage of hundreds of thousands of GPUs running on Slurm infrastructure and transform them into multi-tenant GenAI systems! Read all about it here: blog.helix.ml/p/running-ge...

This is so awesome! Imagine being able to combine the worlds of cloud-native scalable web services for LLMOps with the raw power of Slurm-powered supercomputers with some of the biggest compute power, networking and GPUs! Check out the writeup here: blog.helix.ml/p/running-ge...

So @cybernetist.com got gptscript working with llama3.3:70b! Check out the detailed writeup here: blog.helix.ml/p/gptscript-...

Got helix.ml running GenAI on a supercomputer..

Fucking dope helix.ml release from @cybernetist.com if you like function calling in open source LLMs and @GPTScript_ai github.com/helixml/heli... (Excuse my French)

Test Driven Development (TDD) for your LLMs? Yes please, more of that please! Back to basics - write a test, see the test fail, improve the prompt, see it pass, check it in - just like you would with any other code 😄

Luke, this post, including the video, was very helpful. I loved the conference talk. I took my graduate students through a somewhat similar exercise last week for their last lab of the semester. Well done. Thank you.

This is a wonderful post by @lmarsden.bsky.social Great presentation and video as well.

ICYMI, here's my 2-part blog series on how we can all be AI engineers with open source models – and how to apply testing best practices to LLM apps 1. blog.helix.ml/p/we-can-all... 2. blog.helix.ml/p/from-click...

@llm360.bsky.social please consider adding me to the open source LLMs starter pack ☺️

So how can we _actually_ do AI on Kubernetes? Here's my humble proposal: LLM apps and tests as data (CRDs). Deeply integrated into the existing CI/CD pipeline e.g GitLab and Flux. Self hosted LLMs on GPUs if you want to. Runnable code: github.com/helixml/gena...

Just followed all 1400 people who followed me. If you see this, like this post to say hi! 🦋💚🦋

I wrote a quick summary of the latest MLOps Community podcast: blog.helix.ml/p/from-click...

One year ago, I promised to build helix.ml in the open, so here's an update on our commercial progress: blog.helix.ml/p/revenue-an...

Anyone got a good system in place for running automated evals against your LLM-driven applications, to help test if tweaks to prompts get better results? I'd love to hear about approaches that are working for people on this

Now that loads more people are here I guess I should run rerun this thing, right?

Hey cool this thing is here now 🤣

@jodok.bsky.social hey nice to see you here!

Oh shit we're on hacker news front page with blog.helix.ml/p/we-can-all...

Next up it’s @lmarsden.bsky.social who has renamed his talk!! I didn’t even realise! 😂 “We can all be AI engineers. And we can do it with Open Source models” youtu.be/XR2DicY1zEM?... Note to self: update YouTube title

In which I do the wrong thing from a product perspective.. or do I? blog.helix.ml/p/announcing...

Hey #KubeCon roast my CI/CD for GenAI reference architecture! github.com/helixml/gena...

AI apps and tests should be data, not code

Hello @lmarsden.bsky.social , you're live on scigeeks YT :) I was talking of you CI/CD for GenAI ref, pretty cool!

@dciangot.com hello!! 😄

wdyt #KubeCon github.com/helixml/gena...

Oh cool, we got evals basics (pass/fail, with critique) right in helix.ml test. Great article from @hamel.bsky.social hamel.dev/blog/posts/l...

if this goes viral ill delete twitter fr

I went to this great conference last week aifortherestofus.live It was run by an incredible woman @hannahfoxwell.net - speaking were incredible women www.linkedin.com/in/liannep @amandabrock.bsky.social I came home and saw sofiakourtesis.com best DJ set of the night Grateful to incredible women!

This is so cool

Was thinking today of Hunter S. Thompson's "Wave" passage and the hope that in a few years those most afflicted with the reactionary fever will look back and see now as when their wave finally broke and receded.

RT if you like Bluesky more than X 😤

This is not a very interesting take but I'm really happy to be here. Scrolling this app feels so... wholesome

That sucks

I don’t think Bluesky would be as good had old twitter not existed, what made that site great was how easy it was to find like-minded people you never knew and build connections with, whereas here it’s entirely dependent on existing connections being resurfaced. Old algo was goated

I'm excited to see communities forming here, feels fresh. By way of introduction, I'm a three time startup founder, first DevOps, then MLOps and now LLMOps. I'm particularly interested in making it easier for everyone to be an AI engineer using open source models: docs.google.com/presentation...