Stop the AI Agent "vibe checks" & manual labeling! 🛑🛠️ Samraj Moorjani (Databricks) shows how #MLflow accelerates high-quality, production-ready agent development. Learn the techniques leading companies use to skip the iteration loop. 🚀 🎥 Watch the full session: www.youtube.com/watch?v=qOFK...

MLflow 3.7.0 is here and it brings major features and improvements for GenAI Observability, Evaluation, and Prompt Management! 🙌🥳 🔗 View the release notes: github.com/mlflow/mlflo... Thanks to all the contributions from the community! 🙏 🚀 Try it out: pip install mlflow==3.7.0 #opensource #mlflow

Why log GenAI models as code? It's essential for ensuring versioning & reproducibility of API-based models, providing clear traceability for the model's logic & dependencies. Learn how to log GenAI models as code directly from Python into MLflow Tracking. ⤵️ 🎥 𝗪𝗮𝘁𝗰𝗵: www.youtube.com/watch?v=jXzH...

Is your GenAI agent production-ready, or just passing "vibe checks"? 🤔 Building is easy. Quality is hard. Samraj Moorjani (Databricks) breaks down the full MLflow Quality stack: 🔍 Tracing (@opentelemetry.io) 🤖 AI-based Debugging (AI Insights) ⚖️ LLM as a Judge 🎥Dive in: youtube.com/watch?v=J92r...

Only a few days left to apply for the next #MLflow Ambassador cohort! 🚀 Join a global group of leaders advancing open source MLflow and helping teams ship high-quality #GenAI with evaluation, tracing, and prompt management. Submit your application by 𝗗𝗲𝗰 𝟭. 🔗 Apply today: forms.gle/eBEf6fTfKWNm...

Two weeks from today — don’t miss it! 🙌 📣 Join the next 𝗠𝗟𝗳𝗹𝗼𝘄 𝗖𝗼𝗺𝗺𝘂𝗻𝗶𝘁𝘆 𝗠𝗲𝗲𝘁𝘂𝗽 on November 12 to explore the latest in AI observability and agent tracing. Featuring two exciting talks: 🔹 𝗖𝗹𝗮𝘂𝗱𝗲 𝗖𝗼𝗱𝗲 & 𝗔𝗴𝗲𝗻𝘁 𝗦𝗗𝗞 𝗧𝗿𝗮𝗰𝗶𝗻𝗴 🔹 𝗢𝗽𝗲𝗻𝗧𝗲𝗹𝗲𝗺𝗲𝘁𝗿𝘆 (𝗢𝗧𝗘𝗟) 𝗦𝘂𝗽𝗽𝗼𝗿𝘁 🔗 RSVP: luma.com/mlflowmeetup... #mlflow #oss

Building agentic applications is complex, but it doesn’t have to be slow. In this blog, Samraj Moorjani shows how to go from idea to measurable results in hours using the Claude Agent SDK with MLflow for observability and evaluation. 🔗 Dive in: mlflow.org/blog/mlflow-... #MLflow #agentic

📣 Join the next 𝗠𝗟𝗳𝗹𝗼𝘄 𝗖𝗼𝗺𝗺𝘂𝗻𝗶𝘁𝘆 𝗠𝗲𝗲𝘁𝘂𝗽 on November 12 to explore the latest in AI observability and agent tracing — featuring two exciting talks: 🔹 𝗖𝗹𝗮𝘂𝗱𝗲 𝗖𝗼𝗱𝗲 & 𝗔𝗴𝗲𝗻𝘁 𝗦𝗗𝗞 𝗧𝗿𝗮𝗰𝗶𝗻𝗴 🔹 𝗢𝗽𝗲𝗻𝗧𝗲𝗹𝗲𝗺𝗲𝘁𝗿𝘆 (𝗢𝗧𝗘𝗟) 𝗦𝘂𝗽𝗽𝗼𝗿𝘁 🔗 RSVP: luma.com/mlflowmeetup... #MLflow #opensource #oss #genai

⏰ Don’t forget — MLflow Office Hours are this Wednesday, October 22 at 8AM PT on Zoom! Come for: 🔹 Real-time MLflow troubleshooting and guidance 🔹 Best practices for managing LLM & GenAI experiments 🔹 A look ahead at new MLflow features 🔗 RSVP: luma.com/officehours1... #opensource #oss #MLflow

Missed last week’s #MLflow Community Meetup? Check out Ben Wilson on agentic judges: “The judge no longer works as an LLM as a judge—it actually works as an agent as a judge.” 🎥 Full video: www.youtube.com/live/bkMabn8... #opensource #oss #agenticjudges

Use AI to debug AI! 👏 With MLflow 3.4’s MCP server, Claude can query MLflow traces to compare runs and identify issues. @danliden.com’s post covers setup and examples in minutes. Learn more: www.danliden.com/posts/202510... #opensource #mlflow #oss #MCP #claude

⚡ In this lightning talk at MLOps World, Danny Chiao tackled a top agent challenge: ensuring high quality output. Rather than labeling and analyzing traces by hand, MLflow makes it easy to log, evaluate, and iterate faster—using techniques leading companies rely on to deploy agents in production. ✅

🚨 Reminder: MLflow Community Meetup is tomorrow, Oct 8 at 4:00 PM PT! We'll explore trace‑aware, feedback‑aligned judges and versioned eval datasets in MLflow. You don't wait to miss it! 🎥 LIVE on LinkedIn, YouTube & X 🔗 RSVP: luma.com/mlflow-1001 #opensource #oss #mlflow

Building better LLM evals? Ben Wilson highlights how frameworks like #DSPy boost judge prompts—and reliability—as models evolve. Tips for judge reproducibility/reliability: use reproducible pipelines, re-tune logic as endpoints change, & standardize. ✅ 🎥 Watch more: www.youtube.com/live/HTxpmnO...

Ready to dive into #MLflow? 🚀 Join our text-based LIVE AMA with Danny Chiao & @danliden.com after Danny's MLOps World | GenAI Summit lightning talk! 🗓️ Oct 9 | 1–3pm CT 📍MLflow Slack | #General channel 🔗 RSVP: luma.com/liveama-slac... #opensource #oss #genai #mlops #llmops

🚀 Headed to MLOps World | GenAI Summit 2025 next week? Don’t miss an exciting lightning talk from Danny Chiao, Engineering Lead at Databricks! 🎤 𝗧𝗲𝗰𝗵𝗻𝗶𝗾𝘂𝗲𝘀 𝘁𝗼 𝗯𝘂𝗶𝗹𝗱 𝗵𝗶𝗴𝗵 𝗾𝘂𝗮𝗹𝗶𝘁𝘆 𝗮𝗴𝗲𝗻𝘁𝘀 𝗳𝗮𝘀𝘁𝗲𝗿 𝘄𝗶𝘁𝗵 𝗠𝗟𝗳𝗹𝗼𝘄 🗓️ October 9 📍 Austin, TX 🔗 Learn more: mlopsworld.com#agenda #MLflow #GenAI #MLOps #LLM

🚨 RESCHEDULED: Wednesday, October 8 The next MLflow Community Meetup happens NEXT Wednesday, Oct 8 at 4PM PT—and you won’t want to miss it. RSVP here: luma.com/mlflow-1001 #opensource #oss #mlflow

Our next MLflow Community Meetup is happening TODAY—Wednesday, October 1 at 4PM PT! 🙌 Don’t miss this chance to connect and learn: 🔹 Smarter Evaluations with Trace-Aware, Feedback-Aligned Judges 🔹 Keeping Eval Datasets Relevant as Your App Evolves ✅ RSVP: luma.com/mlflow-1001 #oss #mlflow #genai

🚀 The fifth “Invoice Extraction with OpenAI + MLflow” session is now available! #MLflow Ambassador Shrinath Suresh dives into designing a custom scorer to evaluate invoice extraction models beyond just labels or LLM-as-a-judge. 🎥 youtu.be/SmuhOmOYXSg?... 📖 medium.com/@shrinath.su... #opensource

🚨 Just 2 days away! The next #MLflow Community Meetup happens this Wednesday, Oct 1 at 4PM PT—and you won’t want to miss it. We will cover: 🔹 𝗕𝘂𝗶𝗹𝗱𝗶𝗻𝗴 𝗦𝗺𝗮𝗿𝘁𝗲𝗿 𝗘𝘃𝗮𝗹𝘀 𝘄𝗶𝘁𝗵 𝗧𝗿𝗮𝗰𝗲-𝗔𝘄𝗮𝗿𝗲, 𝗙𝗲𝗲𝗱𝗯𝗮𝗰𝗸-𝗔𝗹𝗶𝗴𝗻𝗲𝗱 𝗝𝘂𝗱𝗴𝗲𝘀 🔹 𝗞𝗲𝗲𝗽𝗶𝗻𝗴 𝗘𝘃𝗮𝗹 𝗗𝗮𝘁𝗮𝘀𝗲𝘁𝘀 𝗥𝗲𝗹𝗲𝘃𝗮𝗻𝘁 𝗮𝘀 𝗬𝗼𝘂𝗿 𝗔𝗽𝗽 𝗖𝗵𝗮𝗻𝗴𝗲𝘀 RSVP 👉 luma.com/mlflow-1001 #oss

Episode 3 of Invoice Extraction is live! 🚀 #MLflow Ambassador Shrinath Suresh explores prompt versioning, comparing, automating workflows, and effective reuse with MLflow’s Prompt Registry. 🎥 Watch: youtube.com/watch?v=fau8... 📖 Read: medium.com/@shrinath.su... #opensource #oss #genai

Businesses run on invoices. Getting structured data from them—fast and accurate—is critical. 🧩 GPT-5 is powerful for extraction ⚙️ MLflow 3 makes it repeatable & traceable Demo + blog from #MLflow Ambassador Shrinath Suresh! 👇 ▶️ youtu.be/E5GSWLhI5uA 📝 medium.com/@shrinath.su... #opensource #oss

🚀 Join the next MLflow Community Meetup on Oct 1 at 4PM PT! 🔹 𝗕𝘂𝗶𝗹𝗱𝗶𝗻𝗴 𝗦𝗺𝗮𝗿𝘁𝗲𝗿 𝗘𝘃𝗮𝗹𝘀 𝘄𝗶𝘁𝗵 𝗧𝗿𝗮𝗰𝗲-𝗔𝘄𝗮𝗿𝗲, 𝗙𝗲𝗲𝗱𝗯𝗮𝗰𝗸-𝗔𝗹𝗶𝗴𝗻𝗲𝗱 𝗝𝘂𝗱𝗴𝗲𝘀 🔹 𝗞𝗲𝗲𝗽𝗶𝗻𝗴 𝗘𝘃𝗮𝗹 𝗗𝗮𝘁𝗮𝘀𝗲𝘁𝘀 𝗥𝗲𝗹𝗲𝘃𝗮𝗻𝘁 𝗮𝘀 𝗬𝗼𝘂𝗿 𝗔𝗽𝗽 𝗖𝗵𝗮𝗻𝗴𝗲𝘀 Bring your questions about dataset management, evaluation workflows! ✅ RSVP 👉 luma.com/mlflow-1001 #opensource #oss

This blog highlights how MLflow’s #GenAI capabilities streamline development of an LLM-based Optical Character Recognition (OCR) tool. These capabilities reduce friction, accelerate workflows, and deliver value to both technical and non-technical contributors. 🚀 Dive in: mlflow.org/blog/mlflow-...

This blog looks at the “Coffee Machine” approach: global teams set up standardized #ML pipelines, & local teams adapt them using their own #data. ☕ #MLflow supports every step, making it possible to track changes, register model variants, & maintain reproducibility. 🔗 medium.com/dscier/brewi...

📣 Happening Tomorrow — MLflow Office Hours! Join #MLflow maintainers for a live Q&A session! Whether you’re running MLflow in production or experimenting with LLMs & GenAI, this is your chance to bring real challenges and get direct feedback. 🕒 Sept 10 @ 3PM SGT 🎟 RSVP: lu.ma/mlflow-910 #oss

Evaluating AI agents is tricky—they make multi-step decisions, use tools, and follow reasoning chains. To measure them, you need to assess the workflow, not just the final answer. That’s where MLflow’s new agent evaluation framework steps in. 🔗 Docs: mlflow.org/docs/latest/... #MLflow #AI #MLOps

In this blog by #MLflow Ambassador Rahul Pandey, learn how the MLflow Prompt Registry helps teams move from scattered notebook files and chat threads to a streamlined prompt management process—one that’s versioned, searchable, and always ready for rollbacks. 🚀 🔗 Dive in: medium.com/dscier/end-t...

📣 MLflow 3.3.0 is now available! This release introduces several major features and improvements: 🔹 𝗠𝗼𝗱𝗲𝗹 𝗥𝗲𝗴𝗶𝘀𝘁𝗿𝘆 𝗪𝗲𝗯𝗵𝗼𝗼𝗸𝘀 🔹 𝗔𝗴𝗻𝗼 𝗧𝗿𝗮𝗰𝗶𝗻𝗴 𝗜𝗻𝘁𝗲𝗴𝗿𝗮𝘁𝗶𝗼𝗻 🔹 𝗚𝗲𝗻𝗔𝗜 𝗘𝘃𝗮𝗹𝘂𝗮𝘁𝗶𝗼𝗻 𝗶𝗻 𝗢𝗦𝗦 🔹 𝗥𝗲𝘃𝗮𝗺𝗽𝗲𝗱 𝗧𝗿𝗮𝗰𝗲 𝗧𝗮𝗯𝗹𝗲 𝗩𝗶𝗲𝘄 🔹 𝗙𝗮𝘀𝘁𝗔𝗣𝗜 + 𝗨𝘃𝗶𝗰𝗼𝗿𝗻 𝗦𝗲𝗿𝘃𝗲𝗿 🔗 Check out the release notes: github.com/mlflow/mlflo... #oss

📣 MLflow Office Hours — Wednesday, Sept 10 Connect directly with #MLflow maintainers and contributors for live Q&A! Bring your production challenges or your latest #LLM and #GenAI experiments—this session is dedicated to hands-on technical discussion and feedback. Save your spot ➡️ lu.ma/mlflow-910

MLflow 3.3 introduces an assessment-first approach to GenAI evaluation workflows. Assessments—quality evaluations and trace annotations—are now integrated directly into the tracing UI, making it easier to create, view, & manage them throughout the application lifecycle. 🔗 mlflow.org/blog/mlflow-...

🚨 Just 1 week to go! The August #MLflow Community Meetup kicks off next Wednesday, August 20 at 4:00 PM PT. What’s on the agenda?👇 🔹 𝗪𝗲𝗯𝗵𝗼𝗼𝗸𝘀 𝗶𝗻 𝗠𝗟𝗳𝗹𝗼𝘄 🔹 𝗠𝗮𝗻𝗮𝗴𝗲𝗱 𝗠𝗟𝗳𝗹𝗼𝘄 𝗙𝗲𝗮𝘁𝘂𝗿𝗲𝘀 𝗡𝗼𝘄 𝗶𝗻 𝗢𝗦𝗦 Bring your questions! Our speakers will be answering them during the meetup. 🔗 RSVP: lu.ma/mlflow820 #oss

At Agents in Production 2025, Yuki Watanabe presented 𝘌𝘷𝘢𝘭𝘶𝘢𝘵𝘪𝘰𝘯-𝘋𝘳𝘪𝘷𝘦𝘯 𝘋𝘦𝘷𝘦𝘭𝘰𝘱𝘮𝘦𝘯𝘵 𝘸𝘪𝘵𝘩 𝘔𝘓𝘧𝘭𝘰𝘸 3.0 — a process that uses evaluation as the foundation for building high-quality, reliable Agentic systems. 🎥 Watch the full presentation: www.youtube.com/watch?v=7Q2Z... #opensource #oss #mlflow

Join us for the next MLflow Community Meetup! 🥳 This month, we’re excited to bring you the latest updates and insights from the MLflow ecosystem, featuring: ​🔔 Webhooks in MLflow 🧪 Managed MLflow Features Now in OSS 📅 August 20 @ 4:00 PM PT 📍 Live on X, YouTube, & LinkedIn 🔗 RSVP: lu.ma/mlflow820

MLflow 3.2 is here! 🚀 Key updates include: 🔹 𝗧𝘆𝗽𝗲𝗦𝗰𝗿𝗶𝗽𝘁 𝗦𝗗𝗞 𝗳𝗼𝗿 𝗧𝗿𝗮𝗰𝗶𝗻𝗴 🔹 𝗦𝗲𝗺𝗮𝗻𝘁𝗶𝗰 𝗞𝗲𝗿𝗻𝗲𝗹 𝗧𝗿𝗮𝗰𝗶𝗻𝗴 🔹 𝗜𝗻𝘁𝗲𝗴𝗿𝗮𝘁𝗲𝗱 𝗙𝗲𝗲𝗱𝗯𝗮𝗰𝗸 𝗟𝗼𝗴𝗴𝗶𝗻𝗴 🔹 𝗘𝘅𝗽𝗲𝗿𝗶𝗺𝗲𝗻𝘁 𝗨𝗜 𝗥𝗲𝗳𝗿𝗲𝘀𝗵 🔹 𝗧𝗿𝗮𝗰𝗲 𝗨𝗜 𝗘𝗻𝗵𝗮𝗻𝗰𝗲𝗺𝗲𝗻𝘁𝘀 🔹 𝗣𝗜𝗜 𝗠𝗮𝘀𝗸𝗶𝗻𝗴 𝗶𝗻 𝗧𝗿𝗮𝗰𝗶𝗻𝗴 🔹 𝗣𝗼𝗹𝗮𝗿𝘀 𝗗𝗮𝘁𝗮𝗙𝗿𝗮𝗺𝗲 𝗟𝗼𝗴𝗴𝗶𝗻𝗴 🔗 Check out the full release notes → github.com/mlflow/mlflo... #oss

Have #MLflow questions? Join us this Wed, August 6 for MLflow Office Hours! 🚀 What to Expect: ✅ Live troubleshooting of your MLflow implementation questions ✅ Expert insights on model lifecycle management & GenAI integrations ✅ Sneak peeks at new & upcoming features 🔗 Register: lu.ma/mlflow8625

At the AI Agent Builders Summit in SF, Eric Peter explained how agent development is different from traditional ML, shared how to evaluate unpredictable outputs, outlined five must-haves for agent platforms, and talked about what's new in #MLflow 3. 🎥 Watch the session: youtube.com/watch?v=ROlU...

MLflow Prompt Registry enables seamless versioning, tracking, and reuse of prompts for #GenAI applications across your organization. 🎥 Check out this 1-minute video to see it in action: www.youtube.com/watch?v=SEqI... #opensource #oss #mlflow #generativeai

📣 Join us next Wed, August 6 for #MLflow Office Hours — your live Q&A with core MLflow maintainers & contributors! This is your opportunity to get expert, hands-on technical feedback directly from the team! 🤝 Open to all levels — bring your questions & join the discussion. 🔗 RSVP: lu.ma/mlflow8625

🔁 Applying SDLC to #GenAI with #MLflow AI agents need the same discipline as traditional software—testing, monitoring, and feedback. This #DataAISummit session showed how MLflow 3 brings SDLC-style rigor to GenAI with domain-specific #LLM judges. 🎥 Full talk: www.youtube.com/watch?v=PZBU...

Production AI agents ≠ set it and forget it. At #DataAISummit, Eric Peter and Niall Turbitt from Databricks dive deep into what it actually takes to monitor and improve AI agent quality in the real world — beyond just latency and error rates. 🎥 Watch the session → www.youtube.com/watch?v=RRpz...

📣 Join us Wednesday, August 6 for #MLflow Office Hours! Q&A with maintainers, live troubleshooting, insights on #LLMs & model management, plus sneak peeks at new features. All experience levels welcome. Bring your questions — and let’s talk MLflow! 🎉 🔗 Register now: lu.ma/mlflow8625 #oss #ML

🎥 MLflow 3.0: AI and MLOps on Databricks From tracking to deployment, MLflow 3.0 simplifies ML and GenAI workflows. ✅ Auto experiment tracking ✅ Model monitoring ✅ GenAI tools for prompts & agents ▶️ Watch the #DataAISummit session: www.youtube.com/watch?v=UezT... #MLflow #MLOps #AI #OpenSource

📣 TOMORROW, July 23 — Join us for an interactive #MLflow Community Meetup packed with the latest updates & insights including: 🔹 MLflow 3.2: Discover the newest UI updates in MLflow 3. 🔹 Managed MLflow: Get an inside look at free managed MLflow on #Databricks. 🔗 REGISTER: lu.ma/mlflowmeetup...

🚨 Just 2 DAYS away! Don’t miss the next MLflow Community Meetup this Wednesday, July 23 at 4:00 PM PT! We’ll be covering key updates: 🔹 MLflow 3.2 🔹 Managed MLflow on Databricks 📍 Live on X, YouTube, and LinkedIn 🔗 Register: lu.ma/mlflowmeetup... #opensource #oss #mlflow

"When we update any part of a system, we need to make sure we’re not introducing regressions — and ideally, that we’re improving quality. One way to address this is through evaluation-driven development." - Yuki Watanabe, MLflow Maintainer 💬 🔗 Watch the full webinar: www.youtube.com/watch?v=-jzm...

Model evaluation is the foundation of reliable machine learning. With #MLflow’s evaluation framework, you get more than just accuracy—you get deep insights into model behavior, automated testing, rich visualizations, and validation pipelines. Get started ➡️ mlflow.org/docs/latest/... #opensource

Happening TODAY! 🚨 Join Agents in Production 2025 for a can’t-miss session on building evaluation-driven #Agentic systems with #MLflow 3.0. 🔎 Yuki Watanabe will break down: ✅ One-line observability ✅ Automatic evaluation ✅ Human-in-the-loop feedback 🔗 Register: home.mlops.community/home/events/...

🎥 “People ask for it. It’s open-source. It works for both classical ML and GenAI. And it’s easy to start.” Mikhail Rozhkov from Nebius shares why their team chose #MLflow as their experiment tracking and observability platform. 👀 Watch the full video: www.youtube.com/live/4Ok-03P... #opensource

🚨 Happening TOMORROW, July 17 — Agents in Production 2025 is almost here! Get an inside look at MLflow 3.0’s powerful new features: ✅ One-line observability ✅ Automatic evaluation ✅ Human-in-the-loop feedback Free + virtual! 🎟️ Register here: home.mlops.community/home/events/... #opensource #oss