Our LLM-as-a-Judge 101 virtual workshop was so popular, we're returning for LLM-as-a-Judge 102. 🎓 RSVP: luma.com/ab78cmgo In this session focused on meta-evaluation, you’ll learn advanced techniques -- like using high-temperature stress tests to detect prompt ambiguity or unstable reasoning.

In case you missed it last week: we released day 0 support for Claude Opus 4.5 in Phoenix! Try it out in the prompt playground today! Learn about the prompt playground: arize.com/docs/phoeni... Sign up for Phoenix Cloud: app.phoenix.arize.com/ Release notes: github.com/Arize-ai/ph...

Arize AX + AWS Bedrock AgentCore = a complete production system where you can deploy agents with confidence and improve them continuously based on real data. From the floor of #reinvent, a new notebook + blog runs through a travel planning agent example. Dive in: arize.com/blog/aws-be...

If you've been debugging agents by scrolling through spans, Arize AX can help you do better! Agent Graph gives you a node-based visual map of your agent workflows, so you can instantly see execution paths, identify failure points, spot self-looping behavior, and more! arize.com/docs/ax/obs...

Arize AX Monitors: set threshold-based alerts for what matters in your LLM apps—latency, hallucination rates, eval failures, token usage, errors. One-click setup for common metrics, or fully custom. Get notified before your users notice something's wrong. Learn more: arize.com/docs/ax/obs...

Just dropped: a new deep-dive on debugging your Google ADK Agent with Arize Phoenix! 𝗪𝗮𝘁𝗰𝗵 𝘁𝗵𝗲 𝗳𝘂𝗹𝗹 𝘁𝘂𝘁𝗼𝗿𝗶𝗮𝗹 𝘁𝗼 𝗹𝗲𝗮𝗿𝗻 𝗵𝗼𝘄 𝘁𝗼: ▲ Implement tracing. ▲ Debug complex agent logic and tool usage. ▲ Run automated evaluations. Full video: www.youtube.com/watch?v=fBs...

The team is gearing up for an epic @AWSreInvent! We have fun happenings all week (chocolate tastings, dinners, happy hours) — join us! arize.com/aws-reinven...

Arize AX is listed as an Emerging Leader in the "Emerging Market Quadrant for Generative AI Engineering" in Gartner's latest "Innovation Guide for Generative AI Engineering" report (13 November).

Microsoft's red teaming agent in Microsoft Foundry generates sophisticated prompts designed to simulate adversarial attacks. Arize AX can help make these vulnerabilities visible and actionable. New blog + notebook outlines how to create self-improving agent security: arize.com/blog/how-to...

Microsoft Foundry + Arize AX = everything you need for self-improving agents. From the floor of #MSIgnite, a new notebook + blog walks through a concrete content safety evaluation example. 📓 Explore: arize.com/blog/evalua...

Learn how to build better AI applications with this introduction to LLM-as-a-judge evaluation! Check out the full video: www.youtube.com/watch?v=pnl...

We benchmarked Prompt Learning (prompt optimizer) against GEPA and saw similar/better results in a fraction of the time. Since we launched Prompt Learning in July, the most common question we get is: “Prompt Learning or GEPA — which should I use?” We break down the results below.

Our MCP Server Tracing Assistant's integration with Google Gemini CLI enables you to ask natural-language questions like: 🟪 “Instrument this app using Arize AX.” 🟪 “How can I redact sensitive information from my spans?” 🔍 Find: Go to the extensions tab of geminicli.com/ and type in 'arize'.

Google ADK + Arize AX = a unified experience for building, deploying, and refining multiagent systems. 𓂅 Try both on for size with this new how-to + code that walks through a ✈️ travel concierge example: arize.com/blog/tracin...

Our thanks to Google Cloud for hosting in Sunnyvale and speaking alongside Meta AI and the Arize crew at "Agents In Action" last night!

Quickly add valuable human insights to your sessions without breaking your flow! With our new Session Annotations, you can now add notes directly from the Session Page, eliminating the need to switch between views or lose context.

Learn in <2min ⏳ ▶️ how Arize AX (available on AWS Marketplace) works with with AWS and NVIDIA to power the future of AI evaluation www.youtube.com/watch?v=KnN...

By popular demand, we're covering 🎓 ​LLM-as-a-judge 101 🎓 in our next workshop! RSVP: luma.com/tmipn699 Learn how to design your eval from scratch -- including what to measure, which model to use, how to prompt effectively, and how to improve your eval.

Thanks to Mastra for organizing the first conference for TypeScript AI developers! If you missed, it, don't fret: we have an upcoming event with Mastra at GitHub HQ in SF on building and evaluating typescript agents luma.com/l3n0qg61

We're excited to be headed to @databricksinc.bsky.social Data + AI Summit next week! Aparna has a session on building & evaluating self-improving agents with Arize, Databricks MLFlow, & Mosaic AI. Info here: www.databricks.com/dataaisummit...

🐳 @arize.bsky.social OSS Prompt Playground @arize-phoenix.bsky.social gets Deepseek support! Now you can compare outputs of all the top tier reasoning models. Which LLM provider would you like to see next? Let us know on GitHub! github.com/Arize-ai/pho...

🚀 Get ready to learn from a powerhouse group of speakers at Shack15 in SF on June 25. Builders, researchers, and leaders from @anthropic.com @microsoft.com @llamaindex.bsky.social (+ many more). Get tickets: arize.com/observe-2025

Learn to prompt better

Chicago event alert: We’re bringing Chicago’s AI builders together at Google’s office for hands-on sessions focused on advancing LLM-powered agents. 🚀 Join us May 19. Space is limited! Register: lu.ma/d6mo5zxs

I'll be speaking at Arize:Observe at SHACK15 on June 25! Looking forward to exploring what’s next for AI agents & assistants. More details on my session to come. @arize.bsky.social arize.com/observe-2025

Join us 6/25 in SF for a full-day event focused on agent reliability and evaluation. Hear from the people building the next generation of AI systems—it's conference by engineers, for engineers. Most of our speakers on the site. 👀 Register: arize.com/observe-2025/

Demo your app at this year's Observe! Fill out a short application by 4.30 to be considered for our Demo Den. Great opportunity to showcase your work to the AI community in SF. Apply here: docs.google.com/forms/d/e/1F...

Automate LLM performance with Arize and NVIDIA NeMo. 😎 More on that here: arize.com/blog/arize-n...

For all my NYC friends! 🗽🍎 We're hosting an in-person office hours tomorrow all around LLM and Agent Evals. Join for the free snacks/drinks, stay for the heated discussions about the validity of Pokemon-based model evaluations ⚡️🐀

🤖 Building agents, but not sure how to measure their performance? Our newest blog post on @hf.co has you covered! This post shows you how to use @arize-phoenix.bsky.social to trace and evaluate your smolagents. Credit to @srichavali.bsky.social and @aymeric-roucher.bsky.social

Managing state and memory in LLM applications is one of the biggest challenges in AI development. From conversation history to semantic switching, choosing the right approach can make or break user experience, cost, and performance. Our latest: arize.com/blog/memory-...

Join us in SF on June 25 for the must-attend AI observability and evaluation event of the year! Past speakers have included top builders and researchers driving AI innovation and tackling its most important challenges. Be a part of the conversation shaping AI’s future. arize.com/observe-2025/

Another full house at GitHub with @arize.bsky.social!

Quick guide to the EU AI Act for AI teams. A few things we break down in here are the risk categories (the core of the Act), navigating transparency requirements, newly drafted guidelines for general purpose AI, and more. 👇 arize.com/blog/quick-g...

New tutorial out on agentic RAG, using @arize-phoenix.bsky.social to help you understand what's happening under the hood. In this example, we also use @llamaindex.bsky.social to simplify query engine creation for structured and unstructured data. www.youtube.com/watch?v=1_73...

Integrating LLM evaluations into CI/CD pipelines can ensure reliable, consistent AI + also help you automate experimental results. Here's a tutorial with an example using @arize-phoenix.bsky.social arize.com/blog/how-to-...

If you're in the Bay Area, come out next month to our agents bootcamp @github.com HQ in SF. Hosting with @llamaindex.bsky.social + @groqinc.bsky.social 🙂 For anyone working on chatbots, virtual assistants, or complex decision-making systems. lu.ma/agent-tracing