If our AI gets 8 out of 9 things right, an exact test count fails it. But did it really fail? Measure utility, not just exactness. Start using scorecards. Full guide on the NEW blog: testingil.com/2025/12/usin... #AI #TestAutomation #QualityEngineering #Scorecards

Here's my current funnel methodology for testing AI products. I want your help in making it more useful for everyone. Join The Captain's Bridge. We're starting in 2026. testingil.com/join-the-cap... #QA #AITesting #EngineeringStrategy #TestAutomation

Flaky tests? If you're blaming the automation, you might be missing the point. With AI, "flaky" may mean the assertion is too rigid. How are you dealing with the diversity of AI responses and behaviors? #QA #AI #SoftwareTesting #TheOracleProblem

Webinar poll results: I gave the room an easy choice: Blame the tools. They refused. 62% said: "We don't have clear rules on what 'CORRECT' looks like." If you can't define "Right", you're just chasing your tail. Recording coming soon. #AITesting #QualityEngineering #SoftwareTesting #GenAI

LIVE IN 2 HOURS! The production-ready methodology for AI Quality. Drift. Evolution. Defense. Grab your spot now: us02web.zoom.us/webinar/regi... #AITesting #Webinar #TechLeadership #AIQuality

Our AI tests are green. The feature is stumbles. Why? Your Golden Dataset went stale. What was good before, is not anymore. Tomorrow, I'll show you how to fix it with Evolution Loops. Last call: us02web.zoom.us/webinar/regi... #AITesting #Webinar #TechLeadership #AIQuality

Testing AI in the lab is one thing. Testing AI in production has storms (Drift) and krakens (Attacks). Our regular test automation won't survive the ocean. Tomorrow, we build the Ship. Secure your seat: us02web.zoom.us/webinar/regi... #AITesting #Webinar #TechLeadership #AIQuality

AI testing maybe is stuck in the "Kayak" phase. We check "Is it working now?" but we miss the long view. Wednesday, I'm breaking down the AI Quality Funnel live. Bug fixes, new requirements, pirate attacks. Get a bigger boat. Register: us02web.zoom.us/webinar/regi... #AITesting #Webinar #AIQuality

Webinar Wednesday. We stop paddling the "Kayak" (tactics for now) and start building the "Ship" (strategy for the long haul). Last Sunday before we sail. Register: us02web.zoom.us/webinar/regi... #AITesting #Webinar #FreeTraining #TechLeadership #Strategy #AIQuality

New Video! You find a fuzzy AI bug. How to prove you actually fixed it? And that it won’t come back? Test-First Bug Fix is essential for AI testing. It's how you anchor the fuzzy behavior and strengthen the hull of your quality ship. Watch here: youtu.be/cW8gEVfBmno #TestFirst #AITesting #CleanCode

Webinar Ahoy! My free webinar, Charting the Course for AI Quality, is next Wed (Dec-3). This is the captain's manual for building an AI Quality Ship. We'll cover drift, evolution, and defense. It's free, live, and built for Strategists. Register: us02web.zoom.us/webinar/regi... #AITesting #Strategy

Had a blast teaching Playwright on Monday! Now gearing up for Thursday's mission: CSI: Flaky Tests. We're investigating the crime scene of unstable automation to uncover the root cause: flawed assumptions about system state. Come ready to solve the case! #AgileTD #SoftwareTesting

@friendlytester.bsky.social kicking off day two of the Test Automation Deep Dive at @agiletdzone.bsky.social. @gilzilberfeld.bsky.social and I will be supporting during the workshops later today. #agileTD 🦄

A Tactician asks: "Is it working now?" A Captain asks: "How do we keep it working?" My free webinar (Dec 3) is for Captains (and wannabes). Learn the framework to keep your AI quality in ship-shape. Register: us02web.zoom.us/webinar/regi... #AITesting #Webinar #TechLeadership #AIQuality

Yesterday's new blog post is the "AI Quality Funnel", my AI testing methodology. It's the chart for the AI stormy seas! Read the full post here: testingil.com/2025/11/the-... #AITesting #QA #Methodology #SoftwareTesting #Strategy

New Blog Post! My core AI quality methodology It's the full AI Quality Funnel. The 6-step "Tactical Funnel" (The Kayak) The "Strategic Loops" (The Ship) This is the map for moving towards a resilient testing framework. testingil.com/2025/11/the-... #AITesting #Methodology #SoftwareTesting #Strategy

Are you building an AI Quality "Kayak" or "Ship"? Kayak: A set of tactics for now. Ship: A strategic framework for the future. This post is the core of my AI testing methodology. Read it here: testingil.com/2025/11/are-... #AITesting #QA #EngineeringManager #SoftwareTesting #Strategy

Manually grading 100 "fuzzy" AI responses is not scalable. So, why not use one powerful AI to grade another’s? This is the "AI Judge" technique. Watch the 5-min demo (and code) for augmenting your AI regression suite. Watch here: youtu.be/tLZE_i3sfu0 #AITesting #AIJudge #SoftwareTesting #Automation

Testing AI in the ocean of production is no simple matter. Are we ready for storms, krakens, and pirates? My 90-sec teaser for the Dec 3rd webinar rises with the tide. Watch it, then register for free: youtu.be/EUEjC9KEfr8 #AITesting #SoftwareTesting #Webinar #QA

Want to level up your team's testing? Now including AI in testing: Using AI as a copilot & Testing AI products My calendar opens in December for remote or on-site training. Let's get your team out of the bug-fixing rut. Ping me to cook up some quality. #automation #unittesting #cleancode #apitesting

AI Testing is for the long haul. The techniques are just the start. This 90-sec teaser for my Dec 3rd webinar explains how we’re going to weather the storm. Watch the teaser, then register for free: www.youtube.com/watch?v=EUEj... #AITesting #SoftwareTesting #Webinar #QA

This week's new blog post is a summary of the 1-hour concepts from "Beyond The Basics" AI testing webinar. Or you can just watch the recording there. It's a great 101 for building your first AI test methodology. Check it out: testingil.com/2025/11/the-... #AITesting #TestAutomation #SoftwareTesting

Your "Golden Datasets" are stale. A response that was ok 6 months ago, is not good enough now. Our test suite must evolve. This "Evolving Scorecard" is a core concept we're covering in the free webinar, Dec 3. Register: us02web.zoom.us/webinar/regi... #AITesting #Webinar #TechLeadership #AIQuality

One week to go! Getting ready for Agile Testing Days in Potsdam next week. If you're there, find me and say hi. Don’t forget the Playwright Tutorial and Deep-Dive workshops. Looking forward to seeing everyone! #AutomationTesting #AgileTD #QA #AITesting #Playwright

New Blog Post! This is the full recording + summary of my 2nd webinar in the AI testing series. Turn techniques into methodology. Read/watch here: testingil.com/2025/11/the-... #AITesting #TestAutomation #SoftwareTesting #Webinar

The "beyond the basics" webinar showed you how to build a Golden Dataset. The "AI Judge" can help to automate scoring at scale. For a real AI quality strategy, you need both. Read the "AI Judge" post: testingil.com/2025/11/if-a... #AITesting #AIJudge #Automation #SoftwareTesting #QA

Your tests didn't change. Your code didn't change. But your AI feature is misbehaving. Welcome to "model drift". You need a long-haul strategy. A drift detector. Learn how to build one in my free webinar. Dec-3. Register: us02web.zoom.us/webinar/regi... #AITesting #Webinar #TechLeadership #AIQuality

Speaking online this Wed (Nov 19) with Testomat.io! We're talking "Exploratory Testing with AI." Can AI be our "pair testing" buddy? Can it help us find new risks? It's live and practical. Register: testomat.io/events/test-... #ExploratoryTesting #AITesting #SoftwareTesting #QA #TestAutomation

Manually checking 100 "fuzzy" AI responses doesn't scale. So, why not use one AI to grade another’s? This is the "AI Judge" technique. Watch the demo (and the code) to augment your AI regression suite. Watch here: www.youtube.com/watch?v=tLZE... #AITesting #SoftwareTesting #Webinar #QA

Want to level up your team's testing? Now including AI in testing: Using AI as a copilot & Testing AI products My calendar opens in December for remote or on-site training. Let's get your team out of the bug-fixing rut. Ping me to cook up some quality. #automation #unittesting #cleancode #apitesting

Promises made, promises kept! 🎬 Watch the recording of our last Continuous Testing Meetup with @gilzilberfeld.bsky.social 🚀 Thanks to all participants for an amazing session! 🌍 See you in 2026! ✨ www.youtube.com/watch?v=fZUm...

My new video is a hands-on demo of the "AI Judge" technique. Learn how to use a stronger model to grade a simpler model and finally automate your fuzzy AI quality checks. Watch the video: www.youtube.com/watch?v=tLZE... #AITesting #SoftwareTesting #QA #Automation

If AI is so smart, why can't it tell me how much I can trust it? My new blog post is a deep dive into the "AI Judge" technique. Learn how to use a model to automate your "fuzzy" quality checks and finally scale your AI regression suite. Read it: testingil.com/2025/11/if-a... #AITesting #AIJudge

Want to have example of API testing using #AI? Check this repository which is currently presented during our online meetup by @gilzilberfeld.bsky.social github.com/gilzilberfel...

#API testing using #AI explained by our speaker @gilzilberfeld.bsky.social here is the live streaming link www.linkedin.com/video/golive...

API testing with #AI with our super guest @gilzilberfeld.bsky.social 🚀🚀🚀

A Strategist has a process for evolving their "definition of good" as the models and requirements change. This is a key "Process Principle" we're covering in our Dec 3rd webinar. Save your spot: us02web.zoom.us/webinar/regi... #AITesting #Webinar #TechLeadership #AIQuality

Missed the last webinar? The recording is live. Watch the 4-step funnel build now. It's the perfect foundation for our "Ship-building" webinar on Dec 3rd. Watch here: youtu.be/i9uzg997_qg #AITesting #Webinar #SoftwareTesting #QA #CI

If AI is so smart, why can't it tell me how much I can trust it? My new blog post is a deep dive into the "AI Judge" technique. Learn how to use a model to automate your "fuzzy" quality checks and finally scale your AI regression suite. Read it: testingil.com/2025/11/if-a... #AITesting #AIJudge #QA

Python devs! Join me at xtremePython (Nov 18) for a 25-min, no-hype session on "Smarter API Testing with AI." We'll skip the "hello world" and focus on practical code: scaffolding client wrappers, generating complex data, and refactoring legacy tests. xtremepython.dev/2025/ #Python #xtremePython

Europe! This is tomorrow (Nov 11). I'm speaking at the Continuous Testing meetup about "API Testing with AI." We'll cover how AI can help with the real challenges: data prep & complex setup. Free & virtual. Join us! www.meetup.com/continuous-t... #ContinuousTesting #APITesting #AITesting #Meetup #QA

The CI pipeline is a crime scene. Join me for a hands-on "CSI: Flaky Tests" investigation at the TestIL meetup on Nov 18th. We'll dust for fingerprints in the code and expose the root causes of instability. www.meetup.com/testil/event... #TestIL #FlakyTests #SoftwareTesting #QA

ICYMI: Are you a "Tactician" (kayak) or a "Strategist" (ship)? My blog post defines the two mindsets for AI quality and sets up the plan for our Dec 3rd webinar. Read it here: testingil.com/2025/11/are-... #AITesting #Strategy #TechLeadership #SoftwareDevelopment #QA

Want to level up your team's testing? Now including AI in testing: Using AI as a copilot & Testing AI products My calendar opens in December for remote or on-site training. Let's get your team out of the bug-fixing rut. Ping me to cook up some quality. #automation #unittesting #apitesting

The "AI Testing: Beyond the Basics" recording is now live! Watch the full, 50-min session where we build a practical, end-to-end testing funnel sanity checks, golden datasets, CI/CD, and more! youtu.be/i9uzg997_qg #AITesting #Webinar #SoftwareTesting #QA #CI

It's here. My new post on why our AI testing framework is just the beginning. Are you a 'Shiphand' or a 'Strategist-Captain'? Time to find out. testingil.com/2025/11/are-... #AITesting #Strategy #TechLeadership #SoftwareDevelopment #QA

REGISTRATION IS OPEN! Join my new advanced webinar: "Charting the Course for AI Quality." We've built the kayak. Now, we build the ship. This is the "Captain's Briefing" for managers and strategists. (It's free). Save your spot: us02web.zoom.us/webinar/regi... #AITesting #Webinar #TechLeadership

New to AI Testing? Start here. The full "Intro" webinar recording! The perfect foundation for our next webinars. Watch: youtu.be/IZcLEifNPMM #AITesting #SoftwareTesting #QA #Webinar #AIJudge

It's here. My new post on why our AI testing framework is just the beginning. Are you a 'Shiphand' or a 'Strategist-Captain'? Time to find out. testingil.com/2025/11/are-... #AITesting #Strategy #TechLeadership #SoftwareDevelopment #QA

The "AI Testing Starter Kit". It's the original 7-step "AI Quality Playbook" with exclusive templates & prompts I didn't show live in the last webinar. Get the full, detailed guide: testingil.com/ai-quality-p... #AITesting #QA #Playbook #SoftwareTesting