Skip to content
PodSubs
ShowsPeopleGuestsJobsNewsEvents
More
BlogPodCred
Menu
ShowsPeopleGuestsJobsNewsEventsBlogPodCredNetworksSign in
Join nowSign in
  • Shows
  • People
  • Jobs
  • News
  • More
    • Guests
    • Events
    • Blog
    • PodCred
    • Networks
    Join nowSign in

TestGuild Automation Podcast

TestGuild Automation Podcast artwork

Why Your AI Tests Pass When Your Features Fail with Donovan Brady

Oct 27, 202649 minAudio
ShareXLinkedInFacebookWhatsAppEmail

Why Your AI Tests Pass When Your Features Fail? Donovan Brady of Leapwork shows how to make AI tests traceable, cheaper to run, and safe to self-heal. 👉 Try Leapwork Play (free tier): https://testgld.link/podcastsleapwork AI can write hundreds of tests in minutes. But can you trust what it built? In this TestGuild episode, Joe Colantonio talks with Donovan Brady, VP of Developer Relations at Leapwork, about the biggest problem in AI testing right now: trust. Donovan shares what he's seeing across industries, from bleeding edge teams running fully agentic development to financial services and healthcare companies that run on technology but aren't tech companies. Then he demos Leapwork Play, which turns your requirements, Jira stories, source code, and design files into a knowledge base, generates standard Playwright tests, and traces every step back to the exact line of the requirement it came from. You'll learn: Why AI self-healing can rewrite tests to pass instead of catching real bugs How to trace every AI generated test back to a requirement Why generating Playwright once and running it deterministically saves time and tokens How to find coverage gaps, prune redundant tests, and run only the tests tied to a code change How to control self-healing so it never masks a real regression How to run tests headlessly through an MCP server from Claude Code, Codex, or Cursor Why exportable Playwright code means no vendor lock-in Donovan's key lesson: when his team used Playwright plus Claude, self-healing sometimes rewrote tests to pass rather than to test the real outcome. His advice is to give your AI the full context of the business workflow you're validating, end to end. What's your experience with AI generated tests? Have you caught one passing when it shouldn't? Tell us in the comments. #Playwright #AITesting #TestAutomation

Audio and video play straight from the show's own hosting. PodSubs stores and serves no media.

Hosts and Guests

Nobody is credited on this episode yet.

Credit the people on this episode

Be the first to rate this episode

More episodes

All episodes
  1. Robot Framework Test Automation: Automate Web, Desktop, Mobile, and Embedded Systems

    Nov 17, 202636 minAudio

    What makes Robot Framework flexible enough to test medical devices, low code bots, monitoring systems, and embedded hardware, all with one framework? In this RoboCon 2027 special, Joe Colantonio talks with four leaders...

    Credit the people on this episode

  2. Playwright at Scale: Run 500 Tests in Minutes

    Nov 10, 202637 minAudio

    Is your Playwright suite slowing you down instead of speeding you up? In this episode, Oliver Stenbom, cofounder of Endform, shares what really happens when teams try to scale Playwright from a handful of tests to...

    Credit the people on this episode

  3. How to Prove Your Release Is Ready When AI Writes the Code with Ashwin Kondapalli

    Nov 3, 202639 minAudio

    How to Prove Your Release Is Ready When AI Writes the Code? Can you prove your software is ready to ship, or does that answer still depend on a meeting and a spreadsheet? Want to see if your team can prove a release is...

    Credit the people on this episode

  4. Scary Test Automation POCs Made Easy: Halloween Special With Paul Grossman

    Oct 20, 202642 minAudio

    Running a proof of concept on test automation tools can feel like a horror movie. Vendors promise everything, your boss wants answers fast, and you don't know what you don't know. In this Halloween special, Paul...

    Credit the people on this episode

  5. Locust and Azure Load Testing: Create and Debug Load Tests with AI with Lars Holmberg and Abhinav Premsekhar

    Oct 6, 202636 minAudio

    Performance testing has never been easier to start, or more important to get right. As teams ship more AI generated code, performance problems are slipping through, and they tend to surface during your highest traffic...

    Credit the people on this episode