Test-Talks.com

About Test-Talks.com

”Saving the world from bad AI software” - a groundbreaking podcast series that delves into the rapidly evolving world of testing AI. Join us as we navigate the cutting-edge technologies, methodologies, and practices that are shaping the future of the AI Assurance and Confidence Engineering landscape. In this captivating series, we’ll be featuring thought leaders, industry experts, and practitioners who are at the forefront of innovation in software testing. Our engaging conversations will cover topics such as: 1️⃣ Artificial Intelligence and Machine Learning: Discover how AI and ML are revolutionizing test automation, analysis, and generation, providing testers with powerful new tools and capabilities. 2️⃣ The Human-Machine Collaboration: Uncover the ways in which testers can leverage AI technologies like Keysight Eggplant Test to enhance their skills, boost productivity, and ensure the highest quality software. 3️⃣ Testing in the Age of Agile and DevOps: Learn how modern development approaches have transformed the role of testers and how they can adapt to remain essential in fast-paced environments. 4️⃣ Emerging Testing Strategies: Dive into the latest methodologies, such as context-aware testing and test-driven development, and explore their potential to improve test coverage and effectiveness. 5️⃣ The Growing Importance of Domain Knowledge: Discuss the significance of integrating domain expertise into the testing process and how AI can help testers gain valuable insights into specific industries. 6️⃣ The Ethical and Social Implications of AI-Driven Testing: Examine the ethical concerns and societal impact of AI in software testing, and envision a responsible and inclusive future for the industry. Don’t miss out on this thrilling journey into the future of software testing! Subscribe now to ”Test-Talks.com” and stay ahead of the curve as we redefine the boundaries of quality assurance. #TestingTomorrowToday #SoftwareTesting #FutureOfTesting #Podcast

Publisher

Automation Cyborg

Category

technology

Language

en

Explicit

No

First episode

20 Nov 2016

Latest episode

8 Jul 2026

Latest episodes

86 episodes in the feed.

1. 

   8 Jul 2026

   The AI Risk Boards Get Wrong — feat. David Subar (Interna)

   The view from the board seat: why the biggest AI risk isn't a bad model — it's moving too slowly while your competitors learn faster. Alex Belotsky and co-host Kuba sit down with David Subar, founder of the LA consultancy Interna and a veteran board advisor, to unpack how AI is reshaping the decisions made in the boardroom. David argues that boards don't care which tool writes the code — they care about value creation and risk, the same math whether you ship in assembly or with Claude Code. He frames the product roadmap as "a series of bets" and explains why unconstraining development velocity forces companies to iterate faster while their risk surface balloons. The conversation digs into why stochastic systems are so hard to test (the boundaries "might be in the middle"), using Google's Gemini founding-fathers image fiasco as a billion-dollar cautionary tale, and why AI red teaming and reliability metrics now matter as much as pass/fail test cases. David and the hosts also tackle the "SaaS apocalypse," the flood of vibe-coded internal tools that smashes the QA problem across every department, Conway's Law and org design, Jevons paradox and developer jobs, and whether the real constraint on AI is TSMC and energy rather than talent. It's a candid, wide-ranging take on shipping reliable AI when the ground shifts every six months. **In this episode:**- The Board's View: Value Creation vs. Risk Reduction- Product Roadmaps As A Series Of Bets- Why Stochastic Systems Fail At The Boundaries- Lessons From Google's Gemini Image Controversy- From AI Red Teaming To Reliability Metrics- The SaaS Apocalypse And Vibe-Coded Internal Tools- Conway's Law, Org Design And Fewer Middle Managers- Jevons Paradox, Layoffs And The Future Of Developer Jobs- Shift-Left (Even Lefter): How QA Tests Non-Deterministic AI **Guest:** David Subar — Founder, Interna (board advisor, ex-CTO/CPO)**Host:** Alex Belotsky (CEO, TestSavant.AI) with co-host Jakub "Kuba" Fiatkevich > "you saw a worm in the ground you stepped on it now there's worm guts everywhere and someone's got to clean that up" 🎧 *Subscribe to Ctrl-Alt-Deploy on Apple Podcasts, Spotify and YouTube for conversations on building and shipping reliable AI to production, QA, testing and AI governance.* ## Hashtags#CtrlAltDeploy #AI #SoftwareTesting #QA #QualityEngineering #AIGovernance #AIRiskManagement #BoardAdvisory #LLM #AIRedTeaming #ShiftLeft #VibeCoding #TestSavant #AIAssurance

2. 

   8 Jul 2026

   Guarding the Henhouse: Testing AI in Regulated Industries — feat. Erick Herring (Vynyl)

   When your chatbot answers legal or medical questions, "close enough" isn't a spec — it's a lawsuit. Erick Herring of Vynyl joins Kuba and Alex to unpack what it actually takes to build and assure LLM-based systems for healthcare, lending, insurance and legal clients. Drawing on a career that spans punch cards, the birth of the commercial web and today's AI frenzy, Erick argues that the fundamentals of accountability haven't changed — but the way we hold code writers (now AI) accountable has, opening the door to formal verification, 100% test coverage and rigorous pre/post-condition testing that were never practical with human-only teams. He makes the case that "red teaming" is the wrong frame — this is AI assurance, spanning hallucination, bias and reliability, not just jailbreaks — and that QA can no longer be a discrete step but a continuous process fed by unified observability. Along the way: why guardrail code deserves more scrutiny than production code, the "ontological reframing" paper on talking an AI past its safety guardrails, the "yes, yes, yes" developer psychology that erodes PR review, and why QA engineers are more necessary now, not less. A grounded, contrarian take on shipping non-deterministic software you can actually stand behind. **In this episode:**- Testing AI Systems In Regulated Industries- AI Assurance Versus Red Teaming- Guardrails For Code And Runtime Systems- Continuous QA And Unified Observability- Formal Verification And Mutation Testing At Scale- Disclaimers, Liability And Legal Chatbots- Developer Psychology And The "Yes, Yes, Yes" Trap- Why QA Is More Necessary, Not Less **Guest:** Erick Herring — Founder, Vynyl (product development firm serving regulated industries)**Host:** Kuba Fiatkevich (CTO, TestSavant.AI) with co-host Alex Belotsky (CEO, TestSavant.AI) > "Our brains are not thinking machines. Our brains are justification machines." 🎧 *Subscribe to Ctrl-Alt-Deploy on Apple Podcasts, Spotify and YouTube for conversations on building and shipping reliable AI to production, QA, testing and AI governance.* ## Hashtags#CtrlAltDeploy #AI #SoftwareTesting #QA #QualityEngineering #AIAssurance #LLM #AITesting #RegulatedIndustries #RedTeaming #Observability #Guardrails #AIGovernance #Vynyl

3. 

   8 Jul 2026

   QA vs QE: Engineering Quality Into Non-Deterministic AI — feat. Janna Loeffler (Quality Engineering Leader)

   When your system gives a different answer every time, "assuring" quality is a trap — you have to engineer it in. Janna Loeffler joins Alex and Kuba to unpack why the shift from quality assurance to quality engineering (and even "quality enablement") matters more than ever in the age of LLMs and agents. She argues that AI didn't kill the tester's job — it made human insight, risk judgement and context-driven thinking essential, because non-deterministic output turns testing from clean pass/fail into questions of accuracy, relevance and intent. Janna makes the case for an "army" of single-purpose agents that handle the mundane — regression, accessibility, OWASP Top 10 security checks — so testers can focus on outcomes over outputs. The conversation digs into the real danger of eroding guardrails, including a chilling example of a system talked past its safety limits within minutes, and why model providers like Anthropic and OpenAI are pushing safety responsibility down onto the customers who deploy them. Along the way she shares how she vibe-coded a unit-test-writing agent in Cursor in a single day, why diverse test teams are the antidote to biased models, and why the emerging "AI architect" role will decide whether we get one agent or an orchestrated fleet of hundreds. **In this episode:**- Quality Assurance vs Quality Engineering vs Quality Enablement- Testing Non-Deterministic And Probabilistic Systems- Automating The Mundane With Single-Purpose Agents- Outcome Over Output: Validating Intent, Not Exact Strings- Guardrails, Context Buffers And Adversarial Manipulation- Bias, Diverse Test Teams And Context-Driven Testing- Auditability, Traceability And Observability In Production- The Emerging AI Architect Role And Agent Orchestration **Guest:** Janna Loeffler — Quality Engineering Leader / Director, 20+ years in QE, testing and platform reliability**Host:** Alex Belotsky (CEO, TestSavant.AI) with co-host Jakub "Kuba" Fiatkevich > "yes, everybody should be responsible for quality, but you need somebody accountable for that quality." 🎧 *Subscribe to Ctrl-Alt-Deploy on Apple Podcasts, Spotify and YouTube for conversations on building and shipping reliable AI to production, QA, testing and AI governance.* ## Hashtags#CtrlAltDeploy #AI #SoftwareTesting #QA #QualityEngineering #QualityEnablement #AITesting #ContextDrivenTesting #Agents #LLM #Guardrails #AIGovernance #TestAutomation #NonDeterministic

Reach and audience

Public platform figures. Ratings count people who left a rating, not total listeners.

Apple Podcasts (US)

5.0 / 5

1 ratings

Spotify

4.4 / 5

29 ratings

Podcast Authority Score: 1 / 100

A composite of feed quality, social presence, YouTube performance and engagement. Read the methodology.

Quality

3

Social presence

0

YouTube

0

Engagement

0