đ What About AI Agents is your go-to podcast for exploring the rapidly evolving world of AI agents. From automating workflows to revolutionizing industries, we break down the latest advancements, real-world applications, and emerging trends in AI.
Join us weekly as we uncover how AI agents are shaping our future, featuring expert interviews, thought-provoking insights, and stories that bridge the gap between humans and intelligent systems. Whether you're an AI enthusiast, industry professional, or simply curious about the tech shaping tomorrow, What About AI Agents has something for you.
Why AI Is About to Get MUCH Faster | Vasanth Mohan, SambaNova
AI spent the last few years competing on intelligence. Now the next major AI race is about speed.
As AI shifts from simple chatbots to agents that reason, write code, call tools, search the web, and coordinate other agents, latency compounds. A task that requires dozens or hundreds of sequential model calls can quickly turn seconds into minutes â or even hours. That makes inference speed a fundamentally different problem in the agentic AI era.
In this episode of So What About AI Agents?, Philippe Trounev sits down with Vasanth Mohan of SambaNova Systems to unpack what actually makes AI faster â from model architecture and memory bandwidth to batching, specialized accelerators, and next-generation inference hardware.
Vasanth explains the two major stages of inference â prefill and decode â and why they create very different hardware bottlenecks. They discuss operator fusion, parallelization across chips, memory bandwidth, and why reducing latency often comes with a significant cost tradeoff.
They also explore why coding agents are one of the clearest use cases for premium inference, how AI providers may eventually offer commodity, premium, and ultra-fast tiers of tokens, and why businesses willing to pay for speed may gain a meaningful productivity advantage.
Vasanth also shares early performance figures for SambaNova's upcoming SN50 architecture, including benchmark results around 800 tokens per second on a large model, compared with roughly 300â400 tokens per second on GPUs in the cited comparison.
We also get into a slightly crazier question: are AI agents already helping engineers design the next generation of AI hardware? The answer is increasingly yes â although humans are still very much in the loop.
In this episode:
Why AI agents make inference speed dramatically more important
Why sequential agent workflows create a latency bottleneck
Prefill vs. decode explained
GPUs vs. specialized AI accelerators
The relationship between speed, batching, throughput, and cost
Why memory bandwidth matters for large AI models
What SambaNova's SN40 and SN50 architectures are designed to solve
800-token-per-second AI inference
Why coding agents benefit so much from faster models
Commodity vs. premium vs. ultra-fast AI inference
Whether faster AI becomes a competitive advantage
How AI agents are already being used in hardware engineering
Why AI infrastructure may become just as important as the models themselves
Chapters
00:00 â The AI race is shifting from intelligence to speed
00:39 â Why AI agents suddenly need faster inference
02:38 â What actually makes an AI model run faster?
05:30 â When does ultra-fast inference matter?
08:08 â Does model architecture determine inference speed?
10:05 â How do you optimize AI from model to hardware?
12:44 â How fast can AI inference actually get?
15:28 â The sequential latency problem with AI agents
16:39 â Where faster AI creates the most value
18:30 â Will premium AI inference become a competitive advantage?
20:11 â What does AI inference actually cost?
23:10 â How many tokens can AI hardware generate?
24:46 â Building private AI infrastructure
28:02 â How much faster can AI eventually become?
30:14 â Are AI agents already designing AI hardware?
32:50 â Why today's âfastâ AI will eventually feel slow
33:34 â What happens next in AI infrastructure
8 Sept 2026
Can a $20 AI Hacker Outspeed Your Security Team? | Neal Iyer | Splunk AI | EP 65
AI attackers can now move at a speed and scale that traditional security operations were never designed to handle.In this episode of **So What About AI Agents**, Philippe Trounev sits down with **Neal Iyer, Director of Product Management for AI at Splunk Security**, to talk about what happens when autonomous AI agents become part of both the attack and defense side of cybersecurity.Neal breaks the new threat landscape into three forces: **scale, speed, and sophistication**. AI can give relatively unsophisticated attackers capabilities that previously required much more expertise, while autonomous attacks can move so quickly that a security team celebrating a five-minute detection time may already be too late.We get into:⢠How AI changes the economics of cyber attacks⢠Why cheap AI agents can dramatically increase the number and sophistication of attacks⢠Why traditional SOC response times may no longer be fast enough⢠How prompt injection creates a new attack surface for defensive AI agents⢠Why simply deploying more security agents isn't enough⢠Building a security âharnessâ around autonomous agents⢠Runtime monitoring, guardrails, observability, and human escalation⢠When security agents should act autonomously â and when a human needs to stay in the loop⢠Using business context to distinguish between compromising an intern's laptop and locking out a CEO⢠Why security tools need better integration for agentic operations⢠How organizations can start testing their agents against prompt injection and other attacks today⢠Why Splunk and Cisco are exploring purpose-built small language models for cybersecurity⢠The role of open-source, self-hosted, and multi-model AI strategies⢠Why AI security economics may force companies to rethink how they store and process security dataWe also get into the broader question of whether frontier AI companies can really replace specialized enterprise software â or whether impressive demos fall apart when customers need reliability, support, governance, and measurable outcomes.The bigger takeaway is that the future SOC probably isn't humans versus AI attackers.It's **agents fighting agents â with humans designing the systems, permissions, guardrails, and escalation paths that keep those agents under control.**Subscribe to **So What About AI Agents** for conversations with the people actually building and deploying AI agents in production.https://www.docsie.io
1 Sept 2026
10 AI Agents That Can Run Your GTM in 2026 | Ginny de la Terre | EP 64
In this episode of **So What About AI Agents**, we break down **10 AI agents and workflows weâve used to drive traffic, generate demand, nurture leads, and automate parts of our go-to-market operation**.This episode was recorded a little while ago, so my own setup has evolved since then. Today I use **fewer, more capable agents with much more advanced workflows**, rather than trying to automate everything with a huge number of separate agents. But the core ideas in this conversation are still useful if you're trying to figure out where agents can actually create leverage in marketing and GTM.We cover agents for:⢠LinkedIn intent detection and outbound⢠Lead nurturing based on actual customer behavior⢠Automated newsletters⢠Social media content planning and distribution⢠Paid-ad creative and optimization⢠Turning videos into blogs, clips, and other content⢠Programmatic SEO and AI-search visibility⢠Building glossary and topic-cluster content at scale⢠Google Search Console and analytics-driven optimization⢠Cross-channel content repurposingWe also talk about what **doesnât** work particularly well: generic cold email, blindly automating social media, expensive always-on AI employees, bad AI-generated content, and agents that cost more to operate than the value they create.The bigger lesson is that you probably donât need one magical âAI employeeâ doing everything.You need a small number of well-defined agents with clear jobs, good data, specific triggers, and enough human oversight to keep them from doing something stupid.If you're building an AI-native marketing or GTM stack, this episode gives you a practical starting point for deciding what is actually worth automating â and what probably isn't.Subscribe to **So What About AI Agents** for conversations about how companies are actually building, deploying, and operating AI agents in the real world.https://www.docsie.io
Who has been a guest on So What About AI Agents
Names identified in recent episode analyses. Showing up to five guests.
Rome Thorstenson
Laurent Cohen
Michael Ullam
Dr Craig Kaplan
Mitchell Jones
Reach and audience
Public platform figures. Ratings count people who left a rating, not total listeners.
Apple Podcasts (US)
5.0 / 5
4 ratings
Spotify
5.0 / 5
7 ratings
Podcast Authority Score: 41 / 100
A composite of feed quality, social presence, YouTube performance and engagement. Read the methodology.
Quality
68
Social presence
0
YouTube
0
Engagement
32
Contact So What About AI Agents
Guest appearances
Does not typically book guests
Based on episode analysis; this does not confirm that the show is currently accepting guests.
Pod Engine is an independent podcast discovery and analytics service and is not affiliated with or endorsed by this podcast. Artwork and show content belong to their owners. Full legal notice.
Explore this show Podcast research with Pod Engine
