AI Agents Are Making Decisions. Who's Checking Their Work? (with Matt Davis)
AI agents can now write code, open pull requests and act on your behalf. So who checks their work? Steve Ryan sits down with Matt Davis, co-founder of Critical Propulsion ("Humans lead. Agents execute."), to work out what agents should decide on their own, where a human approval gate belongs, and why rolling out agents is a change-management problem, not just a tech one. It starts with a real story: Meta's Muse AI gave a stranger a YouTuber's home address on Facebook Marketplace.
🤖 This episode was edited with the help of AI tools, but it was made by a real person: a real conversation between real people, edited and reviewed by Steve.
Key takeaways
Put a human gate wherever an agent's action is hard to undo: publishing, payments, sharing personal data.
An agent shouldn't approve its own work. One agent opens the pull request, another pre-checks it, a human signs off.
The skill that matters now is judging the output, not doing the task.
Match the model to the job. Low-risk internal work doesn't need the most expensive model.
Most AI rollouts stall on people and process, not technology.
Chapters
0:00 Cold open
0:25 Where does an agent's permission end?
2:08 Gates at every function
3:23 YOLO mode vs. guardrails
6:00 Where do humans fit?
6:49 The human bottleneck
8:17 Verification & hallucinations
9:30 It's change management, not tech
11:03 Lessons from Amazon Robotics
12:01 Reskilling: judge the outputs
13:28 One person, many agents
15:39 Keeping up with the models
17:48 The cost of tokens
21:13 Open & Chinese models
22:11 Is AI coming home?
24:17 Security, risk & sandboxes
27:46 Why AI isn't plug-and-play
29:04 Inside Critical Propulsion
31:42 Knowledge workers aren't dead
Stories mentioned
Meta launches Muse Wonder (Android Authority) (https://www.androidauthority.com/meta-muse-wonder-ai-models-3722247/)
Muse shared a YouTuber's home address (Dexerto) (https://www.dexerto.com/youtube/meta-responds-after-muse-ai-gave-stranger-youtubers-home-address-on-facebook-marketplace-3414057/)
Claude Opus 5.5 (The Batch) (https://www.deeplearning.ai/the-batch/claude-opus-5-5-leaps-forward)
Anthropic files confidential IPO paperwork (Yahoo Finance) (https://finance.yahoo.com/news/anthropic-files-confidential-paperwork-to-go-public-ahead-of-openai-160929472.html)
Why residents say no to AI data centers (NPR) (https://www.michiganpublic.org/news/2025-07-17/why-more-residents-are-saying-no-to-ai-data-centers-in-their-backyard)
Nvidia RTX Spark for local AI (The Decoder) (https://the-decoder.com/nvidia-pitches-rtx-spark-as-the-chip-that-finally-makes-local-ai-agents-practical-on-windows-devices/)
OpenAI publishes 377 math results (Interesting Engineering) (https://interestingengineering.com/ai-robotics/openai-unveils-377-math-results)
Watch the full video on YouTube: youtu.be/eIONRMEX0CQ (https://youtu.be/eIONRMEX0CQ)
ARQIV — Auditing Reality. Ask. Research. Question. Inspect. Verify. arqiv.fm (https://arqiv.fm)
21 Sept 2026
Will AI Replace Apps on Your Phone
The launch of the new SIRI AI has me asking some questions about what the future of the phone UI. How can AI replace Apps like games and other apps.
13 May 2026
The AI Education Crisis Nobody is Talking About
Is AI rotting our brains, or is it the ultimate learning tool? MIT scientists hooked 54 people up to EEG sensors and found those using ChatGPT had the lowest cognitive engagement. But that's only half the story.
In this documentary-style deep dive, we explore the massive gap between the panic surrounding artificial intelligence and what the data actually proves. While a Turkish study showed that students using regular ChatGPT scored 17% worse on exams, those using a hint-only AI performed 127% better during practice. The crisis isn't the technology; it's the design. We also audit reality on the job market, uncovering why AI-exposed jobs for 22 to 25-year-olds have dropped by 16%, completely hollowing out the traditional entry-level ladder.
If you want to understand how tech is shaping our future without the heavy jargon, subscribe to ARQIV so you don't miss our next deep dive into the reality of tomorrow's economy.
Reach and audience
Public platform figures. Ratings count people who left a rating, not total listeners.
YouTube views
30,078
Score snapshot 15 Sept 2025
Apple Podcasts (US)
5.0 / 5
2 ratings
Spotify
5.0 / 5
2 ratings
Podcast Authority Score: 37 / 100
A composite of feed quality, social presence, YouTube performance and engagement. Read the methodology.
Quality
43
Social presence
0
YouTube
76
Engagement
0
Contact The Arqiv
Guest appearances
Does not typically book guests
Based on episode analysis; this does not confirm that the show is currently accepting guests.
Host of The Arqiv?
Claim your podcast to manage its listing and keep your show details accurate.
Pod Engine is an independent podcast discovery and analytics service and is not affiliated with or endorsed by this podcast. Artwork and show content belong to their owners. Full legal notice.
Explore this show Podcast research with Pod Engine
