Outperform is a show dedicated to helping your business unlock its full potential through data-driven decision-making and experimentation. Every episode is packed with innovative strategies and practical insights designed to equip and inspire data scientists, marketers, and engineers alike.
We're exploring topics ranging from A/B testing and machine learning to creating a culture of experimentation within your organization.
Discover how businesses win by driving innovation and better decision-making!
The Blueprint for Self Sustaining Experimentation Programs with Lucia van den Brink
What separates experimentation programs that become strategic advantages from those that never make it beyond a handful of A/B tests? According to Lucia van den Brink, it starts with ownership.
As founder of The Initial, Lucia helps companies build experimentation programs from the ground up but unlike most agencies, her goal isn't to become a permanent partner. Instead, she works to create internal capabilities, establish experimentation culture, and leave organizations with self-sufficient teams that can continue growing long after her engagement ends.
In this episode, Lucia joins host Ryan Lucht to discuss why experimentation is about much more than finding winning tests. She explains how organizations can build momentum through early wins, develop internal champions, avoid getting stuck on tool selection, and create a culture where data—not hierarchy—drives better decisions.
In this episode, we discuss:
Why experimentation should become an internal capability instead of an outsourced function
How to build an experimentation culture through early wins, internal champions, and organizational buy-in
Why companies often overthink experimentation tools—and underestimate the importance of simply running experiments
The biggest mistakes organizations make when launching experimentation programs, including chasing velocity at the expense of learning
18 Mar 2026
The Experimentation Program Behind a 15M Subscriber YouTube Channel with Grace Miller
Grace Miller, Head of Experimentation and Failure at FLIGHTSTORY, reveals how her team builds an experimentation engine to drive growth across a 15M subscriber YouTube channel and media business.
19 Dec 2024
How Top Companies Are Evolving Experimentation in 2025
What’s next for experimentation in 2025? We’re breaking down insights from the biggest names in tech—Netflix, Amazon, Meta, and more.
Fresh from top experimentation conferences, we’ve identified three major trends set to shape the future of experimentation.
In this Episode:
Shifting toward self-serve capabilities for less-technical end users
The rise of automated "set it and forget it" experiments
Rethinking statistical guidelines to accelerate innovation
Connect with us:
Ryan on LinkedIn (https://www.linkedin.com/in/ryanlucht/)
Chetan on LinkedIn (https://www.linkedin.com/in/chetanvsharma/)
26 Nov 2024
What We're Getting Wrong About Running Experiments
Eppo Head of Product Eric Metelka took to the stage in San Francisco at the 2024 Lenny & Friends Summit to share some big insights on where product teams are making mistakes in their experimentation programs.
Drawing on case studies from industry leaders like Netflix, MSN and Booking.com, Eric explores how to rebuild trust in your data, accelerate experiment velocity, and foster a culture that thrives on bold, high-impact innovation.
In this Episode:
Discover how rigorous science ensures reliable results and builds trust with stakeholders.
Learn the secret to running faster, more impactful experiments using self-service tools.
Explore why bold changes drive growth—and how to manage risks with guardrails.
12 Nov 2024
4 Stages of Experiment Maturity
Data-driven is the buzzword of the day—but what are the strategies that separate top-tier, data-driven companies from the rest? From chaotic, one-off tests to fully automated systems, we share the four stages that drive scalable growth, speed up learning, and make decision-making a breeze.
In this episode, Lukas Goetz-Weiss, joins Ryan Lucht to explore each maturity stage, the common roadblocks, and the practical steps any business can take to level up.
In this Episode:
Why most companies start with isolated, intuition-driven tests and the pitfalls of this chaotic approach.
Why companies gain structure but struggle with resource bottlenecks and decision-making delays.
How to build trust in experiment results, empower teams, and avoid pitfalls like p-hacking and underpowered tests.
Examples of companies that turn experimentation into a seamless, strategic advantage.
29 Oct 2024
5 places to generate GREAT A/B test ideas
"When in doubt, test it out!"
In today's episode of Outperform, we uncover why the best teams thrive on a culture of testing everything— powerful metrics like segment-level differences and the dynamic balance between best practices and bold experiments, showcasing why both small tweaks and big swings matter. Plus, how a well-balanced experiment portfolio and savvy management can supercharge your path to strategic innovation!
In this Episode:
Discover five unconventional methods for generating powerful A/B test hypotheses.
Learn how to harness historical company insights, customer feedback, and UX best practices to drive impactful business outcomes.
Explore the significance of a balanced experimentation portfolio, blending big and small bets to effectively transform your business and maintain a competitive edge.
16 Oct 2024
3 Challenges in Creating a Culture of Experimentation
The power of experimentation is never clearer than when small changes spark massive breakthroughs. But how do you get your teams convinced to start testing many small changes in the first place?
We explore some common roadblocks that stand in the way of world-class cultures of experimentation. Ryan, Che, and Sven share insider insights from companies like Airbnb and Stitch Fix to give you actionable ideas and strategies in building your own experimentation program - and career.
In this Episode:
Taking calculated risks and consistently experimenting are key to achieving breakthroughs and driving success.
Standardizing processes and metrics minimizes friction, making it easier for teams to run experiments independently.
Leadership is essential in building a culture of experimentation, where successes are celebrated and failures are seen as valuable learning opportunities.
24 Sept 2024
AI model evaluation
AI is evolving at lightning speed - the shift from custom-built models to pre-trained large language models (LLMs) is driving rapid adoption from businesses.
But how do we know if all these models are actually driving positive business outcomes? As the New York Times put it, “AI has a measurement problem”.
In this Episode:
Why most current AI model evaluation methods fall short
How to truly measure AI effectiveness with real-world data and experimentation
9 Sept 2024
AB Testing vs. Multi-Armed Bandits: What You Need to Know
Imagine a world where your AB tests run themselves—faster, smarter, and more dynamic than a simple 50/50 split that takes weeks to measure.
Today’s episode breaks down how multi-armed bandit algorithms could change when and where you use AB testing. But don’t be fooled—there are no free lunches and no cure-alls.. We’ll show you why understanding your use case, keeping the stakes low, and having human oversight are the keys to getting the most out of these powerful algorithms.
In this Episode:
The potential of multi-armed bandit algorithms to supplant traditional AB testing
Critically assessing the limitations and complexities involved in applying bandit algorithms to real-world data and marketing contexts.
The role of these algorithms in personalizing customer interactions and automating low-risk experiments.
Reach and audience
Public platform figures. Ratings count people who left a rating, not total listeners.
Spotify
5.0 / 5
2 ratings
Contact Outperform
Guest appearances
Does not typically book guests
Based on episode analysis; this does not confirm that the show is currently accepting guests.
Host of Outperform?
Claim your podcast to manage its listing and keep your show details accurate.
Pod Engine is an independent podcast discovery and analytics service and is not affiliated with or endorsed by this podcast. Artwork and show content belong to their owners. Full legal notice.
Explore this show Podcast research with Pod Engine
