IntelliJAMS

About IntelliJAMS

We got a real jam going down, welcome to IntelliJAMS. Hosted by Alex and Adam, each episode serves up quick insights and real-world takeaways, all packed into a fast and fun format. Whether you’re experimenting with new ideas or want to learn what other brands are already up to, Intellijams has everything you need to stay in the loop. Tune in for short, sweet, and totally actionable insights!

Publisher

Intelligems

Category

business · technology

Language

en

Explicit

No

First episode

11 May 2026

Latest episode

15 Jun 2026

Latest episodes

6 episodes in the feed.

1. 

   15 Jun 2026

   IntelliJAMS EP 061: How Much Traffic Do You Actually Need To A/B Test?

   How much traffic do you need to A/B test? And is your brand actually big enough to run a real experimentation program? These are two of the most common questions Shopify merchants ask before getting started, and most of the time, the answer is "less than you think." In this episode of IntelliJAMS, Alex and Adam break down the actual thresholds that determine whether A/B testing makes sense for your store. They get specific: what order volume you need to reach statistical significance, how your AOV changes that math entirely, what annual revenue level makes an experimentation program pay for itself, and what to do if you're not quite there yet. Here's the short version: if you're doing 500–700 orders a month, you likely have enough volume to run meaningful Shopify A/B tests — especially if you're testing high-traffic pages like checkout and cart instead of niche landing pages. And if you're at $3–5M in annual revenue, a well-run experimentation program that delivers a 3–5% revenue lift will typically pay for itself within a few months. But traffic and revenue aren't the only objections. A lot of brands ask "is my brand big enough to A/B test?" not because of traffic, but because they don't have the team — no dedicated CRO specialist, no data analyst, no developer on standby for test builds. Adam makes the case that AI has largely closed that gap. What used to take four people can now run with one operator and the right tools. They also dig into the AOV problem: a furniture brand doing $5M a year on $4,000–5,000 couches might only process 80–100 orders a month. At that volume, reaching statistical significance on an A/B test takes so long it stops being useful. The math on "how much traffic do I need to A/B test" isn't just about visitors — it's about conversions, and AOV determines how many conversions you're working with. If you've been putting off testing because you assumed you weren't ready, this episode is worth watching before you make that call. Timestamps: 0:00 - Intro 0:27 - The three reasons brands think they're not ready to test 1:55 - Two different problems: not qualified vs. not resourced 2:45 - Why AI closes the "I don't have a team" gap 3:10 - The 3–5% revenue uplift math (and when it pencils out) 5:54 - Order volume vs. visitors: what actually drives stat sig 6:30 - Why AOV changes everything (the $5K couch problem) 8:00 - The 500–700 orders/month rule of thumb 8:32 - You don't need to be Wayfair to run meaningful experiments 9:28 - Take bigger swings when you have lower traffic Topics covered: How much traffic you actually need to A/B test on Shopify Why order volume matters more than visitors for statistical significance How AOV affects whether your brand is big enough for A/B testing The revenue threshold where experimentation starts paying for itself Why AI has replaced much of the traditional CRO team What to test first when you're under 1,000 orders/month Ready to start testing? Join GEM Academy for free courses and a community of Shopify brands sharing what works: https://www.skool.com/intelligems-academy-1535 Connect with Intelligems: Website: https://intelligems.io Blog: https://intelligems.io/blog LinkedIn: https://www.linkedin.com/company/intelligems

2. 

   8 Jun 2026

   IntelliJAMS EP 060: The Frequently Unanswered Questions

   Your product page probably does a decent job explaining what you sell. But is it answering the questions customers are asking themselves and never typing into a chat widget? Adrian Stewart, co-founder of Scale Messaging, has a framework for finding those gaps, and it can change the way you approach A/B testing your messaging. In this episode of IntelliJAMS, Alex and Adrian dig into the "Frequently Unasked Questions" framework: four categories of questions shoppers silently ask themselves while browsing your site. They cover where most Shopify brands fall short on messaging, why reducing friction is easier than building motivation (but both matter), when urgency tactics actually work versus when they erode trust, and how to build hypotheses around messaging that you can test and learn from. Timestamps: 0:00 - Intro and the Frequently Unasked Questions framework 0:44 - Why "unasked" questions matter more than FAQs 1:57 - The four categories: understanding, motivation, difference, trust 4:26 - Motivation vs. friction and how they drive behavior 6:35 - Why motivation is harder to build than friction is to reduce 7:40 - Urgency as a bonus category (and when it gets hacky) 9:56 - Fake scarcity vs. real scarcity: the windscreen wiper example 11:22 - Difference: competing within your range, against competitors, and against inertia 14:09 - How to figure out which unasked questions to prioritize 17:13 - Message, expression, and placement: the three layers of testing 19:02 - Why one test usually leads to five more questions 20:15 - Where to start: trust is the fastest win, difference is the biggest opportunity 24:07 - Recap and where to find Adrian Topics covered: The Frequently Unasked Questions framework (understanding, motivation, difference, trust) Why "difference" is the most overlooked messaging gap on product pages The motivation-to-friction ratio and how it affects conversion When urgency and scarcity tactics help vs. hurt your brand How traffic source (paid social vs. search) should shape your messaging strategy Building messaging hypotheses you can A/B test Message vs. expression vs. placement as three layers of experimentation Why trust is the fastest win for most e-commerce brands Ready to start testing your messaging? Join GEM Academy for free courses and a community of brands sharing what works: https://www.skool.com/intelligems-academy-1535 Connect with Adrian / Scale Messaging: Website: https://scalemessaging.com LinkedIn: https://www.linkedin.com/in/adrianjstewart/ Connect with Intelligems: Website: https://intelligems.io Blog: https://intelligems.io/blog LinkedIn: https://www.linkedin.com/company/intelligems

3. 

   1 Jun 2026

   IntelliJAMS EP 059: Why Post-Purchase Is the Money Moment for Shopify Brands

   Post-purchase upsells sit at the exact moment a customer has already committed — credit card swiped, conversion done. That means there's zero risk of hurting conversion and pure upside potential for your AOV. In this episode, we break down why post-purchase might be the highest-leverage Shopify A/B testing opportunity most brands haven't explored yet. In this episode of IntelliJAMS, Adam and Alex explore the economics of post-purchase upsells — from a CBD brand that grew AOV 20% overnight to the consumption psychology that makes "buy more now" actually better for long-term LTV. Timestamps: 0:00 - Intro 0:22 - Why post-purchase upsells are worth your attention 1:04 - "Be close to the money" — does post-purchase qualify? 1:52 - What brands are doing with post-purchase today 2:11 - The CBD gummies case study: 20% AOV lift overnight 3:32 - Why there's zero downward pressure on conversion 5:05 - The consumption psychology surprise: more supply = faster consumption 6:09 - Scarcity vs. abundance mindset and second-order effects 8:04 - Three post-purchase upsell strategies that work 9:35 - Matching upsell strategy to your margin profile 10:26 - Using post-purchase for inventory clearance and sell-through 11:02 - How Intelligems handles post-purchase testing and measurement 12:28 - Why post-purchase tests can run in parallel with everything else Topics covered: The economics behind post-purchase upsells (zero incremental CAC, no conversion risk) A real-world CBD brand case study: 50% off second pack, 40% take rate, 20% AOV increase Three post-purchase strategies: same product discount, complementary products, and clearance/inventory sell-through Why consumption scales with supply — and what that means for repurchase rates How to match your upsell strategy to your margin profile Running post-purchase tests in parallel without interaction effects How Intelligems measures incrementality, revenue, and profit on post-purchase offers Want to start testing post-purchase upsells (or anything else)? Join GEM Academy for free courses and a community of brands sharing what works: https://www.skool.com/intelligems-academy-1535 Connect with Intelligems: Website: https://intelligems.io Blog: https://intelligems.io/blog LinkedIn: https://www.linkedin.com/company/intelligems

4. 

   27 May 2026

   IntelliJAMS EP 058: Outputs vs. Outcomes: A Better Way to Think About A/B Testing

   Running 10 tests a month sounds productive, but if none of them are tied to a real business question, you're just taking swings for the sake of swinging. In this episode Adam and Alex dig into why "how many tests should I run?" is often the wrong question, and what to ask instead when you're building an experimentation program on Shopify. In this episode of IntelliJAMS, Adam and Alex explore the difference between test output and test outcomes, how to run concurrent tests without confounding your results, and why elevating the conversation from "number of tests" to "strategic priorities" changes everything. Timestamps: 0:00 - Intro 0:27 - The question everyone's asking right now 0:52 - Why "how many tests" is the wrong question 2:23 - Outputs vs. outcomes: reframing productivity 3:10 - Test the plan, don't plan the tests 3:51 - You can't predict how many tests it'll take 4:54 - Running concurrent tests without confounding results 5:53 - Scoping metrics to the right part of the funnel 6:48 - Every test needs a hypothesis 7:30 - One test often leads to five new questions 8:15 - Real example: ending a checkout upsell test early 9:11 - How to push back on "I need 10 tests this month" 11:49 - Elevating the conversation from output to strategy 13:28 - Final thoughts: see the forest for the trees Topics covered: Why counting tests is an output metric, not an outcomes metric How to reframe testing around strategic business goals Running concurrent A/B tests on Shopify without confounding data Segmenting tests by funnel stage and visitor type How one test can lead to five new questions Pushing back when stakeholders demand a test quota Real-world example: killing a checkout upsell test 24 hours in The "test the plan, don't plan the tests" framework Want to sharpen your experimentation skills? Join GEM Academy for free courses and a community of brands sharing what works: https://www.skool.com/intelligems-academy-1535 Website: https://intelligems.io Blog: https://intelligems.io/blog LinkedIn: https://www.linkedin.com/company/intelligems

5. 

   27 May 2026

   IntelliJAMS EP 057: Calling out the anxieties of A/B testing

   A/B testing can feel high-stakes, especially in e-commerce. You launch a test, check it an hour later, and either think you've broken your store or discovered a goldmine. Neither is true yet. This episode is a therapy session for anyone who's felt the anxiety of running A/B tests on their Shopify store. In this episode of IntelliJAMS, Alex McEachern and experimentation expert Ally Petretti walk through the most common anxieties of A/B testing and how to manage them with better process instead of more stress. Should you check your A/B test results every day? Checking your test daily is like weighing yourself multiple times a day on a diet. The number isn't wrong, but it's not ready to be meaningful yet. Check to make sure the test is collecting data and firing correctly, but don't read into the directional results until you've hit your planned runtime and traffic thresholds. What is statistical significance and when should you end an A/B test? Statistical significance is often treated as a finish line, but reaching stat sig on day one doesn't mean you have a winner. Stat sig only looks at the math. You also need time (to account for day-of-week behavior changes, promotions, and the novelty effect) and volume (small sample sizes are fragile and can skew results dramatically). A test typically needs to run for at least one to two full weeks to account for these variables. What is the novelty effect in A/B testing? The novelty effect happens when returning visitors see something different on your site and react to the change itself rather than the actual experience. In price testing, this can look like a customer treating a different price as a discount and converting out of urgency. The novelty effect fades after a week or two as your sample includes more new visitors and repeat visitors adjust. What is metric shopping in CRO? Metric shopping is when you pick a winning metric after a test is already running, instead of sticking to the success metric defined in your hypothesis. For example, if your hypothesis targeted conversion rate but AOV happened to spike, declaring a win based on AOV is metric shopping. It's what Ally calls "the silent killer of CRO." The right move is to note the unexpected metric change, form a new hypothesis around it, and run a separate test. How should you communicate A/B test results? Don't just drop a list of metrics. That's left open to interpretation. Data storytelling means framing results around your original hypothesis, explaining what customers did and why, and tailoring the narrative for your audience. A CFO needs a different story than a CMO. Use tools like the Intelligems Slack bot or MCP integration to help frame results for different stakeholders. How do you handle test ideas that aren't backed by data? Ideas from teammates or Twitter threads aren't bad, but they need a hypothesis before they become tests. A strong hypothesis includes a data-backed problem, a proposed solution (the test idea), and a success metric. If an idea doesn't have that, either formulate the hypothesis yourself from existing data or add it to the backlog until you can. How do you coordinate A/B testing across teams? CRO teams and paid media teams often test independently, which creates noise in each other's data. The key is sharing hypotheses (not just test plans), coordinating testing calendars, and recognizing that every team is working toward the same growth goal. Regular cross-team syncs where you discuss challenges, upcoming campaigns, and testing angles can turn conflict into collaboration. Join GEM Academy for free courses and a community of brands sharing what works: https://www.skool.com/intelligems-aca... (https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqay10dFBtczlmZzN6Q0ZjV2RHOTBJcURYaWlwZ3xBQ3Jtc0trRG05cHUxLUtvb0drcVZLaGZGOUJhWFlZU24yT2djdmxxS1VYZnFuTmtnYS1mVjFuVUdDVFJUYk5oeTlqc3NDSDFMMjg5cGpaS2Z3Z0hhWnVNdEVmQXFiaDh1WnVRUG1NeXczZmVfZFFNOWFsTUcxcw&q=https%3A%2F%2Fwww.skool.com%2Fintelligems-academy-1535&v=qrh_WJ7Juw8) Connect with Ally Petretti: https://www.linkedin.com/in/ally-petretti-kuhn-47a27014/  (https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqbUo4MWFSb25GN3hQRlVuVHNfSk5aOTFHdEdPUXxBQ3Jtc0trYmozZVV4M3Bxd0ZHa29LM2lGNzFwOE44SlJyek9pa25MRy1fOS1oelJMa3IyZ3VkdDFmdWdXNjk4bnhLR2stNWJlUW1vcGNUaTJKcW93dlFWSC1SbDRnRU5BMUhINmxLZEQyZUVqODZqZ2FSb01mZw&q=https%3A%2F%2Fwww.linkedin.com%2Fin%2Fally-petretti-kuhn-47a27014%2F&v=qrh_WJ7Juw8) Connect with Intelligems: Website: https://intelligems.io (https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqbE1NdlJERDNSZ2N0V0dmc0hRdzRqZTlBYWZyZ3xBQ3Jtc0trSkNKVW5TcDhPQjlwRk5TaHBrVG93a0VISC11V0NYcy1mWGRibjEtMHJhSTBZU1BYRGlhOXk0OE1NREN5MEFhLUtpdkgyWkY0T09tT2N2U2ZvQ2ZZdUhhQVg2RXVkbGo5MnlMbldDMXJPVW1FSm11VQ&q=https%3A%2F%2Fintelligems.io%2F&v=qrh_WJ7Juw8) Blog: https://intelligems.io/blog (https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqbHFsRXA1S1JoY0ZFXy1LbVh0MHF5MkJFMTRWUXxBQ3Jtc0ttTDJ6VzZrUzhzZzJZTGRxSTUtT1ZRZmdrcGVlYmxJejZIQlJwNjllSXVfSEZJcWRWMDVGTS01ZFlOTE9WV056TWRoTzdzeUoxVkxiLTBRdlVKcXJmckNFckU0ZVhDYzJ3a3hXMm5XeDhWTEpnYm0tcw&q=https%3A%2F%2Fintelligems.io%2Fblog&v=qrh_WJ7Juw8) ---- 0:00 (https://www.youtube.com/watch?v=qrh_WJ7Juw8) - Intro: Why we need a CRO therapist 1:05 (https://www.youtube.com/watch?v=qrh_WJ7Juw8&t=65s) - The #1 stressor in testing: urgency and timing 1:44 (https://www.youtube.com/watch?v=qrh_WJ7Juw8&t=104s) - "I'm a genius" vs. "I'm killing the business" (early test reactions) 2:33 (https://www.youtube.com/watch?v=qrh_WJ7Juw8&t=153s) - Peeking at tests: checking vs. reacting 4:51 (https://www.youtube.com/watch?v=qrh_WJ7Juw8&t=291s) - Pre-test analysis: setting guardrails before you launch 5:30 (https://www.youtube.com/watch?v=qrh_WJ7Juw8&t=330s) - Statistical significance isn't the finish line 6:13 (https://www.youtube.com/watch?v=qrh_WJ7Juw8&t=373s) - The novelty effect and why it matters for price testing 7:47 (https://www.youtube.com/watch?v=qrh_WJ7Juw8&t=467s) - Using the time series chart to read test stability 8:39 (https://www.youtube.com/watch?v=qrh_WJ7Juw8&t=519s) - When to call a test early (the right way) 10:12 (https://www.youtube.com/watch?v=qrh_WJ7Juw8&t=612s) - No test losers: every result is a learning 10:59 (https://www.youtube.com/watch?v=qrh_WJ7Juw8&t=659s) - Hypothesis discipline and metric shopping 12:18 (https://www.youtube.com/watch?v=qrh_WJ7Juw8&t=738s) - What metric shopping is and why it's the silent killer of CRO 13:25 (https://www.youtube.com/watch?v=qrh_WJ7Juw8&t=805s) - Communicating test results: data storytelling 15:57 (https://www.youtube.com/watch?v=qrh_WJ7Juw8&t=957s) - The three E's framework: Explore, Experiment, Extend 17:25 (https://www.youtube.com/watch?v=qrh_WJ7Juw8&t=1045s) - Understanding your customers through testing 18:20 (https://www.youtube.com/watch?v=qrh_WJ7Juw8&t=1100s) - "Feelings over data": handling test ideas without a hypothesis 21:19 (https://www.youtube.com/watch?v=qrh_WJ7Juw8&t=1279s) - Cross-team testing: getting paid media and CRO on the same page 25:42 (https://www.youtube.com/watch?v=qrh_WJ7Juw8&t=1542s) - Wrap-up and where to connect with Ally

6. 

   11 May 2026

   IntelliJAMS EP 056: Instead of planning your tests, test your plan

   Conversion rate went up, but did profit? Most testing programs optimize for one metric in isolation, and that's exactly where they go wrong. In this episode, Amanda Siegel (Director of E-commerce at Scale Media) breaks down why she stopped calling what she does "CRO" five years ago and started treating testing as a tool to validate business strategy, not just chase website wins. In this episode, Alex and Amanda explore what happens when you balance conversion rate, AOV, and subscription adoption in every test instead of picking one, why the old UX tricks (spin-to-wins, slashed prices, CTA color swaps) are losing their edge, and how to get buy-in for short-term metric dips that lead to long-term growth. Timestamps: 0:00 - Intro and why Amanda calls herself "a little crazy" 1:20 - The limits of traditional CRO and flat testing 3:00 - What's changed in the last 10 years of e-commerce UX 4:17 - Consumers are catching on to optimization tricks 6:10 - Why reducing discounts is actually improving conversion 7:36 - Shifting from product sales to business strategy (bundles, subscriptions) 9:02 - No silver bullets: what works for your business vs. someone else's 10:20 - Conversion rate is one-dimensional and easy to game 11:43 - The growth experiment mindset: testing for business growth 13:58 - Intentional trade-offs and why short-term losses can be worth it 15:10 - The two most important questions in commerce 16:19 - Getting buy-in when a metric temporarily looks bad 19:15 - "Testing is a tool, not a job title" 21:14 - Diminishing returns of small, isolated tests 22:58 - "Don't plan your tests. Test your plan." 24:03 - Amanda's advice: be bold, back-plan from ideal outcomes 25:39 - Why testing has to be cyclical, not one-and-done 27:06 - Where to connect with Amanda Topics covered: Why conversion rate optimization (CRO) is too narrow for modern e-commerce Balancing conversion rate, AOV, and subscription adoption in a single test How consumer behavior has evolved and why old UX tricks are losing effectiveness The counterintuitive finding that reducing discounts can improve conversion Using A/B testing and experimentation to validate business strategy, not just website changes Getting executive buy-in for short-term metric trade-offs The growth experiment mindset for Shopify brands Why testing needs to be cyclical and revisited over time --- Want to think bigger about your testing program? Join GEM Academy for free courses and a community of e-commerce operators sharing what actually works: https://www.skool.com/intelligems-academy-1535 Connect with Amanda Siegel: https://www.linkedin.com/in/amandadsiegel/ Connect with Intelligems: Website: https://intelligems.io Blog: https://intelligems.io/blog LinkedIn: https://www.linkedin.com/company/intelligems

Contact IntelliJAMS

Guest appearances

Books guests

Based on episode analysis; this does not confirm that the show is currently accepting guests.