Browse tests that generated $7.3M in revenue.

A/B Testing

Article Cover Image: Do Countdown Timers Actually Work on Ecommerce Sites?

Do Countdown Timers Actually Work on Ecommerce Sites?

I spent a decade thinking countdown timers were magic, off the back of a business where I never actually tested the timer. So I dug through the research. They work sometimes, and the timer itself has almost nothing to do with it.

Tim Davidson

Tim Davidson

14 min read

Article Cover Image: Sticky Add to Cart Buttons: Do They Actually Work?

Sticky Add to Cart Buttons: Do They Actually Work?

Sticky add to cart used to be my go-to fix for every store. Then a test barely moved the needle, and I found out why some sticky bars work and some just add friction.

Tim Davidson

Tim Davidson

9 min read

Article Cover Image: Statistical Significance in A/B Testing, Explained

Statistical Significance in A/B Testing, Explained

This quick article explains what statistical significance is, and why it's something you can't shortcut.

Tim Davidson

Tim Davidson

10 min read

Article Cover Image: Micro-Conversions: How to Judge a Test Without Sales Data

Micro-Conversions: How to Judge a Test Without Sales Data

Add to cart isn't always the right proxy. Here's how we pick and combine micro-conversions when a test doesn't have enough purchases to trust yet.

Tim Davidson

Tim Davidson

9 min read

Article Cover Image: A/B Test Prioritization: The Tier 1, 2, 3 Framework

A/B Test Prioritization: The Tier 1, 2, 3 Framework

A 3-tier system for sorting any A/B test idea. Tier 1 touches price or offer, Tier 2 touches page flow, Tier 3 is surface UI only. Bigger changes need far less traffic to prove: a 50% lift needs roughly 6x fewer visitors than a 20% lift to reach significance.

Tim Davidson

Tim Davidson

10 min read

Article Cover Image: How to A/B Test When You Don't Have the Traffic

How to A/B Test When You Don't Have the Traffic

Most A/B testing advice assumes huge traffic. Here's how to test offers, pricing and bigger changes when your store only gets a few thousand sessions a month.

Tim Davidson

Tim Davidson

10 min read

Article Cover Image: Do Parallel A/B Tests Contaminate Each Other's Results?

Do Parallel A/B Tests Contaminate Each Other's Results?

Running two A/B tests on one page won't wreck your data. Here's the research on concurrent test interference, and how it unlocks 200+ tests a year.

Tim Davidson

Tim Davidson

8 min read

Article Cover Image: Picking A/B Tests That Actually Move Revenue

Picking A/B Tests That Actually Move Revenue

90% of A/B tests produce less than 1.2% effect. After an A/A test revealed our client's store needed 100+ days to reach significance, we built a scoring framework that classifies every experiment idea into three tiers before it burns any runtime.

Tim Davidson

Tim Davidson

9 min read

Article Cover Image: Running Parallel A/B Tests on Shopify with Intelligems

Running Parallel A/B Tests on Shopify with Intelligems

Running parallel A/B tests on Shopify is harder than it looks. I dug into how Intelligems actually handles template tests, onsite edits, and price tests under the hood, and figured out which ones can safely stack on the same page and which ones can't.

Tim Davidson

Tim Davidson

12 min read

Don’t miss out on the latest stories!

Sign up for my newsletter to receive the latest news from the blog, you’ll get pinged every few months with a digest from the tech world.

Thank you for reaching out!