Browse tests that generated $7.3M in revenue.

Experimentation

Article Cover Image: Do Countdown Timers Actually Work on Ecommerce Sites?

Do Countdown Timers Actually Work on Ecommerce Sites?

I spent a decade thinking countdown timers were magic, off the back of a business where I never actually tested the timer. So I dug through the research. They work sometimes, and the timer itself has almost nothing to do with it.

Tim Davidson

Tim Davidson

14 min read

Article Cover Image: Sticky Add to Cart Buttons: Do They Actually Work?

Sticky Add to Cart Buttons: Do They Actually Work?

Sticky add to cart used to be my go-to fix for every store. Then a test barely moved the needle, and I found out why some sticky bars work and some just add friction.

Tim Davidson

Tim Davidson

9 min read

Article Cover Image: Statistical Significance in A/B Testing, Explained

Statistical Significance in A/B Testing, Explained

This quick article explains what statistical significance is, and why it's something you can't shortcut.

Tim Davidson

Tim Davidson

10 min read

Article Cover Image: Micro-Conversions: How to Judge a Test Without Sales Data

Micro-Conversions: How to Judge a Test Without Sales Data

Add to cart isn't always the right proxy. Here's how we pick and combine micro-conversions when a test doesn't have enough purchases to trust yet.

Tim Davidson

Tim Davidson

9 min read

Article Cover Image: A/B Test Prioritization: The Tier 1, 2, 3 Framework

A/B Test Prioritization: The Tier 1, 2, 3 Framework

A 3-tier system for sorting any A/B test idea. Tier 1 touches price or offer, Tier 2 touches page flow, Tier 3 is surface UI only. Bigger changes need far less traffic to prove: a 50% lift needs roughly 6x fewer visitors than a 20% lift to reach significance.

Tim Davidson

Tim Davidson

10 min read

Article Cover Image: Do Parallel A/B Tests Contaminate Each Other's Results?

Do Parallel A/B Tests Contaminate Each Other's Results?

Running two A/B tests on one page won't wreck your data. Here's the research on concurrent test interference, and how it unlocks 200+ tests a year.

Tim Davidson

Tim Davidson

8 min read

Article Cover Image: Picking A/B Tests That Actually Move Revenue

Picking A/B Tests That Actually Move Revenue

90% of A/B tests produce less than 1.2% effect. After an A/A test revealed our client's store needed 100+ days to reach significance, we built a scoring framework that classifies every experiment idea into three tiers before it burns any runtime.

Tim Davidson

Tim Davidson

9 min read

Don’t miss out on the latest stories!

Sign up for my newsletter to receive the latest news from the blog, you’ll get pinged every few months with a digest from the tech world.

Thank you for reaching out!