Ads & Traffic

A/B Test

A controlled test comparing two versions (A and B) of an ad, page, or flow, splitting traffic 50/50 to identify the winner by a defined metric.

An A/B test is a controlled experiment comparing two versions of something — an ad creative, a product page headline, an email subject line, a checkout flow — by splitting the audience 50/50 and measuring which version produces a better result on a pre-defined metric.

Most "A/B tests" in dropshipping aren't real A/B tests. They're two creatives running in parallel ad sets with wildly different audience settings, which confounds the variable. A real A/B test isolates exactly one change.

Sample size matters more than most operators think. A test that ends at 200 sessions with a 20% CVR lift is almost certainly within the noise window. Most PDP tests need 1,000+ sessions per variant before they're readable; most ad-creative tests need 3,000+ impressions or $50+ spent per variant.

Articles mentioning A/B Test
Explore More
Browse the full dictionary or dive into operator playbooks.
All 140+ Terms