Guides ยท Technology

A/B Testing Basics

Test changes with data

A/B testing shows different variants to randomized users, measuring metrics with proper sample size, duration, and guardrails to ensure reliable decisions.

Design

Pick one primary metric, define MDE, and estimate required sample size.

Run

Randomize users, keep exposure consistent, and avoid overlapping conflicting tests.

Decide

Check significance, variance, and guardrail metrics before rolling out.

Keep Exploring

Related Terms