prompt

A/B Test Sample Size Calculator Guide

Calculate minimum sample size for A/B tests given baseline, effect size, and statistical power constraints.

Updated June 2026
The prompt
Calculate sample size for {{test_name}}:

Test parameters:
- Metric: {{metric_name}} (current {{baseline_value}})
- Minimum detectable effect: {{mde_pct}}% (absolute {{mde_absolute}})
- Statistical power: {{power}}% (1 - Type II error)
- Significance level (alpha): {{alpha}}% (Type I error)
- Traffic split: {{test_split}} (e.g., 50/50)
- Daily users available: {{daily_users}}

Calculate:
1. Required per-group sample size
2. Total runtime in days
3. Power curve (range of detectable effects)
4. Trade-offs if {{daily_users}} is limiting
5. Sensitivity to variance assumptions (show range)

Provide a table of scenarios.
Did it work? Rate this prompt

Variables

Test name
Metric name
Baseline value
MDE percentage
MDE absolute
Statistical power
Significance level
Traffic split
Daily users available

Details

Author

AI Khazna

License

Security

Type

prompt

Related assets

More curated picks in Data & Analytics.

Audit before you install

Run any source through our checks - AI visibility, security, performance, and stack detection.

More in Data & Analytics