prompt
A/B Test Sample Size Calculator
Computes required sample size from baseline, MDE, power, and significance.
Works with
You are an experimentation analyst. Compute the required sample size for an A/B test and explain the inputs in plain terms. Inputs: - Baseline conversion rate: {{baseline}} - Minimum detectable effect: {{mde}} (absolute or relative \u2014 state which) - Statistical power: {{power}} (default 80%) - Significance level: {{alpha}} (default 5%, two-sided) - One- or two-sided test: {{sided}} Produce: 1. The required sample size PER variant, and total. 2. The formula/approach used (two-proportion z-test) and the plugged-in numbers, so it's auditable. 3. Estimated test duration given a traffic input the user can fill in (visitors/day). 4. Plain-language caveats: don't peek early, the MDE you chose, what happens if baseline is wrong. Rules: show the math steps; state every assumption; if the MDE is tiny relative to baseline, warn that the test may need very high traffic.
Variables
{{baseline}}Baseline rate{{mde}}Minimum detectable effect{{power}}Statistical power{{alpha}}Significance level{{sided}}One/two-sidedExample output
Inputs: baseline 5%, MDE +1 point absolute (5% \u2192 6%), power 80%, alpha 5% two-sided. Sample size (two-proportion z-test): n per variant \u2248 (z_alpha/2 + z_power)^2 \u00d7 [p1(1-p1) + p2(1-p2)] / (p2-p1)^2 = (1.96 + 0.84)^2 \u00d7 [0.05\u00d70.95 + 0.06\u00d70.94] / (0.01)^2 = 7.84 \u00d7 [0.0475 + 0.0564] / 0.0001 \u2248 7.84 \u00d7 0.1039 / 0.0001 \u2248 8,146 per variant. Total: ~16,300 visitors across both. Duration: at 1,000 visitors/day split evenly, ~16 days. Caveats: this detects a 1-point absolute lift; a smaller MDE balloons the number fast. Don't stop the test the moment it looks significant \u2014 fixed-horizon tests assume you wait for the full sample. If your true baseline is below 5%, recompute.
Details
Author
AI Khazna
License
CC-BY
Security
Vetted
Type
prompt
Related assets
More curated picks in Data & Analytics.
Turns a set of findings into a clear narrative with a headline, supporting points, and a call to action.
Get a structured, step-by-step plan to clean a messy dataset before analysis.
Plans a pivot table to answer a specific question from your data.
Produces a structured checklist to audit a dataset across completeness, accuracy, consistency, and timeliness.
Describe what you want in words and get the exact Excel formula, plus a short explanation of how it works.
Define the right KPIs, chart types, and layout for a dashboard that serves a specific goal and audience.
Audit before you install
Run any source through our checks - AI visibility, security, performance, and stack detection.
Automated Web Security Scan
security
PageSpeed Analyzer
performance
AI Content Quality Test
arabic content
AI Agent / MCP Server Tester
ai testing
Site Stack Detector
migration
AI SEO / AEO / GEO Audit
ai visibility
llms.txt Generator
ai visibility
Readability Score
arabic content
Schema / JSON-LD Builder
ai visibility
AI Cost Calculator
ai testing
Headline Analyzer
arabic content