S
SalesTap
Free · Powered by Claude AI

🧪 Cold Email A/B Test Designer

Pick what you're testing, paste your control, and get three variants — plus the sample size you need, the metric to track, and rules for when to call a winner.

Set up the test

Test one variable at a time — otherwise you can't attribute the lift.

Your test plan

🧪

Your test design will appear here

Fill in the form and click Design the test

Frequently asked questions

How big does each test arm need to be?+

For a typical B2B cold email test (baseline reply rate ~5%, expected lift 30%, statistical confidence 95%), you need approximately 500-800 sends per variant. The tool calculates the exact number based on your inputs and shows the math.

Should I test subject line and opener at the same time?+

No. Test one variable at a time. If you change both, you can't attribute the lift (or drop) to either. The tool enforces this — pick subject OR opener and lock the other.

What metric should I track?+

For subject-line tests: open rate (or reply rate if you don't track opens reliably — open tracking is increasingly unreliable with Apple Mail Privacy Protection). For opener tests: reply rate. The tool tells you which one matches your variable.

When can I call a winner?+

Only after every variant has hit the calculated sample size AND the difference exceeds the minimum-detectable-effect threshold (typically a 30% relative lift). Calling winners early on small samples is the most common mistake in cold email testing.

Want more sales playbooks?

Daily AI-researched intelligence for closers, SDRs, and revenue leaders.

Read the latest articles →