Question 1

How does the newsletter subject line A/B tester work?

Accepted Answer

Enter your topic and (optionally) an audience hint. The tool generates five or more subject-line variants across five proven angles — curiosity, urgency, benefit, personalization, and question — then scores each variant on a 0-100 open-rate-potential scale. Each score is broken down by contributing factor (length, spam-trigger risk, emoji usage, personalization tokens, clarity, capitalization/punctuation) so you can see exactly why one variant out-scores another. You can A/B test the top variants using the built-in sample-size and significance calculator.

Question 2

What scoring factors are used?

Accepted Answer

Six heuristic factors, each contributing a sub-score: (1) Length — 30-60 characters is optimal on mobile; longer subject lines get truncated. (2) Spam triggers — known spam words (FREE, GUARANTEE, $$, !!!, ALL CAPS, etc.) penalize. (3) Emoji — one emoji can boost opens, two or more tend to hurt. (4) Personalization — tokens like [name] or [city] add a small bonus. (5) Clarity — clear, concrete language scores higher than vague hype. (6) Capitalization/punctuation — excessive caps or punctuation flags as spammy. Scores are heuristic predictions, not open-rate guarantees — your real audience decides.

Question 3

How does the A/B test calculator work?

Accepted Answer

Enter your total list size, the number of variants you want to test (2-5), your baseline open rate, the minimum detectable effect (the lift you want to reliably see, e.g. 10%), and the desired statistical power (typically 80%). The tool computes the required sample size per variant using a standard two-proportion power formula, the recommended split (e.g. 10% holdout + 90% test, or equal splits), the estimated runtime based on daily send volume, and after the test runs you can enter observed opens/sends to compute a two-proportion z-test and check statistical significance.

Question 4

What extra features does this tool have compared to others?

Accepted Answer

(1) Five subject-line angle templates (curiosity, urgency, benefit, personalization, question). (2) Generate 5+ variants per topic. (3) Transparent scoring with per-factor breakdown bars. (4) Inbox truncation preview (desktop ~60 chars, mobile ~30-40 chars). (5) Preheader preview. (6) Spam-trigger + all-caps/excess-punctuation linter. (7) A/B sample-size calculator (power-based). (8) Two-proportion z-test for significance. (9) Variant comparison table sorted by score. (10) Auto-pick winner. (11) Copy/download variants as CSV. (12) History (localStorage, last 20). (13) Shareable URL. (14) Topic presets. (15) Optional BYO-key LLM enhancement. Apple MPP note included.

Question 5

Is my data sent anywhere?

Accepted Answer

No. All variant generation, scoring, linting, and the stats engine run locally in your browser. Topic and audience text never leave this device. The only network call is if you paste your own LLM API key and click 'Enhance with LLM' — that request goes directly from your browser to the LLM provider you choose. Note: Apple Mail Privacy Protection (MPP) inflates open rates since 2021; this tool flags that and nudges toward click-based testing for definitive results.

AI Newsletter Subject Line A/B Tester

How to use