Reorders agent
Reorders agent · Email · At work
Winner found
Klaviyo · follow-up email to first-time buyers
Short follow-up email vs long
“A follow-up email half the length will get more clicks to reorder.”
Outcome
The short email won: clicks to reorder more than doubled, from 3% to 7%, over 99% confident.
Next: Rewrite the whole sequence in the shorter style, now being tested.
Ran 10 daysOct 6 – Oct 15
The versions
| Version | Sends | Clicks to reorder | Rate | vs current | Confidence |
|---|---|---|---|---|---|
Long follow-up emailCurrent version Six paragraphs about the roastery, the farms and the subscription. | 1,600 | 48 | 3.0% | — | — |
Short follow-up emailLeading Three sentences, the roast date and a link to reorder. | 1,580 | 111 | 7.0% | +134% | 100% |
Confidence is against the current version. The upright mark is the 95% a version needs at the planned end to be called the winner; before then it is a reading.
Oct 6Oct 15
Set-up
- Where
- Klaviyo · follow-up email to first-time buyers
- Split
- Alternate customers
- Measured on
- Clicks to reorder per send
- Planned length
- 10 days
- Started
- Oct 6
Related
How experiments are judged
- The current version always runs alongside the challengers, so results are compared fairly.
- A test is called once, at its planned end: a version wins only at 95% confidence or more, with at least 20 conversions in every version.
- Before the planned end, a lead can still reverse, however strong it looks, so the test isn't called early.
- If nothing clears the bar at the planned end, the current version stays.