All articles
Guide· 10 min read

A/B Testing Emails: Simple Tests for Busy Owners

A/B testing an email is just sending two versions and keeping the winner — no math, no big list. Here is what to test, why to judge on clicks (not opens), and how to run your first test.

MT
Mailmundo Team
Founder, Mailmundo
A/B Testing Emails: Simple Tests for Busy Owners
Photo by Ono Kosuki / Pexels

You have been staring at the subject line for ten minutes: "Spring tune-up time" or "Your AC is due for service"? You pick one, hit send — and never find out whether the other would have doubled your calls. An A/B test is how you stop guessing.

What A/B testing an email actually means

An A/B test is the simplest experiment there is: you send one version of an email to part of your list and a slightly different version to another part, then you look at which one did better. That is the whole idea. Version A might have one subject line and version B another; everything else stays the same. Whichever gets more opens or clicks tells you what your customers actually prefer, so your next email is a little smarter than your last. There is no statistics degree involved and no software to install. If the phrase "A/B testing" sounds like something a tech company does in a lab, set that image aside. For a service business, it is nothing more than trying two versions of the same message and keeping the winner — a habit that quietly makes every email you send from now on more effective.

Copy this and make it yours

Version A: Spring tune-up time

Version B: Maria, your AC filter is six months old

Half the list gets A, half gets B, everything else identical. Whichever gets more opens becomes next month's starting point — and next month you test it against a new challenger. Ten minutes, once a month, and your subject lines stop being guesses.

The objection: "this sounds too technical and I have no time"

This is the real reason most owners never test, and it is worth answering head-on. Testing feels like extra work layered on top of an already-annoying task. But a proper A/B test changes almost nothing about your routine. You still write one email. The only difference is that you also write a second version of one small thing — usually just an alternate subject line, which takes two minutes — and let your email tool split the send for you. You do not calculate anything, you do not pick winners by hand, and you do not need a big list. The tool sends both, watches the results, and can even send the winner to everyone else automatically. So the honest answer to "too technical, no time" is that a good test adds two minutes and zero math, and pays you back with every future email that performs better because you learned something real.

The one rule that makes a test valid: change one thing

There is exactly one rule you must follow, and it is easy. Change only one element between version A and version B. If A has a different subject line, a different button, and a different offer than B, and B wins, you have no idea which change caused it — the result teaches you nothing. But if the only difference is the subject line, then a clear winner tells you precisely what to do next time. So test one thing per experiment: this subject line versus that one, this call-to-action button versus that one, this send time versus that one. Isolating a single variable is what separates a real test from a guess, and it is the difference between learning and just shuffling things around. Keep everything else identical and let the one change speak for itself.

What is actually worth testing

You could test endless details, but a handful of elements drive almost all the difference for a service business. Start with these:

  • The subject line. This decides whether the email gets opened at all, so it is the highest-leverage thing to test. Try benefit versus curiosity, short versus long, or a plain line versus one with the customer's name.
  • The from name. "Mike from ProWash" often beats a faceless company name because people open email from people. Worth testing once.
  • The call to action. The wording and placement of your main button — "Book now" versus "Get my free quote" — can meaningfully change how many people click.
  • The offer or angle. A discount versus a bundle, a reminder versus a limited-time push; the framing of what you are offering often matters more than the design.
  • Send time. Morning versus evening, weekday versus weekend. Less important than the others, but easy to test once you have the habit.

Test them roughly in that order. The subject line and the call to action are where most of your gains will come from, so start there. Our guide to subject lines that get opened gives you a stack of variations to test right away.

Why open rate can no longer be trusted on its own

Here is a shift every owner needs to know about, because it changes how you read a test. Since Apple introduced Mail Privacy Protection, Apple's Mail app quietly loads the tracking image in your emails whether or not the person actually opens them — which registers as an "open" that never really happened. And Apple is not a small slice of the market: according to Litmus, Apple accounts for roughly two-thirds of all email opens (about 65% in its May 2026 report). That means your reported open rate is inflated and unreliable, especially for consumer audiences. For an A/B test, the consequence is important: if you are testing a subject line, do not crown the winner on opens alone, because much of that number is machines, not people. Wherever you can, judge the test on clicks — a click is a real human action that Apple's privacy feature does not fake. Open rate still has some directional value, but clicks are the honest scoreboard now.

How to run your first A/B test, step by step

Here is the entire process, start to finish, for a subject-line test:

  • Write your email once — the body, the offer, the button, all of it.
  • Write two subject lines instead of one. Make them genuinely different, not two near-identical phrasings.
  • Let your tool split the send: a slice of your list gets subject A, an equal slice gets subject B.
  • Wait for the results — a few hours to a day, depending on your list.
  • Read the winner on clicks (with opens as a secondary hint), and send that winning version to the rest of your list.
  • Write down what you learned: "shorter, benefit-first subject won." That one note makes your next email better before you have even written it.

That is a complete A/B test. Notice how little of it is technical — you wrote one extra line and read one result. The tool did the splitting and the counting.

Knowing when a result is real (and when it is noise)

A busy owner should also know when not to trust a result, because small lists can fool you. If you send version A to 20 people and version B to 20 people and A gets one more click, that is not a finding — it is a coin flip. A difference only means something when the numbers are big enough that luck is an unlikely explanation. The practical rule: the bigger the gap and the bigger the list, the more you can trust it. A subject line that wins by a wide margin across a few hundred recipients is worth acting on; a squeaker across a few dozen is not. When results are close, treat them as a tie, keep either version, and test something bolder next time. This is why testing subject lines and calls to action — where differences tend to be large — beats testing tiny cosmetic tweaks that rarely move the needle enough to be sure.

A concrete example: the subject-line test

Say you run a home-service business and want more people to open your spring promotion. You test two subjects: version A, "Spring cleaning special — 15% off"; version B, "Sarah, is your driveway ready for spring?" Version B uses the customer's first name and a personal question. This is not a random guess — Campaign Monitor has found that emails with personalized subject lines are 26% more likely to be opened. So you have a real hypothesis to test, not a whim. You split the send, and if the personalized line wins on clicks, you have learned something you will use in every seasonal campaign from now on. If it does not, you have still learned something true about your specific customers. Either way you come out ahead, which is the whole point of testing rather than guessing. For lining these up across the year, seasonal email campaigns gives you a calendar of moments worth testing.

Testing when your list is small

Plenty of trade businesses have a few hundred contacts, not tens of thousands, and worry testing is pointless at that size. It is not — you just test differently. Instead of splitting one send in half, test across time: send subject-style A this month and subject-style B next month, and compare. Keep a simple running note of what tends to win — shorter subjects, first names, morning sends — and let those lessons accumulate. Over a year, even a small business builds a real playbook of what its customers respond to. The goal is not one perfect experiment; it is a steady habit of trying, noticing, and keeping the winner. A small list that learns constantly will out-earn a big list that never does.

How Mailmundo makes testing a couple of clicks

Everything above is only easy if your tool does the mechanical parts for you, and this is exactly what a campaign platform is for. In Mailmundo, you write your email, add a second subject line, and the platform splits the send, tracks the results with branded open and click tracking, and shows you the winner clearly — no spreadsheets, no math, no guessing which number to trust. Because the tracking is built in, you can judge tests on clicks, the metric that survived Apple's privacy changes, instead of relying on inflated opens. And once you know what works, email automation lets you bake the winning patterns into sequences that run on their own. The "too technical" objection dissolves when the technical part is handled for you: your job is just to write two versions and read one answer.

Why this small habit pays off so much

It is worth stepping back to see why testing matters more than any single clever email. Every business sends email into a fog — you are guessing what your customers want to read. A/B testing slowly clears that fog. Each test replaces one guess with one fact, and those facts compound: after a year of small tests, you know your audience's preferred subject style, best send time, and strongest offer, so every campaign starts from knowledge instead of hope. That compounding is why testing is one of the highest-return habits in email, and it feeds directly into the ROI of your email marketing. You are not just chasing a better open rate on one message; you are getting permanently better at reaching the people who pay you.

Start with one test this month

Do not try to test everything at once. Pick your next email and give it two subject lines instead of one. Let your tool split the send, read the winner on clicks, and jot down what you learned. That single experiment — two minutes of extra writing and zero math — is a complete A/B test, and it is the start of a habit that makes every future email a little sharper. "Too technical, no time" was never really true; it was just unfamiliar. One test from now, it will feel like the easiest improvement you have ever made.

Own email, done right.

Mailmundo handles authentication, one-click unsubscribe, suppression, and confirmed opt-in — so your email lands in the inbox.

No spam. Only about early access.

Keep reading