Which Test Won and Testing Email Templates

1 min read

Home    Usability Testing & A/B Testing    Which Test Won and Testing Email Templates

At Corelio Publishing, a leading online and offline news publisher in Belgium, we’re testing our newsletter templates endlessly. With several 100k emails a day even the smallest change could mean a huge difference in the Click Through Rate and traffic to our websites.

Although A/B testing with email templates is not that hard, it demands effort, time, the right tools and a decent preparation. After a period of trial and error we made progress, improved our templates and finally achieved a considerably higher CTR. All this hard work didn’t go unnoticed. That is why …

I’m very happy and proud to announce that we have won this year’s Email Testing Award with Which Test Won for our A/B testing methods and results.

“This test received a gold award because it did a phenomenal job decluttering the newsletter while providing the same number of stories via text links”
— Anne Holland of Which Test Won

For those who don’t know Which Test Won yet, it’s a team of independent journalists (supported by many industry-leading sponsors) and the #1 weekly evangelizing in conversion optimization — in particular through A/B and multivariate testing. Every week they publish the results of a real A/B test without mentioning the winning version. It’s up to the visitor and his or her gut feeling to pick out the winner of the test. Believe you me, it ain’t easy.

Our case study at Which Test Won

Do you want to give it a try as well? Then read our case study at whichtestwon.com and find out which newsletter version improved the CTR with 36%.

Because this case study is pretty limited in description I will write a more detailed article later on. I will explain our testing methods, the test setup we’re using, which metrics really matter and how you can start improving your emails.

Tagged with ,

Paul Olyslager

Paul is the creator, editor and most regular writer of paulolyslager.com. He's also working as UX Lead for Home24, a leading online shop for furniture and home accessories, based in Berlin, Germany. Read all about Paul or find him on Twitter, LinkedIn or Facebook.

View other posts by .

No responses yet to “Which Test Won and Testing Email Templates”

I would love to hear your thoughts on this.

Yay! You've decided to leave a comment. That's fantastic! Please keep in mind that comments are moderated and rel="nofollow" is in use. So, please do not use a spammy keyword or else it will be deleted. Let's have a personal and meaningful conversation instead. Thanks for dropping by!

(will not be published)

provides you with all the tools to generate actionable insights, both desktop as mobile.“
- Paul