eCommerce Email Marketing: Testing-Weekly Spotlight

Eradium ecommerce email marketing weekly spotlight 6 testing planning

eCommerce Email Marketing: Testing-Weekly Spotlight

Would you buy or not? Testing your campaigns

This is our weekly article from the series of posts about eCommerce Email Marketing Best Practices.

In this weekly spotlight: eCommerce Email Marketing Testing, we review examples of email campaigns from Victoria’s Secret, Walmart and Alex and Alexa.

We usually assume that testing of marketing email campaigns is about “fancy” a/b testing or other techniques such as subject line, offers or design testing. In reality, the simple quality assurance for email campaigns often does not get the time or the planning that it deserves. In today’s complicated digital environments when marketing emails are opened with mobile phones, tablets, phablets, as well as desktop computers this topic is crucial.

If the email you receive has the best offer, but you cannot read it due to broken layout, incorrect message or broken link, the email will be deleted. All the time spent preparing the campaign will be lost due to poor planning of quality assurance.

Always plan to properly test your emails across multiple devices, including mobile and desktop and do not forget testing in Microsoft Outlook.

You must allocate at least ½-1 day for QA and fixes for the template you used before and for a brand new template reserve 2 days. It is better to be safe than sorry.

The examples we reviewed this week show that even the big brands do not spend the required time and fail to properly review the emails.

Marketing managers: the quality of your email is more important than a pretty picture!


All emails will be rated from 1* to 5*, where 1 means poor and 5 is great.

We review on a weekly basis:


1. Colors – colors have good contrast, consistent

2. Typography – fonts have readable size, clear titles

3. Images – clear, visible, easy to understand

4. Formatting – blocks follow each other in an easy to navigate pattern

5. Mobile Optimized – all elements are visible and formatted correctly on the mobile phone


1. Subject line – signals urgency and clear main offer that will be found inside the email

2. Clear offer – one main offer with clear call to action

3. Urgency to purchase – time, stock, shipping that motivates the buyer to purchase

4. Product highlights – clear description of the products to evoke the interest of the reader


Victoria’s Secret

Victoria’s Secret is the largest American retailer of lingerie, 2012 sales were $6.12

billion. The company sells lingerie, womenswear, and beauty products through its

catalogs (sending out 375 million a year), website, and its U.S. stores. Victoria’s Secret

is wholly owned by publicly traded L Brands company.

Email 1: Victoria’s Secret

Subject Line: Book that beach escape: Buy one swim item, get one 50% off!‏

Eradium ecommerce email marketing weekly spotlight 6 testing victorias secret-1
Eradium ecommerce email marketing weekly spotlight 6 testing victorias secret-2


  1. Colors: 4* – the nice combination of the brand colors with various spring colors. Opening the email gives you a great feeling that spring and summer are finally here and that evokes positive emotions.
  2. Fonts: 4* – good size font that easily read. The pink accent font stands out and is easily recognized.
  3. Images: 4*-Good quality images. This brand is known for its beautiful models and it does not disappoint. Great product shots to show how the product can be used, which is great to motivate a purchase.
  4. Formatting: 4* – each block contains a separate offer, the colors are nicely aligned between blocks, and the whole email creates a cohesive visual look. There are just enough blocks to create sufficient interest without overwhelming the user
  5. Mobile Optimized: 5*–Email is perfectly displays on mobile. The colors, the fonts and calls to action are nicely visible on the small screen.


  1. Subject line: 5* – catchy, clear, provides good information and incentive to motivate the reader to open the email.
  2. Clear offer: 4* – there is a clear main theme and offer for this email campaign. The other offers are supporting products for the main promotions.
  3. Urgency to purchase: 5* -very clearly identified that the promo is limited time, right at the top in prominent location
  4. Product highlights: 3* – there is no direct information about the products shown, there is a link to the category page, but it needs to give proper information about the specific products shown in the images.

Overall rating: 4.2*

Conclusion – BUYING FACTOR: Yes

This email follows all the great traditional marketing techniques. It has great products, tied with emotional appeal. It is relevant, timely and has urgency to purchase with “limited offer”. Using the positive appeal of long anticipated spring and summer seasons, together with products that look great on the models is a winning formula. The brand targets female audience and this email is generic enough to appeal to a wide age range. The showcased products are also usually refreshed for the season. There are a lot of traditional marketing campaigns that work great and this email shows that it still works today.


Walmart is the world’s largest company by revenue, according to the Fortune Global 500 list in 2014, as well as the biggest private employer in the world with 2.2 million employees. Walmart is a family-owned business, as the company is controlled by the Walton family. Sam Walton’s heirs own over 50 percent of Walmart through their holding company, Walton Enterprises, and through their individual holdings. It is also one of the world’s most valuable companies by market value, and is also the largest grocery retailer in the U.S. In 2009, it generated 51 percent of its US$258 billion (equivalent to $284 billion in 2015) sales in the U.S. from its grocery business.

Email 2: Walmart

Subject Line: Time for spring cleaning?

radium ecommerce email marketing weekly spotlight 6 testing walmart -1
radium ecommerce email marketing weekly spotlight 6 testing walmart -2


Eradium ecommerce email marketing weekly spotlight 6 testing mobile view walmart -1
Eradium ecommerce email marketing weekly spotlight 6 testing mobile view walmart -2


  1. Colors: 3* – there is not enough color and contrast in the email. The email is missing the bright colors of spring in order to be true to the subject line.
  2. Fonts: 3*– the fonts blend in with the overall whitewashed look of the email. They need to be bigger and more prominent in order to call attention and be effective.
  3. Images: 3*– the images appear fuzzy and not sharp.
  4. Formatting: 2*- Appears messy and not aligned as if all the blocks are floating independently of each other.
  5. Mobile Optimized:  2*–I am including the shots of how the email appeared on mobile. The blocks do not align properly and the footer is completely distorted.


  1. Subject line: 3*relevant and generic enough to provoke interest. Cleaning supplies are always needed
  2. Clear offer: 4* – all the items in the email are supporting the main promotion of this campaign which is cleaning
  3. Urgency to purchase: 2* -there is no defined end or start date or incentive to make an immediate purchase
  4. Product highlights: 3* – it is the confusing user experience since some products link to categories and some directly to product pages. The look of the product and category blocks is not very different. It feels as a user you do not know what you will get once you click.

Overall rating: 2.7*


This email appears to be very poorly made for a retailer of this magnitude. It looks like an email that would come from a small, local store. It is clear that this email was not tested at all on the iPhone. It is inexcusable that a retailer of this size cannot create a proper footer in a template that they send on a weekly basis. This particular email design is not appealing on any level, emotional or practical. There is nothing worse than receiving a broken email from a big name retailer on items that you can buy anywhere, it just sad. Walmart please invest the proper time to test at least your main template that you send on regular bases on the most common mobile device.

Alex and Alexa is your Global Style Destination for kids, offering over 200 coveted international fashion, sportswear and toy brands, from the traditional to the cutting-edge, via worldwide express delivery.

Making stressful shopping trips a thing of the past, you’ll find prestigious heritage fashion labels such as Burberry, Chloé, Fendi and Dolce & Gabbana alongside contemporary clothing from cool, niche labels sourced from all over the world, like Finger In The Nose and Muchacha. Specialised sportswear comes from technically innovative brands such as Nike, Puma, Canterbury and Under Armour, meanwhile unique toy and gift ideas from Moulin Roty, Le Toy Van, Maileg, Vilac and Lego will make you very popular indeed.

Founded in London, 2007 by husband and wife duo, Alex Theophanous and Alexa Till, AlexandAlexa aims to bring “The World’s Best Kids Brands” to other discerning parents at the click of a button. So whether you’re after traditional wear, functional casual clothing, specialised sportswear or luxury gifts, you need look no further for perfectly chic yet practical pieces both you and the little ones will love!

Email 3:

Subject Line:  ‏ The Feet Tapping Five: Best Shoes This Summer‏

Eradium ecommerce email marketing weekly spotlight 6 testing mobile alex and alexa -1
Eradium ecommerce email marketing weekly spotlight 6 testing mobile alex and alexa -2


  1. Colors: 4*-there is no dominant color in the email; it is the white background with a gray block. All the products, however, have different colors that complement the overall look.
  2. Fonts: 3* -the fonts are a bit fuzzy and small. They are not sharp enough to be easily read.
  3. Images: 5* -clear and good size images. Product details are clearly visible, good angle that showcases the product well
  4. Formatting: 4* -very nice format of having banner images in combination with 5 different shoe images; create a great and cohesive flow
  5. Mobile Optimized: 4* – email displays great on the phone, all the blocks shift into a single column. Information areas are big enough to be clickable


  1. Subject line: 4* – relevant and inviting. Generic enough to appeal to wide audience
  2. Clear offer: 4* – greatly put together products. The entire email centers around shoes for the summer. They include both boy and girls shoes. They also cover the different types of shoes you will need in the summer time. The other 2 offers compliment the main topic nicely with additional products you might need in the summer.
  3. Urgency to purchase: 2*– there is no urgency to make a purchase. There is no start or end date, there is no discount. This is more of “information” email about the shoes available in the summer. It is more for someone who did not know such shoes existed vs the discount shopper.
  4. Product highlights: 5* – great product selection, good image, descriptions, products linking to the proper pages or groups of similar products

Overall rating: 3.9


Great looking and creative email campaign will capture a wide audience. Since this email is not targeted, this kind of offer and presentation is quite effective alternative. It covers relevant products that will appeal to majority of parents. It is also thought provoking since it serves as an education on various types of summer shoes. It will defiantly promote interest and click through as parents will want to learn more. Combining creativity and practicality is a great way to engage the consumer.

Just for Fun

This is an actual email that I have received from one of the biggest companies in North America, this is no joke. How something like this can happen? Information leak prior to launch is a pretty big deal. How can I now trust this brand with my personal information?

The brand must do major damage control, sending a sorry email will not cut it. You need to send free offers as well as assurance that my data is safe and the problem was resolved. Mistakes like this should not be viewed lightly into today’s always connected information. Companies must be held responsible if they collect your data.

Eradium ecommerce email marketing weekly spotlight 6 testing mobile Huggies


7 Tips for successful email campaign testing:

  1. Create a list of test accounts; include various domains such as Hotmail, Google and Yahoo. Make sure you send the test email only to the test accounts, triple check.
  2. Always check the email at least on the newest iPhone and Android. Testing with screen emulators is not enough.
  3. Check how the email renders on at least the latest version of Outlook
  4. Make sure images are quick to load
  5. Make sure that “view in HTML” functionality working
  6. Make sure all links link to the intended location
  7. Check the subject line rendering

It is strongly recommended that you allocate sufficient time and resources for all your marketing emails. Set up systems and QA processes in place to eliminate mistakes, and if they do happen proper damage control procedure must be executed in timely manner.

Anna Battrick

Anna Battrick is Eradium’s Director of Ecommerce Services, has an extensive background in retail marketing and project management. With over 10 years of managing complex projects from inception to completion while always maintaining “it can be done” spirit. The world of retail is not only a professional interest but also a personal hobby which lets Anna see the other side of retail, from a shopper perspective. This helps create engaging marketing programs that speak personally to the shoppers interests and engage them in a conversation.

To start a dialog about your next eCommerce initiative