--- title: Put Your Emails to the A/B Test - Palmer Ad Agency description: Not happy with your email marketing conversion rates? Well, have you conducted some A/B testing recently? image: https://blog.palmeradagency.com/hs-fs/hub/195545/file-2496779300.png --- [![Palmer Ad Agency ](https://blog.palmeradagency.com/hubfs/Identity/Logos/Palmer%20Logos/Palmer%20Ad%20Agency%20%7C%20White%20Logo%20163x40.svg)](https://www.palmeradagency.com) [![FREE CONSULTATION](https://hubspot-no-cache-na2-prod.s3.amazonaws.com/cta/default/195545/d8378ea5-668e-4206-804c-5a9be9d86069.png)](https://hubspot-cta-redirect-na2-prod.s3.amazonaws.com/cta/redirect/195545/d8378ea5-668e-4206-804c-5a9be9d86069) [![Palmer Ad Agency ](https://blog.palmeradagency.com/hubfs/Identity/Logos/Palmer%20Logos/Palmer%20Ad%20Agency%20%7C%20White%20Logo%20163x40.svg)](https://www.palmeradagency.com/) [![FREE CONSULTATION](https://hubspot-no-cache-na2-prod.s3.amazonaws.com/cta/default/195545/d8378ea5-668e-4206-804c-5a9be9d86069.png)](https://hubspot-cta-redirect-na2-prod.s3.amazonaws.com/cta/redirect/195545/d8378ea5-668e-4206-804c-5a9be9d86069) ![Blog-Banner](https://blog.palmeradagency.com/hs-fs/hubfs/Blog-Banner.webp?width=1950&name=Blog-Banner.webp "Blog-Banner") Our Blog Our latest articles, all in one place. Content Topics ** [Marketing Strategy](https://blog.palmeradagency.com/topic/marketing-strategy) [Lead Nurturing](https://blog.palmeradagency.com/topic/lead-nurturing) [Social Media Marketing](https://blog.palmeradagency.com/topic/social-media-marketing) [Content Marketing](https://blog.palmeradagency.com/topic/content-marketing) [Brand Awareness](https://blog.palmeradagency.com/topic/brand-awareness) [Inbound Marketing](https://blog.palmeradagency.com/topic/inbound-marketing) [SEO](https://blog.palmeradagency.com/topic/seo) [Advertising](https://blog.palmeradagency.com/topic/advertising) [Buyers Journey](https://blog.palmeradagency.com/topic/buyers-journey) [Marketing Automation](https://blog.palmeradagency.com/topic/marketing-automation) [Outbound Marketing](https://blog.palmeradagency.com/topic/outbound-marketing) [Blogging](https://blog.palmeradagency.com/topic/blogging) [Marketing ROI](https://blog.palmeradagency.com/topic/marketing-roi) [Web Design & Development](https://blog.palmeradagency.com/topic/web-design-development) [Content](https://blog.palmeradagency.com/topic/content) [Content Strategy](https://blog.palmeradagency.com/topic/content-strategy) [Marketing](https://blog.palmeradagency.com/topic/marketing) [Marketing Campaigns](https://blog.palmeradagency.com/topic/marketing-campaigns) [Target Audience](https://blog.palmeradagency.com/topic/target-audience) [Ad Campaign](https://blog.palmeradagency.com/topic/ad-campaign) [Buyers Persona](https://blog.palmeradagency.com/topic/buyers-persona) [Conversions](https://blog.palmeradagency.com/topic/conversions) [ROI](https://blog.palmeradagency.com/topic/roi) [SEO Strategy](https://blog.palmeradagency.com/topic/seo-strategy) [Ads](https://blog.palmeradagency.com/topic/ads) [Blog Strategy](https://blog.palmeradagency.com/topic/blog-strategy) [Consideration Stage](https://blog.palmeradagency.com/topic/consideration-stage) [Content Marketing Strategy](https://blog.palmeradagency.com/topic/content-marketing-strategy) [Creative Development](https://blog.palmeradagency.com/topic/creative-development) [Decision Stage](https://blog.palmeradagency.com/topic/decision-stage) [Digital Marketing](https://blog.palmeradagency.com/topic/digital-marketing) [Email Marketing](https://blog.palmeradagency.com/topic/email-marketing) [Email Strategy](https://blog.palmeradagency.com/topic/email-strategy) [Facebook Advertising](https://blog.palmeradagency.com/topic/facebook-advertising) [Generate Leads](https://blog.palmeradagency.com/topic/generate-leads) [Ideal Buyer](https://blog.palmeradagency.com/topic/ideal-buyer) [Lead Generation](https://blog.palmeradagency.com/topic/lead-generation) [Marketing Content](https://blog.palmeradagency.com/topic/marketing-content) [Marketing Data](https://blog.palmeradagency.com/topic/marketing-data) [Marketing Plan](https://blog.palmeradagency.com/topic/marketing-plan) [Marketing Review](https://blog.palmeradagency.com/topic/marketing-review) [Measuring Campaigns](https://blog.palmeradagency.com/topic/measuring-campaigns) [Mid-Year Marketing Review](https://blog.palmeradagency.com/topic/mid-year-marketing-review) [Nurture Leads](https://blog.palmeradagency.com/topic/nurture-leads) [Public Relations](https://blog.palmeradagency.com/topic/public-relations) [Sales and Marketing](https://blog.palmeradagency.com/topic/sales-and-marketing) [Thought Leadership](https://blog.palmeradagency.com/topic/thought-leadership) [AB Testing](https://blog.palmeradagency.com/topic/ab-testing) [AI marketing strategies](https://blog.palmeradagency.com/topic/ai-marketing-strategies) [Advertising trends 2026](https://blog.palmeradagency.com/topic/advertising-trends-2026) [B2B influencer](https://blog.palmeradagency.com/topic/b2b-influencer) [B2B marketing](https://blog.palmeradagency.com/topic/b2b-marketing) [Best healthcare digital marketing agency](https://blog.palmeradagency.com/topic/best-healthcare-digital-marketing-agency) [Brand](https://blog.palmeradagency.com/topic/brand) [Brand Story](https://blog.palmeradagency.com/topic/brand-story) [Brand Strategy](https://blog.palmeradagency.com/topic/brand-strategy) [Choosing a marketing agency for clean energy](https://blog.palmeradagency.com/topic/choosing-a-marketing-agency-for-clean-energy) [Choosing a marketing firm](https://blog.palmeradagency.com/topic/choosing-a-marketing-firm) [Clean energy marketing partner](https://blog.palmeradagency.com/topic/clean-energy-marketing-partner) [Community bank marketing partner](https://blog.palmeradagency.com/topic/community-bank-marketing-partner) [Community financial marketing](https://blog.palmeradagency.com/topic/community-financial-marketing) [Competitor Matrix](https://blog.palmeradagency.com/topic/competitor-matrix) [Consumer Marketing](https://blog.palmeradagency.com/topic/consumer-marketing) [Content Calendar](https://blog.palmeradagency.com/topic/content-calendar) [Credit union marketing](https://blog.palmeradagency.com/topic/credit-union-marketing) [Digital healthcare marketing agency](https://blog.palmeradagency.com/topic/digital-healthcare-marketing-agency) [E-book Content](https://blog.palmeradagency.com/topic/e-book-content) [E-book Design](https://blog.palmeradagency.com/topic/e-book-design) [E-book Marketing](https://blog.palmeradagency.com/topic/e-book-marketing) [E-book Promotion](https://blog.palmeradagency.com/topic/e-book-promotion) [E-books](https://blog.palmeradagency.com/topic/e-books) [Editorial Calendar](https://blog.palmeradagency.com/topic/editorial-calendar) [Healthcare digital marketing experts](https://blog.palmeradagency.com/topic/healthcare-digital-marketing-experts) [Healthcare marketing agency](https://blog.palmeradagency.com/topic/healthcare-marketing-agency) [Increase patient volume](https://blog.palmeradagency.com/topic/increase-patient-volume) [Industrial seo strategy](https://blog.palmeradagency.com/topic/industrial-seo-strategy) [Landing Page](https://blog.palmeradagency.com/topic/landing-page) [Lead Nurturing Workflow](https://blog.palmeradagency.com/topic/lead-nurturing-workflow) [Maritime digital marketing](https://blog.palmeradagency.com/topic/maritime-digital-marketing) [Marketing Automation and AI](https://blog.palmeradagency.com/topic/marketing-automation-and-ai) [Marketing Emails](https://blog.palmeradagency.com/topic/marketing-emails) [Marketing agency for credit unions](https://blog.palmeradagency.com/topic/marketing-agency-for-credit-unions) [Marketing strategies for renewable energy](https://blog.palmeradagency.com/topic/marketing-strategies-for-renewable-energy) [Mobile Optimization](https://blog.palmeradagency.com/topic/mobile-optimization) [Opt-In Emails](https://blog.palmeradagency.com/topic/opt-in-emails) [PPC](https://blog.palmeradagency.com/topic/ppc) [Paid Media](https://blog.palmeradagency.com/topic/paid-media) [Palmer healthcare marketing agency](https://blog.palmeradagency.com/topic/palmer-healthcare-marketing-agency) [Pay-Per-Click](https://blog.palmeradagency.com/topic/pay-per-click) [Port marketing strategy](https://blog.palmeradagency.com/topic/port-marketing-strategy) [Press](https://blog.palmeradagency.com/topic/press) [Renewable energy marketing agency](https://blog.palmeradagency.com/topic/renewable-energy-marketing-agency) [Reputation Management](https://blog.palmeradagency.com/topic/reputation-management) [Residential Solar](https://blog.palmeradagency.com/topic/residential-solar) [SEO Keywords](https://blog.palmeradagency.com/topic/seo-keywords) [SEO Optimization](https://blog.palmeradagency.com/topic/seo-optimization) [SERPs](https://blog.palmeradagency.com/topic/serps) [Search Engine Optimization](https://blog.palmeradagency.com/topic/search-engine-optimization) [Search Engine Results Pages](https://blog.palmeradagency.com/topic/search-engine-results-pages) [Search Engines](https://blog.palmeradagency.com/topic/search-engines) [Social Media](https://blog.palmeradagency.com/topic/social-media) [Social Proof](https://blog.palmeradagency.com/topic/social-proof) [Top healthcare marketing agency](https://blog.palmeradagency.com/topic/top-healthcare-marketing-agency) [User Engagement](https://blog.palmeradagency.com/topic/user-engagement) [Website Conversion](https://blog.palmeradagency.com/topic/website-conversion) [aeo geo agency selection criteria](https://blog.palmeradagency.com/topic/aeo-geo-agency-selection-criteria) [ai search optimization marketing agencies 2026](https://blog.palmeradagency.com/topic/ai-search-optimization-marketing-agencies-2026) [best marketing agency for small business](https://blog.palmeradagency.com/topic/best-marketing-agency-for-small-business) [influencer marketing](https://blog.palmeradagency.com/topic/influencer-marketing) [logistics industry branding agency](https://blog.palmeradagency.com/topic/logistics-industry-branding-agency) [marketing agency checklist](https://blog.palmeradagency.com/topic/marketing-agency-checklist) ** ![Featured Post Image](https://blog.palmeradagency.com/hs-fs/hub/195545/file-2496779300.png) [**](https://www.facebook.com/sharer/sharer.php?u=https%3A%2F%2Fblog.palmeradagency.com%2Fput-your-emails-to-the-a%2Fb-test) [**](http://www.linkedin.com/shareArticle?mini=true&url=https://blog.palmeradagency.com/put-your-emails-to-the-a/b-test) [**](https://www.twitter.com/share?url=https%3A%2F%2Fblog.palmeradagency.com%2Fput-your-emails-to-the-a%2Fb-test) ## Put Your Emails to the A/B Test **DATE PUBLISHED:** May 05, 2017 May 05, 2017 **Category:** [Marketing Strategy](https://blog.palmeradagency.com/topic/marketing-strategy)   ![email marketing](https://blog.palmeradagency.com/hs-fs/hub/195545/file-2496779300.png?width=317&name=file-2496779300.png "email marketing")Not happy with your email conversion rates? Let A/B tests, also known as conversion rate optimization tests, be your guide to ascertaining what's working and what's not. A/B Testing may sound complicated and daunting, but it's actually fairly easy to implement when you know what you want to test. A/B testing is essentially just an experiment where marketers **test the performance of two different versions of one piece of content. ** It's all about using evidence rather than gut instinct to determine which subject line, landing page, CTA, the size of a subscribe button, or whatever gets the most conversions -- or the most opens.** ** “*The A/B test can be considered the most basic kind of [randomized controlled experiment](https://hbr.org/2017/06/a-refresher-on-ab-testing),*” says Kaiser Fung, founder of the applied analytics program at New York's Columbia University. “*In its simplest form, there are two treatments and one acts as the control for the other.*” ## The 3 Keys to A/B Testing ### Test Only a Single Element at a Time The first key to A/B testing is to **establish which variable you will assess against your predetermined goal, **whether that goal is click-through rates, open rates, conversion rates or something else. For instance, will the element you evaluate be the text itself, the text size or color, the CTA placement, a graphic, or a different element you're interested in? Select a single variable and develop two different versions of it. (Aside: yes, you can conduct tests for more than one element of a piece of content, but concentrate on only one for each trial.)  ![stefan-stefancik-257625-unsplash](https://blog.palmeradagency.com/hs-fs/hubfs/stefan-stefancik-257625-unsplash.jpg?width=300&height=200&name=stefan-stefancik-257625-unsplash.jpg) For example, let's say you're a solar firm and want to reach out to bottom-of-the-funnel leads. The objective of your email is to offer a free on-site residential solar system estimate. You're reasonably comfortable with your email copy -- so you'll keep that identical across the two trial versions. You're also happy with placement of your logo and the overall design of the email, but your primary concern is your CTA, so that's the element you'll change. Perhaps you've decided that the CTA of Version A, known as the "the control," will read, "Start saving money today!" Version B, which is where you generate your change, will read, "Click here to set up your free consultation now." The difference is subtle, with Version A being a bit more aggressive compared to B -- but it's something nonetheless worth testing. Remember: Don't send Version B to low-scoring or top-of-the-funnel leads because you won't generate "apples to apples" comparisons. ### Choose an A/B Test Sample Size Now comes the fun part: **Sending out the eBlasts to a large enough sample size.  **The goal is to send the trial to only a percentage of your full target audience, in this case, your bottom-of-the-funnel leads. Then after a predetermined time, check the results to discover which version performs best, and send that version to the remainder of your target audience. To achieve statistically significant results, you'll need a list of [at least 1,000 addresses](https://blog.hubspot.com/marketing/email-a-b-test-sample-size-testing-time). As previously noted, our example was geared towards bottom-of-the-funnel leads. Don't send Version B to low-scoring or top-of-the-funnel leads because you won't be generating "apples to apples" comparisons. ### **![anete-lusina-146152-unsplash](https://blog.palmeradagency.com/hs-fs/hubfs/anete-lusina-146152-unsplash.jpg?width=300&name=anete-lusina-146152-unsplash.jpg)Account for Mobile Users and Desktop Users** Engage in **"blocking**," which lets you account for any differences between mobile and desktop users, according to Fung. Blocking involves taking the same audience -- your bottom-of-the-funnel leads -- and determining which use mobile devices to read your emails and which use desktops. Randomly assign an equal number to each AB trial to ensure each group of recipients is playing on a level field. ## How to Measure Success of Your A/B Testing Look back at the objective you hoped to achieve before implementing the A/B testing. For example, let's say you wanted to increase the click-through rate of your CTA from 4.16% to 8%. Utilize your tracking software to  evaluate how each version performed. Did Version B accomplish or outperform your goal, or do you need to experiment with another trial? If you found improvement and reached or topped your 8%, that's terrific, but perhaps you could optimize it further, which would mean conducting another A/B test using an alternative variable. Of course, you can also drill deeper to figure out which leads filled out contact forms on the landing pages, but the purpose of this post is to explore the nuts and bolts of actually *conducting *A/B testing. If you're looking for more tips about analyzing commonly tested elements beyond CTAs,  such as subject lines, images, and promotions, check out [HubSpot's thoughts](https://blog.hubspot.com/marketing/4-a/b-testing-elements-for-beginners).  Looking to roll out a killer email marketing strategy? [We'd love to work with you](mailto:drew.com). ### Did you like this article? Share it! [**](https://www.facebook.com/sharer/sharer.php?u=https%3A%2F%2Fblog.palmeradagency.com%2Fput-your-emails-to-the-a%2Fb-test) [**](https://www.twitter.com/share?url=https%3A%2F%2Fblog.palmeradagency.com%2Fput-your-emails-to-the-a%2Fb-test) [**](https://www.instagram.com/palmeradagency/) [**](http://www.linkedin.com/shareArticle?mini=true&url=https://blog.palmeradagency.com/put-your-emails-to-the-a/b-test) ![Featured text](https://static.hubspot.com/final/img/content/email-template-images/placeholder_200x200.png "Featured text") ### Subscribe to our blog: [How to Choose a Marketing Agency in 2026 | Palmer Ad Agency](https://blog.palmeradagency.com/how-to-choose-a-marketing-agency-in-2026-palmer-ad-agency) ## **AI Summary** This guide explains how businesses must evaluate and choose a marketing agency in the **2026 AI-driven search era**, where consumers rely on... [ Read Details ](https://blog.palmeradagency.com/how-to-choose-a-marketing-agency-in-2026-palmer-ad-agency) [Digital Marketing Strategy That Transformed a Gulf Port](https://blog.palmeradagency.com/strategic-branding-digital-marketing-gulf-port) ###  **AI Summary**   The Louisiana Gateway Port case study illustrates that in the modern maritime industry, physical infrastructure alone is no longer... [ Read Details ](https://blog.palmeradagency.com/strategic-branding-digital-marketing-gulf-port) [How a Residential Solar Company Grew from $4M to $23M](https://blog.palmeradagency.com/residential-solar-company-growth-strategy) Palmer Ad Agency helped a residential solar company grow from $4M to $23M by executing a data-driven go-to-market strategy focused on brand... [ Read Details ](https://blog.palmeradagency.com/residential-solar-company-growth-strategy) [Previous Post](https://blog.palmeradagency.com/optimizing-lead-nurturing-workflows) [Next Post](https://blog.palmeradagency.com/how-to-track-ad-campaign-roi-0) [![Group_2390](https://blog.palmeradagency.com/hs-fs/hubfs/Group_2390.png?width=242&height=65&name=Group_2390.png "Group_2390")](https://palmeradagency.com/) - - - - ©2026 All Rights Reserved • Palmer Ad Agency [Privacy Policy](https://www.palmeradagency.com/privacy-policy) ```json { "@context" : "https://schema.org", "@type" : "BlogPosting", "author" : { "@type" : "Person", "name" : "", "url" : "https://palmeradagency.com//author/palmer-ad-agency" }, "dateModified" : "2018-05-30T22:02:51+0000", "datePublished" : "2017-05-05T22:51:27+0000", "description" : "", "headline" : "", "image" : [ "https://cdn2.hubspot.net/hub/195545/file-2496779300.png" ], "mainEntityOfPage" : { "@id" : "https://blog.palmeradagency.com/put-your-emails-to-the-a/b-test", "@type" : "WebPage" }, "publisher" : { "@type" : "Organization", "logo" : { "@type" : "ImageObject", "url" : "https://cdn2.hubspot.net/hubfs/195545/Identity/Logos/Palmer%20Logos/Palmer%20Ad%20Agency%20%7C%20Grey%20Logo%20163x40.svg" }, "name" : "" } } ``` ```json { "@context" : "https://schema.org", "@type" : "BreadcrumbList", "itemListElement" : [ { "@type" : "ListItem", "item" : { "@id" : "https://palmeradagency.com/", "@type" : "WebPage", "name" : "Home" }, "position" : 1 }, { "@type" : "ListItem", "item" : { "@id" : "https://blog.palmeradagency.com/blog", "@type" : "WebPage", "name" : "Blog" }, "position" : 2 }, { "@type" : "ListItem", "item" : { "@id" : "https://blog.palmeradagency.com/put-your-emails-to-the-a/b-test", "@type" : "WebPage", "name" : "Put Your Emails to the A/B Test - Palmer Ad Agency" }, "position" : 3 } ] } ```