• DE&I Commitment
  • Careers
  • Locations
  • Book a Meeting
    Book a Meeting
  • Company
    Learn a little more about us, our values, and our team
    Our Values
    We don't just talk the talk; we live by our core values
    About Us
    Empowering brands to realize their potential with data, insights, and technology
    Leadership
    Meet our leadership team
    Secure Data Architecture
    Our promise of data security and privacy. We keep your data safe from publishers, competitors and bad actors
    Corporate Social Responsibility
    We are committed to making a positive impact on our communities and our planet
  • Platform
    Plan, manage, optimize, and measure your campaigns with our omnichannel platform
    Our Platform
    A platform that connects all walled garden media
    Connected Media
    Create and manage campaigns across search, social, retail media and apps, in one platform
    Connected Data
    Make data-driven decisions as you plan and strategize
    See the industries we serve
    Learn how our customizable solutions can help with your unique needs
    Explore our partner integrations
    See the media, retailer, and data partners we work with
  • Clients
  • News and Events
    Check out recent announcements and see what we’re up to
    News
    Check out our recent media coverage
    Events
    Join us for our next conference or webinar
    Roundtable discussion: Beyond Onsite
    Tackle the next phase of retail media over breakfast with Nectar360 and peers
    Retail Media for Grocery Webinar
    Join us to dig into trends and challenges shaping the industry in 2023
  • Resources
    From new releases, to industry trends and best practices, Skai has you covered
    Blog
    Read the latest insights and thought leadership from our industry experts
    Capabilities
    Take your campaigns to the next level by enhancing your platform capabilities
    Research
    Explore our reports and whitepapers so you can keep up on the latest industry trends
    Subscribe
    Sign up to get the latest updates straight to your inbox
    Quarterly Trends Report
    Learn digital advertising campaign performance trends from Q4 2022
Back to Blog

Are You Still Making Marketing Decisions Using a Single Number…Seriously?

Moti Radomski, VP, Product @ Skai™

July  01, 2020

Generally, marketing experiments are used to test hypotheses in order to make better data-driven decisions about how to run advertising programs. In those cases, even though multiple metrics will be returned, they are all focused on a single value. For example, in the test question “what happens to performance when I double my spend on a channel?”, you might see conversion rate go up by X percent, click-through rate stays the same, or total revenue go down by Y dollars. But marketers can find growth opportunities if they just look at this process a little differently.

find growth opportunities

What if a marketer wants to know what the ideal YouTube remarketing budget level should be for an upcoming campaign? This is a common type of marketing question because if too little is spent, it won’t have enough reach—and spending too much might just waste the budget. A test and learn approach would dictate that you run a marketing experiment to gauge the level of return from the increased budget. 

One test could tell you what happens when you double the spend. Let’s say that you find out that if you double your spend, your conversions triple. 

That’s great to know! But should the marketer stop their curiosity there? Of course not!

Because what we don’t know is if doubling spend is the optimal level? Once you learn that doubling spend shows a good return, the next question becomes, “what if I triple my spend?” And then once you get that number back, you might have another hypothesis to test: “what if I quadruple my spend?”

Let’s say you run multiple tests—first to find out what double-spend does, then what tripling spend does, and then what quadrupling spend does. In each case, what if you find the spend is still efficient? Then you have to keep going at 5X, 6X, 7X, etc until you find the optimal spend level. In fact, you would have to keep running tests until you found where the return on the investment begins to drop. Then you would know where your optimal spend level actually is. 

Simultaneous tests (good) versus sequential tests (not as good)

The problem with running sequential tests is that every test requires a ramp-up period, a testing period, and time to analyze to build a conclusion from the results. If you run every test sequentially, it would take you multiple tests and quite a long time to figure out what would be the optimal spend level. In the previous example, let’s say you could get an entire test (ramp-up, test, analysis) to 2 weeks. Running 8 tests would take you—at minimum—16 weeks. By the time you figure out the optimal spend, you’ll be in the next quarter and that’s simply too long to wait for answers.

Another reason why running multiple tests sequentially isn’t ideal is because, in a live market, your results may vary over time with factors such as seasonality, influence from your other campaigns, competitor spend changes, and other market fluctuations. These variables can impact accuracy when comparing results from multiple tests over time. It would be hard to truly compare the results from the first test (week 2) with your last test (week 16) without external factors skewing your analysis. 

So, if running sequential tests creates issues of time-to-insight (TTI) and data skew, what is the solution?

Running multiple, simultaneous tests at different spend levels solves the time-to-insight and data skew issues.

With simultaneous testing, the output gives you a range of numbers that can be plotted on a graph to develop a diminishing returns curve. As most media planners already know, with a diminishing returns curve, it’s easy to find growth opportunities and the optimal spend level because, at some point, the curve will flatten and reveal the most efficient spend-to-return value. 

finding growth opportunities

Not only will simultaneous tests answer the question of optimal spend, but this curve can answer numerous other questions as well. For example, maybe you don’t care about finding the optimal spend level and just want to forecast the potential conversions for a budget that is set in stone. Maybe you have too little budget to reach your optimal spend, but you have the data in front of you to recommend to your boss or client why they should increase the investment.

Another common situation that marketers face is when some additional budget might come their way. Maybe a TV ad campaign is canceled or budget shifts away from a poor performing channel. The CMO or client may ask each of their media teams to forecast how an extra million dollars could impact KPIs. With a diminishing returns curve built through marketing testing, the practitioner can accurately predict what the ROI would be on the additional investment. 

Marketing measurement to find growth opportunities

When Skai built its incrementality testing platform, Impact Navigator, there were a lot of ideas put on the table. One of those critical components that was prioritized was the ability to handle simultaneous testing to find growth opportunities 

Using multiple, simultaneous tests, marketers can build diminishing returns calculations to help them in the very important area of media-mix recommendation/optimization. After all, it’s great to know what did and didn’t work in your campaigns so that you can get better results over time, but even better would be to run the best campaigns from the start using strong data-driven decision making. You can find growth opportunities when you have the right data in front of you.

How would you grade your marketing measurement practice right now? 

Are you using your marketing measurement approach to find growth opportunities? Or are you still struggling with just getting accurate reads on campaign performance?

Incrementality testing is a fairly simple concept to grasp. You introduce a marketing element to a test group while not introducing it to a control group. While the concept is simple, in the past, incrementality testing was complex and expensive. Skai’s Impact Navigator enables marketers to design and build experiments easily and affordably.

Reach out to us today for a quick demo so you can see how it works and if it would be a solid addition to your current process to find growth opportunities.

Book a Meeting of Impact Navigator

Related Posts

  • What’s Going to Happen with Multi-Touch Attribution in a Cookieless World?
    Read More
  • Monthly Paid Media Spend Snapshot – April 2021
    Read More
  • Monthly Paid Media Spend Snapshot – September 2021
    Read More
  • Monthly Paid Media Spend Snapshot – August 2021
    Read More
  • Monthly Paid Media Spend Snapshot – October 2021
    Read More
  • Monthly Paid Media Spend Snapshot – May 2021
    Read More
  • Share on Facebook
  • Share on Twitter
  • Share on LinkedIn
  • Share via Email
  • Copy Link
    Copied!
Tags: Data, Data & Insights, Incrementality, Measure, Optimize, Plan, Search, Social, Videos, xTLx

Subscribe to Updates

Media that matters.
Marketing that works.
© 2023 Kenshoo, Ltd. All Rights Reserved.
Privacy Policy. Cookie Policy. Recruitment Privacy Policy.
  • Connected Data
    • Market Intelligence
    • Our Approach
    • By Need
    • By Solution
  • Connected Strategy
    • Dynamic Marketing Mix
    • Budget Forecasting
    • Strategic Consulting
  • Connected Media
    • Overview
    • Retail Media
    • Paid Search
    • Paid Social
    • App Marketing
    • Auditing
    • Expert Services
  • Measurement
    • Incrementality
    • Experiments
    • Cross-Channel Attribution
  • Resources
    • Blog
    • Glossary
    • Case Studies
    • Training & Enablement
    • Developer Hub
Privacy Preference

We use cookies on our website. Some of them are essential, while others help us to improve this website and your experience.

Privacy Preference

Save All

Save

Accept Only Essential Cookies

Manage Cookie Preferences

Cookie Details Privacy Policy Imprint

Privacy Preference

Here you will find an overview of all cookies used. You can give your consent to whole categories or display further information and select certain cookies.

Save All Save Accept Only Essential Cookies

Back

Privacy Preference

Essential cookies enable basic functions and are necessary for the proper function of the website.

Show Cookie Information Hide Cookie Information

Name
Provider Owner of this website, Imprint
Purpose Saves the visitors preferences selected in the Cookie Box of Borlabs Cookie.
Host(s) .skai.io, skai.io
Cookie Name borlabs-cookie
Cookie Expiry 1 Year
Name
Provider Owner of this website
Purpose This cookie stores selections made by the user in the Accessibe tool in order to maintain those settings on future visits. These cookies help us make our website compliant with our obligations under US law.
Privacy Policy https://accessibe.com/privacy-policy
Cookie Name acsbState, acsbReset
Cookie Expiry n/a
Name
Provider Owner of this website
Host(s) skai.io
Cookie Name wordpress_sec_,wordpress_test_cookie,wp-postpass_*, wordpresspass_*, wordpressuser_*
Cookie Expiry Session / 1 Year

We use these cookies to enhance functionality and allow for personalisation, such as live chats, videos and the use of social media.

Show Cookie Information Hide Cookie Information

Accept
Name
Provider Owner of this website
Host(s) .chilipiper.com, skai.chilipiper.com
Cookie Name fs_uid, CHILI_PIPER_CLUSTER, guest-session, _sp_ses*, _sp_id*
Cookie Expiry Session / 2 Years
Accept
Name
Provider Owner of this website
Host(s) .comeet.co, www.comeet.co
Cookie Name visid_incap_, nlbi_#######, incap_ses_, referrer22_00a, incap_ses_1364_2167377
Cookie Expiry Session / 1 Year
Accept
Name
Provider Owner of this website
Host(s) skai.io
Cookie Name moduleFormPardotDownload
Cookie Expiry 30 days

Statistics cookies collect information anonymously. This information helps us to understand how our visitors use our website.

Show Cookie Information Hide Cookie Information

Accept
Name
Provider Google Ireland Limited, Gordon House, Barrow Street, Dublin 4, Ireland
Purpose Cookie by Google used for website analytics. Generates statistical data on how the visitor uses the website.
Privacy Policy https://policies.google.com/privacy?hl=en
Cookie Name _ga,_ga_*,_gat,_gat_*,_gid
Cookie Expiry 2 Months
Accept
Name
Provider Hotjar Ltd., Dragonara Business Centre, 5th Floor, Dragonara Road, Paceville St Julian's STJ 3141 Malta
Purpose Hotjar is an user behavior analytic tool by Hotjar Ltd.. We use Hotjar to understand how users interact with our website.
Privacy Policy https://www.hotjar.com/legal/policies/privacy/
Host(s) *.hotjar.com
Cookie Name _hjClosedSurveyInvites, _hjDonePolls, _hjMinimizedPolls, _hjDoneTestersWidgets, _hjIncludedInSample, _hjShownFeedbackMessage, _hjid, _hjRecordingLastActivity, hjTLDTest, _hjUserAttributesHash, _hjCachedUserAttributes, _hjLocalStorageTest, _hjptid, _hjSessionUser_2229986, _hjIncludedInPageviewSample, _hjIncludedInSessionSample, _hjAbsoluteSessionInProgress, _hjFirstSeen
Cookie Expiry Session / 1 Year

Marketing cookies are used by third-party advertisers or publishers to display personalized ads. They do this by tracking visitors across websites.

Show Cookie Information Hide Cookie Information

Accept
Name
Provider Linkedin
Cookie Name lidc, li_gc, lang, AnalyticsSyncHistory, UserMatchHistory, li_sugr, bcookie, TDCPM, TDID, bscookie, ln_or
Cookie Expiry Session / 1 Year
Accept
Name
Provider Skai
Accept
Name
Provider 6sense
Cookie Name _gd_session, _an_uid, _gd_visitor, _gd_svisitor, 6suuid
Cookie Expiry Session / 400 Days
Accept
Name
Provider Pardot
Purpose Cookie name associated with services from marketing automation and lead generation platform Pardot. The visitor value is the visitor_id in your Pardot account. This cookie is set for visitors by the Pardot tracking code.
Host(s) .pardot.com, pi.pardot.com, skai.io
Cookie Name pardot, visitor_id*, lpv*
Cookie Expiry Session / 10 Years
Accept
Name
Provider Google Ireland Limited, Gordon House, Barrow Street, Dublin 4, Ireland
Purpose Cookie by Google used for conversion tracking of Google Ads.
Privacy Policy https://policies.google.com/privacy?hl=en
Cookie Name IDE, 1P_JAR, NID, SOCS, CONSENT, AEC, _gcl_au, OTZ, test_cookie
Cookie Expiry Session / 400 Days
Accept
Name
Provider Meta Platforms Ireland Limited, 4 Grand Canal Square, Dublin 2, Ireland
Purpose Cookie by Facebook used for website analytics, ad targeting, and ad measurement.
Privacy Policy https://www.facebook.com/policies/cookies
Cookie Name _fbp,act,c_user,datr,fr,tr,m_pixel_ration,pl,presence,sb,spin,wd,xs
Cookie Expiry Session / 1 Year

Content from video platforms and social media platforms is blocked by default. If External Media cookies are accepted, access to those contents no longer requires manual consent.

Show Cookie Information Hide Cookie Information

Accept
Name
Provider Wistia
Host(s) .wistia.com
Cookie Name cb_anonymous_id, _sp_ses.2b40, _li_dcdm_c, __hssrc, _gcl_au, _clsk, hubspotutk, _sp_id.2b40, __hssc, __hstc, _uetsid, _uetvid, _gid, _ga, _ga_GQR109DZ3Y, _lc2, fpi, _ex-pricing-cta, _fbp, cb_group_id, cb_user_id, _clck
Cookie Expiry Session / 400 Days
Accept
Name
Provider Meta Platforms Ireland Limited, 4 Grand Canal Square, Dublin 2, Ireland
Purpose Used to unblock Instagram content.
Privacy Policy https://www.instagram.com/legal/privacy/
Host(s) .instagram.com
Cookie Name pigeon_state
Cookie Expiry Session
Accept
Name
Provider Openstreetmap Foundation, St John’s Innovation Centre, Cowley Road, Cambridge CB4 0WS, United Kingdom
Purpose Used to unblock OpenStreetMap content.
Privacy Policy https://wiki.osmfoundation.org/wiki/Privacy_Policy
Host(s) .openstreetmap.org
Cookie Name _osm_location, _osm_session, _osm_totp_token, _osm_welcome, _pk_id., _pk_ref., _pk_ses., qos_token
Cookie Expiry 1-10 Years
Accept
Name
Provider Twitter International Company, One Cumberland Place, Fenian Street, Dublin 2, D02 AX07, Ireland
Purpose Used to unblock Twitter content.
Privacy Policy https://twitter.com/privacy
Host(s) .twimg.com, .twitter.com
Cookie Name __widgetsettings, local_storage_support_test
Cookie Expiry Unlimited
Accept
Name
Provider Vimeo Inc., 555 West 18th Street, New York, New York 10011, USA
Purpose Used to unblock Vimeo content.
Privacy Policy https://vimeo.com/privacy
Host(s) player.vimeo.com
Cookie Name vuid
Cookie Expiry 2 Years
Accept
Name
Provider Google Ireland Limited, Gordon House, Barrow Street, Dublin 4, Ireland
Purpose Used to unblock YouTube content.
Privacy Policy https://policies.google.com/privacy?hl=en&gl=en
Host(s) google.com
Cookie Name CONSENT
Cookie Expiry 6 Month

Borlabs Cookie powered by Borlabs Cookie

Privacy Policy Imprint