• DE&I Commitment
  • Careers
  • Locations
  • Book a Meeting
    Book a Meeting
  • Company
    Learn a little more about us, our values, and our team
    Our Values
    We don't just talk the talk; we live by our core values
    About Us
    Empowering brands to realize their potential with data, insights, and technology
    Leadership
    Meet our leadership team
    Secure Data Architecture
    Our promise of data security and privacy. We keep your data safe from publishers, competitors and bad actors
    Corporate Social Responsibility
    We are committed to making a positive impact on our communities and our planet
  • Platform
    Plan, manage, optimize, and measure your campaigns with our omnichannel platform
    Our Platform
    A platform that connects all walled garden media
    Connected Media
    Create and manage campaigns across search, social, retail media and apps, in one platform
    Connected Data
    Make data-driven decisions as you plan and strategize
    See the industries we serve
    Learn how our customizable solutions can help with your unique needs
    Explore our partner integrations
    See the media, retailer, and data partners we work with
  • Clients
  • News and Events
    Check out recent announcements and see what we’re up to
    News
    Check out our recent media coverage
    Events
    Join us for our next conference or webinar
    Quarterly Trends Webinar
    Get the latest insights on digital marketing campaign performance for Q4 2022
    Retail Media for Grocery Webinar
    Join us to dig into trends and challenges shaping the industry in 2023
  • Resources
    From new releases, to industry trends and best practices, Skai has you covered
    Blog
    Read the latest insights and thought leadership from our industry experts
    Capabilities
    Take your campaigns to the next level by enhancing your platform capabilities
    Research
    Explore our reports and whitepapers so you can keep up on the latest industry trends
    Subscribe
    Sign up to get the latest updates straight to your inbox
    Quarterly Trends Report
    Learn digital advertising campaign performance trends from Q3 2022
Back to Blog

Data-Driven Decision Making: How Good is Your Marketing Org at It? Without Experiments, You Will Never Know

Tom Affinito, VP Corporate Development @ Skai™

August  29, 2019

Data-driven decision making is the gold standard in marketing. Whether that’s strategic at the top such as annual budget allocation or tactical at the day-to-day level for optimizing keyword bids or social ad targeting, without some sort of evidence-based choice, a decision is deemed to be opinion-based—and inherently less valid. Learn how marketing experiments are the key to helping organizations validate and calibrate data-driven decision making. 

data-driven marketing

In a recent survey of practitioners on data-driven marketing, when asked about their most important data objectives, the top answer was “basing more decisions on data analysis”. However, when asked about the biggest data challenges they face, the top answer was “being able to make more data-based decisions” with 81% of marketers saying that they “consider implementing data-driven marketing strategies somewhat to extremely complicated.”

Many of us make what we consider to be data-driven decisions every day, but there’s an essential part of the equation that many people don’t get right or even understand how: data-driven decision making should not be taken for granted…it needs to be constantly tested and tuned via ongoing experiments.

It goes to follow: What could be more important to any brand than validating that their decision-making process is top-notch? 

After all, would you want to get lost in the woods with a faulty compass? 

Data-driven decision making: marketing experiments at the heart of a test-and-learn culture

According to research from Gartner:

“Having a test-and-learn culture empowers your organization to make customer experience, marketing and product decisions that cut through opinion, indecision, and uncertainty with data and insight. The results and outcomes mitigate the risk of making the wrong decisions, reduce or eliminate wasted efforts and resources and improve revenue.”

Marketers have been long-expected to absorb a chart or graph on marketing performance and make educated assumptions on how to proceed. For example, if a brand has invested in a new social channel and the ROI of the campaigns are consistently below expectations, the decision might be made to move the budget to another publisher. However, the process for vetting those decisions is often fuzzier. Did the budget perform better with the other publisher? Was it the best decision? Should it have been allocated across a handful of partners instead? Could only half of the budget have been moved?

These questions put the spotlight on the state of today’s data-driven decision making. Often only if the high-level goal goes up or down is a decision deemed good or bad. But, only a marketing organization committed to continual validation via experiments can truly say that their decision-making practice is sound. 

And marketing experiments matter. Organizations that significantly outperform their competitors are almost twice as likely to make testing and experimentation a marketing priority.

data-driven decision making

Leveraging the scientific method for marketing experiments

The scientific method is a process that most of us are exposed to in middle school science class, and at its core is a simple point-of-view on testing that marketers must adopt. That is, every assumption must be coupled with a hypothesis, tested in a stable environment, given the proper time to collect significant data, and then be analyzed. 

Without this approach, a data-driven decision is simply an educated hypothesis. Probably better than a wild guess, but who knows? A valid testing methodology is needed to know the difference. 

Marketing experiments are a critical component to best-in-class, data-driven decision making:

  • Every decision needs to be viewed as no more than an assumption that needs to be tested—whether it was just an opinion or a highly data-driven one. 
  • A hypothesis needs to be developed. What do we think will happen when we make this decision? Without a hypothesis of what the result might be, a marketer doesn’t have anything to compare with the final results. Just that things got “better” or “worse” should not be the standard—there needs to a quantifiable hypothesis defined to help understand how close or far off was the original guess. This will help you calibrate your data-driven practice over time. Even if most of your decisions turn out to be winners, maybe you could be winning even more if you knew that you could reach higher with your goals?
  • A test needs to be defined. What needs to be tested? How long does the test need to run to enough results to be valid? Most importantly, it needs to run in a “stable environment” without too many changes going on at the same time. For example, a chemist does not test both Chemical A and Chemical B at the same time to see the reaction with Chemical C. They run one test at a time so that it is clear how Chemical A mixes with Chemical C and how Chemical B mixes with Chemical C. A control group is always needed to make sure there weren’t any external factors at play biasing the results.
  • Finally, a proper analysis needs to be performed in order to determine—not if the decision was right or wrong— but how close or far the hypothesis was to the results. Closer means that the decision-making was more accurate. Further away means that it was less accurate. And then a final analysis into what factors might have led to it being close or far can start to provide calibration cues to improve every subsequent decision.
  • To fully close the loop, insights from the marketing experiment should be shared across the org so that everyone can get better. There might even be an experiment performed by one group that on the surface doesn’t impact another, but it absolutely has a positive impact.
data-driven marketing

This sounds like a lot of work, but it doesn’t have to be. Yes, processes may need to change and new tools might need to be utilized, but this is what is required in a true data-driven marketing organization.

Marketing experiments aren’t “nice to have”. They are a critical component. 

And there are ways to do these things fairly easily and isolated away from the bulk of the marketing so that it doesn’t cause a disruption in business. One option from Skai is Impact Navigator, a SaaS solution built specifically for test-and-learn marketing orgs to measure the incrementality and impact of their marketing programs. The platform can easily handle multiple marketing experiments to minimizes test duration while maintaining statistical significance. 

Experiments are the future of data-driven marketing

Based on just how much emphasis marketers put on data-driven decision making, it’s not that hard to imagine that one day every functional group in every marketing organization will always be testing. The creative teams will be testing messaging and visuals, the media team will be testing ad formats and spend, the channel specialists will be testing optimization and automation, the CMO will be testing channel and publisher mix…the future of marketing is marketing experiments.

The most beneficial outcome for brands of ongoing testing across the organization is the improvement in their overall data-driven decision making. They will begin to learn which metrics matter, how to shorten tests as much as possible but still get valid results and at what cadence testing needs to take place in order to optimize their programs.

By leveraging marketing experiments, marketers can uplevel data-driven decision making. It doesn’t mean that every decision requires a white-lab-coat approach with years of testing—if anything, it needs to be a non-disruptive and easy approach. But with a slight change in process and a commitment to this standard, the opportunity for brands to improve their marketing ROI and performance is high.

Book a Meeting of Skai

Related Posts

  • One of the four paper airplanes takes a different flight path.
    Marketing Experiments: Leading the Way to Transformative Marketing
    Read More
  • Team members collaborating at the desk
    Data-Driven Marketing: The Secret is a Test-and-Learn Culture
    Read More
  • The Next Wave of AI Data Analytics Will Revolutionize Marketing
    Read More
  • M&A planning and data at the table
    M&A Data Analytics Can Improve Your Business’ Decision-Making
    Read More
  • Online/Offline Marketing Measurement Isn’t As Impossible As It Once Was
    Read More
  • Test and Learn Marketing Can Guide Your Way Through Even the Toughest Market Conditions
    Read More
  • Share on Facebook
  • Share on Twitter
  • Share on LinkedIn
  • Share via Email
  • Copy Link
    Copied!
Tags: Create, Data, Data & Insights, Marketer Perspective, Measure, Optimize, Plan, Research, Retail Media, Target, xTLx

Subscribe to Updates

Media that matters.
Marketing that works.
© 2023 Kenshoo, Ltd. All Rights Reserved.
Privacy Policy. Cookie Policy. Recruitment Privacy Policy.
  • Connected Data
    • Market Intelligence
    • Our Approach
    • By Need
    • By Solution
  • Connected Strategy
    • Dynamic Marketing Mix
    • Budget Forecasting
    • Strategic Consulting
  • Connected Media
    • Overview
    • Retail Media
    • Paid Search
    • Paid Social
    • App Marketing
    • Auditing
    • Expert Services
  • Measurement
    • Incrementality
    • Experiments
    • Cross-Channel Attribution
  • Resources
    • Blog
    • Glossary
    • Case Studies
    • Training & Enablement
    • Developer Hub
Privacy Preference

We use cookies on our website. Some of them are essential, while others help us to improve this website and your experience.

Privacy Preference

Save All

Save

Accept Only Essential Cookies

Manage Cookie Preferences

Cookie Details Privacy Policy Imprint

Privacy Preference

Here you will find an overview of all cookies used. You can give your consent to whole categories or display further information and select certain cookies.

Save All Save Accept Only Essential Cookies

Back

Privacy Preference

Essential cookies enable basic functions and are necessary for the proper function of the website.

Show Cookie Information Hide Cookie Information

Name
Provider Owner of this website, Imprint
Purpose Saves the visitors preferences selected in the Cookie Box of Borlabs Cookie.
Host(s) .skai.io, skai.io
Cookie Name borlabs-cookie
Cookie Expiry 1 Year
Name
Provider Owner of this website
Purpose This cookie stores selections made by the user in the Accessibe tool in order to maintain those settings on future visits. These cookies help us make our website compliant with our obligations under US law.
Privacy Policy https://accessibe.com/privacy-policy
Cookie Name acsbState, acsbReset
Cookie Expiry n/a
Name
Provider Owner of this website
Host(s) skai.io
Cookie Name wordpress_sec_,wordpress_test_cookie,wp-postpass_*, wordpresspass_*, wordpressuser_*
Cookie Expiry Session / 1 Year

We use these cookies to enhance functionality and allow for personalisation, such as live chats, videos and the use of social media.

Show Cookie Information Hide Cookie Information

Accept
Name
Provider Owner of this website
Host(s) .chilipiper.com, skai.chilipiper.com
Cookie Name fs_uid, CHILI_PIPER_CLUSTER, guest-session, _sp_ses*, _sp_id*
Cookie Expiry Session / 2 Years
Accept
Name
Provider Owner of this website
Host(s) .comeet.co, www.comeet.co
Cookie Name visid_incap_, nlbi_#######, incap_ses_, referrer22_00a, incap_ses_1364_2167377
Cookie Expiry Session / 1 Year
Accept
Name
Provider Owner of this website
Host(s) skai.io
Cookie Name moduleFormPardotDownload
Cookie Expiry 30 days

Statistics cookies collect information anonymously. This information helps us to understand how our visitors use our website.

Show Cookie Information Hide Cookie Information

Accept
Name
Provider Google Ireland Limited, Gordon House, Barrow Street, Dublin 4, Ireland
Purpose Cookie by Google used for website analytics. Generates statistical data on how the visitor uses the website.
Privacy Policy https://policies.google.com/privacy?hl=en
Cookie Name _ga,_ga_*,_gat,_gat_*,_gid
Cookie Expiry 2 Months
Accept
Name
Provider Hotjar Ltd., Dragonara Business Centre, 5th Floor, Dragonara Road, Paceville St Julian's STJ 3141 Malta
Purpose Hotjar is an user behavior analytic tool by Hotjar Ltd.. We use Hotjar to understand how users interact with our website.
Privacy Policy https://www.hotjar.com/legal/policies/privacy/
Host(s) *.hotjar.com
Cookie Name _hjClosedSurveyInvites, _hjDonePolls, _hjMinimizedPolls, _hjDoneTestersWidgets, _hjIncludedInSample, _hjShownFeedbackMessage, _hjid, _hjRecordingLastActivity, hjTLDTest, _hjUserAttributesHash, _hjCachedUserAttributes, _hjLocalStorageTest, _hjptid, _hjSessionUser_2229986, _hjIncludedInPageviewSample, _hjIncludedInSessionSample, _hjAbsoluteSessionInProgress, _hjFirstSeen
Cookie Expiry Session / 1 Year

Marketing cookies are used by third-party advertisers or publishers to display personalized ads. They do this by tracking visitors across websites.

Show Cookie Information Hide Cookie Information

Accept
Name
Provider Linkedin
Cookie Name lidc, li_gc, lang, AnalyticsSyncHistory, UserMatchHistory, li_sugr, bcookie, TDCPM, TDID, bscookie, ln_or
Cookie Expiry Session / 1 Year
Accept
Name
Provider Skai
Accept
Name
Provider 6sense
Cookie Name _gd_session, _an_uid, _gd_visitor, _gd_svisitor, 6suuid
Cookie Expiry Session / 400 Days
Accept
Name
Provider Pardot
Purpose Cookie name associated with services from marketing automation and lead generation platform Pardot. The visitor value is the visitor_id in your Pardot account. This cookie is set for visitors by the Pardot tracking code.
Host(s) .pardot.com, pi.pardot.com, skai.io
Cookie Name pardot, visitor_id*, lpv*
Cookie Expiry Session / 10 Years
Accept
Name
Provider Google Ireland Limited, Gordon House, Barrow Street, Dublin 4, Ireland
Purpose Cookie by Google used for conversion tracking of Google Ads.
Privacy Policy https://policies.google.com/privacy?hl=en
Cookie Name IDE, 1P_JAR, NID, SOCS, CONSENT, AEC, _gcl_au, OTZ, test_cookie
Cookie Expiry Session / 400 Days
Accept
Name
Provider Meta Platforms Ireland Limited, 4 Grand Canal Square, Dublin 2, Ireland
Purpose Cookie by Facebook used for website analytics, ad targeting, and ad measurement.
Privacy Policy https://www.facebook.com/policies/cookies
Cookie Name _fbp,act,c_user,datr,fr,tr,m_pixel_ration,pl,presence,sb,spin,wd,xs
Cookie Expiry Session / 1 Year

Content from video platforms and social media platforms is blocked by default. If External Media cookies are accepted, access to those contents no longer requires manual consent.

Show Cookie Information Hide Cookie Information

Accept
Name
Provider Wistia
Host(s) .wistia.com
Cookie Name cb_anonymous_id, _sp_ses.2b40, _li_dcdm_c, __hssrc, _gcl_au, _clsk, hubspotutk, _sp_id.2b40, __hssc, __hstc, _uetsid, _uetvid, _gid, _ga, _ga_GQR109DZ3Y, _lc2, fpi, _ex-pricing-cta, _fbp, cb_group_id, cb_user_id, _clck
Cookie Expiry Session / 400 Days
Accept
Name
Provider Meta Platforms Ireland Limited, 4 Grand Canal Square, Dublin 2, Ireland
Purpose Used to unblock Instagram content.
Privacy Policy https://www.instagram.com/legal/privacy/
Host(s) .instagram.com
Cookie Name pigeon_state
Cookie Expiry Session
Accept
Name
Provider Openstreetmap Foundation, St John’s Innovation Centre, Cowley Road, Cambridge CB4 0WS, United Kingdom
Purpose Used to unblock OpenStreetMap content.
Privacy Policy https://wiki.osmfoundation.org/wiki/Privacy_Policy
Host(s) .openstreetmap.org
Cookie Name _osm_location, _osm_session, _osm_totp_token, _osm_welcome, _pk_id., _pk_ref., _pk_ses., qos_token
Cookie Expiry 1-10 Years
Accept
Name
Provider Twitter International Company, One Cumberland Place, Fenian Street, Dublin 2, D02 AX07, Ireland
Purpose Used to unblock Twitter content.
Privacy Policy https://twitter.com/privacy
Host(s) .twimg.com, .twitter.com
Cookie Name __widgetsettings, local_storage_support_test
Cookie Expiry Unlimited
Accept
Name
Provider Vimeo Inc., 555 West 18th Street, New York, New York 10011, USA
Purpose Used to unblock Vimeo content.
Privacy Policy https://vimeo.com/privacy
Host(s) player.vimeo.com
Cookie Name vuid
Cookie Expiry 2 Years
Accept
Name
Provider Google Ireland Limited, Gordon House, Barrow Street, Dublin 4, Ireland
Purpose Used to unblock YouTube content.
Privacy Policy https://policies.google.com/privacy?hl=en&gl=en
Host(s) google.com
Cookie Name CONSENT
Cookie Expiry 6 Month

Borlabs Cookie powered by Borlabs Cookie

Privacy Policy Imprint