• DE&I Commitment
  • Careers
  • Locations
  • Book a Meeting
    Book a Meeting
  • Company
    Learn a little more about us, our values, and our team
    Our Values
    We don't just talk the talk; we live by our core values
    About Us
    Empowering brands to realize their potential with data, insights, and technology
    Leadership
    Meet our leadership team
    Secure Data Architecture
    Our promise of data security and privacy. We keep your data safe from publishers, competitors and bad actors
    Corporate Social Responsibility
    We are committed to making a positive impact on our communities and our planet
  • Platform
    Plan, manage, optimize, and measure your campaigns with our omnichannel platform
    Our Platform
    A platform that connects all walled garden media
    Connected Media
    Create and manage campaigns across search, social, retail media and apps, in one platform
    Connected Data
    Make data-driven decisions as you plan and strategize
    See the industries we serve
    Learn how our customizable solutions can help with your unique needs
    Explore our partner integrations
    See the media, retailer, and data partners we work with
  • Clients
  • News and Events
    Check out recent announcements and see what we’re up to
    News
    Check out our recent media coverage
    Events
    Join us for our next conference or webinar
    Retail Media Executive Roundtable
    Join us in Chicago for a discussion with Amazon Ads on measurement and success
    Let's talk omni at Shoptalk!
    See how our omnichannel platform can help you build a winning strategy
  • Resources
    From new releases, to industry trends and best practices, Skai has you covered
    Blog
    Read the latest insights and thought leadership from our industry experts
    Capabilities
    Take your campaigns to the next level by enhancing your platform capabilities
    Research
    Explore our reports and whitepapers so you can keep up on the latest industry trends
    Subscribe
    Sign up to get the latest updates straight to your inbox
    Quarterly Trends Report
    Learn digital advertising campaign performance trends from Q4 2022
Back to Blog

Data-Driven Marketing: The Secret is a Test-and-Learn Culture

Tom Affinito, VP Corporate Development @ Skai™

October  05, 2021

Data-driven marketing has become the aspirational principle for organizations to increase performance while reducing the risk from basing decisions on ad hoc processes fueled by opinions and guesswork. 

But the continued increase in global media spending (at $665 billion this year and growing to $855 billion as soon as 2023) and the further need to align this media impact with business outcomes is putting more scrutiny on justifications for these media plans, especially in the disruptive and dynamic markets in automotive, financial services, retail, ecommerce, CPG and travel verticals.

What is test-and-learn culture?

A test-and-learn culture is a key requirement for data-driven marketing. After all, being “data-driven” can’t just be lip service—it has to be fundamental and core to your entire marketing organization and the only way to truly foster and facilitate a data-driven approach is when the team is committed to the process, the right investments in technology and processes are in place, and everyone is aligned and accountable.

Marketing experiments point marketers in the right direction

In the recent Skai white paper Marketing Experiments: How Leading Companies Make Data-Driven Decisions, marketing experiments are seen as a key approach to improve data-driven execution by enabling marketing leaders to:

  • Validate and calibrate their data-driven decision making
  • Identify the right data sets required for a given decision
  • Test transformative ideas for viability and gain valuable insight before fully committing

Marketers are starting to realize just how important testing is to making great decisions. According to Gartner’s 2018 Marketing Data and Analytics Survey, 67% of marketers say experiment design and test design will become more important within the next five years and Econsultancy reports that nine in 10 (91%) company respondents expect to increase the number of experiments they run over the coming 12 months.

Today’s largest media companies, including Amazon and Google, have mature test-and-learn processes ingrained into their marketing decision-making…but the hard truth is that many brand marketing teams are simply not trained to hypothesize, discover and extract insights from data. Marketing experiments sound good on paper, but outside of short-term publisher-specific A/B tests, most brands struggle with even the basics. 

Download this complimentary white paper to learn more

Test-and-learn culture: Supporting marketing experiments and data-driven maturity

The best way forward for marketing leaders to be more data-driven is to focus on building a test-and-learn culture. This approach cultivates a practice in which team members are armed with the right skills, incentives, processes, and tools to incorporate marketing experiments and to be truly data-driven in actions and not just words.

A test-and-learn culture is one in which the entire organization:

  • Understands the importance of data-driven decision making, with each team member empowered to play a role in more deeply measuring and monitoring media impacts and influences
  • Prioritizes experiments, recognizing when risky less-predictable environments or audiences require the development of new data insights
  • Ensures that everyone on the team is trained in data handling, hypothesis building, insight building, and marketing experiment methodologies 
  • Commits to process-building and technology investments to foster best-in-class data intelligence
  • Understands that experiments will often fail and that only proven insights will reliably drive better business actions

In a test-and-learn culture, most of the challenges to successful data-driven marketing can be overcome or reduced. And because data-driven decision-making is inherently more rigorous than ad hoc or purely historical decision-making, a test-and-learn culture helps to foster a level of alignment and understanding throughout the business because everyone is on board and accountable to the insights, metrics, and key indicators delivered.

Making the move to a test-and-learn culture is worth it

Migrating to a test-and-learn culture isn’t an easy shift, but according to Gartner, high-performance companies that make testing and experimentation a marketing priority reap three significant advantages:

  1. “The reduction of abundant opinion and guesswork from marketing execution. Supported by documented customer insights, approaches become clear for improving effectiveness across advertising, web and mobile initiatives, for example.
  2. The ability to react quickly to changes in customer expectations, including any competitors’ enhancements. Agile testing methodologies accelerate your ability to assess the value of competitors’ enhancements and minimize your market vulnerability.
  3. The creation of disruptive threats and new revenue streams. Teams that test all hypotheses — whether conservative or outrageous — increase their likelihood of revealing a hidden revenue gem.”
data-driven marketing

Test-and-learn culture: Examples from marketing leaders

No Guesses, Just Tests

From the CMO.com article, Five lessons from Expedia’s test-and-learn culture

“For online travel company, Expedia, there is no good or bad idea, you just need to test them. At any one point in time, brand Expedia is working on 50 different versions of the website and providing daily updates to its customers. Its engineering teams can detect small changes and figure out what version a consumer really likes using data insights, then adapt quickly to suit.

‘We don’t have to guess, just test,’ said Expedia’s former CEO in a 2015 interview. ‘What we find is one-third of ideas work, one-third are things the consumer doesn’t care about, and one-third fail. The difference between failure and success can be so small. You need to harness audiences that over time will show if you it’s a good or bad feature.’”

Tests for what’s needed and what’s possible

From the Gartner article, Clorox’s Test and Learn Approach to Building a Martech Roadmap

“Marketers often fail to connect prioritization and planning efforts with the practical realities and challenges of technology. Moreover, emerging technologies with the potential to reshape the consumer journey and experience tend to be overlooked.

To tackle these challenges, Clorox has two kinds of in-depth learning projects — ‘what’s needed’ learning projects and ‘what’s possible’ learning projects.

‘What’s needed’ projects consist of mapping the consumer journey, investigating areas where marketing capabilities do not meet the consumer need and developing and testing solutions.

‘What’s possible’ projects involve investigating where to apply emerging marketing capabilities to create valuable new consumer experiences and developing and testing prototypes.”

Widening impacts through cross-functional test-and-learn 

From the Accenture article, Experimentation and Unlocking Data-Driven Innovation

“Use each innovation hypothesis to direct your efforts to create a targeted experiment. That can then be tested, via a series of real-world scenarios, with data from each test being used to drive decisions.

A common pitfall with these types of experiments is a narrow focus on just one element of product or process. For example, developers may be pushing to make their app faster, but performance speeds may have no positive impact on the business’ most pressing problems. To truly reflect the business, hypotheses should be developed across cross-functional “pods” that focus on specific problems but have input from different entities spanning the organization.

The real value comes with a team at the intersection of business, product, and operations. For a company working on a video product, this means bringing together product management, marketing, customer service, and development. When they create a hypothesis, they’ll have a holistic view of the problem, avoiding a narrow focus.”

Test-and-learn culture: The pillars of success

The best way forward for marketing leaders to be more data-driven is to focus on building a test-and-learn culture. This approach cultivates a practice in which team members are armed with the right skills, incentives, processes, and tools to incorporate marketing experiments and to be truly data-driven in actions and not just words.

In conversations with our clients, four key pillars come up time after time in discussing how to improve test-and-learn culture: a) creating robust testing processes, b) bolstering the dissemination, management, and monitoring of insights and their derived policies, c) supporting teams to recognize and prioritize strategic initiatives, and d) aligning the focus and domain of marketing experiments with the vision of business.

Join us next week as we explore these four marketing test-and-learn foundations and see where your own team can focus to achieve even more data-driven success!

Request a demo with Skai

Related Posts

  • The Next Wave of AI Data Analytics Will Revolutionize Marketing
    Read More
  • Test and Learn Marketing Can Guide Your Way Through Even the Toughest Market Conditions
    Read More
  • One of the four paper airplanes takes a different flight path.
    Marketing Experiments: Leading the Way to Transformative Marketing
    Read More
  • Data Insights Aren’t Enough; It’s Time to Prioritize Impact
    Read More
  • The 10 Key Market Intelligence Data Sources Brands Should Focus On Right Now
    Read More
  • Online/Offline Marketing Measurement Isn’t As Impossible As It Once Was
    Read More
  • Share on Facebook
  • Share on Twitter
  • Share on LinkedIn
  • Share via Email
  • Copy Link
    Copied!
Tags: Data & Insights, Measure, Navigator, Optimize, xTLx

Subscribe to Updates

Media that matters.
Marketing that works.
© 2023 Kenshoo, Ltd. All Rights Reserved.
Privacy Policy. Cookie Policy. Recruitment Privacy Policy.
  • Connected Data
    • Market Intelligence
    • Our Approach
    • By Need
    • By Solution
  • Connected Strategy
    • Dynamic Marketing Mix
    • Budget Forecasting
    • Strategic Consulting
  • Connected Media
    • Overview
    • Retail Media
    • Paid Search
    • Paid Social
    • App Marketing
    • Auditing
    • Expert Services
  • Measurement
    • Incrementality
    • Experiments
    • Cross-Channel Attribution
  • Resources
    • Blog
    • Glossary
    • Case Studies
    • Training & Enablement
    • Developer Hub
Privacy Preference

We use cookies on our website. Some of them are essential, while others help us to improve this website and your experience.

Privacy Preference

Save All

Save

Accept Only Essential Cookies

Manage Cookie Preferences

Cookie Details Privacy Policy Imprint

Privacy Preference

Here you will find an overview of all cookies used. You can give your consent to whole categories or display further information and select certain cookies.

Save All Save Accept Only Essential Cookies

Back

Privacy Preference

Essential cookies enable basic functions and are necessary for the proper function of the website.

Show Cookie Information Hide Cookie Information

Name
Provider Owner of this website, Imprint
Purpose Saves the visitors preferences selected in the Cookie Box of Borlabs Cookie.
Host(s) .skai.io, skai.io
Cookie Name borlabs-cookie
Cookie Expiry 1 Year
Name
Provider Owner of this website
Purpose This cookie stores selections made by the user in the Accessibe tool in order to maintain those settings on future visits. These cookies help us make our website compliant with our obligations under US law.
Privacy Policy https://accessibe.com/privacy-policy
Cookie Name acsbState, acsbReset
Cookie Expiry n/a
Name
Provider Owner of this website
Host(s) skai.io
Cookie Name wordpress_sec_,wordpress_test_cookie,wp-postpass_*, wordpresspass_*, wordpressuser_*
Cookie Expiry Session / 1 Year

We use these cookies to enhance functionality and allow for personalisation, such as live chats, videos and the use of social media.

Show Cookie Information Hide Cookie Information

Accept
Name
Provider Owner of this website
Host(s) .chilipiper.com, skai.chilipiper.com
Cookie Name fs_uid, CHILI_PIPER_CLUSTER, guest-session, _sp_ses*, _sp_id*
Cookie Expiry Session / 2 Years
Accept
Name
Provider Owner of this website
Host(s) .comeet.co, www.comeet.co
Cookie Name visid_incap_, nlbi_#######, incap_ses_, referrer22_00a, incap_ses_1364_2167377
Cookie Expiry Session / 1 Year
Accept
Name
Provider Owner of this website
Host(s) skai.io
Cookie Name moduleFormPardotDownload
Cookie Expiry 30 days

Statistics cookies collect information anonymously. This information helps us to understand how our visitors use our website.

Show Cookie Information Hide Cookie Information

Accept
Name
Provider Google Ireland Limited, Gordon House, Barrow Street, Dublin 4, Ireland
Purpose Cookie by Google used for website analytics. Generates statistical data on how the visitor uses the website.
Privacy Policy https://policies.google.com/privacy?hl=en
Cookie Name _ga,_ga_*,_gat,_gat_*,_gid
Cookie Expiry 2 Months
Accept
Name
Provider Hotjar Ltd., Dragonara Business Centre, 5th Floor, Dragonara Road, Paceville St Julian's STJ 3141 Malta
Purpose Hotjar is an user behavior analytic tool by Hotjar Ltd.. We use Hotjar to understand how users interact with our website.
Privacy Policy https://www.hotjar.com/legal/policies/privacy/
Host(s) *.hotjar.com
Cookie Name _hjClosedSurveyInvites, _hjDonePolls, _hjMinimizedPolls, _hjDoneTestersWidgets, _hjIncludedInSample, _hjShownFeedbackMessage, _hjid, _hjRecordingLastActivity, hjTLDTest, _hjUserAttributesHash, _hjCachedUserAttributes, _hjLocalStorageTest, _hjptid, _hjSessionUser_2229986, _hjIncludedInPageviewSample, _hjIncludedInSessionSample, _hjAbsoluteSessionInProgress, _hjFirstSeen
Cookie Expiry Session / 1 Year

Marketing cookies are used by third-party advertisers or publishers to display personalized ads. They do this by tracking visitors across websites.

Show Cookie Information Hide Cookie Information

Accept
Name
Provider Linkedin
Cookie Name lidc, li_gc, lang, AnalyticsSyncHistory, UserMatchHistory, li_sugr, bcookie, TDCPM, TDID, bscookie, ln_or
Cookie Expiry Session / 1 Year
Accept
Name
Provider Skai
Accept
Name
Provider 6sense
Cookie Name _gd_session, _an_uid, _gd_visitor, _gd_svisitor, 6suuid
Cookie Expiry Session / 400 Days
Accept
Name
Provider Pardot
Purpose Cookie name associated with services from marketing automation and lead generation platform Pardot. The visitor value is the visitor_id in your Pardot account. This cookie is set for visitors by the Pardot tracking code.
Host(s) .pardot.com, pi.pardot.com, skai.io
Cookie Name pardot, visitor_id*, lpv*
Cookie Expiry Session / 10 Years
Accept
Name
Provider Google Ireland Limited, Gordon House, Barrow Street, Dublin 4, Ireland
Purpose Cookie by Google used for conversion tracking of Google Ads.
Privacy Policy https://policies.google.com/privacy?hl=en
Cookie Name IDE, 1P_JAR, NID, SOCS, CONSENT, AEC, _gcl_au, OTZ, test_cookie
Cookie Expiry Session / 400 Days
Accept
Name
Provider Meta Platforms Ireland Limited, 4 Grand Canal Square, Dublin 2, Ireland
Purpose Cookie by Facebook used for website analytics, ad targeting, and ad measurement.
Privacy Policy https://www.facebook.com/policies/cookies
Cookie Name _fbp,act,c_user,datr,fr,tr,m_pixel_ration,pl,presence,sb,spin,wd,xs
Cookie Expiry Session / 1 Year

Content from video platforms and social media platforms is blocked by default. If External Media cookies are accepted, access to those contents no longer requires manual consent.

Show Cookie Information Hide Cookie Information

Accept
Name
Provider Wistia
Host(s) .wistia.com
Cookie Name cb_anonymous_id, _sp_ses.2b40, _li_dcdm_c, __hssrc, _gcl_au, _clsk, hubspotutk, _sp_id.2b40, __hssc, __hstc, _uetsid, _uetvid, _gid, _ga, _ga_GQR109DZ3Y, _lc2, fpi, _ex-pricing-cta, _fbp, cb_group_id, cb_user_id, _clck
Cookie Expiry Session / 400 Days
Accept
Name
Provider Meta Platforms Ireland Limited, 4 Grand Canal Square, Dublin 2, Ireland
Purpose Used to unblock Instagram content.
Privacy Policy https://www.instagram.com/legal/privacy/
Host(s) .instagram.com
Cookie Name pigeon_state
Cookie Expiry Session
Accept
Name
Provider Openstreetmap Foundation, St John’s Innovation Centre, Cowley Road, Cambridge CB4 0WS, United Kingdom
Purpose Used to unblock OpenStreetMap content.
Privacy Policy https://wiki.osmfoundation.org/wiki/Privacy_Policy
Host(s) .openstreetmap.org
Cookie Name _osm_location, _osm_session, _osm_totp_token, _osm_welcome, _pk_id., _pk_ref., _pk_ses., qos_token
Cookie Expiry 1-10 Years
Accept
Name
Provider Twitter International Company, One Cumberland Place, Fenian Street, Dublin 2, D02 AX07, Ireland
Purpose Used to unblock Twitter content.
Privacy Policy https://twitter.com/privacy
Host(s) .twimg.com, .twitter.com
Cookie Name __widgetsettings, local_storage_support_test
Cookie Expiry Unlimited
Accept
Name
Provider Vimeo Inc., 555 West 18th Street, New York, New York 10011, USA
Purpose Used to unblock Vimeo content.
Privacy Policy https://vimeo.com/privacy
Host(s) player.vimeo.com
Cookie Name vuid
Cookie Expiry 2 Years
Accept
Name
Provider Google Ireland Limited, Gordon House, Barrow Street, Dublin 4, Ireland
Purpose Used to unblock YouTube content.
Privacy Policy https://policies.google.com/privacy?hl=en&gl=en
Host(s) google.com
Cookie Name CONSENT
Cookie Expiry 6 Month

Borlabs Cookie powered by Borlabs Cookie

Privacy Policy Imprint