• DE&I Commitment
  • Careers
  • Locations
  • Book a Meeting
    Book a Meeting
  • Company
    Learn a little more about us, our values, and our team
    Our Values
    We don't just talk the talk; we live by our core values
    About Us
    Empowering brands to realize their potential with data, insights, and technology
    Leadership
    Meet our leadership team
    Secure Data Architecture
    Our promise of data security and privacy. We keep your data safe from publishers, competitors and bad actors
    Corporate Social Responsibility
    We are committed to making a positive impact on our communities and our planet
  • Platform
    Plan, manage, optimize, and measure your campaigns with our omnichannel platform
    Our Platform
    A platform that connects all walled garden media
    Connected Media
    Create and manage campaigns across search, social, retail media and apps, in one platform
    Connected Data
    Make data-driven decisions as you plan and strategize
    See the industries we serve
    Learn how our customizable solutions can help with your unique needs
    Explore our partner integrations
    See the media, retailer, and data partners we work with
  • Clients
  • News and Events
    Check out recent announcements and see what we’re up to
    News
    Check out our recent media coverage
    Events
    Join us for our next conference or webinar
    Quarterly Trends Webinar
    Get the latest insights on digital marketing campaign performance for Q4 2022
    Retail Media for Grocery Webinar
    Join us to dig into trends and challenges shaping the industry in 2023
  • Resources
    From new releases, to industry trends and best practices, Skai has you covered
    Blog
    Read the latest insights and thought leadership from our industry experts
    Capabilities
    Take your campaigns to the next level by enhancing your platform capabilities
    Research
    Explore our reports and whitepapers so you can keep up on the latest industry trends
    Subscribe
    Sign up to get the latest updates straight to your inbox
    Quarterly Trends Report
    Learn digital advertising campaign performance trends from Q3 2022
Back to Blog

Test-and-Learn Organizations Find Marginal Gains for Big Improvements

Tom Affinito, VP Corporate Development @ Skai™

October  18, 2019

Marginal gains are how successful organizations consistently find big improvements. Yes, often brands want transformational, big quantum leaps forward, but it’s a slow-and-steady approach that will win the race. In today’s post, Skai’s Tom Affinito discusses how marginal gains are easier to achieve and can add up to help brands win in today’s highly competitive marketplace.

marginal gains

Previously I discussed the approach of test-and-learn organizations, and how they use marketing experiments to qualify data, discover new insights, and align their messaging with evolving customer expectations.

But can your organization do this?

Is this a goal that is just too far from your current practices to achieve?

Don’t despair. Many of today’s leaders were upstarts, challengers to the marketplace, who taught themselves how to win. And often, it’s not about taking magical, quantum leaps forward, but rather a steady, highly rigorous test-and-learn approach that keeps your organization course-correcting to navigate those tough waters while your competitors fail at their complicated plans.

Winning with Marginal Gains

Dave Brailsford, now Sir Dave Brailsford, did not aspire to become a Commander of the British Empire. He just wanted to ride his bike, and to get better and better at it. Spending his youth cycling in Britain and France, he later studied business and athletic science. And then he became the performance director for British Cycling in 2003.

marginal gains winning

Over the century of yearly contests at the Tour de France, the world’s premier endurance cycling race, Britain had never taken home the coveted yellow jersey given to the overall leader. In Brailsford’s decade at British Cycling, that changed. First garnering 2 gold medal wins at the Athens Olympics in 2004, the British team went on to dominate the Beijing Olympics in 2008 with 8 gold medals. And then the first the UK Tour de France yellow jersey win in 2012.

And then 8 more gold medals in 2014.

And another Tour de France yellow jersey in 2013.

And another in 2015.

And another in 2016.

And another in 2017.

No proponent of quick fixes, Brailsford had steadily transformed his cycling team over the course of a decade from being contenders with few trophies to becoming a world-class record-dominating team.

marketing experiments

Download this complimentary Skai white paper to learn more

Performance Transformation

Brailsford’s approach to performance was not based on quick fixes, but on sustainable, continuous improvement using data insights. The approach is easy to understand, and is based on the theory of marginal gains: 1) gather key metrics and understand their role in race performance as either direct performance indicators, lagging indicators, or leading indicators, and 2) focus training on continuous small gains, on the order of a mere 1% improvement on just one metric every training session.

“The whole principle came from the idea that if you broke down everything you could think of that goes into riding a bike, and then improved it by 1%, you will get a significant increase when you put them all together,” Brailsford explained. 

Skeptics will think that 1% is not enough, that improvements that don’t hit 15% to 25% levels are not worth the time…or at least not worth the time to focus on and incorporate into existing processes. But skeptics may be forgetting the powerful growth effects of continuous interest in finance. And many people do not appreciate the alternative: that not building in this 1% focus into your team’s process means that you will be letting opportunities slip away, potentially losing 1% performance over a suite of metrics and driving brand performance down.

James Clear offers a chart showing how this gap grows over a year, yielding a 38:1 performance difference for the marginal gains team versus a more sluggish competitor that does not incorporate reflection and improvement.marginal gains

Is your company getting 1% better every day, or 1% worse every day?

A Test-and-Learn Organization Facilitates Marginal Gains

I’ve received questions and comments from our recent articles on marketing measurement and building a test-and-learn organization, and concerns from some operational practitioners that evolving the types of differentiating capabilities described previously is too difficult, too hard to achieve organizationally.

While I can not assure readers about internal challenges they know all too well, I can vouch for the success I have seen with many of our clients who have taken this marginal gains approach as the method to evolve their test-and-learn culture, to improve the quality and quantity of data-driven decisions, to discover opportunities and strategies that keep them closer to customer intent and need.

How is your marketing organization tapping into marginal gains? Are you getting 1% better every day or 1% worse every day?

Skai’s Impact Navigator is the only SaaS solution for measuring your true marketing incrementality. Unlock smarter market planning, better budgeting, and stronger alignment to business objectives by measuring and monitoring the true business impact of your marketing programs.

With Impact Navigator you can:

  • Run real marketing experiments
  • Accurately measure true incremental impact across all audience segments
  • Design and monitor testing for any media channel, on or off Skai

Contact us today or set up a quick and easy demo.

Related Posts

  • Putting Incrementality Measurement Into Action: How to Figure Out What to Test
    Read More
  • Test and Learn Marketing Can Guide Your Way Through Even the Toughest Market Conditions
    Read More
  • Online/Offline Marketing Measurement Isn’t As Impossible As It Once Was
    Read More
  • Marketing Measurement Cannot Be Reliant on Individual Customer Journeys: Incrementality is the Fix
    Read More
  • Life Without Multi-Touch Attribution: How Your Marketing Measurement Program Will Change Under Incrementality
    Read More
  • The 4 Ingredients of a Best-in-Class Incrementality Measurement Practice
    Read More
  • Share on Facebook
  • Share on Twitter
  • Share on LinkedIn
  • Share via Email
  • Copy Link
    Copied!
Tags: Data, Data & Insights, Incrementality, Measure, Optimize, Plan, xTLx

Subscribe to Updates

Media that matters.
Marketing that works.
© 2023 Kenshoo, Ltd. All Rights Reserved.
Privacy Policy. Cookie Policy. Recruitment Privacy Policy.
  • Connected Data
    • Market Intelligence
    • Our Approach
    • By Need
    • By Solution
  • Connected Strategy
    • Dynamic Marketing Mix
    • Budget Forecasting
    • Strategic Consulting
  • Connected Media
    • Overview
    • Retail Media
    • Paid Search
    • Paid Social
    • App Marketing
    • Auditing
    • Expert Services
  • Measurement
    • Incrementality
    • Experiments
    • Cross-Channel Attribution
  • Resources
    • Blog
    • Glossary
    • Case Studies
    • Training & Enablement
    • Developer Hub
Privacy Preference

We use cookies on our website. Some of them are essential, while others help us to improve this website and your experience.

Privacy Preference

Save All

Save

Accept Only Essential Cookies

Manage Cookie Preferences

Cookie Details Privacy Policy Imprint

Privacy Preference

Here you will find an overview of all cookies used. You can give your consent to whole categories or display further information and select certain cookies.

Save All Save Accept Only Essential Cookies

Back

Privacy Preference

Essential cookies enable basic functions and are necessary for the proper function of the website.

Show Cookie Information Hide Cookie Information

Name
Provider Owner of this website, Imprint
Purpose Saves the visitors preferences selected in the Cookie Box of Borlabs Cookie.
Host(s) .skai.io, skai.io
Cookie Name borlabs-cookie
Cookie Expiry 1 Year
Name
Provider Owner of this website
Purpose This cookie stores selections made by the user in the Accessibe tool in order to maintain those settings on future visits. These cookies help us make our website compliant with our obligations under US law.
Privacy Policy https://accessibe.com/privacy-policy
Cookie Name acsbState, acsbReset
Cookie Expiry n/a
Name
Provider Owner of this website
Host(s) skai.io
Cookie Name wordpress_sec_,wordpress_test_cookie,wp-postpass_*, wordpresspass_*, wordpressuser_*
Cookie Expiry Session / 1 Year

We use these cookies to enhance functionality and allow for personalisation, such as live chats, videos and the use of social media.

Show Cookie Information Hide Cookie Information

Accept
Name
Provider Owner of this website
Host(s) .chilipiper.com, skai.chilipiper.com
Cookie Name fs_uid, CHILI_PIPER_CLUSTER, guest-session, _sp_ses*, _sp_id*
Cookie Expiry Session / 2 Years
Accept
Name
Provider Owner of this website
Host(s) .comeet.co, www.comeet.co
Cookie Name visid_incap_, nlbi_#######, incap_ses_, referrer22_00a, incap_ses_1364_2167377
Cookie Expiry Session / 1 Year
Accept
Name
Provider Owner of this website
Host(s) skai.io
Cookie Name moduleFormPardotDownload
Cookie Expiry 30 days

Statistics cookies collect information anonymously. This information helps us to understand how our visitors use our website.

Show Cookie Information Hide Cookie Information

Accept
Name
Provider Google Ireland Limited, Gordon House, Barrow Street, Dublin 4, Ireland
Purpose Cookie by Google used for website analytics. Generates statistical data on how the visitor uses the website.
Privacy Policy https://policies.google.com/privacy?hl=en
Cookie Name _ga,_ga_*,_gat,_gat_*,_gid
Cookie Expiry 2 Months
Accept
Name
Provider Hotjar Ltd., Dragonara Business Centre, 5th Floor, Dragonara Road, Paceville St Julian's STJ 3141 Malta
Purpose Hotjar is an user behavior analytic tool by Hotjar Ltd.. We use Hotjar to understand how users interact with our website.
Privacy Policy https://www.hotjar.com/legal/policies/privacy/
Host(s) *.hotjar.com
Cookie Name _hjClosedSurveyInvites, _hjDonePolls, _hjMinimizedPolls, _hjDoneTestersWidgets, _hjIncludedInSample, _hjShownFeedbackMessage, _hjid, _hjRecordingLastActivity, hjTLDTest, _hjUserAttributesHash, _hjCachedUserAttributes, _hjLocalStorageTest, _hjptid, _hjSessionUser_2229986, _hjIncludedInPageviewSample, _hjIncludedInSessionSample, _hjAbsoluteSessionInProgress, _hjFirstSeen
Cookie Expiry Session / 1 Year

Marketing cookies are used by third-party advertisers or publishers to display personalized ads. They do this by tracking visitors across websites.

Show Cookie Information Hide Cookie Information

Accept
Name
Provider Linkedin
Cookie Name lidc, li_gc, lang, AnalyticsSyncHistory, UserMatchHistory, li_sugr, bcookie, TDCPM, TDID, bscookie, ln_or
Cookie Expiry Session / 1 Year
Accept
Name
Provider Skai
Accept
Name
Provider 6sense
Cookie Name _gd_session, _an_uid, _gd_visitor, _gd_svisitor, 6suuid
Cookie Expiry Session / 400 Days
Accept
Name
Provider Pardot
Purpose Cookie name associated with services from marketing automation and lead generation platform Pardot. The visitor value is the visitor_id in your Pardot account. This cookie is set for visitors by the Pardot tracking code.
Host(s) .pardot.com, pi.pardot.com, skai.io
Cookie Name pardot, visitor_id*, lpv*
Cookie Expiry Session / 10 Years
Accept
Name
Provider Google Ireland Limited, Gordon House, Barrow Street, Dublin 4, Ireland
Purpose Cookie by Google used for conversion tracking of Google Ads.
Privacy Policy https://policies.google.com/privacy?hl=en
Cookie Name IDE, 1P_JAR, NID, SOCS, CONSENT, AEC, _gcl_au, OTZ, test_cookie
Cookie Expiry Session / 400 Days
Accept
Name
Provider Meta Platforms Ireland Limited, 4 Grand Canal Square, Dublin 2, Ireland
Purpose Cookie by Facebook used for website analytics, ad targeting, and ad measurement.
Privacy Policy https://www.facebook.com/policies/cookies
Cookie Name _fbp,act,c_user,datr,fr,tr,m_pixel_ration,pl,presence,sb,spin,wd,xs
Cookie Expiry Session / 1 Year

Content from video platforms and social media platforms is blocked by default. If External Media cookies are accepted, access to those contents no longer requires manual consent.

Show Cookie Information Hide Cookie Information

Accept
Name
Provider Wistia
Host(s) .wistia.com
Cookie Name cb_anonymous_id, _sp_ses.2b40, _li_dcdm_c, __hssrc, _gcl_au, _clsk, hubspotutk, _sp_id.2b40, __hssc, __hstc, _uetsid, _uetvid, _gid, _ga, _ga_GQR109DZ3Y, _lc2, fpi, _ex-pricing-cta, _fbp, cb_group_id, cb_user_id, _clck
Cookie Expiry Session / 400 Days
Accept
Name
Provider Meta Platforms Ireland Limited, 4 Grand Canal Square, Dublin 2, Ireland
Purpose Used to unblock Instagram content.
Privacy Policy https://www.instagram.com/legal/privacy/
Host(s) .instagram.com
Cookie Name pigeon_state
Cookie Expiry Session
Accept
Name
Provider Openstreetmap Foundation, St John’s Innovation Centre, Cowley Road, Cambridge CB4 0WS, United Kingdom
Purpose Used to unblock OpenStreetMap content.
Privacy Policy https://wiki.osmfoundation.org/wiki/Privacy_Policy
Host(s) .openstreetmap.org
Cookie Name _osm_location, _osm_session, _osm_totp_token, _osm_welcome, _pk_id., _pk_ref., _pk_ses., qos_token
Cookie Expiry 1-10 Years
Accept
Name
Provider Twitter International Company, One Cumberland Place, Fenian Street, Dublin 2, D02 AX07, Ireland
Purpose Used to unblock Twitter content.
Privacy Policy https://twitter.com/privacy
Host(s) .twimg.com, .twitter.com
Cookie Name __widgetsettings, local_storage_support_test
Cookie Expiry Unlimited
Accept
Name
Provider Vimeo Inc., 555 West 18th Street, New York, New York 10011, USA
Purpose Used to unblock Vimeo content.
Privacy Policy https://vimeo.com/privacy
Host(s) player.vimeo.com
Cookie Name vuid
Cookie Expiry 2 Years
Accept
Name
Provider Google Ireland Limited, Gordon House, Barrow Street, Dublin 4, Ireland
Purpose Used to unblock YouTube content.
Privacy Policy https://policies.google.com/privacy?hl=en&gl=en
Host(s) google.com
Cookie Name CONSENT
Cookie Expiry 6 Month

Borlabs Cookie powered by Borlabs Cookie

Privacy Policy Imprint