• DE&I Commitment
  • Careers
  • SIGN IN
  • Book a Meeting
    Book a Meeting
  • Company
    Learn a little more about us, our values, and our team
    Our Values
    We don't just talk the talk; we live by our core values
    About Us
    Empowering brands to realize their potential with data, insights, and technology
    Leadership
    Meet our leadership team
    Secure Data Architecture
    Our promise of data security and privacy. We keep your data safe from publishers, competitors and bad actors
    Corporate Social Responsibility
    We are committed to making a positive impact on our communities and our planet
  • Platform
    Plan, manage, optimize, and measure your campaigns with our omnichannel platform
    Omnichannel Advertising
    A platform that connects all walled garden media for more effective campaigns
    Data Connectivity
    Make data-driven decisions as you plan and strategize
    AI-Powered Capabilities
    Take your campaigns to the next level by leveraging proprietary AI-based technology
    See the industries we serve
    Learn how our customizable solutions can help with your unique needs
    Explore our partner integrations
    See the media, retailer, and data partners we work with
  • Case Studies
  • News and Events
    Check out recent announcements and see what we’re up to
    Newsroom
    Check out our recent media mentions and announcements
    Events
    Join us for our next conference or webinar
    Omnichannel platform launch
    Read the press release to see how we're helping marketers win the walled gardens
    AI Breakthrough Award
    Skai Named "Best AI-based Solution for Advertising" in 6th Annual Artificial Intelligence Breakthrough Awards Program
  • Resources
    From new releases, to industry trends and best practices, Skai has you covered
    The Breakthrough
    Read the latest blog posts and thought leadership from Skai and other industry experts
    Skai Whitepaper Library
    Explore our whitepapers and reports so you can stay up to date
    Skai Research
    Get in-depth analysis, insights and research on the industry's hottest topics
    Quarterly Trends Hub
    Dive into the latest market insights, industry trends, and predictive analysis
    Holiday Hub 2023
    Your go-to source for holiday marketing tips, tricks, and best practices
Back to Blog

Feature Focus: Skai Experiments Helps Data-Driven Search Marketers to Test & Learn

Lior Feldman, Product Manager @ Skai

April  08, 2020

Being data-driven in decision-making is the expectation for most marketing teams today. Yet it only goes so far when the data referenced is historical in nature and limited in source to campaign and performance data.

marketing experiments

The next level of data-driven decision making is to test & learn, a practice that can empower marketers to leverage what they know in order to make informed and educated guesses in order to discern what they don’t—or even can’t.

By building assumptions and running tests to see if they are validated, marketers can glean tremendous value, for even learning that an assumption was wrong becomes both meaningful and actionable. 

At Skai, we believe that a key tenet about the future of marketing is that all members of the marketing team will be experts in the test & learn approach with marketing experiments at the foundation of that practice. The media team will always be testing bidding, the creative team will always be testing messaging, the targeting team will always be testing targeting, and even the CMO will run tests to guide channel budget allocation, media mix and so on.

For more information, read the Skai report:  Marketing Experiments: How Leading Companies Make Data-Driven Decisions.

Skai Experiments takes test & learn to the next level

Search marketers have had access to publisher testing solutions for some time now with Google’s Campaign Drafts and Experiments and Microsoft Advertising Experiments. Using these tools, practitioners can execute standard A/B tests to experiment with campaign iterations to determine what variations work the best.

Those tools are a step in the right direction, but Skai Experiments offers search marketers using Skai Search a set of advanced features to enhance experiment setup, management, and reporting. By utilizing these features, running experiments as a core approach helps marketing become leveled up and more valuable to the organization.

Some of the advanced features of Skai Experiments include:

Multi-campaign support. With Google’s Drafts and Experiments, search marketers can only test one campaign at a time in the A (control) and B (test) groups. With Skai Experiments, marketers can add multiple campaigns to each of their Google experiments.

One of the main advantages of multi-campaigns is that one campaign may not have enough volume to reach statistically significant results. By grouping campaigns running the same test, it helps to get to conclusive results much faster.

Precise control over test parameters. With the publisher tools, a marketer sets start and end dates and the experiment runs. With Skai Experiments, the practitioner can set the baseline, ramp-up, and test periods. 

Allowing the time needed to set a clean baseline is a foundational best practice to marketing experiments so that you have the pre-test numbers to compare with the test results to ensure that nothing out of the ordinary happened during the test that might skew results. With the publisher tools, marketers have to export the pre- and post- data and manually aggregate it in a spreadsheet themselves. 

Choose your tests’ baseline, ramp-up testing timelines

Testing custom metrics. Every marketing organization is different and the standard KPIs hardly ever capture what those teams care most about. Often, there are custom metrics which our clients are most focused on and Skai Search is able to integrate our client’s backend data so that they are able to report and optimize on directly within their advertising campaign management tool instead of having to pick a publisher “off the rack” metric that is usually just a proxy to true performance. 

Skai Experiments allows Skai clients to run marketing experiments on these custom metrics.

Rich, visual reporting. To date, publisher experimentation tools offer fairly simple views of results. One of the parts of Skai Experiments that most clients often love when they first see them are the various charts and graphical views with day-over-day performance metrics. 

Skai Experiments

Skai Experiments offers at-a-glance insights

Data exclusion. As anyone who has run many marketing experiments knows, there are often anomalies that pop up that can skew test results. For example, if a tracking code was mistakenly deleted, a landing page URL accidentally switched, or just something happened in the world that spiked or dropped conversion activity for a few days. 

In most of these cases, the marketing experiment has to be stopped and started over. With Skai Experiments, the practitioner needs only to identify those dates for the system and that data will be excluded from the analysis. 

Skai Experiments

Easily exclude data from dates you choose

Advanced device reporting. Skai Experiments shows you results for your experiments across devices. Why shut a campaign off if it looks like it has average performance, but in reality it’s not working well on one device type while working really well on another? Aggregated/blended results might mean a practitioner might pause the campaign whereas a device split report might have them pause one device type so it can benefit from a device-oriented strategy.

See the future of marketing experiments: contact us for a demo

As more and more marketing organizations begin to rely on a test & learn approach with marketing experiments foundation at its core, the need for more features to enhance Skai Experiments are requested. 

As the product manager on Skai Experiments, I’m excited about some of the next feature sets that we have planned on the roadmap including some near-term things which are set to release this summer. 

Some of those include:

  • Predefined experiment templates so that marketers can quickly launch common experiment types.
  • Apply Google Drafts & Experiments split directly from Skai to make these setups to be much easier
  • Schedule your experiment actions so marketers can set up the test in advance 
  • Proactively recommends relevant experiments that the human eye may miss but artificial intelligence and machine learning can spot
  • Export the raw data so it can be dropped into a practitioner’s desired analytics or business intelligence tool

Would you like to see Skai Experiments in action? 

Contact us to see a brief demo of the tools mentioned in this article. 

Book a Meeting of Skai

Related Posts

  • The Evolution of Search Engine Marketing Software to Total Search Intelligence
    Read More
  • Microsoft Shopping Campaigns Get a Powerful Analytics Upgrade in Skai Search
    Read More
  • Maximize Microsoft Automated Bidding Performance with Skai’s Budget Navigator 
    Read More
  • Monthly Paid Media Spend Snapshot – April 2021
    Read More
  • Monthly Paid Media Spend Snapshot – September 2021
    Read More
  • Monthly Paid Media Spend Snapshot – August 2021
    Read More
  • Share on Facebook
  • Share on Twitter
  • Share on LinkedIn
  • Share via Email
  • Copy Link
    Copied!
Tags: Data & Insights, Google, Measure, Microsoft, Optimize, Search, xKPx

    Subscribe to Updates

    Media that matters.
    Marketing that works.
    © 2023 Kenshoo, Ltd. All Rights Reserved.
    Privacy Policy. Cookie Policy. Recruitment Privacy Policy.
    • Omnichannel Strategy
      • Skai HQ
      • Dynamic Marketing Mix
      • Budget Forecasting
      • Strategic Consulting
    • Walled Garden Advertising
      • Overview
      • Retail Media
      • Paid Search
      • Paid Social
      • App Marketing
      • Auditing
      • Expert Services
    • Marketing Measurement
      • Incrementality
      • Experiments
      • Cross-Channel Attribution
    • Resources
      • Blog
      • Glossary
      • Case Studies
      • Capabilities
      • Skai Research Center
      • Quarterly Trends Hub
      • Training & Enablement
      • Developer Hub
    Privacy Preference

    We use cookies on our website. Some of them are essential, while others help us to improve this website and your experience.

    Privacy Preference

    Save All

    Save

    Accept Only Essential Cookies

    Manage Cookie Preferences

    Cookie Details Privacy Policy Imprint

    Privacy Preference

    Here you will find an overview of all cookies used. You can give your consent to whole categories or display further information and select certain cookies.

    Save All Save Accept Only Essential Cookies

    Back

    Privacy Preference

    Essential cookies enable basic functions and are necessary for the proper function of the website.

    Show Cookie Information Hide Cookie Information

    Name
    ProviderOwner of this website, Imprint
    PurposeSaves the visitors preferences selected in the Cookie Box of Borlabs Cookie.
    Host(s).skai.io, skai.io
    Cookie Nameborlabs-cookie
    Cookie Expiry1 Year
    Name
    ProviderOwner of this website
    Host(s)skai.io
    Cookie Namewordpress_sec_,wordpress_test_cookie,wp-postpass_*, wordpresspass_*, wordpressuser_*
    Cookie ExpirySession / 1 Year
    Name
    ProviderOwner of this website
    PurposeThis cookie stores selections made by the user in the Accessibe tool in order to maintain those settings on future visits. These cookies help us make our website compliant with our obligations under US law.
    Privacy Policy https://accessibe.com/privacy-policy
    Cookie NameacsbState, acsbReset
    Cookie Expiryn/a

    We use these cookies to enhance functionality and allow for personalisation, such as live chats, videos and the use of social media.

    Show Cookie Information Hide Cookie Information

    Accept
    Name
    ProviderOwner of this website
    Host(s).comeet.co, www.comeet.co
    Cookie Namevisid_incap_, nlbi_#######, incap_ses_, referrer22_00a, incap_ses_1364_2167377
    Cookie ExpirySession / 1 Year
    Accept
    Name
    ProviderOwner of this website
    Host(s).chilipiper.com, skai.chilipiper.com
    Cookie Namefs_uid, CHILI_PIPER_CLUSTER, guest-session, _sp_ses*, _sp_id*
    Cookie ExpirySession / 2 Years
    Accept
    Name
    ProviderOwner of this website
    Accept
    Name
    ProviderOwner of this website
    Host(s)skai.io
    Cookie NamemoduleFormPardotDownload
    Cookie Expiry30 days

    Statistics cookies collect information anonymously. This information helps us to understand how our visitors use our website.

    Show Cookie Information Hide Cookie Information

    Accept
    Name
    ProviderGoogle Ireland Limited, Gordon House, Barrow Street, Dublin 4, Ireland
    PurposeCookie by Google used for website analytics. Generates statistical data on how the visitor uses the website.
    Privacy Policy https://policies.google.com/privacy?hl=en
    Cookie Name_ga, _ga_*, _gat,_gat_*,_gid, GOOGLE_ABUSE_EXEMPTION, AEC, __Secure-ENID, SOCS, CONSENT
    Cookie ExpirySession / 2 Years
    Accept
    Name
    ProviderHotjar Ltd., Dragonara Business Centre, 5th Floor, Dragonara Road, Paceville St Julian's STJ 3141 Malta
    PurposeHotjar is an user behavior analytic tool by Hotjar Ltd.. We use Hotjar to understand how users interact with our website.
    Privacy Policy https://www.hotjar.com/legal/policies/privacy/
    Host(s)*.hotjar.com
    Cookie Name_hjClosedSurveyInvites, _hjDonePolls, _hjMinimizedPolls, _hjDoneTestersWidgets, _hjIncludedInSample, _hjShownFeedbackMessage, _hjid, _hjRecordingLastActivity, hjTLDTest, _hjUserAttributesHash, _hjCachedUserAttributes, _hjLocalStorageTest, _hjptid, _hjSessionUser_2229986, _hjIncludedInPageviewSample, _hjIncludedInSessionSample, _hjAbsoluteSessionInProgress, _hjFirstSeen
    Cookie ExpirySession / 1 Year
    Accept
    Name
    ProviderOwner of this website
    PurposeVWO is AB Testing software that we'll use to test different elements of the website - form placement, nav, different page layouts, etc.
    Privacy Policy https://vwo.com/compliance/cookies-notice/
    Host(s).skai.io, dev.visualwebsiteoptimizer.com
    Cookie Name_vis_opt_exp_{CAMPAIGNID}_goal_{GOALID}, _vis_opt_test_cookie, _vis_opt_exp_{CAMPAIGNID}_combi, _vis_opt_exp_{CAMPAIGNID}_exclude, _vis_opt_exp_{CAMPAIGNID}_split, _vis_opt_s, _vis_opt_out, _vwo_uuid, _vwo_uuid_{CAMPAIGNID}, _vwo_ds, _vwo_sn, _vwo_uuid_v2, _vis_opt_exp_{CAMPAIGNID}_combi_choose, _vwo_referrer, _vwo, _vwo_global_opt_out, _vwo_ssm, uuid
    Cookie ExpirySession / 10 Years

    Marketing cookies are used by third-party advertisers or publishers to display personalized ads. They do this by tracking visitors across websites.

    Show Cookie Information Hide Cookie Information

    Accept
    Name
    ProviderPardot
    PurposeCookie name associated with services from marketing automation and lead generation platform Pardot. The visitor value is the visitor_id in your Pardot account. This cookie is set for visitors by the Pardot tracking code.
    Host(s).pardot.com, pi.pardot.com, skai.io
    Cookie Namepardot, visitor_id*, lpv*
    Cookie ExpirySession / 10 Years
    Accept
    Name
    ProviderMeta Platforms Ireland Limited, 4 Grand Canal Square, Dublin 2, Ireland
    PurposeCookie by Facebook used for website analytics, ad targeting, and ad measurement.
    Privacy Policy https://www.facebook.com/policies/cookies
    Cookie Name_fbp,act,c_user,datr,fr,tr,m_pixel_ration,pl,presence,sb,spin,wd,xs
    Cookie ExpirySession / 1 Year
    Accept
    Name
    ProviderLinkedin
    Cookie Namelidc, li_gc, lang, AnalyticsSyncHistory, UserMatchHistory, li_sugr, bcookie, TDCPM, TDID, bscookie, ln_or
    Cookie ExpirySession / 1 Year
    Accept
    Name
    ProviderSkai
    Cookie Nameken_gclid
    Accept
    Name
    Provider6sense
    Cookie Name_gd_session, _an_uid, _gd_visitor, _gd_svisitor, 6suuid
    Cookie ExpirySession / 400 Days
    Accept
    Name
    ProviderGoogle Ireland Limited, Gordon House, Barrow Street, Dublin 4, Ireland
    PurposeCookie by Google used for conversion tracking of Google Ads.
    Privacy Policy https://policies.google.com/privacy?hl=en
    Cookie NameIDE, 1P_JAR, NID, _gcl_au, OTZ, test_cookie
    Cookie ExpirySession / 400 Days
    Accept
    Name
    ProviderOwner of this website
    Cookie NamePHPSESSID, sid, okto-autoposter-XXX, oktgid, oktsid, oktlogid-XXX, oktolead-XXX-Email, oktolead-XXX-Company, oktolead-XXX-FirstName, oktolead-XXX-LastName, oktolead-XXX-Phone, oktolead-XXX-Country, oktolead-XXX-Url, oktolead-XXX-State, oktolead-XXX-Comment, optout
    Cookie ExpirySession / 2 Years

    Content from video platforms and social media platforms is blocked by default. If External Media cookies are accepted, access to those contents no longer requires manual consent.

    Show Cookie Information Hide Cookie Information

    Accept
    Name
    ProviderWistia
    Host(s).wistia.com
    Cookie Namecb_anonymous_id, _sp_ses.2b40, _li_dcdm_c, __hssrc, _gcl_au, _clsk, hubspotutk, _sp_id.2b40, __hssc, __hstc, _uetsid, _uetvid, _gid, _ga, _ga_GQR109DZ3Y, _lc2, fpi, _ex-pricing-cta, _fbp, cb_group_id, cb_user_id, _clck
    Cookie ExpirySession / 400 Days
    Accept
    Name
    ProviderMeta Platforms Ireland Limited, 4 Grand Canal Square, Dublin 2, Ireland
    PurposeUsed to unblock Instagram content.
    Privacy Policy https://www.instagram.com/legal/privacy/
    Host(s).instagram.com
    Cookie Namepigeon_state
    Cookie ExpirySession
    Accept
    Name
    ProviderOpenstreetmap Foundation, St John’s Innovation Centre, Cowley Road, Cambridge CB4 0WS, United Kingdom
    PurposeUsed to unblock OpenStreetMap content.
    Privacy Policy https://wiki.osmfoundation.org/wiki/Privacy_Policy
    Host(s).openstreetmap.org
    Cookie Name_osm_location, _osm_session, _osm_totp_token, _osm_welcome, _pk_id., _pk_ref., _pk_ses., qos_token
    Cookie Expiry1-10 Years
    Accept
    Name
    ProviderTwitter International Company, One Cumberland Place, Fenian Street, Dublin 2, D02 AX07, Ireland
    PurposeUsed to unblock Twitter content.
    Privacy Policy https://twitter.com/privacy
    Host(s).twimg.com, .twitter.com
    Cookie Name__widgetsettings, local_storage_support_test
    Cookie ExpiryUnlimited
    Accept
    Name
    ProviderVimeo Inc., 555 West 18th Street, New York, New York 10011, USA
    PurposeUsed to unblock Vimeo content.
    Privacy Policy https://vimeo.com/privacy
    Host(s)player.vimeo.com
    Cookie Namevuid
    Cookie Expiry2 Years
    Accept
    Name
    ProviderGoogle Ireland Limited, Gordon House, Barrow Street, Dublin 4, Ireland
    PurposeUsed to unblock YouTube content.
    Privacy Policy https://policies.google.com/privacy?hl=en&gl=en
    Host(s)google.com
    Cookie NameCONSENT
    Cookie Expiry6 Month

    Borlabs Cookie powered by Borlabs Cookie

    Privacy Policy Imprint