• DE&I Commitment
  • Careers
  • SIGN IN
  • Book a Meeting
    Book a Meeting
  • Company
    Learn a little more about us, our values, and our team
    Our Values
    We don't just talk the talk; we live by our core values
    About Us
    Empowering brands to realize their potential with data, insights, and technology
    Leadership
    Meet our leadership team
    Secure Data Architecture
    Our promise of data security and privacy. We keep your data safe from publishers, competitors and bad actors
    Corporate Social Responsibility
    We are committed to making a positive impact on our communities and our planet
  • Platform
    Plan, manage, optimize, and measure your campaigns with our omnichannel platform
    Omnichannel Advertising
    A platform that connects all walled garden media for more effective campaigns
    Data Connectivity
    Make data-driven decisions as you plan and strategize
    Product Capabilities
    Take your campaigns to the next level by enhancing your platform capabilities
    See the industries we serve
    Learn how our customizable solutions can help with your unique needs
    Explore our partner integrations
    See the media, retailer, and data partners we work with
  • Case Studies
  • News and Events
    Check out recent announcements and see what we’re up to
    Newsroom
    Check out our recent media mentions and announcements
    Events
    Join us for our next conference or webinar
    Omnichannel platform launch
    Read the press release to see how we're helping marketers win the walled gardens
    Cannes Lions 2023
    Don't miss your chance to meet with Skai leadership in Cannes
  • Resources
    From new releases, to industry trends and best practices, Skai has you covered
    Marketer Insights
    Read the latest blog posts and thought leadership from Skai and other industry experts
    Skai Research
    Explore our studies, reports and whitepapers so you can keep up on the latest industry trends
    Quarterly Trends Report
    See the key digital marketing trends from Q1 2023
    The Breakthrough
    The only resource hub built for marketers in the new era of omnichannel
Back to Blog

Powerful Test-and-Learn Insights from Microsoft Advertising Experiments + Skai Support

Blue Derkin, Senior Director, Product Marketing @ Skai

November  01, 2022
microsoft advertising experiments

A few years ago, Microsoft Advertising Experiments debuted. With this tool, marketers can execute standard A/B tests to experiment with campaign iterations to determine what variations work the best.

According to Microsoft Advertising, an experiment “is a duplicate version of your campaign that provides you with a controlled environment to monitor a change without fully launching it across your whole campaign. This way, you can run a true A/B test within a campaign to determine whether a particular update will work well for you and your business.”

 A few examples of Microsoft Advertising Experiments use cases might include:

  • Ad copy tests. Check messaging to find the ones with the best click-through rate or conversion potential.
  • Landing page URL tests. Experiment to see which landing pages result in better performance for your campaigns.
  • Bidding strategies and modifiers tests. See if a smart bidding tactic or different bid adjustments can drive incremental value.

For the most accurate results, Microsoft recommends running your experiment in what they call “A/A mode” for two weeks. This simply means that your original campaign and experiment campaign remain the same for the first two weeks. This allows you to validate that the experiment campaign is running the same as the original so that you can run a true A/B test.

After the initial two-week ramp-up period, check to see if the performance of the duplicate matches the original campaign. If it does, then you can start the actual A/B experiment. Once you make the desired change to your duplicate campaign, Microsoft Advertising recommends that you run the experiment for at least two more weeks (and four or more when testing complex bidding strategies like Target CPA and Maximize Conversions) to compare performance. 

Skai support enhances Microsoft Advertising Experiments 

Microsoft Advertising’s Experiments tool is now even better with Skai! Our platform helps foster a true test-and-learn culture for your paid search program by making A/B and Pre/Post tests easy to set up, analyze, and scale. 

Skai’s Experiments for Microsoft Advertising allows you to make decisions backed by better data for peak performance. 

With Skai you can easily:

Run experiments on everything to truly zero in on the best-performing elements of your campaign

Test multiple campaigns simultaneously for more conclusive results in a shorter time to insights. One of the main advantages of multi-campaigns is that one campaign may not have enough volume to reach statistically significant results. Grouping campaigns running the same test helps to get conclusive results much faster.

Exclude anomalies for a more accurate analysis. As anyone who has run many marketing experiments knows, anomalies often pop up that can skew test results. For example, if a tracking code was mistakenly deleted, a landing page URL accidentally switched, or something happened in the world that spiked or dropped conversion activity for a few days. 

In most of these cases, the marketing experiment has to be stopped and started over. With Skai Experiments, the practitioner needs only to identify those dates for the system, and that data will be excluded from the analysis. 

Easily exclude data from the dates you choose

Slice and dice daily results using Skai’s visual dashboards, leaving clunky data manipulation behind and confidently making quick decisions.

Skai Experiments offers at-a-glance insights

Scale testing with the ability to create Microsoft drafts and experiments campaigns in bulk. This is especially useful when you want to run many experiments simultaneously. It reduces the total time it takes to set up your experiments and reduces errors that can slow down your entire test-and-learn program.

“Monitoring our tests through Skai’s Experiments solution enhanced our confidence in the results and delivering those back to our clients—allowing for more strategic discussions regarding further tests and improvements.” — Nirmal Samarasinghe, Head of Performance, Kushinda.

Interested to learn more about Microsoft Advertising Experiments + Skai?

Skai empowers the world’s leading brands and agencies across industries to manage omnichannel digital marketing campaigns. Our omnichannel marketing platform includes solutions for retail media, paid search, paid social, and app marketing. 

We’ll keep you at the forefront of the digital evolution with data and insights, marketing execution, and measurement tools that work together to drive powerful brand growth.

To learn more, please schedule a brief demo to see all of our cutting-edge functionality firsthand.

Request a Demo of Skai

Related Posts

  • Use Skai to Master Microsoft Search Advertising’s Responsive Search Ads (RSAs)
    Read More
  • The Skai 5: Five RSA Quick Tips As Search Marketers Get Ready for the Shift
    Read More
  • Arm Microsoft Search Advertising With Your ‘True North’ Data Using Skai Custom Metrics
    Read More
  • Skai is Microsoft Advertising’s 2021 Independent Partner of the Year!
    Read More
  • Man holding a floating item in his hands that represents an audience of three people.
    Skai Supports Microsoft Advertising’s Remarketing and Customer Match
    Read More
  • Paid search predictions 2022 with Skai
    Looking Ahead with Skai: 2022 Paid Search Predictions
    Read More
  • Share on Facebook
  • Share on Twitter
  • Share on LinkedIn
  • Share via Email
  • Copy Link
    Copied!
Tags: Measure, Microsoft, Omnichannel, Optimize, Search, xPAx

    Subscribe to Updates

    Media that matters.
    Marketing that works.
    © 2023 Kenshoo, Ltd. All Rights Reserved.
    Privacy Policy. Cookie Policy. Recruitment Privacy Policy.
    • Connected Data
      • Market Intelligence
      • Our Approach
      • By Need
      • By Solution
    • Connected Strategy
      • Dynamic Marketing Mix
      • Budget Forecasting
      • Strategic Consulting
    • Connected Media
      • Overview
      • Retail Media
      • Paid Search
      • Paid Social
      • App Marketing
      • Auditing
      • Expert Services
    • Measurement
      • Incrementality
      • Experiments
      • Cross-Channel Attribution
    • Resources
      • Blog
      • Glossary
      • Case Studies
      • Training & Enablement
      • Developer Hub
      • The Breakthrough
    Privacy Preference

    We use cookies on our website. Some of them are essential, while others help us to improve this website and your experience.

    Privacy Preference

    Save All

    Save

    Accept Only Essential Cookies

    Manage Cookie Preferences

    Cookie Details Privacy Policy Imprint

    Privacy Preference

    Here you will find an overview of all cookies used. You can give your consent to whole categories or display further information and select certain cookies.

    Save All Save Accept Only Essential Cookies

    Back

    Privacy Preference

    Essential cookies enable basic functions and are necessary for the proper function of the website.

    Show Cookie Information Hide Cookie Information

    Name
    ProviderOwner of this website, Imprint
    PurposeSaves the visitors preferences selected in the Cookie Box of Borlabs Cookie.
    Host(s).skai.io, skai.io
    Cookie Nameborlabs-cookie
    Cookie Expiry1 Year
    Name
    ProviderOwner of this website
    PurposeThis cookie stores selections made by the user in the Accessibe tool in order to maintain those settings on future visits. These cookies help us make our website compliant with our obligations under US law.
    Privacy Policy https://accessibe.com/privacy-policy
    Cookie NameacsbState, acsbReset
    Cookie Expiryn/a
    Name
    ProviderOwner of this website
    Host(s)skai.io
    Cookie Namewordpress_sec_,wordpress_test_cookie,wp-postpass_*, wordpresspass_*, wordpressuser_*
    Cookie ExpirySession / 1 Year

    We use these cookies to enhance functionality and allow for personalisation, such as live chats, videos and the use of social media.

    Show Cookie Information Hide Cookie Information

    Accept
    Name
    ProviderOwner of this website
    Host(s).chilipiper.com, skai.chilipiper.com
    Cookie Namefs_uid, CHILI_PIPER_CLUSTER, guest-session, _sp_ses*, _sp_id*
    Cookie ExpirySession / 2 Years
    Accept
    Name
    ProviderOwner of this website
    Host(s).comeet.co, www.comeet.co
    Cookie Namevisid_incap_, nlbi_#######, incap_ses_, referrer22_00a, incap_ses_1364_2167377
    Cookie ExpirySession / 1 Year
    Accept
    Name
    ProviderOwner of this website
    Host(s)skai.io
    Cookie NamemoduleFormPardotDownload
    Cookie Expiry30 days

    Statistics cookies collect information anonymously. This information helps us to understand how our visitors use our website.

    Show Cookie Information Hide Cookie Information

    Accept
    Name
    ProviderGoogle Ireland Limited, Gordon House, Barrow Street, Dublin 4, Ireland
    PurposeCookie by Google used for website analytics. Generates statistical data on how the visitor uses the website.
    Privacy Policy https://policies.google.com/privacy?hl=en
    Cookie Name_ga, _ga_*, _gat,_gat_*,_gid, GOOGLE_ABUSE_EXEMPTION, AEC, __Secure-ENID, SOCS, CONSENT
    Cookie ExpirySession / 2 Years
    Accept
    Name
    ProviderHotjar Ltd., Dragonara Business Centre, 5th Floor, Dragonara Road, Paceville St Julian's STJ 3141 Malta
    PurposeHotjar is an user behavior analytic tool by Hotjar Ltd.. We use Hotjar to understand how users interact with our website.
    Privacy Policy https://www.hotjar.com/legal/policies/privacy/
    Host(s)*.hotjar.com
    Cookie Name_hjClosedSurveyInvites, _hjDonePolls, _hjMinimizedPolls, _hjDoneTestersWidgets, _hjIncludedInSample, _hjShownFeedbackMessage, _hjid, _hjRecordingLastActivity, hjTLDTest, _hjUserAttributesHash, _hjCachedUserAttributes, _hjLocalStorageTest, _hjptid, _hjSessionUser_2229986, _hjIncludedInPageviewSample, _hjIncludedInSessionSample, _hjAbsoluteSessionInProgress, _hjFirstSeen
    Cookie ExpirySession / 1 Year
    Accept
    Name
    ProviderOwner of this website
    PurposeVWO is AB Testing software that we'll use to test different elements of the website - form placement, nav, different page layouts, etc.
    Privacy Policy https://vwo.com/compliance/cookies-notice/
    Host(s).skai.io, dev.visualwebsiteoptimizer.com
    Cookie Name_vis_opt_exp_{CAMPAIGNID}_goal_{GOALID}, _vis_opt_test_cookie, _vis_opt_exp_{CAMPAIGNID}_combi, _vis_opt_exp_{CAMPAIGNID}_exclude, _vis_opt_exp_{CAMPAIGNID}_split, _vis_opt_s, _vis_opt_out, _vwo_uuid, _vwo_uuid_{CAMPAIGNID}, _vwo_ds, _vwo_sn, _vwo_uuid_v2, _vis_opt_exp_{CAMPAIGNID}_combi_choose, _vwo_referrer, _vwo, _vwo_global_opt_out, _vwo_ssm, uuid
    Cookie ExpirySession / 10 Years

    Marketing cookies are used by third-party advertisers or publishers to display personalized ads. They do this by tracking visitors across websites.

    Show Cookie Information Hide Cookie Information

    Accept
    Name
    ProviderLinkedin
    Cookie Namelidc, li_gc, lang, AnalyticsSyncHistory, UserMatchHistory, li_sugr, bcookie, TDCPM, TDID, bscookie, ln_or
    Cookie ExpirySession / 1 Year
    Accept
    Name
    ProviderSkai
    Cookie Nameken_gclid
    Accept
    Name
    Provider6sense
    Cookie Name_gd_session, _an_uid, _gd_visitor, _gd_svisitor, 6suuid
    Cookie ExpirySession / 400 Days
    Accept
    Name
    ProviderPardot
    PurposeCookie name associated with services from marketing automation and lead generation platform Pardot. The visitor value is the visitor_id in your Pardot account. This cookie is set for visitors by the Pardot tracking code.
    Host(s).pardot.com, pi.pardot.com, skai.io
    Cookie Namepardot, visitor_id*, lpv*
    Cookie ExpirySession / 10 Years
    Accept
    Name
    ProviderGoogle Ireland Limited, Gordon House, Barrow Street, Dublin 4, Ireland
    PurposeCookie by Google used for conversion tracking of Google Ads.
    Privacy Policy https://policies.google.com/privacy?hl=en
    Cookie NameIDE, 1P_JAR, NID, _gcl_au, OTZ, test_cookie
    Cookie ExpirySession / 400 Days
    Accept
    Name
    ProviderOwner of this website
    Cookie NamePHPSESSID, sid, okto-autoposter-XXX, oktgid, oktsid, oktlogid-XXX, oktolead-XXX-Email, oktolead-XXX-Company, oktolead-XXX-FirstName, oktolead-XXX-LastName, oktolead-XXX-Phone, oktolead-XXX-Country, oktolead-XXX-Url, oktolead-XXX-State, oktolead-XXX-Comment, optout
    Cookie ExpirySession / 2 Years
    Accept
    Name
    ProviderMeta Platforms Ireland Limited, 4 Grand Canal Square, Dublin 2, Ireland
    PurposeCookie by Facebook used for website analytics, ad targeting, and ad measurement.
    Privacy Policy https://www.facebook.com/policies/cookies
    Cookie Name_fbp,act,c_user,datr,fr,tr,m_pixel_ration,pl,presence,sb,spin,wd,xs
    Cookie ExpirySession / 1 Year

    Content from video platforms and social media platforms is blocked by default. If External Media cookies are accepted, access to those contents no longer requires manual consent.

    Show Cookie Information Hide Cookie Information

    Accept
    Name
    ProviderWistia
    Host(s).wistia.com
    Cookie Namecb_anonymous_id, _sp_ses.2b40, _li_dcdm_c, __hssrc, _gcl_au, _clsk, hubspotutk, _sp_id.2b40, __hssc, __hstc, _uetsid, _uetvid, _gid, _ga, _ga_GQR109DZ3Y, _lc2, fpi, _ex-pricing-cta, _fbp, cb_group_id, cb_user_id, _clck
    Cookie ExpirySession / 400 Days
    Accept
    Name
    ProviderMeta Platforms Ireland Limited, 4 Grand Canal Square, Dublin 2, Ireland
    PurposeUsed to unblock Instagram content.
    Privacy Policy https://www.instagram.com/legal/privacy/
    Host(s).instagram.com
    Cookie Namepigeon_state
    Cookie ExpirySession
    Accept
    Name
    ProviderOpenstreetmap Foundation, St John’s Innovation Centre, Cowley Road, Cambridge CB4 0WS, United Kingdom
    PurposeUsed to unblock OpenStreetMap content.
    Privacy Policy https://wiki.osmfoundation.org/wiki/Privacy_Policy
    Host(s).openstreetmap.org
    Cookie Name_osm_location, _osm_session, _osm_totp_token, _osm_welcome, _pk_id., _pk_ref., _pk_ses., qos_token
    Cookie Expiry1-10 Years
    Accept
    Name
    ProviderTwitter International Company, One Cumberland Place, Fenian Street, Dublin 2, D02 AX07, Ireland
    PurposeUsed to unblock Twitter content.
    Privacy Policy https://twitter.com/privacy
    Host(s).twimg.com, .twitter.com
    Cookie Name__widgetsettings, local_storage_support_test
    Cookie ExpiryUnlimited
    Accept
    Name
    ProviderVimeo Inc., 555 West 18th Street, New York, New York 10011, USA
    PurposeUsed to unblock Vimeo content.
    Privacy Policy https://vimeo.com/privacy
    Host(s)player.vimeo.com
    Cookie Namevuid
    Cookie Expiry2 Years
    Accept
    Name
    ProviderGoogle Ireland Limited, Gordon House, Barrow Street, Dublin 4, Ireland
    PurposeUsed to unblock YouTube content.
    Privacy Policy https://policies.google.com/privacy?hl=en&gl=en
    Host(s)google.com
    Cookie NameCONSENT
    Cookie Expiry6 Month

    Borlabs Cookie powered by Borlabs Cookie

    Privacy Policy Imprint