• DE&I Commitment
  • Careers
  • Locations
  • Book a Meeting
    Book a Meeting
  • Company
    Learn a little more about us, our values, and our team
    Our Values
    We don't just talk the talk; we live by our core values
    About Us
    Empowering brands to realize their potential with data, insights, and technology
    Leadership
    Meet our leadership team
    Secure Data Architecture
    Our promise of data security and privacy. We keep your data safe from publishers, competitors and bad actors
    Corporate Social Responsibility
    We are committed to making a positive impact on our communities and our planet
  • Platform
    Plan, manage, optimize, and measure your campaigns with our omnichannel platform
    Our Platform
    A platform that connects all walled garden media
    Connected Media
    Create and manage campaigns across search, social, retail media and apps, in one platform
    Connected Data
    Make data-driven decisions as you plan and strategize
    See the industries we serve
    Learn how our customizable solutions can help with your unique needs
    Explore our partner integrations
    See the media, retailer, and data partners we work with
  • Clients
  • News and Events
    Check out recent announcements and see what we’re up to
    News
    Check out our recent media coverage
    Events
    Join us for our next conference or webinar
    Omnichannel platform launch
    Read the press release to see how we're helping marketers win the walled gardens
    Let's talk omni at Shoptalk!
    Learn how our omnichannel platform can help you build a winning strategy
  • Resources
    From new releases, to industry trends and best practices, Skai has you covered
    Blog
    Read the latest insights and thought leadership from our industry experts
    Capabilities
    Take your campaigns to the next level by enhancing your platform capabilities
    Research
    Explore our reports and whitepapers so you can keep up on the latest industry trends
    Subscribe
    Sign up to get the latest updates straight to your inbox
    Quarterly Trends Report
    Learn digital advertising campaign performance trends from Q4 2022
Back to Blog

How Effective Taxonomies Transform Big Data Into Actionable Insights

Joshua Dreller, Sr. Director, Content Marketing @ Skai™

November  09, 2021
taxonomies

The human brain is primed to detect patterns and organize experiences into taxonomies. In fact, human intelligence is based upon our ability to group experiences into categories and concepts; when we experience something new, we’re able to respond intelligently and appropriately by instantly identifying how the new experience fits into the categories we’ve already learned.

Perhaps because our brains work this way naturally, it’s instinctive to apply taxonomic structures to complex concepts in the external world as well in order to make them easier to understand. Carolus Linnaeus, an 18th-century Swedish scientist, invented the Linnaen classification system of the natural world that we still use today (albeit in an updated form).

In 1869, the Russian scientist Dmitri Mendeleev invented the Periodic Table to simplify conversations around the building blocks of our existence. Websites, grocery stores, libraries, and many other well-organized digital and real-life spaces use taxonomy structures to arrange content and objects in logical, easy-to-find ways. 

Organizing a grocery store is one thing. Organizing an ever-growing collection of raw data is quite another. Although classification is key to making sense of and manipulating data, few data analytics companies are able to apply consistent, useful taxonomies to big data in a way that produces transformative insights.

Why do we need data taxonomies?

Digital data creation is growing at an exponential rate. Every day, Facebook users post more than 250 million photos to the platform. Every second, Instagram users upload 1,000 photos. About 10% of all consumers write online product reviews for the products they buy, and more than 30,000 new CPG products are launched each year.

Many of our experiences—as both people and organizations—have moved online, and we’ve left digital footprints everywhere. Brands that are able to harness the meaning behind all of that data can generate valuable insights into their consumers, competitors, and the overall marketplace. Those insights drive optimizations in marketing, messaging, product development, and more. But it’s not an easy thing to do, for three reasons:

  1. 80-90% of data is unstructured. Because data is generated and stored in a variety of formats and locations, there’s no single “owner” and no simple way to search or format all of it. The problem only gets harder to solve as data grows exponentially every day.
  2. Human communications are rarely straightforward. We’re clever with language. Hyperbole, jokes, sarcasm, and double entendres are common in a range of data types, especially social media posts and product reviews. Even when these data sources are structured and searchable, it’s hard to correctly tease out the nuance inherent in our language.
  3. Few unstructured data types speak the same language. While structured data types often use unique identifiers to connect with other types (such as a SKU), unstructured data types have no such commonalities. At a basic level, there may be multiple names (with multiple spellings) that describe the same thing; for example, consumers may misspell the word “avocado” or refer to it as “avo” in product reviews, while scientists and researchers may prefer the scientific name “persea americana”. Additional complexity is introduced when terms develop double meanings that make it difficult to extract context. If a skincare brand was searching for consumer sentiment around “avocado face mask” reviews, how many results today would actually be about cloth face masks with an avocado theme—a totally irrelevant yet identically named product?

The key to effective taxonomies

All data analytics companies can structure external data into taxonomies. But effective taxonomies—those that can provide specific, transformative insights – have an essential element: super granular, super-relevant taxonomy values that are consistent across all data sources and points. If every data point can be tagged using the same parameters that are important to the business, then every data point can be connected to every other.   

Classifying data into effective taxonomies is a game-changer for brands that want to make data-driven decisions. Taxonomies connect and organize all data across an organization, making it possible for data software platforms to quickly and easily search for information, extract sentiment, and generate meaningful visuals. Most interestingly, taxonomies allow brands to connect both market chatter and the voice of the consumer with their products, revealing a brand’s strengths, gaps, and opportunities. 

How effective taxonomies organize data

Imagine data points as individual books. Unstructured data is akin to haphazard piles of books everywhere and no card catalog to guide you to the information you want. A so-so taxonomy might organize the big pile of books into a few different stacks based on genre. If you were hoping to sort your books by the author’s last name or publication date, you’d be out of luck. 

An effective taxonomy is like a giant bookcase, with books organized onto shelves and tagged with thousands of specific attribute identifiers like genre, number of pages, publication year, author name, and any other tags that are important to your bookstore. The books can be easily reshuffled by identifier because every book, from comic books to scientific journals, uses the same taxonomy values, or Key Intelligence Parameters (KIPs).

Connecting two or more KIPs can generate trend predictions. For instance, to see if romance novels are becoming more popular over time, you could plot sales figures for books in the “romance” category. If your identifiers are appropriately specific, you can even roll some of them up into broader classifications for a more zoomed-out view of a category. Perhaps you know that a segment of your audience enjoys both biographies and academic texts; combining the two into a “non-fiction” category allows you to include more data sets for more accurate analytical results.

taxonomies

Taxonomies Broke the Mold

A platform that configures the most effective taxonomies possible uses three techniques:

  1. Using super granular KIPs. Every feature, benefit, ingredient, trend, SKU, competitor, and detail that’s important to a brand is included in its KIPs. Getting the specific KIPs right is the hardest part; once those are set, it’s easy to group several KIPs together under bigger themes to examine different angles on a trend or attribute. 
  2. Creating a shared language for all data types. It’s common for data analytics companies to structure all the unstructured data types they analyze. But many stop there, and structuring alone is not enough. Instead, all data should be both structured and normalized before building taxonomies; that second step is rare but essential for getting the most out of your data. Normalizing all data types with a Natural Language Processing (NLP) engine using the same taxonomy values effectively translates them all into the same language, making it possible to see how each KIP is naturally affecting or engaging with each other in all corners of the real world.
  3. Taking a flexible approach. Every data source has different levels of language specificity. Patents and scientific research papers are often the most specific in their language. By contrast, consumers will rarely start a social media discussion using the SKU of the product being discussed; instead, those conversations tend to be conducted at the product type level. The Skai platform has the flexibility required to ensure all use cases are represented in the data outputs. Rolling several taxonomy values together under a single umbrella will capture both the most specific mentions of a term as well as broader conversations about the same thing. So a CPG brand that’s interested in tracking trends in organic products can combine terms like “organic,” “100% natural”, and “no preservatives” under the same “organic” umbrella to fully capture all the ways that consumers talk about organic and organic-adjacent products. 

There is another type of flexibility, too: the ability to add new taxonomy values quickly, easily, and on demand for an early-stage view on what’s trending or happening in the world. New terms—like “biodiverse”, in the organic food world—and new developments in the world at large—like the COVID-19 pandemic—are simple to add to existing taxonomy values since all of our data is normalized.

How Skai configures data taxonomies

When creating taxonomy values for a category that’s new to Skai, we take two different paths to ensure total coverage. The first is a top-down approach. Every vertical already has some taxonomy values in common use, such as product filters, attributes that appear in product descriptions, and categories and subcategories in various ecommerce channels. We start with these familiar taxonomies. Then we add a bottom-up approach, running huge data sets through an NLP engine to surface meaningful keywords with a high recurrence. This helps us identify keywords that are harder to spot at scale using the top-down method.

Once the taxonomy values are identified, create custom combinations of values to reflect mega and micro trends. Combining values in this way presents new views on large market trends that affect several categories as well as very specific connections between, say, product attributes and perceived benefits for a particular product line.

PepsiCo, for example, used the Skai platform to track mega and micro trends across their entire portfolio of products to reveal new product development opportunities they had never seen before.

Brands like PepsiCo turn to Skai because nobody else can provide the level of granular insights that we can. And that’s all thanks to our taxonomies! Read the full case study.

To find out how Skai could help your brand do more with data, contact us for a demo.

Request a Demo

Related Posts

  • M&A planning and data at the table
    M&A Data Analytics Can Improve Your Business’ Decision-Making
    Read More
  • Multiple networks and connections
    6 Insights You Should Get from Your Market Intelligence Data
    Read More
  • Analyzing metrics and charts
    Market Intelligence vs. Market Research: What’s the difference?
    Read More
  • Woman looking and analyzing her computer screen while holding a pen in her hand.
    What is Modern Market Intelligence?
    Read More
  • The 10 Key Market Intelligence Data Sources Brands Should Focus On Right Now
    Read More
  • Skai’s Chief product officer guy cohen on market intelligenceSkai’s Chief product officer guy cohen on market intelligence
    The Skai 5: Five Questions About Market Intelligence With Skai’s Guy Cohen, Chief Product Officer 
    Read More
  • Share on Facebook
  • Share on Twitter
  • Share on LinkedIn
  • Share via Email
  • Copy Link
    Copied!
Tags: Data, Market Intelligence, xTLx

Subscribe to Updates

Media that matters.
Marketing that works.
© 2023 Kenshoo, Ltd. All Rights Reserved.
Privacy Policy. Cookie Policy. Recruitment Privacy Policy.
  • Connected Data
    • Market Intelligence
    • Our Approach
    • By Need
    • By Solution
  • Connected Strategy
    • Dynamic Marketing Mix
    • Budget Forecasting
    • Strategic Consulting
  • Connected Media
    • Overview
    • Retail Media
    • Paid Search
    • Paid Social
    • App Marketing
    • Auditing
    • Expert Services
  • Measurement
    • Incrementality
    • Experiments
    • Cross-Channel Attribution
  • Resources
    • Blog
    • Glossary
    • Case Studies
    • Training & Enablement
    • Developer Hub
Privacy Preference

We use cookies on our website. Some of them are essential, while others help us to improve this website and your experience.

Privacy Preference

Save All

Save

Accept Only Essential Cookies

Manage Cookie Preferences

Cookie Details Privacy Policy Imprint

Privacy Preference

Here you will find an overview of all cookies used. You can give your consent to whole categories or display further information and select certain cookies.

Save All Save Accept Only Essential Cookies

Back

Privacy Preference

Essential cookies enable basic functions and are necessary for the proper function of the website.

Show Cookie Information Hide Cookie Information

Name
Provider Owner of this website, Imprint
Purpose Saves the visitors preferences selected in the Cookie Box of Borlabs Cookie.
Host(s) .skai.io, skai.io
Cookie Name borlabs-cookie
Cookie Expiry 1 Year
Name
Provider Owner of this website
Purpose This cookie stores selections made by the user in the Accessibe tool in order to maintain those settings on future visits. These cookies help us make our website compliant with our obligations under US law.
Privacy Policy https://accessibe.com/privacy-policy
Cookie Name acsbState, acsbReset
Cookie Expiry n/a
Name
Provider Owner of this website
Host(s) skai.io
Cookie Name wordpress_sec_,wordpress_test_cookie,wp-postpass_*, wordpresspass_*, wordpressuser_*
Cookie Expiry Session / 1 Year

We use these cookies to enhance functionality and allow for personalisation, such as live chats, videos and the use of social media.

Show Cookie Information Hide Cookie Information

Accept
Name
Provider Owner of this website
Host(s) .chilipiper.com, skai.chilipiper.com
Cookie Name fs_uid, CHILI_PIPER_CLUSTER, guest-session, _sp_ses*, _sp_id*
Cookie Expiry Session / 2 Years
Accept
Name
Provider Owner of this website
Host(s) .comeet.co, www.comeet.co
Cookie Name visid_incap_, nlbi_#######, incap_ses_, referrer22_00a, incap_ses_1364_2167377
Cookie Expiry Session / 1 Year
Accept
Name
Provider Owner of this website
Host(s) skai.io
Cookie Name moduleFormPardotDownload
Cookie Expiry 30 days

Statistics cookies collect information anonymously. This information helps us to understand how our visitors use our website.

Show Cookie Information Hide Cookie Information

Accept
Name
Provider Google Ireland Limited, Gordon House, Barrow Street, Dublin 4, Ireland
Purpose Cookie by Google used for website analytics. Generates statistical data on how the visitor uses the website.
Privacy Policy https://policies.google.com/privacy?hl=en
Cookie Name _ga,_ga_*,_gat,_gat_*,_gid
Cookie Expiry 2 Months
Accept
Name
Provider Hotjar Ltd., Dragonara Business Centre, 5th Floor, Dragonara Road, Paceville St Julian's STJ 3141 Malta
Purpose Hotjar is an user behavior analytic tool by Hotjar Ltd.. We use Hotjar to understand how users interact with our website.
Privacy Policy https://www.hotjar.com/legal/policies/privacy/
Host(s) *.hotjar.com
Cookie Name _hjClosedSurveyInvites, _hjDonePolls, _hjMinimizedPolls, _hjDoneTestersWidgets, _hjIncludedInSample, _hjShownFeedbackMessage, _hjid, _hjRecordingLastActivity, hjTLDTest, _hjUserAttributesHash, _hjCachedUserAttributes, _hjLocalStorageTest, _hjptid, _hjSessionUser_2229986, _hjIncludedInPageviewSample, _hjIncludedInSessionSample, _hjAbsoluteSessionInProgress, _hjFirstSeen
Cookie Expiry Session / 1 Year

Marketing cookies are used by third-party advertisers or publishers to display personalized ads. They do this by tracking visitors across websites.

Show Cookie Information Hide Cookie Information

Accept
Name
Provider Linkedin
Cookie Name lidc, li_gc, lang, AnalyticsSyncHistory, UserMatchHistory, li_sugr, bcookie, TDCPM, TDID, bscookie, ln_or
Cookie Expiry Session / 1 Year
Accept
Name
Provider Skai
Accept
Name
Provider 6sense
Cookie Name _gd_session, _an_uid, _gd_visitor, _gd_svisitor, 6suuid
Cookie Expiry Session / 400 Days
Accept
Name
Provider Pardot
Purpose Cookie name associated with services from marketing automation and lead generation platform Pardot. The visitor value is the visitor_id in your Pardot account. This cookie is set for visitors by the Pardot tracking code.
Host(s) .pardot.com, pi.pardot.com, skai.io
Cookie Name pardot, visitor_id*, lpv*
Cookie Expiry Session / 10 Years
Accept
Name
Provider Google Ireland Limited, Gordon House, Barrow Street, Dublin 4, Ireland
Purpose Cookie by Google used for conversion tracking of Google Ads.
Privacy Policy https://policies.google.com/privacy?hl=en
Cookie Name IDE, 1P_JAR, NID, SOCS, CONSENT, AEC, _gcl_au, OTZ, test_cookie
Cookie Expiry Session / 400 Days
Accept
Name
Provider Meta Platforms Ireland Limited, 4 Grand Canal Square, Dublin 2, Ireland
Purpose Cookie by Facebook used for website analytics, ad targeting, and ad measurement.
Privacy Policy https://www.facebook.com/policies/cookies
Cookie Name _fbp,act,c_user,datr,fr,tr,m_pixel_ration,pl,presence,sb,spin,wd,xs
Cookie Expiry Session / 1 Year

Content from video platforms and social media platforms is blocked by default. If External Media cookies are accepted, access to those contents no longer requires manual consent.

Show Cookie Information Hide Cookie Information

Accept
Name
Provider Wistia
Host(s) .wistia.com
Cookie Name cb_anonymous_id, _sp_ses.2b40, _li_dcdm_c, __hssrc, _gcl_au, _clsk, hubspotutk, _sp_id.2b40, __hssc, __hstc, _uetsid, _uetvid, _gid, _ga, _ga_GQR109DZ3Y, _lc2, fpi, _ex-pricing-cta, _fbp, cb_group_id, cb_user_id, _clck
Cookie Expiry Session / 400 Days
Accept
Name
Provider Meta Platforms Ireland Limited, 4 Grand Canal Square, Dublin 2, Ireland
Purpose Used to unblock Instagram content.
Privacy Policy https://www.instagram.com/legal/privacy/
Host(s) .instagram.com
Cookie Name pigeon_state
Cookie Expiry Session
Accept
Name
Provider Openstreetmap Foundation, St John’s Innovation Centre, Cowley Road, Cambridge CB4 0WS, United Kingdom
Purpose Used to unblock OpenStreetMap content.
Privacy Policy https://wiki.osmfoundation.org/wiki/Privacy_Policy
Host(s) .openstreetmap.org
Cookie Name _osm_location, _osm_session, _osm_totp_token, _osm_welcome, _pk_id., _pk_ref., _pk_ses., qos_token
Cookie Expiry 1-10 Years
Accept
Name
Provider Twitter International Company, One Cumberland Place, Fenian Street, Dublin 2, D02 AX07, Ireland
Purpose Used to unblock Twitter content.
Privacy Policy https://twitter.com/privacy
Host(s) .twimg.com, .twitter.com
Cookie Name __widgetsettings, local_storage_support_test
Cookie Expiry Unlimited
Accept
Name
Provider Vimeo Inc., 555 West 18th Street, New York, New York 10011, USA
Purpose Used to unblock Vimeo content.
Privacy Policy https://vimeo.com/privacy
Host(s) player.vimeo.com
Cookie Name vuid
Cookie Expiry 2 Years
Accept
Name
Provider Google Ireland Limited, Gordon House, Barrow Street, Dublin 4, Ireland
Purpose Used to unblock YouTube content.
Privacy Policy https://policies.google.com/privacy?hl=en&gl=en
Host(s) google.com
Cookie Name CONSENT
Cookie Expiry 6 Month

Borlabs Cookie powered by Borlabs Cookie

Privacy Policy Imprint