Sentiment analysis has become a household phrase in this “era of the consumer” that has ushered in an acute focus for organizations towards customer experience, as both a necessity in business success and a core differentiator. Sentiment analysis in the context of customer experience refers to gaining an understanding of how your customers feel about your products, promotions, brands, or the interactions they have with your organization such as through the contact center.
Traditionally customer feelings have been measured through use of surveys, what Gartner refers to as Direct Voice of the Customer. While asking for direct feedback is a critically important component of measuring customer sentiment, surveys do have several limitations, one being that they only collect feedback from the small percentage of customers that actually respond. The small sample of respondents usually represents a dichotomy of customer groups – the very happy, or the unhappy. The contact center or customer engagement center represents a huge repository of data, that if tapped, could give you a much broader view of your customers’ sentiment, with limitless ability to ask different questions of the data that you are already capturing every day.
This two-part blog will explore how to achieve sentiment analysis with the use of speech and text analytics, and how to implement a sentiment model within an engagement analytics platform such as CallMiner Eureka.
What is “Sentiment Analysis” and why should you care?
According to Oxford Dictionaries Sentiment Analysis is:
The process of computationally identifying and categorizing opinions expressed in a piece of text, especially in order to determine whether the writer’s attitude towards a particular topic, product, etc., is positive, negative, or neutral.
Of course with the advent of speech analytics, sentiment analysis is not limited only to written text, but can also be extracted from spoken word. Contact centers record an estimated nine million hours of calls per day in the United States alone (extrapolated from Pelorus Associates Interaction Recording report). According to The Northridge Group, 48% percent of consumers still prefer to use voice channel for their mode of engaging with organizations, more than double that of any other channel, but of course live support through text channels such as chat, email, and Facebook messenger are growing rapidly. Through all of these customer communications and the associated data collected with them, there is a treasure trove of opportunity to extract and analyze customer sentiment.
The best news is you don’t have to conduct surveys in order to get at this data. While surveys do allow your customers to provide you direct feedback about how they feel, there are several key limitations to relying on surveys to understand customer sentiment.
For starters, response rates are low. According to the American Customer Satisfaction Index, response rates to customer surveys range between 5 and 15%, and as the volume of surveys are increasing (SurveyMonkey alone collects more than 3 million responses a day), response rates are continuing to decline (this article from survey vendor Medallia with suggestions on how to combat response issues). This means that your analysis of customer attitude through surveys only represents a small portion of your customer base, and typically only the dissatisfied or extremely satisfied customers will take the time to respond. This won’t give you a true measure of customer sentiment towards your brand, products, or promotions. The short falls of sampling to collect feedback can be avoided by leveraging the already captured customer interactions to extract customer sentiment through analytics. You already have all the “responses” in your interaction archives, in data that is just waiting to be mined. Interaction analytics (aka customer engagement analytics) will give you a better understanding across your customer base for how they feel towards various elements within your organization.
Surveys are also limited largely to the questions asked within the survey. Best practices suggest surveys should be a maximum of 10 questions according to Survey Gizmo (and find more in depth data from Survey Monkey). To gather additional information, particularly if you need to dig into a particular reason for specific response, would require another survey, and the likelihood of getting the same respondents is slim to none. Surveys limit your ability to get context, or to be able to ask the “how” or “why” associated with the questions asked. Using interaction analytics to analyze your existing interactions allows you to return to the data over and over with additional questions. You have the ability to filter, target and dig in deep in certain areas as desired. Such analysis can even greatly inform what questions you should be asking when you do conduct a survey.
The last shortcoming of surveys is speed to intelligence, or lack thereof. In order to collect feedback, you have to determine the questions to ask, construct the survey, issue the survey, wait for responses, and then analyze the responses. Yes – analytics requires some of the same “setup” in terms of configuring the queries or searches to help ask the questions of the data you desire, but once configured, “responses” or insight can be gathered in near real-time as your customer engagement center continues to have interactions with your client base.
This is not to say you shouldn’t be surveying and collecting that direct feedback, but if you are only relying on surveys to understand your customers’ sentiment, you’re missing a big opportunity and may be making decisions based on inaccurate data.
How Interaction Analytics measures sentiment (and why it’s better than traditional approaches)
In order to measure your customers’ sentiment towards various topics with Interaction Analytics, you need a sentiment model. Most sentiment models are black boxes, that look at your conversation and give you a rating. But let’s breakdown the anatomy of one approach to measuring sentiment.
First off you need to look for your customers’ expressions of positive or negative sentiment. You might also be able to look “neutral” sentiment or for simplicity, the absence of expressions of positive or negative sentiment is indicative of neutral sentiment. There are all kinds of sources of expressions of sentiment online, but simply put, positive expressions of sentiment would include various positive adjectives such as good, wonderful, awesome. Similarly, expressions of negative sentiment would be defined by list of negative descriptors such as bad, terrible, or awful.
Within the presence of what we’ll call either “intensifiers” or “inverters”, such expressions of sentiment can have varying degrees of positive or negative sentiment, or they may even have the opposite meaning. To state something is “bad” is not as condemning as it is to state something is “very bad”. And to state something is “not bad”, means the inverse, but likely doesn’t mean it is as good as saying it is “good”. If you think of sentiment as a score ranging from -10 to 10 you can see how various combinations of expressions of sentiment can range from having very high negative sentiment, through to neutral, through to very high positive sentiment, depending on the language used.
Interaction analytics is purpose built for looking for your customers’ use of certain language within their conversations or interactions with you. And some interaction analytics systems (such as CallMiner Eureka) support sophisticated scoring models to allow for the creation of indices as described in the previous paragraph.
Having a sentiment model is only the start of the process. The next step is to not just get sentiment “as a whole”, but rather to apply that sentiment model to different parts of the conversation. For example – what is the overall or trend in sentiment of a specific segment of your customers. How does it compare to other segments of your customer base? More importantly, what is the “sentiment score” near references to specific products, product features, policies, or promotions? Powerful analytics solutions allow you to conduct this type of query or questions of your data by essentially stitching together building blocks of queries that identify references to products or features, and positive or negative sentiment.
To learn more about how you can leverage CallMiner Eureka in sentiment analysis, click here to reach out to a Customer Engagement Analytics specialist at CallMiner, and stay tuned for part 2 of this blog in our product user form.
For CallMiner customers and partners, find part 2 of this blog here -