Big data refers to the large collections of data that may be analysed to reveal patterns, trends and associations, especially relating to human behaviour and interactions. Big data has already been explained in another article (Big data 1: What is big data?). This article will describe some real life examples of the use of big data for performance management and measurement purposes.
Performance management involves managing the organisation in order to ensure that it meets its objectives. Broadly, big data is relevant to performance management in the following ways:
Netflix began as a DVD mailing service and developed algorithms to help it to predict viewers’ preferences and habits. Now it delivers films over the internet and can easily collect information about when movies are watched, how often films might be stopped and restarted, where they might be abandoned, and how users rate films. This allows Netflix to predict which films will be popular with which customers. It is also being used by Netflix to produce its own TV series, with much greater assurance that these will be hits.
The world’s leading e-retailer collects huge amounts of information about customers’ preferences and habits which allow it to market very accurately to each customer. For example, it routinely makes recommendations to customers based on products previously purchased.
Airlines know where you’ve flown, preferred seats, cabin class, when you fly, how often you search for a flight before booking, how susceptible you are to price reductions, probably which airline you might book with instead, whether you are returning with them but didn’t fly out with them, whether car hire was purchased last time, what class of hotel you might book through their site, which routes are growing in popularity, seasonality of routes. They also know the profitability of each customer so that, for example, if a flight is cancelled they can help the most valuable customers first.
This information allows airlines to design new routes and timings, match routes to planes and also to make individualised offers to each potential passenger.
Target is a large discount retailer in the USA. There is an often quoted story about their ability to predict when a customer is pregnant – frequently before the customer has informed her family. By looking at about 25 products it is claimed that they can create a pregnancy predictor. For example, early pregnancy often causes morning sickness so consumers would perhaps change to blander food and less perfumed shower gel. Why would Target be interested in knowing whether a consumer is pregnant? Well that person will require different products during the pregnancy then in a few months the baby will have its own product needs: nappies, baby shampoo and clothes. Early identification of pregnancy can allow Target to establish the shopping habits of the mother and perhaps even the preferences of the child.
Walmart is an American retailer that operates in 28 countries around the world. It is the world’s largest company based on revenues. Many of Walmart’s customers buy online through the company’s website. Walmart wanted to make sure that customers can find what they are looking for on its website, so it developed its Polaris search engine. If customers are looking for a particular product, they enter the description in a search box, and the website displays products which meet that description.
What is unusual about Polaris is the way it ranks the search results. It attempts to show the products that the customer is most likely to buy towards the top of the list. The algorithm takes into account many factors, including the number of likes that the product has on social media networks and how many favourable reviews it has.
The system also uses artificial intelligence to learn so that it can continually provide better search results. If a phrase has been entered that the engine did not initially understand, for example, the engine can ‘learn’ what that phrase meant based on what the customer actually bought. Thus the system was soon able to figure out that when a user entered ‘House’ into the search box, they were probably looking for merchandise connected with the TV series of that name, not furniture or other items for their house. If someone searches for ‘Flats’, the engine has learned that they probably want to buy shoes, not apartments or flat screen TVs.
The metric that is used to measure the success of the website is customer conversion rate – the number of customers that actually buy a product after a search. It is estimated that the Polaris search engine has increased the conversion rate by between 10% and 15%. That is worth billions of dollars in extra revenue.
Beredynamic is a manufacturer of high quality audio products such as microphones and headphones. The company is based in Germany, but has a wide international sales and distribution network. The company wanted to improve its analysis of sales. Most ad hoc reports required data to be extracted from its legacy systems into a spreadsheet where the reports would then be manually compiled. This was time consuming, leading to delays in producing the reports. The reports themselves were not always accurate either.
The company developed a data warehouse that automatically extracts transactions from its existing ERP and financial accounting systems. The structure of this warehouse was carefully designed so that standard information is stored for each transaction such as product codes, country code, customer and region. This is supplemented by a web based reporting solution that enables managers to create their own reports, both standard and ad hoc, based on the data held in the warehouse.
The system allows the company to perform detailed analysis of sales, which helps it to identify trends in different products or markets. This leads to two business advantages. The first is that the sales and distribution strategy can be changed when demand changes in certain markets – for example, when sales of gaming headphones began to increase in Japan, the company introduced promotions for all its gaming products in that country, including a large advertising campaign and introduction of product bundles specially for the Japanese market. The second advantage is that production plans can quickly be changed as demand changes. If demand is falling, production is slowed to ensure that the company is not left with excessive inventory. If demand is expanding, production is increased to take advantage of higher sales.
The ability to provide more detailed analysis quickly can also be used for performance measurement and appraisal, for example, comparing actual sales with targets by region, assessing whether a promotion achieved the expected increase in profits. Such reports can be produced quickly based on real time data, meaning that management can respond quickly to any adverse variances.
The success of the new system is measured in terms of the growth in revenues and profits. While this seems simple, it has to be recognised that some growth would have been expected even if the system had not been implemented, so determining how much revenue growth has resulted from the greater analysis can be difficult. Assumptions need to be made.
A customer jokingly tweeted US chain Morton’s and requested that dinner be sent to the Newark airport where he was due to arrive late. Morton’s saw the tweet, realised he was a regular customer, pulled up information on what he typically ordered, figured out which flight he was on and then sent a waiter to meet him at the airport and serve him dinner.
Clearly this action was a publicity stunt which the restaurant hoped that their customer would publicise in future tweets. What it demonstrates is how easy it was for Morton’s to identify the customer who sent the tweet, and to ascertain what his favourite meal was. It also shows how companies like to influence social media users who have a large following as a means of increasing their own publicity.
It is difficult to measure the impact of interventions into social media. No doubt the happy customer would have communicated this story, and this may have improved the reputation of the restaurant, but it is very difficult to measure the impact of this on sales.
The cases above have shown how detailed analysis of data can be used in a number of different ways to improve the performance of an organisation. Big data can be used to understand customers and trends better, to provide insights into costs, and to make it easier for customers to find what they want on the website. Companies are likely to continue to identify innovative uses of the increasing volumes of data available to them, and analysis of big data is likely to grow in importance as an important strategic tool for many businesses.
Written by a member of the PM examining team