The Real Cost of Bad Data

The Real Cost of Bad Data | Blog | Featured Image

Data is everywhere and touches all aspects of our personal and business lives; it’s in the news every day to explain the government’s policies to deal with the Covid pandemic. Retail bosses use it to analyse our shopping habits and encourage us to buy more “stuff”. Business executives use it to make major strategic decisions about new product developments or production schedules.

The problem is that not all data is good data and if it is not used or managed correctly it can lead to poor outcomes with potentially catastrophic consequences for the population and individual businesses as well as the wider economy.

Many organisations fail to manage data correctly

Yet, according to a survey of 1,800 senior business leaders in North America and Europe carried out by Price Waterhouse Coopers and Iron Mountain in 2019, “three quarters of organizations surveyed lack the skills and technology to use their data to gain an edge on competitors. Even further, three out of four companies haven't employed a data analyst, and out of companies that do, only one quarter are using these employees competently”.

Bad Data Impacts on the Bottom line

This would seem to suggest that many organisations still do not recognise the true value of their data and moreover they don’t realise that bad data can have a major negative impact on their business and that it can actually cost them money on a daily basis. IBM has estimated that bad data costs the U.S. economy around $3.1 trillion dollars each year. Additional research from Experian also found that bad data has a direct impact on the bottom line of 88% of American companies, with the average company losing around 12% of its total revenue.

These staggering statistics come in spite of the increasing investment businesses are making in new business tools and AI initiatives. The fact is that the growth in the volume of data companies are accumulating seems to be inversely proportional to its quality with business leaders appearing to prefer to rely on their intuition when it comes to decision making.

Bad Data Equals Bad Decision Making

Bad data invariably leads to bad decision making that can have an impact right across the organisation especially on employee efficiency, marketing, R&D and on lower productivity levels. These are typical examples of how bad data has resulted in bad outcomes for some businesses:

#1 At an energy services company, its inconsistent supplier data resulted in incorrect payments and increased costs of entering the same data multiple times.

#2 At a telecommunications company, due to poor data quality underbilling resulted in revenue leakage of just over 3 percent of total revenue.

#3 At a call center, data inconsistencies led to a lack of trust in the data that negatively affected productivity through agents often increasing call times by needing to ask a customer to validate product, service, and customer data during an interaction.

#4 At the Department of Defense “… the inability to match payroll records to the official employment records cost millions in payroll overpayments to deserters, prisoners, and ‘ghost’ soldiers.”

These are just a few of the many cases where bad data has led to serious financial losses for the organisation but bad data can also have an impact in other areas with equally serious consequences. As we have all experienced during the recent health crisis, ensuring that hospitals have the capacity to cope with thousands of emergency cases has been a priority for politicians and healthcare managers and has relied heavily on the daily infection rate data being accurate and available. History will judge if they got this right or not.

Data Quality needs to be a top priority

While many businesses decisions do not have such serious life or death outcomes to consider, bad data for any business can mean lost revenue, reputational damage and loss of jobs, that can ultimately lead to closure. With over 40% (according to Gartner) of businesses failing to achieve their objectives due to missing, incomplete or inaccurate data, bad data is clearly a widespread problem and business leaders have a responsibility to their stakeholders and employees to put data quality at the top of their to-do list.

Learn how continuous testing can improve your business

IDS' Chief Technical Officer, James Briers, sheds light on the solutions to approaching complex data testing projects with mechanical efficiency.

grayscale-mountain