"Every minute the world generates 1.7 million billion bytes of data, equivalent to 360,000 standard DVDs. More digitised data was created in the last two years than in the rest of human history. This trend and the mountains of data it produces is what we call 'Big Data'. The big data sector is growing at a rate of 40 percent a year." – 7 November 2013 European Commission Fact Sheet, What is data?
Think about that number.
360,000 DVDs (4.7GB per disc) worth of data per minute. And for some organisations that’s the tip of the iceberg.
"There's no doubt that knowledge is king. And today, when we're literally swimming in data, it's essential we're able to not only define and find data of real value but be innovative in where and how we use it. For any business that can do this, I believe, they will find true competitive advantage."
Partner, Analytics, Information and Modelling
Two years ago Facebook alone was storing 100 petabytes of data1
. That's all of the data from their near 1 billion plus 'active users'.
Then consider the estimated 154.6 billion emails sent globally every day (89 billion of which are corporate emails – a figure expected to grow at an average annual rate of 13 percent over the next four years2
Now add in every Twitter tweet (over 30,000 per second), every SMS, every data transfer, returned survey, indirect tax statement, bank transfer, Frequent Flyer and supermarket rewards card transaction, scanned data from supermarket checkouts, etc.... the list goes on.
Defining Big Data
All of which combines to become what we now call 'Big Data', a term that can be broken down into the three V's:
1. Volume – the amount of data
2. Velocity – how fast it is processed / analysed
3. Variety – the different types of data
• structured (databases, spreadsheets, etc)
• unstructured (emails, social media, SMS, etc)
And to make that even more complex, a fourth and a fifth are also key:
4. Veracity – the accuracy of that data and how it may relate to business value (remember that 'bad data in means bad data out')
5. Volatility – how long data is valid and how long it should be stored for. 5
Big data clearly deals with issues beyond volume, velocity and variety to other concerns like veracity and volatility. Needless to say, the potential value
of all of that data cannot be underestimated.
Business advantage through better insights
So the question is – how many organisations are making the best of what they’ve got? Are they using data analytics to identify and extract any valuable information and insights?
And the answer matters.
A recent Bain & Company study3
showed that those who were early adopters of Big Data analytics not only gained a substantial lead in the corporate world but those with advanced analytics capabilities outperformed their competition by a wide margin. Additionally, another European Commission study4
showed that 'data-driven decision making leads to 5-6 percent efficiency gains in the different sectors observed'.
It's no surprise then that data analytics is a quickly evolving area within businesses – with different organisations and industries at different stages or maturity.
Whoever has the knowledge has the power
Naturally, data analytics can be used by many different areas of the business for a variety of reasons. By being able to look deeper into the their data, directors and senior management can, for example, better tailor services and products to specific customers, minimise risk, boost innovative product and service development, make better management decisions, and improve decision-making.
The difficulty is in ensuring it is utilised in all departments, not just a select few. How can you recognise all potential benefits if you don’t share ideas, projects and insights that cover more than one or two key areas? How can you identify data of real value so you can adequately use it and protect it from risk (and being a risk)?
An entity-wide perspective is essential for optimal use of data analytics. As is being able to identify 'why' you want the information and 'how' it can add value and align to your business strategy.
This can mean utilising in-house capabilities – while ensuring those people have the right amount of expertise to analyse and interpret results – rather than outsourcing to external consultants.
Big Data, big uses, bigger advantage
Like Big Data itself, its potential is growing exponentially.
Google Flu Trends uses big data to predict the spread of the flu virus. Police departments use it to predict crime before it happens. Retailers use it to optimise their stock based on weather forecasts, social media and online search trends. And your employees, clients and suppliers are increasingly becoming aware of how their information is being used bringing broader public scrutiny (for example ABC Four Corners' story on external data usage and privacy in Sept 2013).
It's a clear indicator that for any company wanting to stay competitive, they have to start thinking seriously about data.
That means getting serious about privacy and data security, up-skilling those needed to analyse the data, investing in appropriate technology to make use of these large datasets and looking at ways and areas to broaden the ability to analyse and provide actionable insights.
Because in a world of data, knowledge is king. * This article represents the view of a group of directors on the topic of ‘Big Data’ held as part of KPMG’s Audit Committee Institute. Further articles will be developed that update audit committees with what they need to know about data analytics and Big Data.
1 Facebook IPO filing to the US Security and Exchange Commission on 1 February, 2012.
2 Email Statistics Report, 2012-2016. The Radicati Group, Inc.
3 Big Data: The organizational challenge. September 11, 2013 By Travis Pearson and Rasmus Wegener, Bain & Company.
4 Big Data for All: Privacy and User Control in the Age of Analytics. Omer Tene and Jules Polonetsky, September 20, 2012 (revised 1 November 2013).5 Source: www.insidebigdata.com