Technology & Innovation

Big data

October 26, 2011

Africa

October 26, 2011

Africa
Our Editors

The Economist Intelligence Unit

_____________________

An examination of the organisational characteristics of companies that are adept at extracting value from data

Executive summary

The era of big data is upon us. As ever-more data pour through the networks of organizations worldwide, the race is on to extract insight and value from this abundant resource. The opportunities are enormous, as are the challenges. But companies that master the emerging discipline of big data management can reap significant rewards and separate themselves from their competitors.

Indeed, research conducted by Eric Brynjolfsson, an economist at the Sloan School of Management at the Massachusetts Institute of Technology, shows that companies that use “data-directed decision-making” (defined “not only by collecting data, but also by how it is used—or not—in making crucial decisions”) enjoy a 5-6% boost in productivity.

In June 2011 the Economist Intelligence Unit conducted a global survey of 586 senior executives, sponsored by SAS, to look at the state of big data, along with the organisational characteristics of companies that are adept at extracting value from data. It also explores the most challenging aspects of data management. The research findings are as follows:

There is a strong link between effective data management strategy and financial performance. Companies that use data most effectively—what we define as strategic data managers in our taxonomy of big data users—stand out from the rest. Fifty-three percent of respondents in this group say their organisations achieve higher financial performance than their peers, compared with 36% overall. The survey shows that these companies recognise the significance of data and attribute the responsibilities for data management strategy most consistently to the C-suite; 47% of survey respondents in this group report that it is set by either the CEO or another C-level business executive. These businesses understand the potential of big data and are already leveraging their data to their competitive advantage, applying them to strategy development, product direction, market development and operational efficiency.

Extracting value from big data remains elusive for many organisations. For most companies today, data are abundant and readily available, but not well used. Survey results confirm this. Nearly one in four survey respondents says the vast majority of its company’s data are untapped. Another 53% say they only use about half of their valuable data. Yet 73% say that data collection in their organization has increased over the last year. These figures indicate that organisations are still learning how to manage big data.

Many companies struggle with the most basic aspects of data management, such as cleaning, verifying or reconciling data across the organisation. Nearly one-third of respondents admit their data governance practices are insufficient. Many struggle to deliver important data to the right people within an acceptable timeframe. And there is also a dearth of workforce skills required to sift through, analyse and develop insights from big data. Some experts believe that big data is not yet a boon to most businesses, and that there is an urgent need for more analytical capability. “Data will not answer questions by themselves,” says Eric Bradlow, co-director of the Wharton Business School Customer Analytics Initiative.

Companies that are furthest along the data management competency continuum—strategic data managers—provide a useful model for how organisations will need to evolve if they are to extract and utilise valuable data-driven insights. Strategic data managers use data to first identify specific measurements and data points that align closely with corporate strategic goals. They select the most appropriate data to make decisions, and put a high percentage of the data they collect to use. They are also more likely to assign a C-level executive to manage data strategy, and they continue to explore emerging sources of data for potential value.

Big data: sorting out the skill sets

Companies surveyed by the Economist Intelligence Unit fall into four loosely defined categories of big data management. Each group has specific characteristics, which we assessed by cross-referencing the responses of each group against those of the rest of the survey respondents:

  • Strategic data managers—companies that have well-defined data management strategies that focus resources on collecting and analysing the most valuable data
  • Aspiring data managers—companies that understand the value of data and are marshalling resources to take better advantage of them
  • Data collectors—companies that collect a large amount of data but do not consistently maximise their value
  • Data wasters—companies that collect data but severely underuse them

 

Enjoy in-depth insights and expert analysis - subscribe to our Perspectives newsletter, delivered every week