The study, titled The State of Big Data Infrastructure: Benchmarking Global Big Data Users to Drive Future Performance, revealed the top five major obstacles to overcome for successful big data project implementation. These include: insufficient existing infrastructure (32 percent), organizational complexity (27 percent), security/compliance concerns (26 percent), lack of budget/resources (25 percent), and a lack of visibility into information and processes (25 percent).
Yet the benefits clearly outweigh the obstacles as 84 percent of large organizations have already, or plan to, implement a Big Data project within the next year. Managers cite improving customer experience (60 percent), acquiring customers (54 percent) and keeping up with competition (41 percent) as critical business factors and major drivers for deploying Big Data projects.
“This research uncovers the promise of Big Data and its application to a broad range of organizational priorities,” said David Hodgson, general manager, Mainframe, CA Technologies. “While organizations face challenges in tackling complexities associated with implementation efforts, the results overwhelmingly demonstrate that companies are committed to developing and deploying fully integrated Big Data strategies. By overcoming the obstacles, companies can successfully compete in the application economy.”
According to the survey, companies see Big Data as an important aspect of digital transformation in the application economy. Respondents report already seeing, or anticipating, benefits of increased revenue (88 percent), improved competitive positioning (92 percent), ability to provide new products or services (94 percent), and more effective targeted marketing campaigns (90 percent).
Additional key findings revealed:
- Virtually all (98 percent) respondents acknowledge that major investments are required to allow their Big Data projects to work well.
- More than half (56 percent) of respondents see scaling existing projects to address more data sources as a major priority for their Big Data projects.
- The majority of Big Data projects are independent, with one in five organizations having a project limited to a single department or area.
The amount of data organizations have has increased by an average of 16 percent in the last two years, which is predicted to rise by a further 24 percent in the next two years. The benefits of implementing Big Data projects as a way to succeed in the application economy ultimately outweighs the challenges for businesses. On average, respondents have experienced improvements of up to 21 percent due to successful Big Data projects.
The State of Big Data Infrastructure Whitepaper
Vanson Bourne conducted the CA Technologies-sponsored study of 1,000 IT managers in 11 countries from a range of sectors, including retail, financial services, banking, telecom, insurance, and government. The key elements of the study focused on the complexities and challenges organizations are facing with their Big Data infrastructure and environment.