Nearly 40% of data professionals spend half of their time prepping data rather than analyzing it

More than 800 Digital Analytics Association (DAA) community members participated in the online survey, which was conducted between June 8 and July 14 of this year.* The DAA is composed of data professionals at every level, from C-suite leadership to in-the-trenches analysts. While the vast majority of members are employed by large corporations, consultants, government/non-profit workers and academics are also among DAA's members.

With a 3.3% margin of error at the 95% confidence level, TMMData and the DAA have analyzed the survey responses and are sharing the following key findings with the industry:

Disjointed, inaccessible data is a major productivity inhibitor for analysts, diverting skilled resources from contributing to valuable business intelligence.

Nearly two in five data (38.7%) professionals are spending more than half of their work week on tasks unrelated to actual analysis: 43.8% of managers reported that 51% or more of their team's work week is spent collecting, integrating and preparing data rather than analyzing it, while 31.3% of analysts said they spend 21 or more hours a week on data housekeeping.

Many data professionals struggle with data access. 43% of respondents named access as one of their top two analytics challenges. Nearly three in five respondents (56.9%) said it takes days or weeks to access all the data they need, and nearly 10% (9.8%) say they can rarely or never access a complete range of data sources. Only a third of data professionals (33.4%) are immediately able to access all their data, or can get it in less than a day.

As a result, a majority of analysts find it necessary to learn programming languages specifically to help them access or prepare data for analysis. Outside of mandates from their employers, a full 70% of analysts reported taking it upon themselves to learn to code for this reason, and more than a quarter of those analysts have spent 80 or more hours learning to program.

Data professionals lack confidence in data accuracy, which poses an existential threat to the industry.

The industry is split in terms of confidence in data accuracy, with a little more than half saying they are always or reasonably confident in the data their teams work with regularly (51.7%), and slightly less than half reporting that they question the accuracy of that data (48.3%). In fact, second only to data access, 26.7% of respondents identified inaccurate data as one of their top two analytics challenges. Data professionals tasked with analyzing organizational information meaningfully and actionably can't adequately perform their core job function without accurate data, incenting the industry to invest in data quality.

A lack of formalized data governance programs could be to blame for some of the uncertainty surrounding data quality; less than a quarter of respondents said their organization has a governance program in place (22.7%). Nearly one in five (18.2%) reported that each department is responsible for its own data governance, rather than having a comprehensive organizational governance program ensuring consistency across business units.

The industry recognizes its areas of inefficiency and is poised to make important investments that will free data professionals up to perform next-generation analysis.

The survey findings indicate a consensus among industry professionals on the importance of solving data access, integration and governance problems. In addition to the statistics already discussed, data integration was the most frequently cited investment priority for the upcoming year (as reported by more than 40% of management and 37.8% of staff). Nearly a third (32%) of respondents' organizations are planning or researching a formalized data governance program, and nearly 20% (19.4%) are in the early stages of rolling out their governance programs, primarily with the goal of ensuring that everyone is working with consistent data.

"Making analytics professionals more effective and valuable is at the core of the DAA's mission, so it's important for us to track the issues that create barriers in their daily work," said Marilee Yorchak, DAA executive director. "By collecting and sharing our findings on the impact of siloed, disjointed data with our members and the analytics industry at large, we believe we're both validating and elevating concerns that data professionals have had for years, and are more prepared than ever to tackle."

"In the decade that we've been providing data integration software to the industry, the roadblocks to efficient analysis have worn down to a small degree – but even as more nimble and sophisticated BI tools and analysis platforms evolve, clients are still coming to us with basic data access and preparation challenges," said Bob Selfridge, TMMData CEO and founder. "The industry as a whole still seems to be struggling to give analysts the quality data, quick access and self-service tools that will make it possible for them to focus on analysis rather than housekeeping."

TMMData is a member of the DAA. For more information on each organization, please visit their respective websites.

*Survey Methodology
TMMData partnered with the DAA to survey its community members via an email invitation to an online questionnaire, fielded between June 8 and July 14, 2017. More than 824 qualified responses were collected and analyzed to produce this press release and infographic with a 3.3% margin of error at the 95% confidence level.

About TMMData
TMMData simplifies the movement and enrichment of data for analysis through its self-service data integration, preparation and management platform Foundation. A range of users – from marketers and analysts to developers and engineers – rely on TMMData's enterprise-grade software to ingest data from any source, automate complex data synthesis and customize direct data outputs for delivery to any platform. Whether implemented in-cloud or on-premises, TMMData's powerful data governance and taxonomy functionalities ensure data quality and protection of sensitive information across data environments.

TMMData Foundation powers the data supply chains of clients including Comcast, FedEx, Blue Cross Blue Shield, the Pennsylvania State University, Expedia and others. TMMData was founded in 2008 outside of State College, Pa., and has additional offices in Philadelphia and Baltimore. For more information, visit TMMData.com.

About The Digital Analytics Association (DAA)
The DAA is a not-for-profit, volunteer-powered association whose mission is to make analytics professionals more effective and valuable through professional development and community. Its vision is advancing the profession of using data to improve business.

The DAA was founded as the Web Analytics Association in 2004. The organization has 4,000 members around the world, representing a broad spectrum of expertise. For more information about the DAA, or to become a member, visit the DAA website at https://www.digitalanalyticsassociation.org/.

SOURCE TMMData

Related Links

http://TMMData.com