The Data Management Survey is a brand new BARC research study focused on the data management tools market. Our research is primarily based on a major survey of 782 software users and consultants worldwide, and provides a wealth of user feedback on eleven of the leading data management solutions on the market today.

Our user survey covered issues ranging from the selection and purchase of software through to deployment and use, including questions about the success of software projects, the usability of each product and the challenges encountered.

The following links provide more detail on our survey methodology, the survey sample, and how we categorize and score data management tools:

Sample, Products, Methodology & KPIs
0
Respondents
0
Data Management Products
0
Countries
0
Year

Components of The Data Management Survey

The findings from The Data Management Survey are presented in a number of documents (see below). They do not need to be read in sequence. ‘The Results’, and the ‘Vendor Performance Summaries’ can be read independently.

The Data Management Survey Analyzer, a web-based, self-service tool enables users to carry out their own analysis of the survey results.

The Results

An overview and analysis of the most important product-related findings and topical results from The Data Management Survey 19.

The Analyzer

Our powerful interactive online tool, enabling you to perform your own custom analysis of the full survey data set.

Vendor Performance Summaries

A series of reports on each of the products featured in The Data Management Survey 19. Each report contains an in-depth product review by BARC’s analyst team plus all the relevant product-related results from The Data Management Survey.

Want to buy The Data Management Survey?

All the published survey results and expert analysis at your fingertips + full access to The Analyzer for your own further research

Contact us

Sample & methodology

Much of the value of The Data Management Survey lies in the large number and distribution of survey responses. With a sample of 690 responses, it is among the largest independent surveys into this topic in the world.

This section describes the characteristics of the people who took part in the study, including information on the type, company size and industry sector of participants.

The sample of the Planning Survey

Sample size and make-up

Many thousands of people were invited to take part in The Data Management Survey 19, using a range of media.

A summary of the online data collected is shown in the table, with the number of responses removed also displayed.

Our data cleansing rules are thorough and involve several different tests. All fraudulent or suspect data that purports to be from bona fide data management software users is removed.

The number of responses is divided between users, consultants and vendors. The questionnaire for vendors contains a different set of questions to those answered by users and consultants.

Responses removed from the sampleResponses
Total responses804
Removed during data cleansing-22
Total answering questions782
Breakdown of responsesResponses
Users500*
Consultants143*
All users690*
Vendors/Resellers87

*Users and consultants had the option to review more than one product.

Organization sizes by headcount

Data management products are mostly found in large organizations, a fact reflected in the high percentage of responses we received from users in companies with more than 2,500 employees.

However, the level of responses from mid-size organizations (100 – 2,500 employees) was not far behind on 36%. Participants from smaller companies (i.e., with less than 100 employees) formed the smallest grouping with 21% of the total number of responses.

The distribution of the Data Management Survey by company size

Frequency of employee count in respondent organization (n= 620)

Vertical markets

The chart on the right shows the breakdown of survey responses by industry sector. It only includes respondents who answered product-related questions in the survey (i.e., users and consultants).

The services industry tops the list with 22% of the sample, followed by industry with 19%.

Data Management Survey respondents analyzed by industry

Respondents analyzed by industry (n=582)

Products in The Data Management Survey

11 data management tools are analyzed in detail, having reached the inclusion threshold of 25 user reviews each.

For convenience, the product names we use in The Data Management Survey are sometimes abbreviated and are not always the official product names used by the vendors at the time of publication.

We asked respondents explicitly about their experiences with products from a predefined list, with the option to nominate other products.

Where respondents said they were using an ‘other’ product, but from the context it was clear that they were actually using one of the listed products, we reclassified their data accordingly.

The table to the right shows the data management products included in our detailed analysis.

Product
2150 Datavault Builder
AnalyticsCreator
Informatica PowerCenter
Microsoft Azure
Microsoft SQL Server
Microsoft SSIS
Oracle Database
Pentaho Data Integration
SAP BW
SAP BW on HANA
SAP BW/4HANA

Want to rate your BI software?

Participate in the world‘s largest and most comprehensive survey of BI software users

Take part in The BI Survey

The peer groups

The Data Management Survey 19 features a range of different types of data management tools so we use peer groups to help identify competing products. The groups are essential to allow fair and useful comparisons of products that are likely to compete.

The peer groups have been defined by BARC analysts using their experience and judgment, with segmentation based on usage scenario. These functional peer groups are mainly data-driven and based on how customers say they use the product.

Peer groups are intended to help the reader understand which products are comparable and why there is such a disparity of findings between all the individual products. The groupings themselves make no judgment on the quality of the products. Most products appear in more than one peer group.

Analytical database products prepare, store and provide data for analytical purposes.

Data warehouse automation products cover the data-driven or requirements-driven data warehouse design and implementation. Data warehouse automation products cover data-driven or requirements-driven data warehouse design and implementation. They mainly focus on the simplification and automation of data integration and data modeling tasks.

ETL products connect, extract, transform and load data from various source systems to a target system for analytical purposes.

Global vendors have a sales and marketing reach through subsidiaries and/or partners which gives them a truly global presence. They are present worldwide and their products are used all around the world.

The KPIs

The KPIs are designed to help the reader spot winners and losers in The Data Management Survey 19 using well-designed dashboards packed with concise information. There is a set of 12 normalized KPIs (which we refer to as ‘root’ KPIs) for each of the 11 products.

A set of KPIs has been calculated for each of the four peer groups. The values are normalized according to the whole sample.

The KPIs all follow these simple rules:

  • Only measures that have a clear good/bad trend are used as the basis for KPIs.
  • KPIs may be based on one or more measures from The Data Management Survey.
  • Only products with samples of at least 15 to 30 (depending on the KPI) for each of the questions that feed into the KPI are included.
  • For quantitative data, KPIs are converted to a scale of 1 to 10 (worst to best).
  • A linear min-max transformation is applied, which preserves the order of, and the relative distance between, products‘ scores.
  • In some instances, adjustments are made to account for extreme outliers.

KPIs are only calculated if the samples have at least 15 to 30 data points (this varies depending on the KPI) and if the KPI in question is applicable to a product. Therefore some products do not have a full set of root KPIs.

Our methodology document describes all the KPIs and calculation methods in detail. See our methodology PDF.

KPIs
Product satisfaction
Recommendation
Developer efficiency
Time to market
Data access
Price-to-value
Performance
Scalability
Maintenance efficiency
Compliance
Data governance
Skills availability