The Planning Survey 17 is the third edition of BARC’s annual report on the planning software market. Our research is primarily based on a sample of over 1,600 survey responses from software users and consultants around the world, providing detailed user feedback on 18 of the leading planning and budgeting software solutions on the market.

Our user survey covers issues ranging from the selection and purchase of software through to deployment and use, including questions about the success of planning software projects, the usability of each product and problems encountered.

The following links provide more detail on our survey methodology, the survey sample, and the way in which we categorize and rate planning products:

Sample, Products, Methodology & KPIs
0
Respondents
0
BI Products
0
Countries
0
Years

Components of The Planning Survey

The findings from The Planning Survey 17 are published across several bite-size documents (see below). These documents do not need to be read in sequence. ‘The Results’, and the ‘Vendor Performance Summaries’ can be read independently.

BARC also provides the raw data via a Web-based tool – The Planning Survey Analyzer – enabling users to carry out their own analysis of The Survey results.

The Results

An overview and analysis of the most important product-related findings and topical results from The Planning Survey 17.

The Analyzer

Our powerful interactive online tool, enabling you to perform your own custom analysis of the full survey data set.

Vendor Performance Summaries

A series of executive reports on each product featured in The Planning Survey 17. Each report contains an in-depth product review by BARC’s analyst team plus all of the relevant product-related results from The Planning Survey.

Want to buy The Planning Survey?

Are you interested in seeing the whole picture?

Contact us

Sample & Methodology

Much of the value of The Planning Survey 17 comes from its large, well-distributed and unbiased sample of survey responses. This section describes the characteristics of the people who took part in the study.
The Planning Survey 17 has the largest sample of any survey of planning and budgeting software users available on the market. As far as possible, we only draw conclusions from sub-samples containing at least 30 data points.
Our data cleansing rules are thorough and involve a number of different tests. All fraudulent or suspect data that purports to be from genuine planning software users is removed.

The sample of the Planning Survey

Sample size and make-up

Many thousands of people around the world were invited to take part in The Planning Survey 17, using dozens of email lists, magazines, and Web sites.

A summary of the online data collected is shown in the table, with the total of responses removed also displayed.

The number of responses is divided between users, consultants, and vendors. As in previous years, vendors answered a different set of questions to those answered by users (and consultants answering on behalf of users).

Responses removed from the samplesResponses
Total responses1,747
Removed during data cleansing-60
Total answering questions1,687
Total responses analyzedResponses
Users1,235
Consultants238
All users1,473
Vendors/Resellers143

Organization sizes by headcount

Planning and budgeting products are mostly found in large organizations, a fact reflected in the high percentage of responses we received from users in companies with more than 2,500 employees.

However, the level of responses from small organizations has been catching up over the years.

The split between respondents from small and large enterprises is well balanced this year.

The distribution of the Planning Survey by company size

Frequency of employee count in respondent organization (n= 1243)

Vertical markets

The chart on the right shows the breakdown of survey responses by industry sector. It only includes respondents who answered product-related questions in the survey (i.e. users and consultants).

Manufacturing comes out on top – as it has in previous years – with 30% of the sample.

Planning Survey respondents analyzed by industry

Respondents analyzed by industry (n=1525)

Planning Products in The Planning Survey

We require at least 30 user reviews for the survey results of any planning product to be analyzed in detail. In this year’s Planning Survey 18 planning and budgeting tools reached this threshold.

When grouping and describing the planning solutions featured in The Planning Survey, we do not always follow the naming conventions the vendors use to the letter. The names we use in The Planning Survey are sometimes abbreviated and are not always the official product names used by the vendors at the time of publication.

We asked respondents explicitly about their experiences with products from a pre-defined list, with the option to nominate other products. This list is updated each year and is based on the sample size of the products in the previous year, as well including new entrants to the planning market.

Where respondents said they were using an ‘other’ product, but from the context it was clear that they were actually using one of the listed products, we reclassified their data accordingly.

The table to the right shows the planning products included in our detailed analysis.

ProductNumber of reviews
Anaplan 28
Bissantz 56
BOARD 97
CALUMO 29
Corporate Planning 73
Cubeware 78
cubus 74
evidanza 36
IBM Planning Analytics 175
Infor 71
Jedox 99
LucaNet 34
Oracle Hyperion Planning 41
prevero 66
Prophix 39
SAP BPC 32
SAP BW-IP 31
Tagetik 30

Want to rate your BI software?

Participate in the world‘s largest and most comprehensive survey of BI software users

Take part in The BI Survey

The Peer Groups

A range of different planning and budgeting tools are featured in The Planning Survey 17 so we use peer groups to help identify competing products. This approach ensures we make fair and useful comparisons of planning tools that are likely to compete, for the benefit of readers and vendors alike.

The peer groups are defined each year by BARC analysts using their experience and judgment.

The segmentation of the peer groups is based on three key factors:

  • Flexibility – Is the solution development-oriented or does it provide predefined planning content (e.g. for financial planning)?
  • Specialization – is the vendor a performance management/planning specialist or a software generalist?
  • Geographical reach – does the vendor have a truly global reach? does it have a presence in the DACH region (Germany, Austria and Switzerland)?

Peer groups serve as a guide to the reader to help make the products easier to understand and to show why individual products return such disparate results. They are not intended to be a judgment of the quality of the products. Most products appear in more than one peer group.

DACH-focused planning vendors have a presence in the DACH region. They may also focus on other geographies, but they are not considered to be global vendors.

Development-oriented solutions allow customers to implement totally individual planning requirements.

These are flexible planning and budgeting solutions but also provide predefined planning content (e.g. for financial planning).

Global planning vendors have a truly global sales and marketing reach. They are present worldwide, and their planning products are used all around the world.

Products from software generalists who have a broad portfolio including most (or all) types of business software.

The KPIs

The KPIs are designed to help the reader spot winners and losers in The Planning Survey 17 using well-designed dashboards packed with concise information. There is a set of 18 normalized KPIs (which we refer to as ‘root’ KPIs) for each of the 18 products, as well as 4 aggregated KPIs based on aggregations of various combinations of ‘root’ KPIs.

A set of KPIs has been calculated for each of the six peer groups. The values are normalized according to the whole sample.

The KPIs all follow these simple rules:

  • Only measures that have a clear good/bad trend are used as the basis for KPIs.
  • KPIs may be based on one or more measures from The Planning Survey.
  • Only products with samples of at least 20 – 30 (depending on the KPI) for each of the questions that feeds into the KPI are included.
  • For quantitative data, KPIs are converted to a scale of 1 to 10 (worst to best).
  • A linear min-max transformation is applied, which preserves the order of, and the relative distance between, products‘ scores.
  • In some instances, adjustments are made to account for extreme outliers.

KPIs are only calculated if the samples have at least 15 – 30 data points (this varies depending on the KPI) and if the KPI in question is applicable to a product. Therefore some products do not have a full set of root KPIs.

Our methodology document describes all the KPIs and calculation methods in detail. See our methodology PDF.

Aggregated KPIsRoot KPIs
Business ValueBusiness benefits
Project success
Project length
CompetitivenessConsidered for purchase
Competitive win rate
Customer SatisfactionProduct satisfaction
Vendor support
Implementer support
Price-to-value
Recommendation
Customer ExperiencePerformance satisfaction
Ease of use
Planning functionality
Self-service
Reporting/analysis functionality
Predefined data connections
Flexibility
Integrated planning