The Planning Survey 21 is the seventh edition of BARC’s annual report on the planning software market. Our research is primarily based on a sample of 1,422 survey responses from software users and consultants around the world, providing detailed user feedback on 21 of the leading planning, budgeting and forecasting software solutions on the market.

Our user survey covers issues ranging from the selection and purchase of software through to deployment and use, including questions about the success of planning software projects, the usability of each product and problems encountered.

The following links provide more detail on our survey methodology, the survey sample and the way in which we categorize and rate planning products:

Sample, Products, Methodology & KPIs
0
Respondents
0
Planning Products
0
Countries
0
Years

Components of The Planning Survey

The findings from The Planning Survey 21 are published across several bite-size documents (see below). These documents do not need to be read in sequence. The Results and the Vendor Performance Summaries can be read independently.

BARC also provides the raw data via a web-based tool – The Planning Survey Analyzer – enabling users to carry out their own analysis of the survey results.

The Results

An overview and analysis of the most important product-related findings and topical results from The Planning Survey 21.

The Analyzer

Our powerful interactive online tool, enabling you to perform your own custom analysis of the full survey data set.

Vendor Performance Summaries

A series of executive reports on each product featured in The Planning Survey 21. Each report contains a vendor and product overview by BARC’s analyst team plus all the relevant product-related results from The Planning Survey.

Want to buy The Planning Survey?

Are you interested in seeing the whole picture?

Contact us

Sample & Methodology

Much of the value of The Planning Survey 21 lies in its large, well-distributed and unbiased sample of survey responses. This section describes the characteristics of the people who took part in the study.

The Planning Survey 21 has the largest sample of any survey of planning, budgeting and forecasting software users available on the market. As far as possible, we only draw conclusions from sub-samples containing at least 30 data points.

Our data cleansing rules are thorough and involve a number of different tests. All fraudulent or suspect data that purports to be from genuine planning software users is removed.

The sample of the Planning Survey

Sample size and make-up

Many thousands of people around the world were invited to take part in The Planning Survey 21, using dozens of email lists, magazines and websites.

A summary of the online data collected is shown in the table, with the total number of responses removed also displayed.

The number of responses is divided between users, consultants and vendors. As in previous years, vendors answered a different set of questions to those answered by users (and consultants answering on behalf of users).

Responses removed from the samplesResponses
Total responses1,422
Removed during data cleansing-70
Total answering questions1,352
Total responses analyzedResponses
Users915
Consultants236
All users1,151
Vendors/Resellers132

Organization sizes by headcount

Planning, budgeting and forecasting products are mostly found in large organizations, a fact reflected in the high percentage of responses we received from users in companies with more than 2,500 employees.

However, the level of responses from small organizations has been catching up over the years.

The split between respondents from small and large enterprises is well balanced this year.

Frequency of employee count in respondent organization (n= 953)

Vertical markets

The chart on the right shows the breakdown of survey responses by industry sector. It only includes respondents who answered product-related questions in the survey (i.e., users and consultants).

Manufacturing comes out on top – as it has in previous years – with 29% of the sample.

Respondents analyzed by industry (n=1221)

Planning Products in The Planning Survey

We require at least 30 user reviews for the survey results of any planning product to be analyzed in detail. 21 planning, budgeting and forecasting tools reached this threshold in this year’s Planning Survey.

When grouping and describing the planning solutions featured in The Planning Survey, we do not always follow the naming conventions the vendors use to the letter. The names we use in The Planning Survey are sometimes abbreviated and are not always the official product names used by the vendors at the time of publication.

We asked respondents explicitly about their experiences with products from a predefined list, with the option to nominate other products. This list is updated each year and is based on the sample size of the products in the previous year, as well including new entrants to the planning market.

Where respondents said they were using an ‘other’ product, but from the context it was clear that they were actually using one of the listed products, we reclassified their data accordingly.

The table to the right shows the planning products included in our detailed analysis.

ProductNumber of reviews
Anaplan33
Board45
CCH Tagetik36
Corporate Planning83
evidanza30
IBM Planning Analytics81
IDL31
Infor d/EPM30
Jedox49
LucaNet34
macs Software31
OneStream43
Oracle Cloud EPM39
Prophix34
SAP Analytics Cloud37
SAP BPC33
Serviceware Performance36
Unit4 FP&A31
Valsight40
Workday Adaptive Planning33

Want to rate your BI and analytics software?

Share your experience in the world‘s largest and most comprehensive survey of BI software users

Take part in The BI & Analytics Survey

The Peer Groups

A range of different planning and budgeting tools is featured in The Planning Survey 21, so we use peer groups to help identify competing products. This approach ensures we make fair and useful comparisons of planning tools that are likely to compete, for the benefit of readers and vendors alike.

The peer groups are defined each year by BARC analysts using their experience and judgment.

The segmentation of the peer groups is based on four key factors:

  • Focus – Is the product focused on and typically used for integrated corporate planning (including sales & operations planning as well as financial planning), financial performance management (including financial planning and financial consolidation) or business intelligence and analytics?
  • Specialization – Is the vendor a performance management/planning specialist or a business software generalist, offering a broader portfolio of enterprise software for a variety of business requirements?
  • Usage scenario – Is the product typically used in midsize/departmental implementations or large/enterprise-wide implementations?
  • Geographical presence – Does the vendor have a global reach and offer its products worldwide?

Peer groups serve as a guide to the reader to help make the products easier to understand and to show why individual products return such disparate results. They are not intended to be a judgment of the quality of the products. Most products appear in more than one peer group.

Besides planning and performance management, BI and analytics-focused products also target use cases such as reporting, dashboarding, (ad hoc) analysis and advanced analytics.

Business software generalists have a broad product portfolio including most (or all) types of enterprise software for a variety of business requirements (e.g., ERP).

Financial performance management products are often standardized applications that support use cases such as financial planning (P&L, balance sheet, cash flow) and financial consolidation. Typically, these products offer built-in financial intelligence with predefined business rules for financial management.

Global vendors have a truly global sales and marketing reach. They are present worldwide, and their products are used all around the world.

Integrated corporate planning products are focused on flexibly supporting a wide range of individual sub-plans in an integrated corporate planning approach. This not only includes sales and operations planning but also financial planning. Often, these products offer predefined planning solutions designed for particular applications (e.g., integrated financial planning, HR).

Products in this peer group are typically (but not exclusively) used in large scenarios and/or enterprise-wide implementations with a large number of users.

Products in this peer group are typically (but not exclusively) used in small and midsize scenarios and/or departmental implementations with a moderate number of users.

Performance management specialists are software vendors who focus solely on performance management and/or planning. Often, they have just one product in their portfolio.

The KPIs

The KPIs are designed to help the reader spot winners and losers in The Planning Survey 21 using well-designed dashboards packed with concise information. There is a set of 24 normalized KPIs (which we refer to as ‘root’ KPIs) for each of the 21 products, as well as 5 aggregated KPIs based on aggregations of various combinations of ‘root’ KPIs.

A set of KPIs has been calculated for each of the eight peer groups. The values are normalized according to the whole sample.

The KPIs all follow these simple rules:

  • Only measures that have a clear good/bad trend are used as the basis for KPIs.
  • KPIs may be based on one or more measures from The Planning Survey.
  • Only products with samples of at least 20 – 30 (depending on the KPI) for each of the questions that feeds into the KPI are included.
  • For quantitative data, KPIs are converted to a scale of 1 to 10 (worst to best).
  • A linear min-max transformation is applied, which preserves the order of, and the relative distance between, products‘ scores.
  • In some instances, adjustments are made to account for extreme outliers.

KPIs are only calculated if the samples have at least 15 – 30 data points (this varies depending on the KPI) and if the KPI in question is applicable to a product. Therefore some products do not have a full set of root KPIs.

Our methodology document describes all the KPIs and calculation methods in detail. See our methodology PDF.

Aggregated KPIsRoot KPIs
Business ValueBusiness Benefits
Project Success
Project Length
CompetitivenessConsidered for Purchase
Competitive Win Rate
Customer SatisfactionProduct Satisfaction
Vendor Support
Implementer Support
Price to Value
Recommendation
FunctionalityPredefined Connectors
Data Integration
Planning Content
Planning Functionality
Workflow
Forecasting
Simulation
Reporting/Analysis
Financial Consolidation
Customer ExperienceSelf-Service
Ease of Use
Flexibility
Performance Satisfaction
Sales Experience