At least 30 user reviews are necessary to be included in the detailed BI product analysis. In this year’s BI Survey we analyze 36 BI tools (or groups of products) in detail.
When grouping and describing the business intelligence solutions featured in The BI Survey, we did not strictly follow the naming conventions that the vendors use. In some cases, we combined various BI products to make analysis more convenient. Note that the names we use in The BI Survey are our own and are not always the official product names used by the vendors.
One of the key reasons for this is that the products we analyze are not necessarily the latest version of the tool. Vendors will often change a product’s name between versions, making it difficult to have a single official name for several versions of the same product.
Another reason is that we sometimes bundle related products into a single group to increase the sample size, even if the vendor prefers to view them as distinct for marketing reasons. In both these cases, the point is not to challenge the naming conventions of the vendor, but simply to reduce the complexity of the survey findings for the convenience of the reader. In some cases, we also shorten the names of the products to improve the formatting of charts.
We asked respondents explicitly about their experiences with products from a predefined list, with the option to nominate other products. This list is updated each year and is based on the sample size of the products in the previous year, as well as additional new products in the BI market. In cases where respondents said they were using an ‘other’ product, but from the context it was clear that they were actually using one of the listed products, we reclassified their data accordingly.
We solicited responses on all surviving products with more than a minimal response in the last BI Survey, plus a few others whose numbers had potentially grown to the point where there would be enough data to be analyzed.
The table shows the products included in the detailed analysis.
The last few years have seen an increase in the proportion of German respondents. This is partly due to cooperation with German vendors and the presence of strong German subsidiaries of international vendors, reflected through products like Bissantz, BOARD, Cubeware, cubus and SAP.
This year we also included a few new vendors such as Exago, Report One and ReportServer.