XebiaLabs TestView is a test management and analytics tool, integrating the execution, data analysis and visualization of multiple functional and unit testing tools.
TestView can work with a number of testing tools and test result formats, including Selenium, FitNesse, Cucumber, Cucumber.js, JUnit, Appium, JMeter, Gatling, and TestNG. It can also be integrated with Jenkins which will push the test results to TestView when done with the specified tests.
A TestView Project is a set of Test Specifications, and there are four types of such specifications:
- Active: used to retrieve test results generated by supported testing tools
- Executable: used to run tests across multiple testing tools and import the results
- Passive: provides a place for Jenkins to push test results into
- Set: a collection of multiple specifications
After running tests, the logged data is collected and analyzed, resulting in a number of reports (charts) organized in dashboards. There can be multiple dashboards customized for different stakeholders, as Viktor Clerc, Product Manager of XL TestView, explained to InfoQ:
Currently, we allow for over ten different reports for functional testing tools. Way too many to properly visualize on a single dashboard. And, moreover, different stakeholders may have different needs regarding to the test results: the team would be more interested in ‘just the results’, whereas a test automation engineer would be interested in e.g. the duration trend of running all automated tests. Managers would be interested in an overall quality trend. Let alone including e.g. combined results of functional tests and performance tests in one dashboard. So, while providing all these kinds of insights in individual report, we also would like the possibility to provide tailor-made dashboards.
These reports include information and statistics on passed/failed tests, test flakiness, their duration, trends and comparison with previous tests results to see their evolution over time. By setting up qualification criteria, one can automatically determine if a set of tests has passed or failed, deciding to hit the release button or not.
Clerc told us they intend to add support for other testing tools in the future, and provide an API for developers to create custom plug-ins that would support proprietary tools.
TestView comes as a free Community Edition including a project and a dashboard, and two paid editions with support for multiple projects and dashboards.