Ctrlflow Automated Error Reporting now comes with a much requested feature: charts and dashboards.
At the moment, you can choose from a dozen different chart types. These range from a simple pie chart showing the severity of reported problems to an elaborate scatter plot showing which of your projects are best at fixing problems. This multitude of chart types offers something for everyone, from quality engineers and developers to project leads and product managers.
So let’s have a look at a few examples on how a dashboard full of charts can improve your day-to-day workflow.
Triage the Most Important Problems First
If you are a quality engineer tasked with triaging incoming problems, the Problem Statuses pie chart is the perfect starting point for your task. It tells you exactly how many problems with an “Unconfirmed” status there are for you to work on.
Even better, clicking on the corresponding slice of the pie chart immediately takes you to the Top 20 problems with this status. This allows you to quickly drill down and see which problems affect the most users, so that you can triage those first.
Once you are done triaging a problem (see also our post on common triaging workflows with Ctrlflow Automated Error Reporting), you change its status to “New” and hand it over to your developer colleagues. They can then follow a similar route, using the Problem Statuses Pie chart to quickly get at the new problems that trouble your users the most.
Track Your Progress
If you are a project lead and your developers have been busy during the sprint fixing problems, then the Open/Closed Problems timeline chart is the perfect tool for you to monitor their progress. This chart not only shows you how many problems have been closed in a given time frame, but also how many new problems your users have opened during that time.
This allows you to see emerging trends, be they positive or negative, and to react to them.
Compare Your Projects
If you are a product manager overseeing multiple projects, then the Projects Activity bar chart shows you how your projects perform. You can not only see which projects are struggling with a large number of open problems and which projects have closed a lot of them, but you can also assess the crucial ratio between open and closed problems, which indicates overload.
If you have a large number of projects in your project group, you may want a more concise presentation of this crucial ratio. The Projects Activity scatter chart offers exactly that.
The above scatter chart displays those projects which are good at closing their incoming problems in the upper left part. Projects that receive more problems than they can handle can be found towards the lower right.
How to Add a Chart to Your Dashboard
Charts are available on the dashboard of both a project and a project group, i.e., a collection of projects. Visit the respective dashboard and click Edit Project or Edit Project Group. In the Dashboard Charts panel you can then add a new chart.
In addition to a Title you can give your chart an (optional) query, which selects the problems that form the basis of the chart from among all problems assigned to the project or project group in question.
The above Problem Statuses pie chart, for example, includes only those problems assigned to a project which have been created in the last month. This can be useful to see how quickly your quality engineers are able to triage problems and move them from “Unconfirmed” to “New” status.
More Ideas for Charts
Here are some more suggestions for useful charts:
- Is your application plagued by
NullPointerExceptions(the invention of which Tony Hoare called his billion dollar mistake)? Find out using the Exception Types pie chart (and consider using tools like Eclipse JDT’s Null Analysis or FindBug’s NP bug detectors.
- Are there still being new problems discovered every day? Use the Problems timeline chart to see whether saturation is in sight.
- Does the number of reports reach the limits of your SaaS plan? Find out using the Incidents timeline chart when it is time to upgrade.
Also, you can always export the charts’ raw data as
.tsv for further analysis with your favorite tool.
Have a look at our demo server to create a few charts and customize your dashboard.