The analyze performance measures task is used to provide a deep understanding into the performance of a solution in comparison to the value it brings.
The measure solution performance task needs to be interpreted to be better understood. In order to understand the results of this task, the business analyst requires a complete understanding of the possible value that the stakeholders hope to attain with the solution.
To understand the performance measures results, variables such as the goals and objectives of the enterprise, key performance indicators (KPIs), the risk level of the solution and the risk tolerance of both the stakeholders and the enterprise needed to be attained.
There are five elements that can help with the analyze performance measures task and they are :
1. Solution Performance versus Desired Value: the business analysts need to analyze the the performance measures previously collected in the measure solution performance task in order to understand the solution’s value.
A solution might be performing very well for example an online ordering system, but it might also provide lower than expected value when compared with the performance measures.
While a low performing but potentially valuable solution, for example a time carding system, might be inefficient but it can also be enhanced to increase its performance level.
If the performance measures are not explicit enough to help the stakeholders determine the solution value, the business analysts would need to either collect more measurements or treat the lack of measures as a solution risk.
2. Risks: the performance measures may expose new risks to the solution performance and to the enterprise. These risks need to be identified and managed like any other risks.
3. Trends: once the performance data is collected, the business analysts need to analyze this data but they would also need to consider the time period in which the data was collected to guard against anomalies and skewer trends.
A large enough sample size over an adequate time period would provide an accurate picture of the solution performance which could be used to make decisions. Any noticeable and repeated trends, such as an increase in errors at certain times or a change in process speed when the volume is increased should be noted.
4. Accuracy: The performance measures need to be accurate to ensure the validity of their analysis. The business analysts should test and analyze the data collected by the performance measures to ensure that they are accurate.
To be considered accurate and reliable, the results of performance measures should be reproducible and repeatable.
5. Performance Variances: the variance between the expected and actual performance of the solution should be considered when analyzing solution performance.
A root cause analysis may be necessary to determine the underlying causes of significant variances within a solution. Recommendations on how to improve the performance and reduce any variances are made in the Recommend Actions to Increase Solution Value task.