Solution performance measurements are used to describe performance measures.
It does this by collecting data to assess the effectiveness of the solution and the value added to the organization by a newly implemented or an existing solution.
The performance measures used depend on the solution itself, the circumstances, and how the organization defines value.
If the solutions do not have existing performance measures, the business analyst should work with stakeholders to establish and gather performance measures that would best reflect the performance of a solution.
Performance may be analysed through key performance indicators (KPI’s) which are in line with the enterprise goals and objectives for a project or tests for a software application.
So how is the performance measured in a solution ?
There are three elements that can help with measuring the solution’s performance task and they are:
1. Define Solution Performance Measures: if the business analyst determines that there are applicable existing performance measures, then they have to be checked for accuracy, relevance and performance measures gaps.
Solution performance measures may be derived from business goals, objectives, and business processes.
But performance measures may also be influenced or imposed by third parties such as solution vendors, government bodies, or other regulatory organizations.
The type and nature of the performance measurements need to be considered when choosing the right elicitation method.
2. Validate Performance Measures: the business analyst has to ensure that the performance measures being used are valid and useful.
The business analyst can perform this validation by confirming the validity of the performance measures with the stakeholders.
Specific performance measures should also be aligned with any higher-level measures that exist within the context applicable to the solution.
The project sponsor is often responsible for deciding which performance measures are used to evaluate the solution performance but, it can also be made by any stakeholder with decision-making authority.
3. Collect Performance Measures: the business analyst needs to use statistical sampling methods when defining performance measures.
To properly collect the performance measures, the business analyst needs to consider the following:
a. Volume or Sample Size: a volume or sample size that is appropriate for the initiative needs to be selected. If the sample size that is too small the results might be skewered and lead to inaccurate conclusions.
But while a larger sample sizes may be more desirable, but it might be too difficult to obtain this.
b. Frequency and Timing: the frequency and timing with which the performance measurements were taken might influence the results, so it is important that they are chosen correctly.
c. Currency: recent performance measurements are usually more accurate than historical data. The business analysts use qualitative measures to support discussions which are used in the value estimation of the solution.
The stakeholders who are well informed about the operation and use of the solution should reach a consensus based on facts and any reasonable assumptions.