Solution performance measurements

The measure solution performance task is used to describe performance measures, which uses collected data to assess the effectiveness of the solution and the value which it adds to the enterprise.

The performance measures are used to confirm the value of a newly implemented or an existing solution.

The performance measures used depend on the solution itself, the circumstances, and how the organization defines value.

If the solutions do not have existing performance measures, the business analyst should work with stakeholders to establish and gather performance measures that would best reflect the performance of a solution.

Performance may be analyzed through key performance indicators (KPI’s) which are in line with the enterprise goals and objectives for a project or tests for a software application.

There are three elements that can help with the measure solution performance task and they are:

1. Define Solution Performance Measures: if the business analyst determines that there are applicable existing performance measures, then they have to be checked for accuracy, relevance and performance measures gaps.

Solution performance measures may be derived from business goals, objectives, and business processes.

But performance measures may also be influenced or imposed by third parties such as solution vendors, government bodies, or other regulatory organizations.

The type and nature of the performance measurements need to be considered when choosing the right elicitation method.

2. Validate Performance Measures: the business analyst has to ensure that the performance measures being used are valid and useful.

The business analysts performs the validation by checking the validity of the performance measures with the stakeholders.

Specific performance measures should be aligned with any higher-level measures that exist within the context affecting the solution.

The project sponsor is often responsible for deciding which performance measures are used to evaluate the solution performance but, it may also be made by any stakeholder with decision-making authority.

3. Collect Performance Measures: the business analyst needs to use statistical sampling methods when defining performance measures.

When collecting the performance measures, the business analysts needs to consider the following:

a. Volume or Sample Size: a volume or sample size that is appropriate for the initiative needs to be selected. If the sample size that is too small the results might be skewered and lead to inaccurate conclusions.

But while a larger sample sizes may be more desirable, but it might be too difficult to obtain this.

b. Frequency and Timing: the frequency and timing with which the performance measurements were taken might influence the results, so it is important that they are chosen correctly.

c. Currency: recent performance measurements are usually more accurate than historical data. The business analysts use qualitative measures to support discussions which are used in the value estimation of the solution.

The stakeholders who are well informed about the operation and use of the solution should reach a consensus based on facts and any reasonable assumptions.