Measurement Performance Flashcards
Metric
A description of a project or product attribute and how to measure it.
Baseline
The approved version of a work product used as a basis for comparison to actual results.
Dashboard
A set of charts and graphs showing progress or performance against important measures of the project.
KPI’s
Key Performance Indicators
What reasons are measurements used for?
Evaluating performance compared to plan
Tracking the utilization of resources, work completed, budget expended, etc.
Demonstrating accountability
Providing information to stakeholders
Assessing whether project deliverables are on track to deliver planned benefits
Focusing conversations about trade-offs, threats, opportunities, and options
Ensuring the project deliverables will meet customer acceptance criteria
What is the value of measurements?
The conversations about how to use the data to take appropriate action.
What is NOT the value of measurements?
It is NOT in the collection and dissemination of the data.
The Performance Domain focuses on what measures?
Measures for ACTIVE projects. It addresses measures and metrics that are used DURING the project.
Key Performance Indicators (KPIs)
Are quantifiable measures used to evaluate the success of a project. They have no real use unless and until they are used.
What are the two types of KPIs?
Leading Indicators and Lagging Indicators
Leading Indicators
Predict changes or trends in the project.
Leading Indicators that are not quantifiable but provide early warning signs that project performance may be at risk.
Lack of risk management process.
Stakeholders who are not available or engaged.
Poorly defined project success criteria.
Lagging Indicators
Measure project deliverables or events. They provide information AFTER the fact.
SMART Metrics
Specific
Meaningful or Measurable
Achievable or Agreed to
Relevant or Realistic or Reasonable
Timely or Time Bound
A Specific Measurement
Specific as to what to measure. Examples include the # of defects, the defects that have been fixed, etc.
Meaningful Measurement
Should be tied to the business case, baselines, or requirements. It is NOT efficient to measure attributes that do not lead to meeting objectives or improving performance. AKA ‘Measurable’
Achievable Measurement
Achievable given the people, technology, and environment. AKA ‘Agreed to’
Relevant Measurement
Should provide value and allow for actionable information. AKA ‘Reasonable/Realistic’
Timely Measurement
Useful measurements are timely. Forward looking info, such as emerging trends, can help project teams change direction and make better decisions. AKA ‘ Time Bound’
Common categories of metrics are?
Deliverable Metrics
Delivery
Baseline Performance
Resources
Business Value
Stakeholders
Forecast
Customary Deliverable Metrics
Information on errors or defects
Measures of performance
Technical performance measures
Delivery Measurements
Associated with Work in Progress (frequently used in adaptive approaches).
Examples of Delivery Measurements
Work in Progress
Lead Time
Cycle Time
Queue Size
Batch Size
Process Efficiency
Lead Time
The amount of elapsed time from a story or chunk of work entering the backlog to the end of the iteration or the release. Lower lead time indicates a more effective process and a more productive project team.
Cycle Time
Indicates the amount of time it takes the project team to complete a task. Shorter times indicate a more productive project team. A consistent time helps predict the possible rate of work in the future.
Queue Size
Little’s Law states that queue size is proportional to both the rate of arrival in the queue and the rate of completion of items from the queue.
Batch Size
Measures the estimated amount of work (level of effort, story points, etc) that is expected to be completed in an iteration.
Process Efficiency
is a ratio used in lean systems to optimize the flow of work. Ratio between value-adding time and non-value-adding activities.
What adds to non-value-adding time?
Tasks that are waiting.
What is a representation of value-adding time?
Tasks that are in development or in verification.
Do higher or lower process efficiency ratios indicate a more efficient process?
Higher ratios.
What are the most common baselines?
Cost and Schedule.
What does a Schedule Baseline track?
Actual performance to planned performance.
Critical Path
The longest path through the project.
Schedule Variance (SV)
SV - EV - PV.
It is the difference between the earned value and the planned value.
Schedule Performance Index (SPI)
SPI = EV/PV.
Indicates how efficiently the scheduled work is being performed.
Feature Completion Rate
Can help assess progress and estimate completion dates and costs.
Examples of Schedule Measurements
Start and finish dates
Effort and duration
Schedule Variance (SV)
Schedule Performance Index (SPI)
Feature Completion Rates
Common Cost Measurements
Actual cost compared to planned cost
Cost Variance (CV)
Cost performance Index (CPI)
How else can ‘actual cost compared to planned cost’ be referred to?
The Burn Rate
Cost Variance (CV)
CV = EV - AC
The difference between the earned value and the actual cost. Comparing the actual cost of a deliverable to the estimated cost.
Cost Performance Index (CPI)
CPI = EV/AC
Indicates how efficiently the work is being performed with regard to the budgeted cost of the work.
Resource Measurements are a subset of what?
Cost Measurements
True or False, Do variances in resource measurements lead to variances in cost measurements.
Yes, they often do.
Usage Variance
= AU - PU
Planned resource utilization compared to actual resource utilization.
Price Variance
= AC - EC
Compares the actual cost of resources to the estimated costs.
What are Business Value Measurements used for?
To ensure the project deliverable stays aligned to the business case and the benefits realization plans.
What metrics measure financial business value?
Cost-benefit ratio
Planned benefits delivery compared to actual benefits delivery
Return on investment (ROI)
Net present value (NPV)
Cost-Benefit Ratio
= C/B
Measure of the expected present value (B) of an investment with the initial cost (C).
What is the cost-benefit ratio used for?
To determine if the costs of a project outweigh its benefits.
In the cost-benefit ratio, if costs outweigh the benefits, the ratio is higher than what?
1.0
In this case, the project should not be considered UNLESS there are regulatory, social good, or other reasons to do the project.
Benefit-Cost Ratio
= B/C
If the ratio is greater than 1.0, the project SHOULD be considered.
Return on Investment (ROI)
= Projected Average of all Net Benefits/Initial Cost
The amount of financial percent return compared to the cost.
Net Present Value (NPV)
the difference between the present value of inflows of capital and the present value of outflows of capital over a period of time.
When is Net Present Value generally developed?
When deciding to undertake a project.
Net Promoter Score (NPS)
Measures the degree to which a stakeholder (usually the customer) is willing to recommend a product or service to others. It measures a range from -100 to +100
Mood Chart
Tracks the mood or reactions of the project team, a group of very important stakeholders
Morale Measurement
Measures a project team morale. Can be done by surveys asking to rate agreement on a scale of 1 to 5.
Stakeholder Measurements
Net Performance Score (NPS)
Mood Chart
Morale
Turnover
Estimate to Complete (ETC)
= BAC - EV/CPI
Forecasts the expected cost to finish all the REMAINING project work.
Estimate at Completion (EAC)
= BAC/CPI
Forecasts the expected total cost of completing ALL work.
Variance at Completion
= EAC - BAC
Forecasts the amount of budget deficit or surplus.
To-complete Performance Index (TCPI)
Estimates the cost performance required to meet a specified management goal. It is expressed as a RATIO of the cost to finish the OUTSTANDING work to the REMAINING budget.
Regression Analysis
An analytical method where a series of input variables are examined in relation to their corresponding output results in order to develop a mathematical or statistical relationship.
Throughput Analysis
An analytical method that assesses the number of items being completed in a fixed time frame.
Information Radiators
AKA Big Visible Charts (BVCs) are visible, physical displays that provide information to the rest of the organization, enabling timely knowledge sharing.
Burndown Chart
Shows how much work is yet to be completed.
Burnup Chart
Shows how much work has been completed.
Task Board or Kanban Board
A visual representation of the planned work that allows everyone to see the status of the tasks. Can show work that is ready to be started (to do), work in progress (wip) and work that is completed.
Velocity
Measures the productivity rate at which the deliverables are produced, validated, and accepted within a predefined interval.
Hawthorne Effect
States that the very act of measuring something influences behavior.
Vanity Metric
A measure that shows data but does not provide useful information for making decisions.
Demoralization
Unrealistic or unachievable goals can be counterproductive.
Confirmation Bias
As human beings, we tend to look for and see information that supports our preexisting point of view. This can lead us to false interpretations of data.
Exception Plan
An agreed-upon set of actions to be taken if a threshold is crossed or forecast. Do NOT have to be formal.
Value Stream Map
A display of the critical steps in a process and the time taken in each step used to identify waste.
Value Stream Mapping
A lean enterprise method used to document, analyze, and improve the flow of information or materials required to produce a product or service for a customer.
