Webinar Recap: Project Performance Measurement – Part 1: Overview Of Project Performance Measurements

MPUG

Please find below a transcription of the audio portion of Fletcher Hearn’s session, Project Performance Measurement – Part 1: Overview Of Project Performance Measurements, being provided by MPUG for the convenience of our members. Fletcher Hearns: What can be measured?

Phrases Used for Technical Performance Measures

Herding Cats

All project progress is measured independent of resources expended - Mr. Gary Bliss, Director Performance Assessment and Root Cause Analysis (PARCA), US Department of Defense. Call me when you find a customer who thinks it is cheaper to not plan and forecast the short, medium, and long term expected performance in exchange for a planned cost, delivered at the needed date to fulfill the business mission. Measuring progress must be in units meaningful to the decision maker.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Webinar Recap: Project Performance Measurement – Part 2: What to Measure and How to Report

MPUG

Please find below a transcription of the audio portion of Fletcher Hearn’s session, Project Performance Measurement – Part 2: What to Measure and How to Report, being provided by MPUG for the convenience of our members. This one covering, What to Measure and How to Report.

Project Management, Performance Measures, and Statistical Decision Making

Herding Cats

There is a current rash of suggestions on how to improve the performance of software projects. I work in the Software Intensive System of Systems domains in Aerospace, Defense, Enterprise IT (both commercial and government) applying Agile, Earned Value Management, Productive Statistical Estimating (both parametric and Monte Carlo), Risk Management, and Root Cause Analysis with a variety of capabilities. Figure 1 - Planned Estimates versus Actual Performance from [1].

How to Talk About Estimates

Herding Cats

What is an estimate? An estimate as a noun is an approximate calculation or judgment of the value, number, quantity, or extent of something. An estimate as a verb is to roughly calculate or judge the value, number, quantity, or extent of. But those estimates, nouns, and verbs themselves's have other attributes. Every month there is a Month End reports, both showing cumulative cost to date, cumulative schedule performance, and Physical Percent Complete.

4 Fallacious Reasons to Estimate and Why Those Are Fallacious

Herding Cats

There's a recent post titled Four Fallacious Reasons to Estimate. It lists the usual suspects for why those spending the money think they don't have to estimate how much they plan to spend when they'll be done producing the value they've been assigned to produce for that expenditure. And like many posts and tweets about estimating, it's made from this point of view, not the business point view, not from the point of view of those paying the developer.

Compendium of Works to Increase Probability of Project Success

Herding Cats

Project Performance Management (#PPM). Technical Performance Measures (#TPM). Cost, Schedule, and Technical Performance Management (#CSTPM). Governance (#Governance). The overarching theme is focused on defining what Done looks like, assessing progress toward Done in units of measure meaningful to the decision makers. Those units always start with Measures of Effectiveness and Measures of Performance. Governance.

2019 37

Increasing the Probability of Project Success

Herding Cats

These charts are an extract from the book Performance-Based Project Management: Increasing the Probability of Project Success and the abstracted training materials Handbook. How to Avoid the "Yesterday's Weather" Estimating Problem. Capabilities Earned Value Estimating Governance Management Performance-Based Project Management® Principles Requirements Risk Root Cause Analysis Technical Performance Measures

2017 69

Deconstructing the Hertz and Accenture Debacle

Herding Cats

A recent lawsuit by Hertz Rental Car against Accenture has turned into a rallying cry by Agilest and No Estimates advocates. Of course, No Root Cause analysis has been performed by these advocates, but it makes good click bait for their followers. Were there: Measures of Effectiveness. Measures of Performance. Key Performance Parameters. We play this role in ERP acquisitions for commercial and government clients .

2019 36

Project Versus Product in Agile Development

Herding Cats

But if the development work is a Project is a fixed period of performance, for a fixed (with margin) budget, and a fixed set of Capabilities, then the question is can agile be used to develop the software? Developers may be working on a Product, but the CFO is recording the work as a Project that has a bounded period of performance, a bounded budget, a bounded set of Capabilities, from which revenue will be generated.

2018 38

What is an Estimate? What is Estimating?

Herding Cats

I work in a domain where estimates are made every single week. Estimate to Complete (ETC), Estimate at Completion (EAC), Estimated Completion Date (ECD) are the life blood of our software intensive system of systems programs. There are several partitions of this information that are common in building the Performance Measurement Baseline (PMB). In the #NoEstimates paradigm, the term estimate is redefined to be Forecast and relabeled as NOT Estimating.

Value First, Requires Margin and Contingency

Herding Cats

The principles of microeconomics of decision making in the presence of uncertainty mandates you make estimates of how to achieve that Value in terms of cost and schedule, those three (and all) variables are random variables, usually driven by a stochastic process. NoEstimates Agile Decision Making Estimating Governance Planning Principles Scheduling Technical Performance MeasuresThere's a popular notion in Agile that says Focus on Value.

2018 36

Biases in Project Management and How to Remove Them

Herding Cats

There is always lots of complaining about the biases introduced into managing projects and making the estimates needed to make project decisions. What dos Done look like in units of measure meaningful to the decision makers? What are the measures of physical percent complete needed to inform the decision makers of progress to plan in order to take corrective or preventive actions to stay on plan?

From Mission Capabilities to Done

Herding Cats

No matter the project domain or the technical development method, project success is dependent on knowing what Done looks like in units of measure meaningful to the decision maker. These measures are: Measures of Effectiveness (MOE) – are the operational measures of success that are closely related to the achievements of the mission or operational objectives evaluated in the operational environment, under a specific set of conditions.

2017 35

Increasing the Probability of Program Success

Herding Cats

We're working on a White Paper for the Joint Space Cost Council which is an organization composed of government (NRO, NASA, USAF, and others) and industry representatives with an interest in space. The origins of this paper came about at a recent JSCC meeting here in Boulder, with local Aerospace contractors, the DCMA (Defense Contract Management Agency) and several government agencies (NRO and NASA). Top Four Sources of Unfavorable Program Performance. Estimating Processes.

2017 34

Risk Management in Five Easy Pieces, with Apologies to Jack

Herding Cats

Managing Cost, Schedule, & Technical Performance Risk Is The Basis Of Good Project Management. Certain information about key project cost, performance, and schedule attributes are often unknown until the project is underway. What are the “units of measure” for this increasing maturity? The answers to each of these questions require making estimates in the presence of uncertainty. No Point Estimate of Cost or Duration can be Correct.

2017 37

Connecting "What" with "How" - and the Failure to Understand the Principles of Systems Engineering and Systems Management

Herding Cats

Progress and Value are measured with the same in Earned Value Management. In Earned Value Management paradigm, progress is always measured as physical percent complete. This physical percent complete is measured as compliance with the Technical Performance Measures of the outcomes of the work efforts, that consume the budget for that work. The Measures of effectiveness. The Measures of Performance are. Key Performance Parameters.

2018 31

INVEST, Scrum and Enterprise IT

Herding Cats

Cohesion is the measure of how well module fits together. The component may be performing more than one function. Informational cohesion: performs a number of functions, each with its own entry point, with independent code for each function, all performed on the same data structure. In the presence of uncertainty, estimates is needed to make decisions. The term INVEST is an acronym for good User Stories. I ndependent (of all others).

2018 31

Misinterpretations of the Cone of Uncertainty

Herding Cats

The Cone of Uncertainty as a Technical Performance Measure. Active reduction requires we have a desired reduction goal, perform the work, and measure progress toward the rduction goal. Management of this reduction work and measurement of the progress is a Close Loop Control System paradigm. Closed Loop Control, has a goal, an action, a measurement, and a corrective action. The Cone of Uncertainty as a Technical Performance Measure.

2017 32

Five Immutable Principles of Project Success

Herding Cats

Without these measures, Done will usually mean . Without these measures, Done will usually mean we ran out of time and money. . The test of the hypothesis for projects are the Measures of Effectiveness, Measures of Performance, Key Performance Parameters, and techTechnicalformance Measures used to assess progress to plan for the project. Estimating how much is the starting point. Estimating is part of risk management. No Estimating?

2017 35

Biases in Project Management and How to Remove Them

Herding Cats

There is always lots of complaining about the biases introduced into managing projects and making the estimates needed to make project decisions. What dos Done look like in units of measure meaningful to the decision makers? What are the measures of physical percent complete needed to inform the decision makers of progress to plan in order to take corrective or preventive actions to stay on plan?

INVEST, Scrum and Enterprise IT

Herding Cats

Cohesion is the measure of how well module fits together. The component may be performing more than one function. Informational cohesion: performs a number of functions, each with its own entry point, with independent code for each function, all performed on the same data structure. In the presence of uncertainty, estimates is needed to make decisions. The term INVEST is an acronym for good User Stories. I ndependent (of all others).

2018 28

Integrated Master Plan - Revisited

Herding Cats

Transparent – Comprehensible display of what needs to be done and how completion is measured. It is essential that the IMP represent the work that must be performed. If the IMP is being prepared as part of a proposal, then the Request for Proposal (RFP) and RFP attachments will be the primary documents to define the work to be performed. The IMP shows the Accomplishments and the measures of Accomplishments that are essential to get through a design review.

2017 37

Cone of Uncertainty Bibliography

Herding Cats

I work in a domain where the CoU is baked into the Integrated Program Performance Management (IPPM) processes flowed down from the buyer, in this case, the Federal Government. The CoU paradigm defines the needed reduction in uncertainty is some performance metric. This can be the confidence in the estimate for any variable. It can be the needed performance of a measure - Effectiveness, Performance, Key Performance Parameter, or a Technical Performance Measures.

2017 32

Closed Loop Control and Granularity of the Estimating Process

Herding Cats

For software, this can be value produced (assuming we have a unit of measure for that value in the for of effectiveness, performance, key performance parameters, or technical performance measures ). For your Honeywell or Nest controller on the wall, that sample rate is measured in seconds. It can be the cost, schedule, and technical performance measures of the software project.

Fallacy of the Day

Herding Cats

Project Controls are Management Actions, either preplanned to achieve the desired result, or taken as a corrective measure prompted by the monitoring process. Project controls are concerned with the metrics of the project – quantities, time, cost, and other resources and their measurable beneficial outcomes for the project. In the Project Controls paradigm, Value is a measurable attribute of the project controls process - a Closed Loop Control measure.

2017 34

Physical Percent Complete: Knowing When You Are Done

Herding Cats

The goal of every program manager is to have a set of practices that connect all the programmatic planning, risk, and performance information in a single unified view needed to support the decisions that increase the probability of success of any project or program. Cost is measured in dollars and schedule is measured in time. Technical performance is likewise difficult to integrate with either cost or schedule because its units of measure vary with the subject matter.

2018 38

3 Questions That Must Be Asked at Every Project Management Meeting

Herding Cats

In the ConOps are measures of Effectiveness for the components of the project that implement the Capabilities . The only answer to that is a measure of Physical Percent Complete (P%C). P%C starts with defining the Measures of Performance and Technical Performance Measures for each deliverable as a function of time. These measures are supported by Quantifiable Backup Data. Progress Means Measuring Physical Percent Complete.

2018 35

The Problems with Schedules

Herding Cats

Unrealistic performance expectations missing Measures of Effectiveness and Measures of Performance. Unrealistic Cost and Schedule estimates based on inadequate risk adjusted growth models. Before diving into the details of these, let me address another issue that has come up around project success and estimates. There is a common chart used to show poor performance of projects that compares Ideal project performance with the Actual project performance.

2016 42

Cone of Uncertainty - Part Cinq

Herding Cats

The Cone is a project management framework describing the uncertainty aspects of estimates (cost and schedule) and other project attributes (cost, schedule, and technical performance parameters). Estimates of cost, schedule, technical performance on the left side of the cone have a lower probability of being precise and accurate than estimates on the right side of the cone. The Cone is NOT the result of the project's past performance.

2017 33

Software Intensive System of Systems

Herding Cats

If a system of systems is disassembled into the component systems, these component systems are capable of independently performing useful operations independently of one another. The system of systems performs functions and carries out purposes that do not reside in any component system. Measures of Effectiveness, Measures of Performance, Technical Performance Measures, and Key Performance Parameters are the units of measure meaningful to the decision makers.

2001 30

What's Missing from the Agile Software Development Paradigm

Herding Cats

The customer is accountable for knowing what Done Looks Like (in Unity of measure meaningful to their domain). The results include system-level qualities, properties, characteristics, functions, behavior, and performance. Systems Engineering assess the processes for achieving stakeholder functional, physical, and operational performance requirements in the intended use environment over the planned life of the system within cost, schedule, and internal and external constraints.

Software Intensive System of Systems

Herding Cats

If a system of systems is disassembled into the component systems, these component systems are capable of independently performing useful operations independently of one another. The system of systems performs functions and carries out purposes that do not reside in any component system. Measures of Effectiveness, Measures of Performance, Technical Performance Measures, and Key Performance Parameters are the units of measure meaningful to the decision makers.

2001 28

Cone of Uncertainty - Part Cinq (Updated)

Herding Cats

The Cone is a project management framework describing the uncertainty aspects of estimates (cost and schedule) and other project attributes (cost, schedule, and technical performance parameters). Estimates of cost, schedule, technical performance on the left side of the cone have a lower probability of being precise and accurate than estimates on the right side of the cone. Estimates are needed but are subject to large level of uncertainty.

2017 30

Cone of Uncertainty - Part Trois

Herding Cats

The Cone is a project management framework describing the uncertainty aspects of estimates (cost and schedule) and other project attributes (cost, schedule, and technical performance parameters). Estimates of cost, schedule, technical performance on the left side of the cone have a lower probability of being precise and accurate than estimates on the right side of the cone. The Cone is NOT the result of the project's past performance.

2017 28

Cone of Uncertainty - Part Deux

Herding Cats

The Cone is a project management framework describing the uncertainty aspects of estimates or any other project attribute (in this post, cost, schedule, and technical performance parameters). Estimates of cost, schedule, technical performance on the left side of the cone have a lower probability of being precise and accurate than estimates on the right side of the cone. There can be cost and schedule performance measures as well.

2017 30

Is Macroeconomics and Social Science the Same as Software Development?

Herding Cats

In our domain this is the Performance Measurement Baseline, which is a time-phased budget plan for accomplishing work against which contract performance is measured. Five Estimating Pathologies and Their Corrective Actions. Why Guessing is not Estimating and Estimating is not Guessing. NoEstimates Agile Economics Estimating Governance

2016 36

Start with Principles, Not Personal Anecdotes

Herding Cats

I've seen estimates abused by bad managers, so let's NOT estimate and that will fix the behavior of Bad Managers." While the human behaviors are real and observable, conjecturing that decisions can be made in the presence of uncertainty without estimating the outcome of those decisions, there is no principle to support that conjecture. The first thing to do is NOT fall for the fallacy that NOT Estimating will fix the behavior of the bad manager.

2018 39

Project Management Process: The Basics

Clarizen

Monitoring & Controlling : processes required to track, assess, and regulate project performance and progress, as well as identify and initiate changes as necessary. . Performance measurement baseline. Work performance data. Team performance assessments.

Best PMI-ACP Exam Prep Books

Rebel’s Guide to PM

Chapter 5 covers the agile project management model and then the rest of the book covers the process and project lifecycle in detail, with chapters on governance, scaling and performance measurement. It talks about measuring and monitoring velocity during an iteration too.

PMI 195