Webinar Recap: Project Performance Measurement – Part 1: Overview Of Project Performance Measurements

MPUG

Please find below a transcription of the audio portion of Fletcher Hearn’s session, Project Performance Measurement – Part 1: Overview Of Project Performance Measurements, being provided by MPUG for the convenience of our members. Fletcher Hearns: What can be measured?

Phrases Used for Technical Performance Measures

Herding Cats

All project progress is measured independent of resources expended - Mr. Gary Bliss, Director Performance Assessment and Root Cause Analysis (PARCA), US Department of Defense. No matter the domain, the engineering development process, these concepts are applicable. Measuring progress must be in units meaningful to the decision maker. For any system, estimates of future life-cycle costs are subject to varying degrees of uncertainty.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Webinar Recap: Project Performance Measurement – Part 2: What to Measure and How to Report

MPUG

Please find below a transcription of the audio portion of Fletcher Hearn’s session, Project Performance Measurement – Part 2: What to Measure and How to Report, being provided by MPUG for the convenience of our members. This one covering, What to Measure and How to Report.

4 Fallacious Reasons to Estimate and Why Those Are Fallacious

Herding Cats

There's a recent post titled Four Fallacious Reasons to Estimate. It lists the usual suspects for why those spending the money think they don't have to estimate how much they plan to spend when they'll be done producing the value they've been assigned to produce for that expenditure. And like many posts and tweets about estimating, it's made from this point of view, not the business point view, not from the point of view of those paying the developer.

Connecting "What" with "How" - and the Failure to Understand the Principles of Systems Engineering and Systems Management

Herding Cats

This view of the system of producing value in exchange for money ignores the principles of systems engineering. . Systems engineering is an interdisciplinary field of engineering and engineering management that focuses on how to design and manage complex systems over their life cycles. At its core, systems engineering utilizes systems thinking principles to organize this body of knowledge. The elements of Systems Engineering are shown below.

A Compendium of Works to Increase the Probability of Project Success

Herding Cats

Integrated Master Plan: The Foundation of Program Success , College of Performance Management, May 21, 2014. The Nine "I's" of Program Success ," College of Performance Management. Forming, Storming, Norming, Performing, and Adjourning. Project Performance Management. Connecting the 5 Principles and 5 Practices of Performance-Based Project Management ® To Increase the Probability of Project Success. Building a Credible Performance Measurement Baseline.

2008 45

What is an Estimate? What is Estimating?

Herding Cats

I work in a domain where estimates are made every single week. Estimate to Complete (ETC), Estimate at Completion (EAC), Estimated Completion Date (ECD) are the life blood of our software intensive system of systems programs. There are several partitions of this information that are common in building the Performance Measurement Baseline (PMB). In the #NoEstimates paradigm, the term estimate is redefined to be Forecast and relabeled as NOT Estimating.

Deconstructing the Hertz and Accenture Debacle

Herding Cats

A recent lawsuit by Hertz Rental Car against Accenture has turned into a rallying cry by Agilest and No Estimates advocates. Of course, No Root Cause analysis has been performed by these advocates, but it makes good click bait for their followers. Were there: Measures of Effectiveness. Measures of Performance. Key Performance Parameters. Past Performance is the 1st question - have you done this before and if so, were your efforts successful?

Biases in Project Management and How to Remove Them

Herding Cats

There is always lots of complaining about the biases introduced into managing projects and making the estimates needed to make project decisions. What dos Done look like in units of measure meaningful to the decision makers? What are the measures of physical percent complete needed to inform the decision makers of progress to plan in order to take corrective or preventive actions to stay on plan?

Cone of Uncertainty Bibliography

Herding Cats

I work in a domain where the CoU is baked into the Integrated Program Performance Management (IPPM) processes flowed down from the buyer, in this case, the Federal Government. The CoU paradigm defines the needed reduction in uncertainty is some performance metric. This can be the confidence in the estimate for any variable. It can be the needed performance of a measure - Effectiveness, Performance, Key Performance Parameter, or a Technical Performance Measures.

2017 32

Integrated Master Plan - Revisited

Herding Cats

Transparent – Comprehensible display of what needs to be done and how completion is measured. It is essential that the IMP represent the work that must be performed. If the IMP is being prepared as part of a proposal, then the Request for Proposal (RFP) and RFP attachments will be the primary documents to define the work to be performed. The IMP shows the Accomplishments and the measures of Accomplishments that are essential to get through a design review.

Increasing the Probability of Program Success

Herding Cats

And to make those risk-informed decisions in the presence of reducible and irreducible uncertainty we need to ESTIMATE. So, If your making decisions in the presence of uncertainty and you're NOT estimating the impact of those risks on the probability of success, then you're not managing the project - usually paid with other people's money as an Adult. Top Four Sources of Unfavorable Program Performance. Unrealistic Performance Expectations. Estimating Processes.

Cone of Uncertainty - Revisited

Herding Cats

We're writing two chapters in an upcoming Project Management Book, with a working title, The Gower Handbook of Project Performance for Agile, Waterfall and Everything in Between , edited by Mark Phillips. Improving Software Development Tracking and Estimation Inside the Cone of Uncertainty,” Pongtip Aroonvatanaporn, Thanida Hongsongkiat, and Barry Boehm, Technical Report USC?CSSE?2012?504, 504, Center for Systems and Software Engineering, University of Southern California, 2012.

2012 28

INVEST, Scrum and Enterprise IT

Herding Cats

This always takes us back the coupling and cohesion discussion all of us who were Software Engineers in the 1980's . Cohesion is the measure of how well module fits together. The component may be performing more than one function. Informational cohesion: performs a number of functions, each with its own entry point, with independent code for each function, all performed on the same data structure. The term INVEST is an acronym for good User Stories.

2018 31

Misinterpretations of the Cone of Uncertainty

Herding Cats

The Cone of Uncertainty as a Technical Performance Measure. Active reduction requires we have a desired reduction goal, perform the work, and measure progress toward the rduction goal. Management of this reduction work and measurement of the progress is a Close Loop Control System paradigm. Closed Loop Control, has a goal, an action, a measurement, and a corrective action. The Cone of Uncertainty as a Technical Performance Measure.

2017 32

Principles, Processes, and Practices of Project Success

Herding Cats

What does Done look like in units of measure meaningful to the decision makers? What impediments will be encountered along the way to Done and what work must be performed to handle these impediments? What are the units of measures of progress to plan for each deliverable? With execution underway, managing the risks of the project becomes our focus beyond the engineering work. Estimating Processes in Support of Economic Analysis. Principles are timeless.

2017 44

Biases in Project Management and How to Remove Them

Herding Cats

There is always lots of complaining about the biases introduced into managing projects and making the estimates needed to make project decisions. What dos Done look like in units of measure meaningful to the decision makers? What are the measures of physical percent complete needed to inform the decision makers of progress to plan in order to take corrective or preventive actions to stay on plan?

Five Immutable Principles of Project Success

Herding Cats

No matter the engineering processes used to produce the outcomes from the project. Without these measures, Done will usually mean . Without these measures, Done will usually mean we ran out of time and money. . The test of the hypothesis for projects are the Measures of Effectiveness, Measures of Performance, Key Performance Parameters, and techTechnicalformance Measures used to assess progress to plan for the project. No Estimating?

2017 35

INVEST, Scrum and Enterprise IT

Herding Cats

This always takes us back the coupling and cohesion discussion all of us who were Software Engineers in the 1980's . Cohesion is the measure of how well module fits together. The component may be performing more than one function. Informational cohesion: performs a number of functions, each with its own entry point, with independent code for each function, all performed on the same data structure. The term INVEST is an acronym for good User Stories.

Performance-Based Project Management®

Herding Cats

Successfully managing projects, not matter the domain, the size, the development or engineering method starts with a set of Principles, Practices, and Processes. Principles and Practices of Performance-Based Project Management® from Glen Alleman. Information Technology Estimating Quality. Here are those Principles and Practices. The Principles are Immutable. The Practices are universal. The Processes need to be tailored to your domain.

2017 32

Fallacy of the Day

Herding Cats

Project Controls are Management Actions, either preplanned to achieve the desired result, or taken as a corrective measure prompted by the monitoring process. Project controls are concerned with the metrics of the project – quantities, time, cost, and other resources and their measurable beneficial outcomes for the project. In the Project Controls paradigm, Value is a measurable attribute of the project controls process - a Closed Loop Control measure.

2017 34

Systems Engineering and Software Intensive System of Systems

Herding Cats

But in technical systems - engineered technical systems - the system has to work when commanded to do so. This is the domain of Systems Engineering, that many times is based on the principles of Ackoff and others like him. Systems Engineering: Coping with Complexity , Richard Stevens, Peter Brook, Ken Jackson, and Stuart Arnold. INCOSE Systems Engineering Handbook - membership needed. This is the professional society for Systems Engineers. Estimating Guidance.

Physical Percent Complete: Knowing When You Are Done

Herding Cats

The goal of every program manager is to have a set of practices that connect all the programmatic planning, risk, and performance information in a single unified view needed to support the decisions that increase the probability of success of any project or program. There are cost people, scheduling people, risk people, EVM people, engineers, testers, and others on any program. Cost is measured in dollars and schedule is measured in time.

2018 38

Don't Be Fooled

Herding Cats

Hyndman - in our program planning and controls domain ARIMA (Autoregressive Integrated Moving Average) is a powerful tool for forecasting future project behaviors based on past performance. Probability Methods for Cost Uncertainty Analysis: A Systems Engineering Perspective , Paul R. Systems Engineering is the basis of all we do, so this book enables the execution of the programs driven by Systems Engineering.

2018 44

Risk Management is How Adults Manage Projects

Herding Cats

All making things smaller dos is show that you're late, over budget, and what you're building (Technical Performance Measures) doesn't work faster. But when some statement is made about risk, estimating, performance modeling, or the like - always ask for references. Probabilistic Risk Assessment and Management for Engineers and Scientist 2nd Edition , Ernest J. Software Engineering Risk Management , Dale Karolak, IEEE Computer Society Press, 1996.

2003 38

3 Questions That Must Be Asked at Every Project Management Meeting

Herding Cats

In the ConOps are measures of Effectiveness for the components of the project that implement the Capabilities . The only answer to that is a measure of Physical Percent Complete (P%C). P%C starts with defining the Measures of Performance and Technical Performance Measures for each deliverable as a function of time. These measures are supported by Quantifiable Backup Data. Progress Means Measuring Physical Percent Complete.

2018 35

Cone of Uncertainty - Part Cinq

Herding Cats

Barry Boehm's work in “Software Engineering Economics”. The Cone is a project management framework describing the uncertainty aspects of estimates (cost and schedule) and other project attributes (cost, schedule, and technical performance parameters). Estimates of cost, schedule, technical performance on the left side of the cone have a lower probability of being precise and accurate than estimates on the right side of the cone.

2017 33

What's Missing from the Agile Software Development Paradigm

Herding Cats

The customer is accountable for knowing what Done Looks Like (in Unity of measure meaningful to their domain). Systems Engineering. Systems engineering is a methodical, multi-disciplinary approach for design, realization, technical management, operations, and retirement of a system. The results include system-level qualities, properties, characteristics, functions, behavior, and performance. Systems Engineering looks at the big picture to make technical decisions.

Managing in Presence of Uncertainty

Herding Cats

This is an immutable principle that impacts planning, execution, performance measures, decision making, risk, budgeting, and overall business and technical management of the project and the business funding the project no matter the domain, context, technology or any methods. Do we have measures of Effectiveness, Performance, all the .ilities. Is each of these measures being met for the planned cost at the planned time? . Why did the estimates NOT get better?

Start with Principles, Not Personal Anecdotes

Herding Cats

I've seen estimates abused by bad managers, so let's NOT estimate and that will fix the behavior of Bad Managers." While the human behaviors are real and observable, conjecturing that decisions can be made in the presence of uncertainty without estimating the outcome of those decisions, there is no principle to support that conjecture. The first thing to do is NOT fall for the fallacy that NOT Estimating will fix the behavior of the bad manager.

2018 39

Microeconomics and Risk Management in Decision Making for Software Development

Herding Cats

If we look at the discipline of software engineering, we see that the microeconomics branch of economics deals more with the types of decisions we need to make as software engineers or managers. Throughout the software life cycle, there are many decision situations involving limited resources in which software engineering economics techniques provide useful assistance. Software engineering economics." IEEE Transactions of Software Engineering, 1 (1984): 4-21.

2007 32

Software Intensive System of Systems

Herding Cats

If a system of systems is disassembled into the component systems, these component systems are capable of independently performing useful operations independently of one another. The system of systems performs functions and carries out purposes that do not reside in any component system. The principal purposes of supporting the engineering of these systems are fulfilled by these emergent behaviors. Cost, Schedule, and these measures are tightly interconnected.

2001 30

Software Intensive System of Systems

Herding Cats

If a system of systems is disassembled into the component systems, these component systems are capable of independently performing useful operations independently of one another. The system of systems performs functions and carries out purposes that do not reside in any component system. The principal purposes of supporting the engineering of these systems are fulfilled by these emergent behaviors. Cost, Schedule, and these measures are tightly interconnected.

2001 28

Cone of Uncertainty - Part Cinq (Updated)

Herding Cats

Barry Boehm's work in “Software Engineering Economics”. The Cone is a project management framework describing the uncertainty aspects of estimates (cost and schedule) and other project attributes (cost, schedule, and technical performance parameters). Estimates of cost, schedule, technical performance on the left side of the cone have a lower probability of being precise and accurate than estimates on the right side of the cone.

2017 30

Cone of Uncertainty - Part Trois

Herding Cats

Barry Boehm's work in “Software Engineering Economics”. The Cone is a project management framework describing the uncertainty aspects of estimates (cost and schedule) and other project attributes (cost, schedule, and technical performance parameters). Estimates of cost, schedule, technical performance on the left side of the cone have a lower probability of being precise and accurate than estimates on the right side of the cone.

2017 28

Cone of Uncertainty - Part Deux

Herding Cats

Barry Boehm's work in “Software Engineering Economics”. The Cone is a project management framework describing the uncertainty aspects of estimates or any other project attribute (in this post, cost, schedule, and technical performance parameters). Estimates of cost, schedule, technical performance on the left side of the cone have a lower probability of being precise and accurate than estimates on the right side of the cone.

2017 30

Why Johnny Can't Do The Math

Herding Cats

In a previous post, Why Johnny Can't Estimate , mentioned some resources for estimating, the principles of business and technical management that demand estimates be made to make decisions, and background on the sources of uncertainty, that create risk, that require estimating to increase the probability of project success. One of the #Noestimates advocates has now discovered a phrase: Estimates are non-ergodic. It is not the Estimates that are non-ergodic.

Is Macroeconomics and Social Science the Same as Software Development?

Herding Cats

He was not a program manager of engineered to order software intensive system of systems. In our domain this is the Performance Measurement Baseline, which is a time-phased budget plan for accomplishing work against which contract performance is measured. Five Estimating Pathologies and Their Corrective Actions. Why Guessing is not Estimating and Estimating is not Guessing. NoEstimates Agile Economics Estimating Governance

2016 36

Value and the Needed Units of Measure to Make Decisions

Herding Cats

Without units of measure of Value beyond time and money, there can be not basis of comparison between one value based choice and another. In the Systems Engineering world where we work, there are four critical units of measure for all we done. Measures of Effectiveness - these are operational measures of success that are closely related to the achievements of the mission or operational objectives evaluated in the operational environment, under a specific set of conditions.

2016 42

Misquotes of Deming

Herding Cats

It is wrong to suppose that if you can’t measure it, you can’t manage it – a costly myth. This is used in support of the fallacy that estimates aren't needed to make decisions in the presence of uncertanty. I spent the week speaking at the College of Performance Management conference where government and industry come together to work on the issues of cost, schedule, and technical performance management process improvement needed to increase the probability of program success.

2016 40