Archive for the ‘Uncategorized’ Category

MA in T&M

Thursday, March 16th, 2006

Well, while profit (or “programmatics”) is (are) the most “key” of business performance indicators when the contract is T&M, it turns out that there are valuable process metrics even in that scenario.

Admittedly, there’s a small (and arguably fictitious) loop-hole in the MA (Measurement and Analysis) process area in CMMI. In brief, the  MA process area  expects  companies to  identify  business goals and to find metrics from their practices that provide valuable business analysis / intelligence to further those goals.  Whether those metrics provide insight into process improvement or only into programmatics is the potential loop hole.   We can discuss that another time.

I’d considered the ‘incentive’ aspect as Wayne points out, but that’s a matter for those who fashion the contract.  Collecting metrics on or even influencing the contracts decision might be beyond the powers of most process improvement practitioners.  — Though I would say that in an ideal world, executives making contract decisions would be doing so with an eye towards their process improvement efforts and more than just profit, but let’s be real.  Those types of executives are far fewer than the kind the rest of us work with.

Back to our scenario… A common metric is estimates to actuals, but when the estimate is feature/functions, not time or budget, this becomes somewhat problematic, right?  And, when the developer is using Scrum to manage development their ability to spend their allocated budget and deliver a product the client is happy with is pretty good. 

What can we still learn from estimates to actuals on functions even when it’s a seemingly feature-poor process metric?  How about giving management data that tells them they can go and sell more business without increasing staff?  E.g., “we so (over)|(under)-estimated what we could do that we could have (broken this up into several $20k jobs) | (sold more time during this period of performance)”, etc.

Try that on.

Lesson learned…

Wednesday, March 15th, 2006

When publishing from email… make sure to send it as plain text and don’t
let your email client format your entries… the div tags mess things up
ROYALLY!

[This is another emailed blog post... As (hopefully) proof of my theorem.]

Agile, Metrics, and T&M

Wednesday, March 15th, 2006

An interesting conversation took place with a client today.

I suspect many development shops using agile methods may run into the same issues. Namely, agile development methods arguably run counter-current to fixed-price contracts and therefore agile shops are often found in relationships with their clients where they are compensated for Time and Materials (T&M). This works especially well with development approaches that re-scope the feature/functions to meet the schedule and/or the available budget rather than constraining the the developer to deliver all features/functions regardless of the exposure to themselves (a la, “Fixed Price”).

So consider the following scenario: a developer managing its development using Scrum has a client with a fixed budget to spend on the developers to deliver a set of features — but doesn’t necessarily expect all the features to be delivered as long as a good value has been delivered. The developers work to deliver as much as they can and burn off the hours — and their goal is to not leave any hours un-burnt.

In this scenario, the only business metric the developers’ CEO cares about is whether they’ve burnt all the hours. Assuming they delivered a quality product and the client is happy with the value, the metric here is pretty simple: profit. The client will pay the maximum budget and regardless of how efficiently the developers have worked, the company will make the same amount of money.

In comes the CMMI process area of Measurement and Analysis (MA)… which expects the company to be collecting metrics based on business objectives — presumably to help improve the process. However, in a T&M situation, what metrics are really any more important than whether or not the company spent all the hours? What’s the incentive to deliver more of the functions and burn less when they don’t get paid for what they don’t spend?

I hope to generate some discussion on this point and I’ll post what we ended up doing in the next day or so — I’m here to learn as much as anyone else. :-)

[By the way, this was also my first test of emailing blog entries... I hope it didn't suck.]