Actionable Agile Metrics for Predictability - Daniel Vacanti

59
Daniel S. Vacanti ActionableAgile TM [email protected] @danvacanti Actionable Agile Metrics for Predictability

Transcript of Actionable Agile Metrics for Predictability - Daniel Vacanti

Page 1: Actionable Agile Metrics for Predictability - Daniel Vacanti

Daniel S. VacantiActionableAgileTM

[email protected]@danvacanti

Actionable Agile Metrics for Predictability

Page 2: Actionable Agile Metrics for Predictability - Daniel Vacanti

First, let me set the record straight…

Page 3: Actionable Agile Metrics for Predictability - Daniel Vacanti

“When will it be done?”

Page 4: Actionable Agile Metrics for Predictability - Daniel Vacanti

“When will it be done?”

Date (number of days)

Elapsed Time

Page 5: Actionable Agile Metrics for Predictability - Daniel Vacanti

“When will it be done?”

Date (number of days)

Story Points / Velocity

Page 6: Actionable Agile Metrics for Predictability - Daniel Vacanti

Stop me if you’ve heard this

one before…

Page 7: Actionable Agile Metrics for Predictability - Daniel Vacanti

“Relative Complexity is the

best predictor of how long it

takes an item to complete”

Page 8: Actionable Agile Metrics for Predictability - Daniel Vacanti
Page 9: Actionable Agile Metrics for Predictability - Daniel Vacanti

Why do we even bother with

Story Points?*

Page 10: Actionable Agile Metrics for Predictability - Daniel Vacanti

I’m going to suggest something

radical…

Page 11: Actionable Agile Metrics for Predictability - Daniel Vacanti

As an example:

How long does it take you to get

to work in the morning?

Page 12: Actionable Agile Metrics for Predictability - Daniel Vacanti

“It depends…”

Page 13: Actionable Agile Metrics for Predictability - Daniel Vacanti

Here’s a spot!!

Page 14: Actionable Agile Metrics for Predictability - Daniel Vacanti

4 4 2

Active Done

Testing DoneDoneActive

DevelopmentReady Analysis

3

Here’s a spot!!

Page 15: Actionable Agile Metrics for Predictability - Daniel Vacanti

Try an experiment for

me…

Page 16: Actionable Agile Metrics for Predictability - Daniel Vacanti

Calendar Time

Elapsed Time

Page 17: Actionable Agile Metrics for Predictability - Daniel Vacanti
Page 18: Actionable Agile Metrics for Predictability - Daniel Vacanti
Page 19: Actionable Agile Metrics for Predictability - Daniel Vacanti
Page 20: Actionable Agile Metrics for Predictability - Daniel Vacanti
Page 21: Actionable Agile Metrics for Predictability - Daniel Vacanti

Try the same thing

for your process

Page 22: Actionable Agile Metrics for Predictability - Daniel Vacanti

Backlog Analysis Develop Test Deployed

Start Timer Stop Timer

Page 23: Actionable Agile Metrics for Predictability - Daniel Vacanti

This chart is called a (Cycle Time) Scatterplot

Page 24: Actionable Agile Metrics for Predictability - Daniel Vacanti

If you track nothing else, track the date that an item starts and the date

that an item completes(for all work items)

Page 25: Actionable Agile Metrics for Predictability - Daniel Vacanti

That will give you a measure of the flow

metric of

Cycle Time

Page 26: Actionable Agile Metrics for Predictability - Daniel Vacanti

Cycle Time is the amount of

elapsed time

it takes for a given work item to complete

Page 27: Actionable Agile Metrics for Predictability - Daniel Vacanti

“When will it be done?” for a single item is best answered

by

Cycle Time

Page 28: Actionable Agile Metrics for Predictability - Daniel Vacanti

“Huh?”

Page 29: Actionable Agile Metrics for Predictability - Daniel Vacanti

How does generating a chart like this help us

answer “When will it be done”?

Page 30: Actionable Agile Metrics for Predictability - Daniel Vacanti

How do we make sense of this randomness?

Page 31: Actionable Agile Metrics for Predictability - Daniel Vacanti

Your process is “random”.

Therefore, you can’t think

deterministically.

You need to think

probabilistically.

Page 32: Actionable Agile Metrics for Predictability - Daniel Vacanti

What does it mean to

think probabilistically?

Page 33: Actionable Agile Metrics for Predictability - Daniel Vacanti

Let’s try another experiment…

Page 34: Actionable Agile Metrics for Predictability - Daniel Vacanti

Thinking probabilistically means

acknowledging that there is

more than one

possible future outcome

Page 35: Actionable Agile Metrics for Predictability - Daniel Vacanti

How many people can we “expect”

to be standing after 3 flips?

12.5%

Does that mean 12.5% was the

only possible outcome?

Page 36: Actionable Agile Metrics for Predictability - Daniel Vacanti

Backlog Analysis Develop Test Deployed

2

Start Timer Stop Timer

Page 37: Actionable Agile Metrics for Predictability - Daniel Vacanti

Backlog Design Develop Test Deployed

2

Exactly

this dot?

Exactly

this dot?

Or Exactly

this dot?

Will Item #3

end up as…

Page 38: Actionable Agile Metrics for Predictability - Daniel Vacanti

Backlog Design Develop Test Deployed

2

There is more than one possible outcome

for Item #3 while it is sitting in the backlog

Page 39: Actionable Agile Metrics for Predictability - Daniel Vacanti

What are the possible

outcomes?

Page 40: Actionable Agile Metrics for Predictability - Daniel Vacanti

40

How do we make sense of this

“randomness”?

Page 41: Actionable Agile Metrics for Predictability - Daniel Vacanti

41

50th Percentile = 6 days or less

Page 42: Actionable Agile Metrics for Predictability - Daniel Vacanti

42

85th Percentile = 15 days or less

Page 43: Actionable Agile Metrics for Predictability - Daniel Vacanti

43

95th Percentile = 22 days or less

Page 44: Actionable Agile Metrics for Predictability - Daniel Vacanti

44

50th Percentile = 6 days or less

95th Percentile = 22 days or less

85th Percentile = 15 days or less

Scatterplot Percentiles (making a forecast)

Page 45: Actionable Agile Metrics for Predictability - Daniel Vacanti
Page 46: Actionable Agile Metrics for Predictability - Daniel Vacanti

85th Percentile = 33 days or less

Page 47: Actionable Agile Metrics for Predictability - Daniel Vacanti

85th Percentile = 13 days or less

Page 48: Actionable Agile Metrics for Predictability - Daniel Vacanti
Page 49: Actionable Agile Metrics for Predictability - Daniel Vacanti
Page 50: Actionable Agile Metrics for Predictability - Daniel Vacanti

What factors

affect

Cycle Time?

Page 51: Actionable Agile Metrics for Predictability - Daniel Vacanti

WIP

Page 52: Actionable Agile Metrics for Predictability - Daniel Vacanti
Page 53: Actionable Agile Metrics for Predictability - Daniel Vacanti

Avg Cycle Time = Avg WIP

Avg Throughput

Page 54: Actionable Agile Metrics for Predictability - Daniel Vacanti

What else?

Page 55: Actionable Agile Metrics for Predictability - Daniel Vacanti

Poor Pull Policies,

Blockers,

External Dependencies,

Page 56: Actionable Agile Metrics for Predictability - Daniel Vacanti

“Actionable Agile

Metrics for

Predictability”

https://leanpub.com/actionableagilemetrics

Page 57: Actionable Agile Metrics for Predictability - Daniel Vacanti

What does a 19th century

Yorkshire cotton

industrialist have to do

with the Manhattan

Project?

For next time…

Page 58: Actionable Agile Metrics for Predictability - Daniel Vacanti

QUESTIONS?

Daniel S. Vacantihttp://www.actionableagile.com

[email protected]@danvacanti

Page 59: Actionable Agile Metrics for Predictability - Daniel Vacanti

All charts created by:

Thank-you!