Unlocking Excellence with Agile Metrics

www.rallydev.comConfidential Do not copy or distribute without express permission of Rally. ©2015 Rally Software Development Corp. All rights reserved. - 4 -

Metrics Support Desired Outcomes

Outcomes require- Decisions require

• Insights requireoMeasurements

Measurements inspire- Insights inform

• Decisions driveoOutcomes


Agility Throughout the Business System


Enterprise Scale AgileTeams working together deliver value faster


Cadence and Synchronization

- 7 -

RELEASEPLANNING

DEMO & RETROSPECTIVE

RELEASES / MILESTONES

ITERATIONS (Synchronized)


Communities Of Practice

AgileTeam

AgileTeam

AgileTeam

AgileTeam

Product ManagerRelease Train Engineer

SM

SM

PO

PO

PO

DeliveryManager

DeliveryManager PO

Organized for the Work

- 8 -


• Measure and improve performance

• Guide team execution and value delivery

• Correlate value delivered with strategic priorities

- 9 -

How Metrics Can Help You Succeed


• Build an effective measurement plan

• Identify traps and actively manage them

• Inspect and adapt!

- 10 -

How Do You Get There?


Agile Metrics to Guide DeliveryWill we meet our delivery commitments?

- 11 -


Agile Teams

• Will we complete our work in an iteration (stories, tasks, defects, etc.)?

Agile Delivery Groups

• Will we meet our plan objectives (features, milestones, quality, etc.)?

- 12 -

Agile Steering

13

Oh my!


Maturity and Metrics


Teams: Healthy Cumulative Flow


Cumulative Flow: WTWF


Teams: Consistent Iteration Health Message


Delivery: Release Tracking


Delivery: Plan and Milestone Progress


Delivery: Initiative Progress


Delivery: Feature Responsiveness


Delivery: Performance Consistency


Data-driven Continuous ImprovementHow do we achieve our goals over time?

- 24 -


Performance KPIs

• Are our teams healthy?

• How much can we predictably deliver?

• What improvements would we value most?

• What improvement action will we try next?

- 25 -

Performance Metrics Support Outcomes


Software Development

Performance Index


Findings

160,00050,000 13,000


SDPI DimensionsProductivity = ThroughputPredictability = Consistency of throughputResponsiveness = Time in process (TiP)Quality = Released defect density


The Impact of Agile Quantified

- 29 -


Work Interacts (Through Workers) …

- 30 -

… and Impacts Throughput


Work in Process


Limit WiPKey FindingsTeams that aggressively control WiP:

● Cut time in process in half● Have ¼ as many defects● But have 34% lower Productivity

Recommendations● If your WiP is high, reduce it● If your WiP is already low, consider

your economic drivers○ If Productivity drives your

bottom line, don’t push WiP too low

○ If Time To Market drives your bottom line, push WiP as low as it will go


“We can see that there is almost a 2:1 difference in throughput between teams that are 95% or more dedicated compared with teams that are 50% or less dedicated.”

Stable Teams


Boost Efficiency and Innovation

“We uncovered the performance costs of unstable teams … and are seeing 30 - 50% improvements in both cost and delivery duration compared to similar waterfall projects.”

– Michael Santoro, Director, GVS Global Business Partnership Team


Recommendations

• Limit WiP• If practicing Scrum, use two-week iterations; task

out stories• Size teams appropriately: 7 +/- 2 for balanced

performance (larger teams are okay)• Have dedicated and stable teams• Encourage small stories

- 35 -


TrapsWhat will impede our outcomes?

- 36 -


Common Metrics Traps

1. Manipulation

2. Unbalanced metrics

3. Costly KPIs

4. Availability bias

5. Mechanical decision-making

6. False negatives

- 37 -


False Negatives


Data Integrity Checks for Insights

• Quality stories(avoid stories that are really tasks and/or fake stories)

• Mapping kanban states to schedule state values(especially in-progress and accepted)

• Quantity of in-progress split stories (splitting stories at the end of the iteration)

• Defect state value accuracy

• Consistent use of defect environment field value

• Consistent use of defect priority field

- 39 -


Use Case: Annual Company Disruptions


The Seven Deadly Sins of Agile Measurement Whitepaper

The Impact of Agile Quantified: SDPI Whitepaper

Agile Reports and Metrics Rally Help

Rally Success Program

- 41 -

To Learn More...

https://www.rallydev.com/resource/seven-deadly-sins-agile-measurement

https://www.rallydev.com/resource/impact-agile-quantified-sdpi-whitepaper

https://www.rallydev.com/product-feature/reporting-analytics

https://www.rallydev.com/rally-success-program

Unlocking Excellence with Agile Metrics

Data & Analytics

Transcript of Unlocking Excellence with Agile Metrics