1

2

www.rallydev.comConfidential Do not copy or distribute without express permission of Rally. ©2015 Rally Software Development Corp. All rights reserved.

www.rallydev.comConfidential Do not copy or distribute without express permission of Rally. ©2015 Rally Software Development Corp. All rights reserved. - 4 -

Metrics Support Desired Outcomes

Outcomes require- Decisions require

• Insights requireoMeasurements

Measurements inspire- Insights inform

• Decisions driveoOutcomes

www.rallydev.comConfidential Do not copy or distribute without express permission of Rally. ©2015 Rally Software Development Corp. All rights reserved. - 5 -

Agility Throughout the Business System

www.rallydev.comConfidential Do not copy or distribute without express permission of Rally. ©2015 Rally Software Development Corp. All rights reserved. - 6 -

Enterprise Scale AgileTeams working together deliver value faster

www.rallydev.comConfidential Do not copy or distribute without express permission of Rally. ©2015 Rally Software Development Corp. All rights reserved.

Cadence and Synchronization

- 7 -

RELEASEPLANNING

DEMO & RETROSPECTIVE

RELEASES / MILESTONES

ITERATIONS (Synchronized)

www.rallydev.comConfidential Do not copy or distribute without express permission of Rally. ©2015 Rally Software Development Corp. All rights reserved.

Communities Of Practice

AgileTeam

AgileTeam

AgileTeam

AgileTeam

Product ManagerRelease Train Engineer

SM

SM

PO

PO

PO

DeliveryManager

DeliveryManager PO

Organized for the Work

- 8 -

www.rallydev.comConfidential Do not copy or distribute without express permission of Rally. ©2015 Rally Software Development Corp. All rights reserved.

• Measure and improve performance

• Guide team execution and value delivery

• Correlate value delivered with strategic priorities

- 9 -

How Metrics Can Help You Succeed

www.rallydev.comConfidential Do not copy or distribute without express permission of Rally. ©2015 Rally Software Development Corp. All rights reserved.

• Build an effective measurement plan

• Identify traps and actively manage them

• Inspect and adapt!

- 10 -

How Do You Get There?

www.rallydev.comConfidential Do not copy or distribute without express permission of Rally. ©2015 Rally Software Development Corp. All rights reserved.

Agile Metrics to Guide DeliveryWill we meet our delivery commitments?

- 11 -

www.rallydev.comConfidential Do not copy or distribute without express permission of Rally. ©2015 Rally Software Development Corp. All rights reserved.

Agile Teams

• Will we complete our work in an iteration (stories, tasks, defects, etc.)?

Agile Delivery Groups

• Will we meet our plan objectives (features, milestones, quality, etc.)?

- 12 -

Agile Steering

13

Oh my!

www.rallydev.comConfidential Do not copy or distribute without express permission of Rally. ©2015 Rally Software Development Corp. All rights reserved. - 14 -

Maturity and Metrics

www.rallydev.comConfidential Do not copy or distribute without express permission of Rally. ©2015 Rally Software Development Corp. All rights reserved. - 15 -

Maturity and Metrics

www.rallydev.comConfidential Do not copy or distribute without express permission of Rally. ©2015 Rally Software Development Corp. All rights reserved. - 16 -

Teams: Healthy Cumulative Flow

www.rallydev.comConfidential Do not copy or distribute without express permission of Rally. ©2015 Rally Software Development Corp. All rights reserved. - 17 -

Cumulative Flow: WTWF

www.rallydev.comConfidential Do not copy or distribute without express permission of Rally. ©2015 Rally Software Development Corp. All rights reserved. - 18 -

Teams: Consistent Iteration Health Message

www.rallydev.comConfidential Do not copy or distribute without express permission of Rally. ©2015 Rally Software Development Corp. All rights reserved. - 19 -

Delivery: Release Tracking

www.rallydev.comConfidential Do not copy or distribute without express permission of Rally. ©2015 Rally Software Development Corp. All rights reserved. - 20 -

Delivery: Plan and Milestone Progress

www.rallydev.comConfidential Do not copy or distribute without express permission of Rally. ©2015 Rally Software Development Corp. All rights reserved. - 21 -

Delivery: Initiative Progress

www.rallydev.comConfidential Do not copy or distribute without express permission of Rally. ©2015 Rally Software Development Corp. All rights reserved. - 22 -

Delivery: Feature Responsiveness

www.rallydev.comConfidential Do not copy or distribute without express permission of Rally. ©2015 Rally Software Development Corp. All rights reserved. - 23 -

Delivery: Performance Consistency

www.rallydev.comConfidential Do not copy or distribute without express permission of Rally. ©2015 Rally Software Development Corp. All rights reserved.

Data-driven Continuous ImprovementHow do we achieve our goals over time?

- 24 -

www.rallydev.comConfidential Do not copy or distribute without express permission of Rally. ©2015 Rally Software Development Corp. All rights reserved.

Performance KPIs

• Are our teams healthy?

• How much can we predictably deliver?

• What improvements would we value most?

• What improvement action will we try next?

- 25 -

Performance Metrics Support Outcomes

www.rallydev.comConfidential Do not copy or distribute without express permission of Rally. ©2015 Rally Software Development Corp. All rights reserved. - 26 -

Software Development

Performance Index

www.rallydev.comConfidential Do not copy or distribute without express permission of Rally. ©2015 Rally Software Development Corp. All rights reserved. - 27 -

Findings

160,00050,000 13,000

www.rallydev.comConfidential Do not copy or distribute without express permission of Rally. ©2015 Rally Software Development Corp. All rights reserved. - 28 -

SDPI DimensionsProductivity = ThroughputPredictability = Consistency of throughputResponsiveness = Time in process (TiP)Quality = Released defect density

www.rallydev.comConfidential Do not copy or distribute without express permission of Rally. ©2015 Rally Software Development Corp. All rights reserved.

The Impact of Agile Quantified

- 29 -

www.rallydev.comConfidential Do not copy or distribute without express permission of Rally. ©2015 Rally Software Development Corp. All rights reserved.

Work Interacts (Through Workers) …

- 30 -

… and Impacts Throughput

www.rallydev.comConfidential Do not copy or distribute without express permission of Rally. ©2015 Rally Software Development Corp. All rights reserved. - 31 -

Work in Process

www.rallydev.comConfidential Do not copy or distribute without express permission of Rally. ©2015 Rally Software Development Corp. All rights reserved. - 32 -

Limit WiPKey FindingsTeams that aggressively control WiP:

● Cut time in process in half● Have ¼ as many defects● But have 34% lower Productivity

Recommendations● If your WiP is high, reduce it● If your WiP is already low, consider

your economic drivers○ If Productivity drives your

bottom line, don’t push WiP too low

○ If Time To Market drives your bottom line, push WiP as low as it will go

www.rallydev.comConfidential Do not copy or distribute without express permission of Rally. ©2015 Rally Software Development Corp. All rights reserved. - 33 -

“We can see that there is almost a 2:1 difference in throughput between teams that are 95% or more dedicated compared with teams that are 50% or less dedicated.”

Stable Teams

www.rallydev.comConfidential Do not copy or distribute without express permission of Rally. ©2015 Rally Software Development Corp. All rights reserved.

Boost Efficiency and Innovation

“We uncovered the performance costs of unstable teams … and are seeing 30 - 50% improvements in both cost and delivery duration compared to similar waterfall projects.”

– Michael Santoro, Director, GVS Global Business Partnership Team

www.rallydev.comConfidential Do not copy or distribute without express permission of Rally. ©2015 Rally Software Development Corp. All rights reserved.

Recommendations

• Limit WiP• If practicing Scrum, use two-week iterations; task

out stories• Size teams appropriately: 7 +/- 2 for balanced

performance (larger teams are okay)• Have dedicated and stable teams• Encourage small stories

- 35 -

www.rallydev.comConfidential Do not copy or distribute without express permission of Rally. ©2015 Rally Software Development Corp. All rights reserved.

TrapsWhat will impede our outcomes?

- 36 -

www.rallydev.comConfidential Do not copy or distribute without express permission of Rally. ©2015 Rally Software Development Corp. All rights reserved.

Common Metrics Traps

1. Manipulation

2. Unbalanced metrics

3. Costly KPIs

4. Availability bias

5. Mechanical decision-making

6. False negatives

- 37 -

www.rallydev.comConfidential Do not copy or distribute without express permission of Rally. ©2015 Rally Software Development Corp. All rights reserved. - 38 -

False Negatives

www.rallydev.comConfidential Do not copy or distribute without express permission of Rally. ©2015 Rally Software Development Corp. All rights reserved.

Data Integrity Checks for Insights

• Quality stories(avoid stories that are really tasks and/or fake stories)

• Mapping kanban states to schedule state values(especially in-progress and accepted)

• Quantity of in-progress split stories (splitting stories at the end of the iteration)

• Defect state value accuracy

• Consistent use of defect environment field value

• Consistent use of defect priority field

- 39 -

www.rallydev.comConfidential Do not copy or distribute without express permission of Rally. ©2015 Rally Software Development Corp. All rights reserved. - 40 -

Use Case: Annual Company Disruptions

www.rallydev.comConfidential Do not copy or distribute without express permission of Rally. ©2015 Rally Software Development Corp. All rights reserved.

The Seven Deadly Sins of Agile Measurement Whitepaper

The Impact of Agile Quantified: SDPI Whitepaper

Agile Reports and Metrics Rally Help

Rally Success Program

- 41 -

To Learn More...

42