AgilePalooza - Agile Reporting and Metrics

72
© 2009 BigVisible Solutions, Inc. All Rights Reserved Giora Morein | [email protected] Co-Founder of BigVisible Solutions Certified Scrum Trainer (CST) Agile Coach Specialize in ramping up and scaling Agile and Scrum teams. Agile Reporting and Metrics

description

This presentation provides a sample of diagnostics and metrics on Agile projects to help diagnose and evaluate project performance.

Transcript of AgilePalooza - Agile Reporting and Metrics

Page 1: AgilePalooza - Agile Reporting and Metrics

© 2009 BigVisible Solutions, Inc. All Rights Reserved

Giora Morein | [email protected] •  Co-Founder of BigVisible Solutions •  Certified Scrum Trainer (CST) •  Agile Coach •  Specialize in ramping up and scaling Agile and

Scrum teams.

Agile Reporting and Metrics

Page 2: AgilePalooza - Agile Reporting and Metrics

© 2009 BigVisible Solutions, Inc.. All Rights Reserved

2

____ __ ____ _____ ____ ______ _____ _____ ____ _____ _____ _____ ____ _____

Click to edit Master text styles Second level Third level Fourth level Fifth level

Pro

duct

Levels of Reporting

Release/Project

Iteration Iteration

Iteration

Release/Project

Iteration Iteration

Iteration Iteration Iteration

Release/Project

Pro

gram

Iteration

Team

Page 3: AgilePalooza - Agile Reporting and Metrics

© 2009 BigVisible Solutions, Inc.. All Rights Reserved

3

____ __ ____ _____ ____ ______ _____ _____ ____ _____ _____ _____ ____ _____

Click to edit Master text styles Second level Third level Fourth level Fifth level

Starting off with…

Iteration Reporting

Iteration Reporting

Page 4: AgilePalooza - Agile Reporting and Metrics

© 2009 BigVisible Solutions, Inc.. All Rights Reserved

4

____ __ ____ _____ ____ ______ _____ _____ ____ _____ _____ _____ ____ _____

Click to edit Master text styles Second level Third level Fourth level Fifth level

Iteration Reporting Objectives

► Visibility into iteration performance

► Visibility into iteration risks

► Identify opportunities for correction

► Provide guidance on when/how to respond  Are we executing as planned?   Is our plan at risk?  Do we need to adjust?  How should we adjust?  When should I adjust?

Iteration Reporting

Page 5: AgilePalooza - Agile Reporting and Metrics

© 2009 BigVisible Solutions, Inc.. All Rights Reserved

5

____ __ ____ _____ ____ ______ _____ _____ ____ _____ _____ _____ ____ _____

Click to edit Master text styles Second level Third level Fourth level Fifth level

Stories are Selected

Story: 27

As a customer, I want to… see the how much the price of a stock has changed since I bought it

Story: 12

As a customer, I want to… see the latest stock price of a specific stock

Story: 18

As a prospective customer, I want to… see the list of products and services that are offered

Story: 35

As a customer, I want to…

see the list of stocks that I own

3 5

8 13

Iteration Reporting

Page 6: AgilePalooza - Agile Reporting and Metrics

© 2009 BigVisible Solutions, Inc.. All Rights Reserved

6

____ __ ____ _____ ____ ______ _____ _____ ____ _____ _____ _____ ____ _____

Click to edit Master text styles Second level Third level Fourth level Fifth level

Tasks are Defines

Story

Story: 27 As a customer, I want to… see the how much the price of a stock has changed since I bought it

Story: 18

As a customer, I want to… see the latest stock price of a specific stock

Story: 12

As a prospective customer, I want to… see the list of products and services that are offered

Story: 35

As a customer, I want to… see the list of stocks that I own

Finalize Requirements

8 hrs

Define Tests 8 hrs

Define Web- Service Interface

4 hrs

Develop Stock Object 16 hrs

Integrate with Stock Ticker Svs.

16 hrs

Visual Design 8 hrs

HTML Template 16 hrs

Modify Controller 24 hrs

Develop JSP 24 hrs

Execute Tests 16 hrs

Finalize Requirements

8 hrs

Define Tests 12 hrs

Define Web- Service Interface

4 hrs

Develop Portfolio Object 16 hrs

Call Stored Procedure

16 hrs

Visual Design 8 hrs

HTML Template 16 hrs

Modify Controller 24 hrs

Develop JSP 24 hrs

Execute Tests 16 hrs

Modify Schema 16 hrs

Stored Procedure 32 hrs

Build Cache 32 hrs

8

13

5

3

Finalize Requirements

4 hrs

Define Tests 8 hrs

Define Web- Service Interface

4 hrs

Develop Owned Object 16 hrs

Develop Compare Logic 16 hrs

Visual Design 2 hrs

HTML Template 16 hrs

Modify Controller 10 hrs

Develop JSP 12 hrs

Execute Tests 8 hrs

Finalize Requirements

4 hrs

Create Offering Content

8 hrs

Visual Design 8 hrs

Execute Tests 2 hrs

Develop JSP 4 hrs

Configure Role & Permissions

4 hrs

Define Tests 1 hrs

Tasks

Stored Procedure 8 hrs

Iteration Reporting

Page 7: AgilePalooza - Agile Reporting and Metrics

© 2009 BigVisible Solutions, Inc.. All Rights Reserved

7

____ __ ____ _____ ____ ______ _____ _____ ____ _____ _____ _____ ____ _____

Click to edit Master text styles Second level Third level Fourth level Fifth level

Day - 1 Task Board is Created

Story

Story: 27 As a customer, I want to… see the how much the price of a stock has changed since I bought it

Story: 18

As a customer, I want to… see the latest stock price of a specific stock

Story: 12

As a prospective customer, I want to… see the list of products and services that are offered

Story: 35

As a customer, I want to… see the list of stocks that I own

Finalize Requirements

8 hrs

Define Tests 8 hrs

Define Web- Service Interface

4 hrs

Develop Stock Object 16 hrs

Integrate with Stock Ticker Svs.

16 hrs Visual Design

8 hrs

HTML Template 16 hrs

Modify Controller 24 hrs Develop JSP

24 hrs

Execute Tests 16 hrs

Finalize Requirements

8 hrs

Define Tests 12 hrs

Define Web- Service Interface

4 hrs

Develop Portfolio Object 16 hrs

Call Stored Procedure

16 hrs

Visual Design 8 hrs

HTML Template 16 hrs

Modify Controller 24 hrs

Develop JSP 24 hrs

Execute Tests 16 hrs

Modify Schema 16 hrs Stored Procedure

32 hrs

Build Cache 32 hrs

8

13

5

3

Finalize Requirements

4 hrs

Define Tests 8 hrs

Define Web- Service Interface

4 hrs

Develop Owned Object 16 hrs

Develop Compare Logic 16 hrs

Visual Design 2 hrs

HTML Template 16 hrs

Modify Controller 10 hrs

Develop JSP 12 hrs

Execute Tests 8 hrs

Finalize Requirements

4 hrs

Create Offering Content

8 hrs

Visual Design 8 hrs

Execute Tests 2 hrs

Develop JSP 4 hrs

Configure Role & Permissions

4 hrs

Define Tests 1 hrs

Not Started

Stored Procedure 8 hrs

In Progress Complete

Iteration Reporting

Page 8: AgilePalooza - Agile Reporting and Metrics

© 2009 BigVisible Solutions, Inc.. All Rights Reserved

8

____ __ ____ _____ ____ ______ _____ _____ ____ _____ _____ _____ ____ _____

Click to edit Master text styles Second level Third level Fourth level Fifth level

Task List – Day 1 Iteration Reporting

Page 9: AgilePalooza - Agile Reporting and Metrics

© 2009 BigVisible Solutions, Inc.. All Rights Reserved

9

____ __ ____ _____ ____ ______ _____ _____ ____ _____ _____ _____ ____ _____

Click to edit Master text styles Second level Third level Fourth level Fifth level

Day 2 – Task Board Updated

Story

Story: 27 As a customer, I want to… see the how much the price of a stock has changed since I bought it

Story: 18

As a customer, I want to… see the latest stock price of a specific stock

Story: 12

As a prospective customer, I want to… see the list of products and services that are offered

Story: 35

As a customer, I want to… see the list of stocks that I own

Finalize Requirements

8 hrs

Define Tests 8 hrs

Define Web- Service Interface

4 hrs

Develop Stock Object 16 hrs

Integrate with Stock Ticker Svs.

16 hrs

Visual Design 8 hrs

HTML Template 16 hrs

Modify Controller 24 hrs

Develop JSP 24 hrs

Execute Tests 16 hrs

Finalize Requirements

8 hrs

Define Tests 12 hrs

Define Web- Service Interface

4 hrs

Develop Portfolio Object 16 hrs

Call Stored Procedure

16 hrs

Visual Design 8 hrs HTML Template

16 hrs

Modify Controller 24 hrs Develop JSP

24 hrs

Execute Tests 16 hrs

Modify Schema 16 hrs

Stored Procedure 32 hrs

Build Cache 32 hrs

8

13

5

3

Finalize Requirements

4 hrs

Define Tests 8 hrs

Define Web- Service Interface

4 hrs

Develop Owned Object 16 hrs

Develop Compare Logic 16 hrs

Visual Design 2 hrs

HTML Template 16 hrs

Modify Controller 10 hrs

Develop JSP 12 hrs

Execute Tests 8 hrs

Finalize Requirements

4 hrs

Create Offering Content

8 hrs

Visual Design 8 hrs

Execute Tests 2 hrs

Develop JSP 4 hrs

Configure Role & Permissions

4 hrs

Define Tests 1 hrs

Not Started

Stored Procedure 8 hrs

In Progress Complete

Iteration Reporting

Page 10: AgilePalooza - Agile Reporting and Metrics

© 2009 BigVisible Solutions, Inc.. All Rights Reserved

10

____ __ ____ _____ ____ ______ _____ _____ ____ _____ _____ _____ ____ _____

Click to edit Master text styles Second level Third level Fourth level Fifth level

Task List – Day 2 Iteration Reporting

Page 11: AgilePalooza - Agile Reporting and Metrics

© 2009 BigVisible Solutions, Inc.. All Rights Reserved

11

____ __ ____ _____ ____ ______ _____ _____ ____ _____ _____ _____ ____ _____

Click to edit Master text styles Second level Third level Fourth level Fifth level

Day 3 – Task Board Updated

Story

Story: 27 As a customer, I want to… see the how much the price of a stock has changed since I bought it

Story: 18

As a customer, I want to… see the latest stock price of a specific stock

Story: 12

As a prospective customer, I want to… see the list of products and services that are offered

Story: 35

As a customer, I want to… see the list of stocks that I own

Finalize Requirements

8 hrs

Define Tests 8 hrs

Define Web- Service Interface

4 hrs

Develop Stock Object 16 hrs

Integrate with Stock Ticker Svs.

16 hrs

Visual Design 8 hrs

HTML Template 16 hrs

Modify Controller 24 hrs Develop JSP

24 hrs

Execute Tests 16 hrs

Finalize Requirements

8 hrs

Define Tests 12 hrs

Define Web- Service Interface

4 hrs

Develop Portfolio Object 16 hrs

Call Stored Procedure

16 hrs

Visual Design 8 hrs

HTML Template 16 hrs

Modify Controller 24 hrs

Develop JSP 24 hrs

Execute Tests 16 hrs

Modify Schema 16 hrs

Stored Procedure 32 hrs

Build Cache 32 hrs 8

13

5

3

Finalize Requirements

4 hrs

Define Tests 8 hrs

Define Web- Service Interface

4 hrs

Develop Owned Object 16 hrs

Develop Compare Logic 16 hrs

Visual Design 2 hrs

HTML Template 16 hrs

Modify Controller 10 hrs

Develop JSP 12 hrs

Execute Tests 8 hrs

Finalize Requirements

4 hrs

Create Offering Content

8 hrs

Visual Design 8 hrs

Execute Tests 2 hrs

Develop JSP 4 hrs

Configure Role & Permissions

4 hrs

Define Tests 1 hrs

Not Started

Stored Procedure 8 hrs

In Progress Complete

Iteration Reporting

Page 12: AgilePalooza - Agile Reporting and Metrics

© 2009 BigVisible Solutions, Inc.. All Rights Reserved

12

____ __ ____ _____ ____ ______ _____ _____ ____ _____ _____ _____ ____ _____

Click to edit Master text styles Second level Third level Fourth level Fifth level

Task List – Day 3 Iteration Reporting

Page 13: AgilePalooza - Agile Reporting and Metrics

© 2009 BigVisible Solutions, Inc.. All Rights Reserved

13

____ __ ____ _____ ____ ______ _____ _____ ____ _____ _____ _____ ____ _____

Click to edit Master text styles Second level Third level Fourth level Fifth level

Day 4 – Task Board Updated

Story

Story: 27 As a customer, I want to… see the how much the price of a stock has changed since I bought it

Story: 18

As a customer, I want to… see the latest stock price of a specific stock

Story: 12

As a prospective customer, I want to… see the list of products and services that are offered

Story: 35

As a customer, I want to… see the list of stocks that I own

Finalize Requirements

8 hrs

Define Tests 8 hrs

Define Web- Service Interface

4 hrs

Develop Stock Object 16 hrs

Integrate with Stock Ticker Svs.

16 hrs

Visual Design 8 hrs

HTML Template 16 hrs

Modify Controller 24 hrs

Develop JSP 24 hrs

Execute Tests 16 hrs

Finalize Requirements

8 hrs

Define Tests 12 hrs

Define Web- Service Interface

4 hrs

Develop Portfolio Object 16 hrs

Call Stored Procedure

16 hrs

Visual Design 8 hrs HTML Template 16 hrs

Modify Controller 24 hrs

Develop JSP 24 hrs

Execute Tests 16 hrs

Modify Schema 16 hrs

Stored Procedure 32 hrs

Build Cache 32 hrs 8

13

5

3

Finalize Requirements

4 hrs

Define Tests 8 hrs

Define Web- Service Interface

4 hrs

Develop Owned Object 16 hrs

Develop Compare Logic 16 hrs

Visual Design 2 hrs

HTML Template 16 hrs

Modify Controller 10 hrs

Develop JSP 12 hrs

Execute Tests 8 hrs

Finalize Requirements

4 hrs

Create Offering Content

8 hrs

Visual Design 8 hrs

Execute Tests 2 hrs

Develop JSP 4 hrs

Configure Role & Permissions

4 hrs

Define Tests 1 hrs

Not Started

Stored Procedure 8 hrs

In Progress Complete

Iteration Reporting

Page 14: AgilePalooza - Agile Reporting and Metrics

© 2009 BigVisible Solutions, Inc.. All Rights Reserved

14

____ __ ____ _____ ____ ______ _____ _____ ____ _____ _____ _____ ____ _____

Click to edit Master text styles Second level Third level Fourth level Fifth level

Task List – Day 4 Iteration Reporting

Page 15: AgilePalooza - Agile Reporting and Metrics

© 2009 BigVisible Solutions, Inc.. All Rights Reserved

15

____ __ ____ _____ ____ ______ _____ _____ ____ _____ _____ _____ ____ _____

Click to edit Master text styles Second level Third level Fourth level Fifth level

Day 5 – Task Board Updated

Story

Story: 27 As a customer, I want to… see the how much the price of a stock has changed since I bought it

Story: 18

As a customer, I want to… see the latest stock price of a specific stock

Story: 12

As a prospective customer, I want to… see the list of products and services that are offered

Story: 35

As a customer, I want to… see the list of stocks that I own

Finalize Requirements

8 hrs

Define Tests 8 hrs

Define Web- Service Interface

4 hrs

Develop Stock Object 16 hrs

Integrate with Stock Ticker Svs.

16 hrs

Visual Design 8 hrs

HTML Template 16 hrs

Modify Controller 24 hrs

Develop JSP 24 hrs

Execute Tests 16 hrs

Finalize Requirements

8 hrs

Define Tests 12 hrs

Define Web- Service Interface

4 hrs

Develop Portfolio Object 16 hrs

Call Stored Procedure

16 hrs

Visual Design 8 hrs HTML Template 16 hrs

Modify Controller 24 hrs

Develop JSP 24 hrs

Execute Tests 16 hrs

Modify Schema 16 hrs Stored Procedure

32 hrs

Build Cache 32 hrs 8

13

5

3

Finalize Requirements

4 hrs

Define Tests 8 hrs

Define Web- Service Interface

4 hrs

Develop Owned Object 16 hrs

Develop Compare Logic 16 hrs

Visual Design 2 hrs

HTML Template 16 hrs

Modify Controller 10 hrs

Develop JSP 12 hrs

Execute Tests 8 hrs

Finalize Requirements

4 hrs

Create Offering Content

8 hrs

Visual Design 8 hrs

Execute Tests 2 hrs

Develop JSP 4 hrs

Configure Role & Permissions

4 hrs

Define Tests 1 hrs

Not Started

Stored Procedure 8 hrs

In Progress Complete

Iteration Reporting

Page 16: AgilePalooza - Agile Reporting and Metrics

© 2009 BigVisible Solutions, Inc.. All Rights Reserved

16

____ __ ____ _____ ____ ______ _____ _____ ____ _____ _____ _____ ____ _____

Click to edit Master text styles Second level Third level Fourth level Fifth level

Task List – Day 5 Iteration Reporting

Page 17: AgilePalooza - Agile Reporting and Metrics

© 2009 BigVisible Solutions, Inc.. All Rights Reserved

17

____ __ ____ _____ ____ ______ _____ _____ ____ _____ _____ _____ ____ _____

Click to edit Master text styles Second level Third level Fourth level Fifth level

The Iteration Burn-down

Iteration Progress Reporting

►  Is the team on-track to complete planned iteration work?

►  Which stories are at risk of not being completed?

►  Do I need to add or remove stories from the iteration?

Iteration Reporting

Page 18: AgilePalooza - Agile Reporting and Metrics

© 2009 BigVisible Solutions, Inc.. All Rights Reserved

18

____ __ ____ _____ ____ ______ _____ _____ ____ _____ _____ _____ ____ _____

Click to edit Master text styles Second level Third level Fourth level Fifth level

Burn-down Analysis Fundamentals Iteration Reporting

Page 19: AgilePalooza - Agile Reporting and Metrics

© 2009 BigVisible Solutions, Inc.. All Rights Reserved

19

____ __ ____ _____ ____ ______ _____ _____ ____ _____ _____ _____ ____ _____

Click to edit Master text styles Second level Third level Fourth level Fifth level

Burn-down Analysis Fundamentals Iteration Reporting

Page 20: AgilePalooza - Agile Reporting and Metrics

© 2009 BigVisible Solutions, Inc.. All Rights Reserved

20

____ __ ____ _____ ____ ______ _____ _____ ____ _____ _____ _____ ____ _____

Click to edit Master text styles Second level Third level Fourth level Fifth level

Burn-down Analysis Fundamentals

Too Slow ± 200 hours over

Iteration Reporting

Page 21: AgilePalooza - Agile Reporting and Metrics

© 2009 BigVisible Solutions, Inc.. All Rights Reserved

21

____ __ ____ _____ ____ ______ _____ _____ ____ _____ _____ _____ ____ _____

Click to edit Master text styles Second level Third level Fourth level Fifth level

Burn-down Analysis Fundamentals Iteration Reporting

Page 22: AgilePalooza - Agile Reporting and Metrics

© 2009 BigVisible Solutions, Inc.. All Rights Reserved

22

____ __ ____ _____ ____ ______ _____ _____ ____ _____ _____ _____ ____ _____

Click to edit Master text styles Second level Third level Fourth level Fifth level

Burn-down Analysis Fundamentals

Too Fast ± 200 hours under

Iteration Reporting

Page 23: AgilePalooza - Agile Reporting and Metrics

© 2009 BigVisible Solutions, Inc.. All Rights Reserved

23

____ __ ____ _____ ____ ______ _____ _____ ____ _____ _____ _____ ____ _____

Click to edit Master text styles Second level Third level Fourth level Fifth level

Basic Iteration Burn-down Analysis Iteration Reporting

Page 24: AgilePalooza - Agile Reporting and Metrics

© 2009 BigVisible Solutions, Inc.. All Rights Reserved

24

____ __ ____ _____ ____ ______ _____ _____ ____ _____ _____ _____ ____ _____

Click to edit Master text styles Second level Third level Fourth level Fifth level

Basic Iteration Burn-down Analysis Iteration Reporting

Page 25: AgilePalooza - Agile Reporting and Metrics

© 2009 BigVisible Solutions, Inc.. All Rights Reserved

25

____ __ ____ _____ ____ ______ _____ _____ ____ _____ _____ _____ ____ _____

Click to edit Master text styles Second level Third level Fourth level Fifth level

What about….

Changes to the planned tasks?

Iteration Reporting

Page 26: AgilePalooza - Agile Reporting and Metrics

© 2009 BigVisible Solutions, Inc.. All Rights Reserved

26

____ __ ____ _____ ____ ______ _____ _____ ____ _____ _____ _____ ____ _____

Click to edit Master text styles Second level Third level Fourth level Fifth level

More Iteration Burn-down Analysis Iteration Reporting

Page 27: AgilePalooza - Agile Reporting and Metrics

© 2009 BigVisible Solutions, Inc.. All Rights Reserved

27

____ __ ____ _____ ____ ______ _____ _____ ____ _____ _____ _____ ____ _____

Click to edit Master text styles Second level Third level Fourth level Fifth level

More Iteration Burn-down Analysis Iteration Reporting

Page 28: AgilePalooza - Agile Reporting and Metrics

© 2009 BigVisible Solutions, Inc.. All Rights Reserved

28

____ __ ____ _____ ____ ______ _____ _____ ____ _____ _____ _____ ____ _____

Click to edit Master text styles Second level Third level Fourth level Fifth level

More Iteration Burn-down Analysis Iteration Reporting

Page 29: AgilePalooza - Agile Reporting and Metrics

© 2009 BigVisible Solutions, Inc.. All Rights Reserved

29

____ __ ____ _____ ____ ______ _____ _____ ____ _____ _____ _____ ____ _____

Click to edit Master text styles Second level Third level Fourth level Fifth level

More Iteration Burn-down Analysis

Rate of work completion prior to scope change

At the same rate this team does not complete all planned work

Iteration Reporting

Page 30: AgilePalooza - Agile Reporting and Metrics

© 2009 BigVisible Solutions, Inc.. All Rights Reserved

30

____ __ ____ _____ ____ ______ _____ _____ ____ _____ _____ _____ ____ _____

Click to edit Master text styles Second level Third level Fourth level Fifth level

More Iteration Burn-down Analysis Iteration Reporting

Page 31: AgilePalooza - Agile Reporting and Metrics

© 2009 BigVisible Solutions, Inc.. All Rights Reserved

31

____ __ ____ _____ ____ ______ _____ _____ ____ _____ _____ _____ ____ _____

Click to edit Master text styles Second level Third level Fourth level Fifth level

Burn-down Anti-Patterns Iteration Reporting

Page 32: AgilePalooza - Agile Reporting and Metrics

© 2009 BigVisible Solutions, Inc.. All Rights Reserved

32

____ __ ____ _____ ____ ______ _____ _____ ____ _____ _____ _____ ____ _____

Click to edit Master text styles Second level Third level Fourth level Fifth level

Burn-down Anti-Patterns Iteration Reporting

Page 33: AgilePalooza - Agile Reporting and Metrics

© 2009 BigVisible Solutions, Inc.. All Rights Reserved

33

____ __ ____ _____ ____ ______ _____ _____ ____ _____ _____ _____ ____ _____

Click to edit Master text styles Second level Third level Fourth level Fifth level

Burn-down Anti-Patterns Iteration Reporting

Page 34: AgilePalooza - Agile Reporting and Metrics

© 2009 BigVisible Solutions, Inc.. All Rights Reserved

34

____ __ ____ _____ ____ ______ _____ _____ ____ _____ _____ _____ ____ _____

Click to edit Master text styles Second level Third level Fourth level Fifth level

Burn-down Anti-Patterns

Typical slow-down caused by bottle- neck

Iteration Reporting

Page 35: AgilePalooza - Agile Reporting and Metrics

© 2009 BigVisible Solutions, Inc.. All Rights Reserved

35

____ __ ____ _____ ____ ______ _____ _____ ____ _____ _____ _____ ____ _____

Click to edit Master text styles Second level Third level Fourth level Fifth level

Burn-down Limitations

►  Simple quantitative diagnostic – little use without context

►  Requires first-hand knowledge to effectively diagnose   However common patterns/anti-patterns emerge

►  Shows impact of bottleneck – does not help in identifying bottle-neck

Iteration Reporting

Page 36: AgilePalooza - Agile Reporting and Metrics

© 2009 BigVisible Solutions, Inc.. All Rights Reserved

36

____ __ ____ _____ ____ ______ _____ _____ ____ _____ _____ _____ ____ _____

Click to edit Master text styles Second level Third level Fourth level Fifth level

Revisiting the Bottleneck

Typical slow-down caused by bottle- neck

Iteration Reporting

Page 37: AgilePalooza - Agile Reporting and Metrics

© 2009 BigVisible Solutions, Inc.. All Rights Reserved

37

____ __ ____ _____ ____ ______ _____ _____ ____ _____ _____ _____ ____ _____

Click to edit Master text styles Second level Third level Fourth level Fifth level

Bottleneck pattern not observed early Iteration Reporting

Page 38: AgilePalooza - Agile Reporting and Metrics

© 2009 BigVisible Solutions, Inc.. All Rights Reserved

38

____ __ ____ _____ ____ ______ _____ _____ ____ _____ _____ _____ ____ _____

Click to edit Master text styles Second level Third level Fourth level Fifth level

Exploring Functional Specialties

Story

Story: 27 As a customer, I want to… see the how much the price of a stock has changed since I bought it

Story: 18

As a customer, I want to… see the latest stock price of a specific stock

Story: 12

As a prospective customer, I want to… see the list of products and services that are offered

Story: 35

As a customer, I want to… see the list of stocks that I own

Finalize Requirements

8 hrs

Define Tests 8 hrs

Define Web- Service Interface

4 hrs

Develop Stock Object 16 hrs

Integrate with Stock Ticker Svs.

16 hrs

Visual Design 8 hrs

HTML Template 16 hrs

Modify Controller 24 hrs

Develop JSP 24 hrs

Execute Tests 16 hrs

Finalize Requirements

8 hrs

Define Tests 12 hrs

Define Web- Service Interface

4 hrs

Develop Portfolio Object 16 hrs

Call Stored Procedure

16 hrs

Visual Design 8 hrs

HTML Template 16 hrs

Modify Controller 24 hrs

Develop JSP 24 hrs

Execute Tests 16 hrs

Modify Schema 16 hrs

Stored Procedure 32 hrs

Build Cache 32 hrs

8

13

5

3

Finalize Requirements

4 hrs

Define Tests 8 hrs

Define Web- Service Interface

4 hrs

Develop Owned Object 16 hrs

Develop Compare Logic 16 hrs

Visual Design 2 hrs

HTML Template 16 hrs

Modify Controller 10 hrs

Develop JSP 12 hrs

Execute Tests 8 hrs

Finalize Requirements

4 hrs

Create Offering Content

8 hrs

Visual Design 8 hrs

Execute Tests 2 hrs

Develop JSP 4 hrs

Configure Role & Permissions

4 hrs

Define Tests 1 hrs

Tasks

Stored Procedure 8 hrs

Iteration Reporting

Page 39: AgilePalooza - Agile Reporting and Metrics

© 2009 BigVisible Solutions, Inc.. All Rights Reserved

39

____ __ ____ _____ ____ ______ _____ _____ ____ _____ _____ _____ ____ _____

Click to edit Master text styles Second level Third level Fourth level Fifth level

Identify Task Categories

Story

Story: 27 As a customer, I want to… see the how much the price of a stock has changed since I bought it

Story: 18

As a customer, I want to… see the latest stock price of a specific stock

Story: 12

As a prospective customer, I want to… see the list of products and services that are offered

Story: 35

As a customer, I want to… see the list of stocks that I own

Finalize Requirements

8 hrs

Define Tests 8 hrs

Define Web- Service Interface

4 hrs

Develop Stock Object 16 hrs

Integrate with Stock Ticker Svs.

16 hrs

Visual Design 8 hrs

HTML Template 16 hrs

Modify Controller 24 hrs

Develop JSP 24 hrs

Execute Tests 16 hrs

Finalize Requirements

8 hrs

Define Tests 12 hrs

Define Web- Service Interface

4 hrs

Develop Portfolio Object 16 hrs

Call Stored Procedure

16 hrs

Visual Design 8 hrs

HTML Template 16 hrs

Modify Controller 24 hrs

Develop JSP 24 hrs

Execute Tests 16 hrs

Modify Schema 16 hrs

Stored Procedure 32 hrs

Build Cache 32 hrs

8

13

5

3

Finalize Requirements

4 hrs

Define Tests 8 hrs

Define Web- Service Interface

4 hrs

Develop Owned Object 16 hrs

Develop Compare Logic 16 hrs

Visual Design 2 hrs

HTML Template 16 hrs

Modify Controller 10 hrs

Develop JSP 12 hrs

Execute Tests 8 hrs

Finalize Requirements

4 hrs

Create Offering Content

8 hrs

Visual Design 8 hrs

Execute Tests 2 hrs

Develop JSP 4 hrs

Configure Role & Permissions

4 hrs

Define Tests 1 hrs

Tasks

Stored Procedure 8 hrs

Iteration Reporting

Page 40: AgilePalooza - Agile Reporting and Metrics

© 2009 BigVisible Solutions, Inc.. All Rights Reserved

40

____ __ ____ _____ ____ ______ _____ _____ ____ _____ _____ _____ ____ _____

Click to edit Master text styles Second level Third level Fourth level Fifth level

Category or Functional Burn-Down Iteration Reporting

Page 41: AgilePalooza - Agile Reporting and Metrics

© 2009 BigVisible Solutions, Inc.. All Rights Reserved

41

____ __ ____ _____ ____ ______ _____ _____ ____ _____ _____ _____ ____ _____

Click to edit Master text styles Second level Third level Fourth level Fifth level

Category Burn-Down

Bottleneck or Limiting Constraint

This type of tasks is not trending toward completion

Iteration Reporting

Page 42: AgilePalooza - Agile Reporting and Metrics

© 2009 BigVisible Solutions, Inc.. All Rights Reserved

42

____ __ ____ _____ ____ ______ _____ _____ ____ _____ _____ _____ ____ _____

Click to edit Master text styles Second level Third level Fourth level Fifth level

Incorrectly Diagnosed Burn-Down

Without the Category Burn-Down, one may mistakenly add additional story to iteration

Iteration Reporting

Page 43: AgilePalooza - Agile Reporting and Metrics

© 2009 BigVisible Solutions, Inc.. All Rights Reserved

43

____ __ ____ _____ ____ ______ _____ _____ ____ _____ _____ _____ ____ _____

Click to edit Master text styles Second level Third level Fourth level Fifth level

How about…

Release Reporting

Iteration Reporting

Page 44: AgilePalooza - Agile Reporting and Metrics

© 2009 BigVisible Solutions, Inc.. All Rights Reserved

44

____ __ ____ _____ ____ ______ _____ _____ ____ _____ _____ _____ ____ _____

Click to edit Master text styles Second level Third level Fourth level Fifth level

Release/Project Reporting Objectives

►  Visibility into overall team performance and productivity

►  Visibility into release and project progress

►  Ability to forecast   When will we finish?   How much will be finished?

►  Determine if adjustments are needed

►  Determine impact of environment/constraint changes

Release Reporting

Page 45: AgilePalooza - Agile Reporting and Metrics

© 2009 BigVisible Solutions, Inc.. All Rights Reserved

45

____ __ ____ _____ ____ ______ _____ _____ ____ _____ _____ _____ ____ _____

Click to edit Master text styles Second level Third level Fourth level Fifth level

Velocity Chart – Bar Chart

►  Shows velocity history for single team

►  Cannot be used to compare multiple teams

►  Remember: Past Performance Does Not Guarantee Future Results

Release Reporting

Page 46: AgilePalooza - Agile Reporting and Metrics

© 2009 BigVisible Solutions, Inc.. All Rights Reserved

46

____ __ ____ _____ ____ ______ _____ _____ ____ _____ _____ _____ ____ _____

Click to edit Master text styles Second level Third level Fourth level Fifth level

Velocity Chart – Line Chart

►  Easier to identify trends

Release Reporting

Page 47: AgilePalooza - Agile Reporting and Metrics

© 2009 BigVisible Solutions, Inc.. All Rights Reserved

47

____ __ ____ _____ ____ ______ _____ _____ ____ _____ _____ _____ ____ _____

Click to edit Master text styles Second level Third level Fourth level Fifth level

Velocity Chart – Line Chart

►  Easier to identify trends

►  Overlay “Planned” and “Actual” Velocity

Release Reporting

Page 48: AgilePalooza - Agile Reporting and Metrics

© 2009 BigVisible Solutions, Inc.. All Rights Reserved

48

____ __ ____ _____ ____ ______ _____ _____ ____ _____ _____ _____ ____ _____

Click to edit Master text styles Second level Third level Fourth level Fifth level

Velocity Chart – Line Chart

►  Easier to identify trends

►  Overlay “Planned” and “Actual” Velocity

►  Delta shows levels of variance

Release Reporting

Page 49: AgilePalooza - Agile Reporting and Metrics

© 2009 BigVisible Solutions, Inc.. All Rights Reserved

49

____ __ ____ _____ ____ ______ _____ _____ ____ _____ _____ _____ ____ _____

Click to edit Master text styles Second level Third level Fourth level Fifth level

Velocity Chart Patterns - Converging

Symptom ►  Planned and Actual

converging

►  Delta getting smaller

Diagnosis ►  Healthy trend

►  Team is converging on consistent velocity

►  Team is improving its ability to plan and execute consistently

►  Developing rhythm

Release Reporting

Page 50: AgilePalooza - Agile Reporting and Metrics

© 2009 BigVisible Solutions, Inc.. All Rights Reserved

50

____ __ ____ _____ ____ ______ _____ _____ ____ _____ _____ _____ ____ _____

Click to edit Master text styles Second level Third level Fourth level Fifth level

Velocity Chart Patterns - Erratic

Symptom ►  Erratic pattern

►  Consistently high delta

►  Little or no planned-actual convergence

Diagnosis ►  Stories are not being

completed within the iteration – bleed-over

►  Stories are being started then completed in subsequent iteration

►  Velocity accounts for completed stories

Release Reporting

Page 51: AgilePalooza - Agile Reporting and Metrics

© 2009 BigVisible Solutions, Inc.. All Rights Reserved

51

____ __ ____ _____ ____ ______ _____ _____ ____ _____ _____ _____ ____ _____

Click to edit Master text styles Second level Third level Fourth level Fifth level

Velocity Chart Patterns - Diverging

Symptom ►  Planned and Actual

diverging

►  Delta getting bigger

Diagnosis ►  Unhealthy trend

►  Team not completing stories

►  Iteration bleed-over increasing

►  Team losing rhythm

►  Requires immediate investigation

Release Reporting

Page 52: AgilePalooza - Agile Reporting and Metrics

© 2009 BigVisible Solutions, Inc.. All Rights Reserved

52

____ __ ____ _____ ____ ______ _____ _____ ____ _____ _____ _____ ____ _____

Click to edit Master text styles Second level Third level Fourth level Fifth level

Velocity Chart Patterns - Decreasing

Symptom ►  Decreasing Velocity

►  Consistent Delta

Diagnosis ►  Very bad trend

►  Decreasing productivity

Release Reporting

Page 53: AgilePalooza - Agile Reporting and Metrics

© 2009 BigVisible Solutions, Inc.. All Rights Reserved

53

____ __ ____ _____ ____ ______ _____ _____ ____ _____ _____ _____ ____ _____

Click to edit Master text styles Second level Third level Fourth level Fifth level

Velocity Chart Patterns - Decreasing

Symptom ►  Decreasing Velocity

►  Consistent Delta

Possible Causes ►  Changes in Team

►  Changes in Team member availability

►  Accumulation of Technical Debt

►  Most Likely: Increase in Manual Testing Activities ►  Poor unit-test coverage

►  Poor test automation

Release Reporting

Page 54: AgilePalooza - Agile Reporting and Metrics

© 2009 BigVisible Solutions, Inc.. All Rights Reserved

54

____ __ ____ _____ ____ ______ _____ _____ ____ _____ _____ _____ ____ _____

Click to edit Master text styles Second level Third level Fourth level Fifth level

Release Burn-down

►  Primary progress-monitoring tool

►  Tracks progress from iteration to iterations

►  Indicates if team is on-schedule

►  Indicates whether there is sufficient time and velocity

Release Reporting

Page 55: AgilePalooza - Agile Reporting and Metrics

© 2009 BigVisible Solutions, Inc.. All Rights Reserved

55

____ __ ____ _____ ____ ______ _____ _____ ____ _____ _____ _____ ____ _____

Click to edit Master text styles Second level Third level Fourth level Fifth level

Release Burn-Down

►  How long will it take to release these features?

Release Reporting

Page 56: AgilePalooza - Agile Reporting and Metrics

© 2009 BigVisible Solutions, Inc.. All Rights Reserved

56

____ __ ____ _____ ____ ______ _____ _____ ____ _____ _____ _____ ____ _____

Click to edit Master text styles Second level Third level Fourth level Fifth level

Release Burn-Down – Multiple Velocities

►  Forecasting with Different Velocities

*Assumes Controlled Scope

Release Reporting

Page 57: AgilePalooza - Agile Reporting and Metrics

© 2009 BigVisible Solutions, Inc.. All Rights Reserved

57

____ __ ____ _____ ____ ______ _____ _____ ____ _____ _____ _____ ____ _____

Click to edit Master text styles Second level Third level Fourth level Fifth level

Release Burn-Up

►  How much can I complete within a specific timeframe (15 Iterations)?

Release Reporting

Page 58: AgilePalooza - Agile Reporting and Metrics

© 2009 BigVisible Solutions, Inc.. All Rights Reserved

58

____ __ ____ _____ ____ ______ _____ _____ ____ _____ _____ _____ ____ _____

Click to edit Master text styles Second level Third level Fourth level Fifth level

Exploring…

Program Reporting

Program Reporting

Page 59: AgilePalooza - Agile Reporting and Metrics

© 2009 BigVisible Solutions, Inc.. All Rights Reserved

59

____ __ ____ _____ ____ ______ _____ _____ ____ _____ _____ _____ ____ _____

Click to edit Master text styles Second level Third level Fourth level Fifth level

The Program Reporting Problem

►  Independent teams with independent backlogs

►  Story sizes and velocities are not comparable across teams

►  Normalizing story points is expensive, temporary and inaccurate

Program Reporting

Page 60: AgilePalooza - Agile Reporting and Metrics

© 2009 BigVisible Solutions, Inc.. All Rights Reserved

60

____ __ ____ _____ ____ ______ _____ _____ ____ _____ _____ _____ ____ _____

Click to edit Master text styles Second level Third level Fourth level Fifth level

Sprint/Weeks Remaining Snapshot

►  For each team, calculate time/sprints to complete backlog   Release Backlog Size/Velocity

0

2

4

6

8

10

12

14

Team A Team B Team C Team D

Sprin

ts R

em

ain

ing

Team

Release Backlog Completion Forecast As of 3/3/2009

Target Release

Program Reporting

Page 61: AgilePalooza - Agile Reporting and Metrics

© 2009 BigVisible Solutions, Inc.. All Rights Reserved

61

____ __ ____ _____ ____ ______ _____ _____ ____ _____ _____ _____ ____ _____

Click to edit Master text styles Second level Third level Fourth level Fifth level

Cumulative Weeks Remaining Time Series

0

10

20

30

40

50

60

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15

Cum

ula

tive

Sp

rints

Re

ma

inin

g

Sprint #

Cumulative Sprints Remaining

Team D

Team C

Team B

Team A

Program Reporting

Page 62: AgilePalooza - Agile Reporting and Metrics

© 2009 BigVisible Solutions, Inc.. All Rights Reserved

62

____ __ ____ _____ ____ ______ _____ _____ ____ _____ _____ _____ ____ _____

Click to edit Master text styles Second level Third level Fourth level Fifth level

Cumulative Time Remaining Burndown

0

10

20

30

40

50

60

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15

Cum

ula

tive

Sp

rints

Re

ma

inin

g

Sprint #

Cumulative Sprints Remaining

Team D

Team C

Team B

Team A

Linear(Trend)

Program Reporting

Page 63: AgilePalooza - Agile Reporting and Metrics

© 2009 BigVisible Solutions, Inc.. All Rights Reserved

63

____ __ ____ _____ ____ ______ _____ _____ ____ _____ _____ _____ ____ _____

Click to edit Master text styles Second level Third level Fourth level Fifth level

Let’s look at…

Product Reporting

Iteration Reporting

Page 64: AgilePalooza - Agile Reporting and Metrics

© 2009 BigVisible Solutions, Inc.. All Rights Reserved

64

____ __ ____ _____ ____ ______ _____ _____ ____ _____ _____ _____ ____ _____

Click to edit Master text styles Second level Third level Fourth level Fifth level

Feature Reporting

►  Stories can be grouped into features

►  Progress reported based on points

Product Reporting

Page 65: AgilePalooza - Agile Reporting and Metrics

© 2009 BigVisible Solutions, Inc.. All Rights Reserved

65

____ __ ____ _____ ____ ______ _____ _____ ____ _____ _____ _____ ____ _____

Click to edit Master text styles Second level Third level Fourth level Fifth level

Feature Progress Reporting Product Reporting

Page 66: AgilePalooza - Agile Reporting and Metrics

© 2009 BigVisible Solutions, Inc.. All Rights Reserved

66

____ __ ____ _____ ____ ______ _____ _____ ____ _____ _____ _____ ____ _____

Click to edit Master text styles Second level Third level Fourth level Fifth level

Test Reporting

►  Test-Centric rather than Defect-Centric

►  Determine level of tests defined, executed and passed

►  Tracks progress from iteration to iterations

Product Reporting

Page 67: AgilePalooza - Agile Reporting and Metrics

© 2009 BigVisible Solutions, Inc.. All Rights Reserved

67

____ __ ____ _____ ____ ______ _____ _____ ____ _____ _____ _____ ____ _____

Click to edit Master text styles Second level Third level Fourth level Fifth level

Testing per Iteration Product Reporting

Page 68: AgilePalooza - Agile Reporting and Metrics

© 2009 BigVisible Solutions, Inc.. All Rights Reserved

68

____ __ ____ _____ ____ ______ _____ _____ ____ _____ _____ _____ ____ _____

Click to edit Master text styles Second level Third level Fourth level Fifth level

Testing Coverage Growth Product Reporting

Page 69: AgilePalooza - Agile Reporting and Metrics

© 2009 BigVisible Solutions, Inc.. All Rights Reserved

69

____ __ ____ _____ ____ ______ _____ _____ ____ _____ _____ _____ ____ _____

Click to edit Master text styles Second level Third level Fourth level Fifth level

“Escape” Defects Product Reporting

Page 70: AgilePalooza - Agile Reporting and Metrics

© 2009 BigVisible Solutions, Inc.. All Rights Reserved

70

____ __ ____ _____ ____ ______ _____ _____ ____ _____ _____ _____ ____ _____

Click to edit Master text styles Second level Third level Fourth level Fifth level

Test Automation Product Reporting

Page 71: AgilePalooza - Agile Reporting and Metrics

© 2009 BigVisible Solutions, Inc.. All Rights Reserved

71

____ __ ____ _____ ____ ______ _____ _____ ____ _____ _____ _____ ____ _____

Click to edit Master text styles Second level Third level Fourth level Fifth level

A little…

Team Reporting

Iteration Reporting

Page 72: AgilePalooza - Agile Reporting and Metrics

© 2009 BigVisible Solutions, Inc.. All Rights Reserved

72

____ __ ____ _____ ____ ______ _____ _____ ____ _____ _____ _____ ____ _____

Click to edit Master text styles Second level Third level Fourth level Fifth level

Morale Barometer

►  Track and plot the ebb and flow in team morale.   10=happiness; 1= get me off this project   Plot average team vote against Iteration

►  Falling trend in morale should be addressed immediately

Project A Morale Iteration 1 8.2 Iteration 2 8.5 Iteration 3 7.9 Iteration 4 8.0

Team Reporting