Leap ahead with Effective monitoring for testing in agile

Tomer Rider, Intel

Leap ahead with effective monitoring in agile 2 Tomer Rider

What to expect?

Focus

Takeaways

Monitoring in an agile environment

Familiarity with common measurements

What to expect?

Audience Agile team leaders / project managers / QA

Leap ahead with effective monitoring in agile 3 Tomer Rider

Introduction

• Increase team productivity

• Ensure product quality

• Enable decision making

• Motivation

• Provide a project status • Real-time

• Retrospective

• Projected

Why do we need to measure?

Leap ahead with effective monitoring in agile 4 Tomer Rider

What's different about Agile?

Leap ahead with effective monitoring in agile 5 Tomer Rider

Short dev cycles

Leap ahead with effective monitoring in agile 6 Tomer Rider

Strong collaboration

Leap ahead with effective monitoring in agile 7 Tomer Rider

Welcome changes

Leap ahead with effective monitoring in agile 8 Tomer Rider

Team ownership

Leap ahead with effective monitoring in agile 9 Tomer Rider Organization name

Constant need of data

Leap ahead with effective monitoring in agile 10 Tomer Rider

Measuring across the development lifecycle

Tracking Execution Planning

Leap ahead with effective monitoring in agile 11 Tomer Rider

Planning

Leap ahead with effective monitoring in agile 12 Tomer Rider

Planning – Velocity

Leap ahead with effective monitoring in agile 13 Tomer Rider

Planning – Bug fixing

Leap ahead with effective monitoring in agile 14 Tomer Rider

Planning – QA coverage and focus

- Based on Risk: what are the areas that are compromised?

- Based on bug spread: what are the most “buggiest” areas?

- Based on new user stories

67 User Stories

30 Bugs

Leap ahead with effective monitoring in agile 15 Tomer Rider

Execution

Leap ahead with effective monitoring in agile 16 Tomer Rider

Execution – Coverage and Progress

67 User Stories

88% Covered

189 Test Cases

65% Executed

43 Bugs Found

27 Bugs verified

Leap ahead with effective monitoring in agile 17 Tomer Rider

Execution – Coverage and Progress

Execution – Opened bugs, current iteration

Leap ahead with effective monitoring in agile 18 Tomer Rider

Tracking

Leap ahead with effective monitoring in agile 19 Tomer Rider

Tracking – Task / User story

Leap ahead with effective monitoring in agile 20 Tomer Rider

Tracking – User stories Acceptance

Acceptance status:

Acceptance rate:

Leap ahead with effective monitoring in agile 21 Tomer Rider

Tracking

- Backlog bugs

- Unassigned / Un prioritized Bugs

- incompleted tasks

- Risks

- Changes in requirements

Leap ahead with effective monitoring in agile 22 Tomer Rider

How to stay effective?

Leap ahead with effective monitoring in agile 23 Tomer Rider

How to stay effective?

- Data consolidation – connect the dots

- Clear definition of the acceptance criteria

- Define clear business metrics

- Define clear diagnostics that will enable metrics improvement

- Continues improvement of the processes

- Give the right context

Leap ahead with effective monitoring in agile 24 Tomer Rider

If you can’t measure it, you can’t improve it!

Questions ?

Thank You!