Managing Coverage in an Agile World - Meetupfiles.meetup.com/1686895/20120510-SFAUG-QMetry.pdf ·...

phone: (408) 727-1101 | website: www.QMetry.com | email: [email protected]

©2008-2012 InfoStretch Corporation. All rights reserved.

Managing Coverage in an Agile World



QMetry Customer Profile

QMetry Helps

Small Companies: Transition from Excel to a test management solution

Mid-Sized Companies: Integrate test efforts, Reduce Costs

Large Companies: Replace Legacy systems

Target Audience: QA Managers Testers Developers Automation leads QA directors



Our User Story

•  Challenge –  Shorter time frame to respond –  Need to resolve issues quickly

•  Solution –  Moved from Mantis to JIRA and integrated our

systems

•  Results –  Increased Visibility, Collaboration and Flexibility



What is Agile?

The Agile Manifesto: “We are uncovering better ways of developing software by doing it and helping others do it. Through this work we have come to value:

•  Individuals and interactions over processes and tools •  Working software over comprehensive documentation •  Customer collaboration over contract negotiation •  Responding to change over following a plan

That is, while there is value in the items on the right, we value the items on the left more.”



Our Agile Goals

•  Improve communication between departments

•  Improve communication with customers •  Be more responsive to changing demands •  Improve software stability and compatibility –  Improve Coverage –  Automate regression



What is Coverage?

•  Functional testing of the User Stories •  Regression testing of Core Functionality •  Platform / Configuration testing

(Hardware configurations, software settings, Browsers, Mobile platforms, etc.) “In the increasingly splintered world of the cloud and mobile the need to perform platform coverage grows.”



Managing Coverage

•  The Holy Grail is Complete traceability –  Verify Functional testing of the User Stories

•  Internal Bug Fixes vs. Customer based Bug Fixes

–  Verify functionality against Platforms –  Verify stability –  Reporting results



How we Use JIRA for Agile •  Log and define all Issues –  Bugs

•  Customer related bugs are created by Zendesk

–  Improvements –  New Features

•  Sub-tasks to create “epics” •  Link “guidelines” (custom issue type) that define general

standards (mostly UI). •  Link related bugs



How we Use JIRA for Agile (2) •  Converting Issues to Requirements –  Using comments in JIRA we define issue

•  When issue defined we update description

–  Add “Affected Version/s” to define Release –  Added new “Planned Sprint” field to define Sprint

•  Import Requirements to QMetry –  Queries are setup based on Planned Sprint –  One to one mapping



What Does QMetry Add?

•  Test Cases •  Test Suites •  Platforms •  Test Results and Reports •  Easy way to log new issues against

Requirements

•  How is all of this extra documentation / process Agile???



Recycle and Reuse •  Test Cases

–  Created directly from Requirements •  Most have Steps to Reproduce •  Ad hoc

•  Test Suites –  Regressions are easily imported from past sprints. –  Functional Test Suites help organize testing

•  Platforms –  Simple to identify and add to Test Suites –  Create once and re-use.

•  Test Results and Reports –  Automatically generated and updated –  Integrated Manual & Automated

•  New Defects can be traced back to the original requirement / issue.



ASAP and Continuous Testing

•  As Soon as Programmed Testing and Tracking –  Verify features early to allow you to close issues

quickly. –  Identify when a feature was verified resolved –  Identify regressions early

•  Continuous Testing –  For every sprints there are often many builds –  Fixes between sprints should be tested –  Progress through the sprint cycle should be

tracked



Regression Testing

•  The Reason and Purpose of Regression Testing –  To test for the unexpected

bugs bugs bugs

•  Regression can be boring, automate it whenever possible –  Manual tests can easily be linked with future

automated tests.

Hey Morgan. Can I get some bug images here??? J Thanks!

Managing Coverage in an Agile World - Meetupfiles.meetup.com/1686895/20120510-SFAUG-QMetry.pdf ·...

Documents

Transcript of Managing Coverage in an Agile World - Meetupfiles.meetup.com/1686895/20120510-SFAUG-QMetry.pdf ·...