SIMPLICITY: THE PATH TO ACHIEVING AGILE …cqaa.org/resources/Documents/Presentations 2016/Agile...
Transcript of SIMPLICITY: THE PATH TO ACHIEVING AGILE …cqaa.org/resources/Documents/Presentations 2016/Agile...
![Page 1: SIMPLICITY: THE PATH TO ACHIEVING AGILE …cqaa.org/resources/Documents/Presentations 2016/Agile Testing... · Why be Agile? Project management methods for software Individuals &](https://reader031.fdocuments.us/reader031/viewer/2022030215/5ba2e1c109d3f221368cda85/html5/thumbnails/1.jpg)
SIMPLICITY:
THE PATH TO ACHIEVING
AGILE TESTING EFFICIENCY
![Page 2: SIMPLICITY: THE PATH TO ACHIEVING AGILE …cqaa.org/resources/Documents/Presentations 2016/Agile Testing... · Why be Agile? Project management methods for software Individuals &](https://reader031.fdocuments.us/reader031/viewer/2022030215/5ba2e1c109d3f221368cda85/html5/thumbnails/2.jpg)
Matt Paxton – My Inspiration
![Page 3: SIMPLICITY: THE PATH TO ACHIEVING AGILE …cqaa.org/resources/Documents/Presentations 2016/Agile Testing... · Why be Agile? Project management methods for software Individuals &](https://reader031.fdocuments.us/reader031/viewer/2022030215/5ba2e1c109d3f221368cda85/html5/thumbnails/3.jpg)
Why Be Agile?
Why do businesses adopt
Agile Methodologies?AGILEMETHODOLOGIES
![Page 4: SIMPLICITY: THE PATH TO ACHIEVING AGILE …cqaa.org/resources/Documents/Presentations 2016/Agile Testing... · Why be Agile? Project management methods for software Individuals &](https://reader031.fdocuments.us/reader031/viewer/2022030215/5ba2e1c109d3f221368cda85/html5/thumbnails/4.jpg)
They want to develop
software products faster!
With rare exception, EVERY business decision
is about going faster! They just call it “efficient”
instead…”faster” implies “sloppy”.
Why be Agile?
![Page 5: SIMPLICITY: THE PATH TO ACHIEVING AGILE …cqaa.org/resources/Documents/Presentations 2016/Agile Testing... · Why be Agile? Project management methods for software Individuals &](https://reader031.fdocuments.us/reader031/viewer/2022030215/5ba2e1c109d3f221368cda85/html5/thumbnails/5.jpg)
Project
management
methods for
software
Individuals &
interactions over
processes & Tools
Working software
over comprehensive
documentation
Customer
collaboration over
contract negotiation
Responding to
change over
following a plan
From Lean
manufacturing
Small,
self-sufficient
teams
A manifesto
was developed
on four values:
1
2
3
4
Twelve
Principles
behind the
Values
Agile – A Level Set
![Page 6: SIMPLICITY: THE PATH TO ACHIEVING AGILE …cqaa.org/resources/Documents/Presentations 2016/Agile Testing... · Why be Agile? Project management methods for software Individuals &](https://reader031.fdocuments.us/reader031/viewer/2022030215/5ba2e1c109d3f221368cda85/html5/thumbnails/6.jpg)
My Favorite Agile Principle
As testers, without a defined role on an Agile Team,
we must look for this principle – Simplicity – in every aspect of our job
“Simplicity – the art of maximizing
work not done – is essential ”Principle #10
![Page 7: SIMPLICITY: THE PATH TO ACHIEVING AGILE …cqaa.org/resources/Documents/Presentations 2016/Agile Testing... · Why be Agile? Project management methods for software Individuals &](https://reader031.fdocuments.us/reader031/viewer/2022030215/5ba2e1c109d3f221368cda85/html5/thumbnails/7.jpg)
What you do as a tester
should be analyzed:
Focus on what’s left at each
Agile milestone:Inception (“Sprint 0”)
Sprint 1 – Test Planning
Sprint <n> - Test Execution & Defects
Sprint Retrospectives – Process Improvements
Change it?
Do less of it?
Remove it entirely?
Living Principle #10
![Page 8: SIMPLICITY: THE PATH TO ACHIEVING AGILE …cqaa.org/resources/Documents/Presentations 2016/Agile Testing... · Why be Agile? Project management methods for software Individuals &](https://reader031.fdocuments.us/reader031/viewer/2022030215/5ba2e1c109d3f221368cda85/html5/thumbnails/8.jpg)
Ask questions of stories and
acceptance criteria
Plan test repository
Propose improvements to
Testing processes,
milestones and deliverables
Identify project metrics –
use the GQM model
What’s Important:
Stakeholders create and
estimate initial user
story backlog
Project Inception: Sprint 0
![Page 9: SIMPLICITY: THE PATH TO ACHIEVING AGILE …cqaa.org/resources/Documents/Presentations 2016/Agile Testing... · Why be Agile? Project management methods for software Individuals &](https://reader031.fdocuments.us/reader031/viewer/2022030215/5ba2e1c109d3f221368cda85/html5/thumbnails/9.jpg)
Sprint 0: Analyzing Deliverables
If your team won’t use it during the project…
and won’t use it to improve later…
DON’T DO IT!
Test Plans /
Strategies
Test Suite
Design
Does anyone read this?
Who else needs it?
Test Review
Meetings
Traceability
Matrix
Test Result
Report
Defect
Metrics
Do you have a
standalone repository?
Do you need a formal
review process?
What do we do
with this info?
Is this automatic
to our test tool?
Do these drive
process improvement?
![Page 10: SIMPLICITY: THE PATH TO ACHIEVING AGILE …cqaa.org/resources/Documents/Presentations 2016/Agile Testing... · Why be Agile? Project management methods for software Individuals &](https://reader031.fdocuments.us/reader031/viewer/2022030215/5ba2e1c109d3f221368cda85/html5/thumbnails/10.jpg)
Agile DOES NOT MEAN “you don’t
need or have documentation”
Some projects greatly benefit from traditional
documents
Some industries require
a high volume of
documentation of
every step of the process
…but documents are
project overhead!
By the Way, Deliverables are OK
![Page 11: SIMPLICITY: THE PATH TO ACHIEVING AGILE …cqaa.org/resources/Documents/Presentations 2016/Agile Testing... · Why be Agile? Project management methods for software Individuals &](https://reader031.fdocuments.us/reader031/viewer/2022030215/5ba2e1c109d3f221368cda85/html5/thumbnails/11.jpg)
Goals have:
Questions are:
Metrics are:
Purpose | Issue | Object | Viewpoint
about characterizing the objects
are numbers to answer the questions
Sprint 0: GQM
![Page 12: SIMPLICITY: THE PATH TO ACHIEVING AGILE …cqaa.org/resources/Documents/Presentations 2016/Agile Testing... · Why be Agile? Project management methods for software Individuals &](https://reader031.fdocuments.us/reader031/viewer/2022030215/5ba2e1c109d3f221368cda85/html5/thumbnails/12.jpg)
Metrics must either:
Assist in day-to-day
project management
Drive process
improvements
Fulfill industry
requirements
What’s a Valuable Metric?
![Page 13: SIMPLICITY: THE PATH TO ACHIEVING AGILE …cqaa.org/resources/Documents/Presentations 2016/Agile Testing... · Why be Agile? Project management methods for software Individuals &](https://reader031.fdocuments.us/reader031/viewer/2022030215/5ba2e1c109d3f221368cda85/html5/thumbnails/13.jpg)
Get InvolvedDO NOT wait until Sprint Planning to see User Stories
Read…review acceptance criteria…estimate…digest… start thinking about how to test…ASAP
Ask the Right QuestionsWhere are my data sources?
What APIs or other interfacesare implemented?
Schedule of deployments to a test environment?
?
Sprint 1: Test Planning
![Page 14: SIMPLICITY: THE PATH TO ACHIEVING AGILE …cqaa.org/resources/Documents/Presentations 2016/Agile Testing... · Why be Agile? Project management methods for software Individuals &](https://reader031.fdocuments.us/reader031/viewer/2022030215/5ba2e1c109d3f221368cda85/html5/thumbnails/14.jpg)
Business-oriented testing, not functionalDon’t wait for comprehensive requirements
Why have detailed requirements?Adds overall value, or just easier for you?
Make less work for yourself…and others!
Sprint 1: Don’t Sweat the Detail
![Page 15: SIMPLICITY: THE PATH TO ACHIEVING AGILE …cqaa.org/resources/Documents/Presentations 2016/Agile Testing... · Why be Agile? Project management methods for software Individuals &](https://reader031.fdocuments.us/reader031/viewer/2022030215/5ba2e1c109d3f221368cda85/html5/thumbnails/15.jpg)
Clear detail for future automation
Coverage to support each
user story or requirement
Don’t write tests for code
that won’t change again
Purposeful negative conditions
What’s Important:
Necessary component
of the process
Greatest time waster
(if you do it wrong!)
Sprint <n>: Test Case Creation
![Page 16: SIMPLICITY: THE PATH TO ACHIEVING AGILE …cqaa.org/resources/Documents/Presentations 2016/Agile Testing... · Why be Agile? Project management methods for software Individuals &](https://reader031.fdocuments.us/reader031/viewer/2022030215/5ba2e1c109d3f221368cda85/html5/thumbnails/16.jpg)
FUN PRODUCTIVE=/
Test for ROBUSTNESS!
It can be really fun
to try to break the
software for the sake
of breaking it…
Sprint <n>: Test Case Creation
![Page 17: SIMPLICITY: THE PATH TO ACHIEVING AGILE …cqaa.org/resources/Documents/Presentations 2016/Agile Testing... · Why be Agile? Project management methods for software Individuals &](https://reader031.fdocuments.us/reader031/viewer/2022030215/5ba2e1c109d3f221368cda85/html5/thumbnails/17.jpg)
Know ahead of time how to prioritize development
New features?
Bug fixes?
If you wait until there’s a backlog, you’re too late
“Zero backlog” approach
Sprint <n>: New WORK OR Bugs?
![Page 18: SIMPLICITY: THE PATH TO ACHIEVING AGILE …cqaa.org/resources/Documents/Presentations 2016/Agile Testing... · Why be Agile? Project management methods for software Individuals &](https://reader031.fdocuments.us/reader031/viewer/2022030215/5ba2e1c109d3f221368cda85/html5/thumbnails/18.jpg)
Basic stats - Pass/Fail counts, remaining tests
Does your team need any more than that?
Root Cause Analysis metadata for failed tests
Connect RCA to your GQM model
RCA can drive great process improvements
…BUT YOU HAVE TO USE IT!!
Sprint <N>: Test Execution
![Page 19: SIMPLICITY: THE PATH TO ACHIEVING AGILE …cqaa.org/resources/Documents/Presentations 2016/Agile Testing... · Why be Agile? Project management methods for software Individuals &](https://reader031.fdocuments.us/reader031/viewer/2022030215/5ba2e1c109d3f221368cda85/html5/thumbnails/19.jpg)
Multiple people,
multiple conversations
for each failure!
How are you using this
data to improve your
process?
Root Cause Swim Lanes
![Page 20: SIMPLICITY: THE PATH TO ACHIEVING AGILE …cqaa.org/resources/Documents/Presentations 2016/Agile Testing... · Why be Agile? Project management methods for software Individuals &](https://reader031.fdocuments.us/reader031/viewer/2022030215/5ba2e1c109d3f221368cda85/html5/thumbnails/20.jpg)
Failure TypesWhy did this test fail?
ResolutionWhat changed to fix the problem?
How do we prevent either from happening again?
Retrospective: RCA Improvement
![Page 21: SIMPLICITY: THE PATH TO ACHIEVING AGILE …cqaa.org/resources/Documents/Presentations 2016/Agile Testing... · Why be Agile? Project management methods for software Individuals &](https://reader031.fdocuments.us/reader031/viewer/2022030215/5ba2e1c109d3f221368cda85/html5/thumbnails/21.jpg)
Understand each
defect state
Your team can
have more…
but why?
Tie it back to
your GQM modelDone
Assigned
New
Committed
Sprint <N>: DEFECT STATE MANAGEMENT
![Page 22: SIMPLICITY: THE PATH TO ACHIEVING AGILE …cqaa.org/resources/Documents/Presentations 2016/Agile Testing... · Why be Agile? Project management methods for software Individuals &](https://reader031.fdocuments.us/reader031/viewer/2022030215/5ba2e1c109d3f221368cda85/html5/thumbnails/22.jpg)
Have you ever seen this?
![Page 23: SIMPLICITY: THE PATH TO ACHIEVING AGILE …cqaa.org/resources/Documents/Presentations 2016/Agile Testing... · Why be Agile? Project management methods for software Individuals &](https://reader031.fdocuments.us/reader031/viewer/2022030215/5ba2e1c109d3f221368cda85/html5/thumbnails/23.jpg)
Each data point
leads to decision & dissent.
The more you have, the more you add.
OVER 80 MAN-HOURS
10 metadata changes per bug
1 minute each X X 500 bugs
=
DEFECT INFORMATION: NO HOARDING!
![Page 24: SIMPLICITY: THE PATH TO ACHIEVING AGILE …cqaa.org/resources/Documents/Presentations 2016/Agile Testing... · Why be Agile? Project management methods for software Individuals &](https://reader031.fdocuments.us/reader031/viewer/2022030215/5ba2e1c109d3f221368cda85/html5/thumbnails/24.jpg)
Every defect model
has a removed state…
what’s it for?Your team has
all the data.
Use it to improve!
Duplicate
Not an
issue
Pending
DEFECTS: Remove “REMOVED”?
![Page 25: SIMPLICITY: THE PATH TO ACHIEVING AGILE …cqaa.org/resources/Documents/Presentations 2016/Agile Testing... · Why be Agile? Project management methods for software Individuals &](https://reader031.fdocuments.us/reader031/viewer/2022030215/5ba2e1c109d3f221368cda85/html5/thumbnails/25.jpg)
Involved from Inception
Necessary Deliverables
Evaluate Acceptance Criteria ASAP
No Perfect Requirements
Manual Tests for Automation
No “Tests for Bugs”
Purposeful Negative Conditions
Bug Fix Priority
Root Cause Improvements
Streamlined Defect States
Improve from Removed
KEEP CLEANING!
Your “Checklist”
![Page 26: SIMPLICITY: THE PATH TO ACHIEVING AGILE …cqaa.org/resources/Documents/Presentations 2016/Agile Testing... · Why be Agile? Project management methods for software Individuals &](https://reader031.fdocuments.us/reader031/viewer/2022030215/5ba2e1c109d3f221368cda85/html5/thumbnails/26.jpg)
If you can’t tell me
WHY you’re doing something…
…and
HOW it helps your Agile team…
STOP DOING IT!
If You Only Remember One Thing…
![Page 27: SIMPLICITY: THE PATH TO ACHIEVING AGILE …cqaa.org/resources/Documents/Presentations 2016/Agile Testing... · Why be Agile? Project management methods for software Individuals &](https://reader031.fdocuments.us/reader031/viewer/2022030215/5ba2e1c109d3f221368cda85/html5/thumbnails/27.jpg)
“Testing is no longer the last step in the Software Development
Life Cycle. It is our responsibility to make sure we add value to
every aspect of quality software.
Be efficient.
Be undeniably important to your projects.”
Paul HerzogDelivery Manager, Testing Services Practice
312.756.1760 x410
Closing