Continuous Cycles in Test Automation
-
Upload
derk-jan-de-grood -
Category
Software
-
view
361 -
download
2
Transcript of Continuous Cycles in Test Automation
![Page 1: Continuous Cycles in Test Automation](https://reader034.fdocuments.us/reader034/viewer/2022042701/55c3af2ebb61eb1d678b487b/html5/thumbnails/1.jpg)
June 2015
Continuous Cycles in Test Automation
Ard Kramer (Delta Lloyd)Derk-Jan de Grood (Valori)
2015
![Page 2: Continuous Cycles in Test Automation](https://reader034.fdocuments.us/reader034/viewer/2022042701/55c3af2ebb61eb1d678b487b/html5/thumbnails/2.jpg)
2
A shared experience
Ard Kramer• Testmanager Delta Lloyd Leven• Test Consultant EclipseIT• @Ard_Kramer
Derk-Jan de Grood• Principal consultant Valori• @DerkJandeGrood• http://djdegrood.wordpress.com/
![Page 3: Continuous Cycles in Test Automation](https://reader034.fdocuments.us/reader034/viewer/2022042701/55c3af2ebb61eb1d678b487b/html5/thumbnails/3.jpg)
The Test Automation day – A continuing story
3
The Test Automation day – A continuing story
![Page 4: Continuous Cycles in Test Automation](https://reader034.fdocuments.us/reader034/viewer/2022042701/55c3af2ebb61eb1d678b487b/html5/thumbnails/4.jpg)
The sequels
4
![Page 5: Continuous Cycles in Test Automation](https://reader034.fdocuments.us/reader034/viewer/2022042701/55c3af2ebb61eb1d678b487b/html5/thumbnails/5.jpg)
TAD 2014
TAD 2013
1. TA only works when
mature 2. We need to start with TA to gain experience
(esp in Agile)
3. Start with pilot, don't let
the organization
get in the way
4. We need a business case
in order to convince managers
5. BC is influenced by
maturity6. get started and let each team find its own solution
7. TA as driver for Change
8.Growing need for central
approach
9. Embedding in the
organization is crucial
10. What test do you
automate? Are there any tests
defined?
TAD 2012
TAD 2015
![Page 6: Continuous Cycles in Test Automation](https://reader034.fdocuments.us/reader034/viewer/2022042701/55c3af2ebb61eb1d678b487b/html5/thumbnails/6.jpg)
Where we ended last year…
Steps 1-7: Early insights
6
![Page 7: Continuous Cycles in Test Automation](https://reader034.fdocuments.us/reader034/viewer/2022042701/55c3af2ebb61eb1d678b487b/html5/thumbnails/7.jpg)
Initial starting point
We want effective usage of Test Automation throughout the organization
7
Convert Manual to
Automated Testing
Re-usage of knowledge and standardized
approach
Tool selection should
lead to leading tool
![Page 8: Continuous Cycles in Test Automation](https://reader034.fdocuments.us/reader034/viewer/2022042701/55c3af2ebb61eb1d678b487b/html5/thumbnails/8.jpg)
1. Which application will fit
2. Which Divisions wants to start with test
automation
3. Prioritize (roadmap with TI, PoC en
Operational phase per division
4. Management decision to consolidate
5. Plan TI sessions
Test AnalystTest NavigatorART team Test Navigator
ART team
Support
Operational phase
Test Analyst
Business case
Managerial steering
First estimation by IT/Test manager
Commitment on priorities and roadmap
Turining BC bases upon PoC findings
Decision operational launch
Support by
ART team
PoC (pilot) faseexploration phase
PoC report
Test NavigatorPer division
Test NavigatorART team
Economic feasibility
Technicalfeasibility
Organizational feasibility
![Page 9: Continuous Cycles in Test Automation](https://reader034.fdocuments.us/reader034/viewer/2022042701/55c3af2ebb61eb1d678b487b/html5/thumbnails/9.jpg)
Apply individual results to other teams
9
![Page 10: Continuous Cycles in Test Automation](https://reader034.fdocuments.us/reader034/viewer/2022042701/55c3af2ebb61eb1d678b487b/html5/thumbnails/10.jpg)
Sharing Knowledge
10
![Page 11: Continuous Cycles in Test Automation](https://reader034.fdocuments.us/reader034/viewer/2022042701/55c3af2ebb61eb1d678b487b/html5/thumbnails/11.jpg)
v
11
Making a mind map with things that need to be organized for proper
support learned that this was a lot!
![Page 12: Continuous Cycles in Test Automation](https://reader034.fdocuments.us/reader034/viewer/2022042701/55c3af2ebb61eb1d678b487b/html5/thumbnails/12.jpg)
Roles and competences
12
Helpdesk ….CoachLicence manager
![Page 13: Continuous Cycles in Test Automation](https://reader034.fdocuments.us/reader034/viewer/2022042701/55c3af2ebb61eb1d678b487b/html5/thumbnails/13.jpg)
Conclusion of last year’s presentation:
13
People Determine
Success
Change needs speed, limited
scope and visibility
Chose an adaptive Approach
![Page 14: Continuous Cycles in Test Automation](https://reader034.fdocuments.us/reader034/viewer/2022042701/55c3af2ebb61eb1d678b487b/html5/thumbnails/14.jpg)
NEW LESSONS LEARNED WHILE IMPLEMENTING
Step 8-10
14
![Page 15: Continuous Cycles in Test Automation](https://reader034.fdocuments.us/reader034/viewer/2022042701/55c3af2ebb61eb1d678b487b/html5/thumbnails/15.jpg)
DECENTRAL: SUPPORT SA’S WITH EACH OF THE DEPT.
Helpdesk ….CoachLicence manager
Service
agreement
![Page 16: Continuous Cycles in Test Automation](https://reader034.fdocuments.us/reader034/viewer/2022042701/55c3af2ebb61eb1d678b487b/html5/thumbnails/16.jpg)
Transition TA in scrum
Team A
Team B
Team CIntegration
![Page 17: Continuous Cycles in Test Automation](https://reader034.fdocuments.us/reader034/viewer/2022042701/55c3af2ebb61eb1d678b487b/html5/thumbnails/17.jpg)
Give me the 10% most critical
tests in your testsetNOW
![Page 18: Continuous Cycles in Test Automation](https://reader034.fdocuments.us/reader034/viewer/2022042701/55c3af2ebb61eb1d678b487b/html5/thumbnails/18.jpg)
The Full Circle
18
1. TA only works when
mature 2. We need to start with TA to
gain experrience (esp in Agile)
3. Start with pilot, don't let
the organization get
in the way
4. We need a business case in
order to convince managers
5. BC is influenced by
maturity6. get started and let each team find its own solution
7. TA as driver for Change
8. Growing need for central
approach
9. Embedding in the
organization is crucial
10. What test do you
automate? Are there any tests
defined?
![Page 19: Continuous Cycles in Test Automation](https://reader034.fdocuments.us/reader034/viewer/2022042701/55c3af2ebb61eb1d678b487b/html5/thumbnails/19.jpg)
So it’s about maturity after all
19
![Page 20: Continuous Cycles in Test Automation](https://reader034.fdocuments.us/reader034/viewer/2022042701/55c3af2ebb61eb1d678b487b/html5/thumbnails/20.jpg)
Testflight: When tests are available …
![Page 21: Continuous Cycles in Test Automation](https://reader034.fdocuments.us/reader034/viewer/2022042701/55c3af2ebb61eb1d678b487b/html5/thumbnails/21.jpg)
What do we have, what can we do?
Team B Integration
![Page 22: Continuous Cycles in Test Automation](https://reader034.fdocuments.us/reader034/viewer/2022042701/55c3af2ebb61eb1d678b487b/html5/thumbnails/22.jpg)
Benchmark facts • 40-60% of the required tests is already automated
• 25-40% of these tests actually run • Failed tests need to be repaired.• Missing tests need to be designed
and automated.
Automated and OK
Automated but failing
Not Automated
![Page 23: Continuous Cycles in Test Automation](https://reader034.fdocuments.us/reader034/viewer/2022042701/55c3af2ebb61eb1d678b487b/html5/thumbnails/23.jpg)
When in a greenfield situation
![Page 24: Continuous Cycles in Test Automation](https://reader034.fdocuments.us/reader034/viewer/2022042701/55c3af2ebb61eb1d678b487b/html5/thumbnails/24.jpg)
Original roadmap
24
![Page 25: Continuous Cycles in Test Automation](https://reader034.fdocuments.us/reader034/viewer/2022042701/55c3af2ebb61eb1d678b487b/html5/thumbnails/25.jpg)
25
1. TA only works when
mature 2. We need to start with TA to gain experience (esp. in Agile)
3. Start with pilot, don't let
the organization get
in the way
4. We need a business case in
order to convince managers
5. BC is influenced by
maturity6. get started and let each team find its own solution
7. TA as driver for Change
8. Growing need for central
approach
9. Embedding in the
organization is crucial
10. What test do you
automate? Are there any tests
defined?
![Page 26: Continuous Cycles in Test Automation](https://reader034.fdocuments.us/reader034/viewer/2022042701/55c3af2ebb61eb1d678b487b/html5/thumbnails/26.jpg)
Key process, new challenge
26
TI PoC Ops
![Page 27: Continuous Cycles in Test Automation](https://reader034.fdocuments.us/reader034/viewer/2022042701/55c3af2ebb61eb1d678b487b/html5/thumbnails/27.jpg)
ORGANISATIONAL CHANGE
FROM DECENTRAL TO CENTRAL
27
![Page 28: Continuous Cycles in Test Automation](https://reader034.fdocuments.us/reader034/viewer/2022042701/55c3af2ebb61eb1d678b487b/html5/thumbnails/28.jpg)
New leadership: centralisation competences
Test
Business lines
Com
pete
nce
lines
Support TA
![Page 29: Continuous Cycles in Test Automation](https://reader034.fdocuments.us/reader034/viewer/2022042701/55c3af2ebb61eb1d678b487b/html5/thumbnails/29.jpg)
29
1. TA only works when
mature 2. We need to start with TA to gain experience (esp. in Agile)
3. Start with pilot, don't let
the organization get
in the way
4. We need a business case in
order to convince managers
5. BC is influenced by
maturity6. get started and let each team find its own solution
7. TA as driver for Change
8. Growing need for central
approach
9. Embedding in the
organization is crucial
10. What test do you
automate? Are there any tests
defined?
![Page 30: Continuous Cycles in Test Automation](https://reader034.fdocuments.us/reader034/viewer/2022042701/55c3af2ebb61eb1d678b487b/html5/thumbnails/30.jpg)
v
30
RETHINK THE SUPPORT AND MAINTENANCE IDEAS
![Page 31: Continuous Cycles in Test Automation](https://reader034.fdocuments.us/reader034/viewer/2022042701/55c3af2ebb61eb1d678b487b/html5/thumbnails/31.jpg)
New leadership: centralisation competences:Possibilities per business line?
Business lines
Com
pete
nce
lines
TestSupport TA
![Page 32: Continuous Cycles in Test Automation](https://reader034.fdocuments.us/reader034/viewer/2022042701/55c3af2ebb61eb1d678b487b/html5/thumbnails/32.jpg)
32
1. TA only works when
mature 2. We need to start with TA to gain experience (esp. in Agile)
3. Start with pilot, don't let
the organization get
in the way
4. We need a business case in
order to convince managers
5. BC is influenced by
maturity6. get started and let each team find its own solution
7. TA as driver for Change
8. Growing need for central
approach
9. Embedding in the
organization is crucial
10. What test do you
automate? Are there any tests
defined?
![Page 33: Continuous Cycles in Test Automation](https://reader034.fdocuments.us/reader034/viewer/2022042701/55c3af2ebb61eb1d678b487b/html5/thumbnails/33.jpg)
Scrum Teams
• Are test automation driven• Improve their way of working• Think of new solutions• That benefit their business
case.
33
TAD!
![Page 34: Continuous Cycles in Test Automation](https://reader034.fdocuments.us/reader034/viewer/2022042701/55c3af2ebb61eb1d678b487b/html5/thumbnails/34.jpg)
Reaching a tipping point
![Page 35: Continuous Cycles in Test Automation](https://reader034.fdocuments.us/reader034/viewer/2022042701/55c3af2ebb61eb1d678b487b/html5/thumbnails/35.jpg)
35
What tool to put in the spotlight ?
![Page 36: Continuous Cycles in Test Automation](https://reader034.fdocuments.us/reader034/viewer/2022042701/55c3af2ebb61eb1d678b487b/html5/thumbnails/36.jpg)
36
1. TA only works when
mature 2. We need to start with TA to gain experience (esp. in Agile)
3. Start with pilot, don't let
the organization get
in the way
4. We need a business case in
order to convince managers
5. BC is influenced by
maturity6. get started and let each team find its own solution
7. TA as driver for Change
8. Growing need for central
approach
9. Embedding in the
organization is crucial
10. What test do you
automate? Are there any tests
defined?
The new solutions that pop up can have value for other scrum teams as well.
![Page 37: Continuous Cycles in Test Automation](https://reader034.fdocuments.us/reader034/viewer/2022042701/55c3af2ebb61eb1d678b487b/html5/thumbnails/37.jpg)
THERE MORE CYCLES
37
![Page 38: Continuous Cycles in Test Automation](https://reader034.fdocuments.us/reader034/viewer/2022042701/55c3af2ebb61eb1d678b487b/html5/thumbnails/38.jpg)
Other cycles
38
Business Case Testing
![Page 39: Continuous Cycles in Test Automation](https://reader034.fdocuments.us/reader034/viewer/2022042701/55c3af2ebb61eb1d678b487b/html5/thumbnails/39.jpg)
Other cycles
39
Agile Adoption
![Page 40: Continuous Cycles in Test Automation](https://reader034.fdocuments.us/reader034/viewer/2022042701/55c3af2ebb61eb1d678b487b/html5/thumbnails/40.jpg)
Other cycles
40
Organizational Changes
![Page 41: Continuous Cycles in Test Automation](https://reader034.fdocuments.us/reader034/viewer/2022042701/55c3af2ebb61eb1d678b487b/html5/thumbnails/41.jpg)
Other cycles
41
TPI
![Page 42: Continuous Cycles in Test Automation](https://reader034.fdocuments.us/reader034/viewer/2022042701/55c3af2ebb61eb1d678b487b/html5/thumbnails/42.jpg)
Other cycles
42
(agile) Test strategy
![Page 43: Continuous Cycles in Test Automation](https://reader034.fdocuments.us/reader034/viewer/2022042701/55c3af2ebb61eb1d678b487b/html5/thumbnails/43.jpg)
Collaborate
43
![Page 44: Continuous Cycles in Test Automation](https://reader034.fdocuments.us/reader034/viewer/2022042701/55c3af2ebb61eb1d678b487b/html5/thumbnails/44.jpg)
WRAP-UP
44
![Page 45: Continuous Cycles in Test Automation](https://reader034.fdocuments.us/reader034/viewer/2022042701/55c3af2ebb61eb1d678b487b/html5/thumbnails/45.jpg)
Highlights
- People determine the success- Continue balance between central and decentral- Technique can be driver for change- But maturity can slow it down
- Be aware the context is changing – Collaboration needed
45
Technique
People
![Page 46: Continuous Cycles in Test Automation](https://reader034.fdocuments.us/reader034/viewer/2022042701/55c3af2ebb61eb1d678b487b/html5/thumbnails/46.jpg)
The earlier presentations
2014• http://www.slideshare.net/DerkJandeGrood/experience-story-
implementing-test-automation-in-your-organization• http://www.slideshare.net/DerkJandeGrood/implementing-test-
automation
2013• http://www.slideshare.net/DerkJandeGrood/im-looking-at-you-to-tell-
me-should-i-automate-v102012• http://www.slideshare.net/DerkJandeGrood/ta-day-door-to-open-or-to-
lock-in-template-taday-v11
46