Tester get out of your cave SIGIST 2012 London
description
Transcript of Tester get out of your cave SIGIST 2012 London
![Page 1: Tester get out of your cave SIGIST 2012 London](https://reader035.fdocuments.us/reader035/viewer/2022062709/558e94b01a28ab52108b46ec/html5/thumbnails/1.jpg)
Tester, get out of your cave!
Jan Jaap Cannegieter – Vice President SYSQA B.V. [email protected]@jjcannegieter http
://www.sy
sqa.com/ and
http://w
ww.sysqa.com/expertis
e-it-
quality-management/presentations/
![Page 3: Tester get out of your cave SIGIST 2012 London](https://reader035.fdocuments.us/reader035/viewer/2022062709/558e94b01a28ab52108b46ec/html5/thumbnails/3.jpg)
© S
YS
QA
Alm
ere
3
Why are we here?
![Page 4: Tester get out of your cave SIGIST 2012 London](https://reader035.fdocuments.us/reader035/viewer/2022062709/558e94b01a28ab52108b46ec/html5/thumbnails/4.jpg)
© S
YS
QA
Alm
ere
4
Agenda
• TMMi in under 10 minutes• Data from 20 TMMi workshops• Conclusions• How to get out of your cave
![Page 5: Tester get out of your cave SIGIST 2012 London](https://reader035.fdocuments.us/reader035/viewer/2022062709/558e94b01a28ab52108b46ec/html5/thumbnails/5.jpg)
![Page 6: Tester get out of your cave SIGIST 2012 London](https://reader035.fdocuments.us/reader035/viewer/2022062709/558e94b01a28ab52108b46ec/html5/thumbnails/6.jpg)
© S
YS
QA
Alm
ere
6
TMMi – essentials
• Test maturity framework• Benchmark model for assessments• 5 levels• Based on:
• TMM• Evolutionary Testmodel (Gelperin / Hetzel)• CMMI for Development
• In line with ISTQB terminology• Developed by the TMMi-foundation• Public domain• www.tmmifoundation.org
![Page 7: Tester get out of your cave SIGIST 2012 London](https://reader035.fdocuments.us/reader035/viewer/2022062709/558e94b01a28ab52108b46ec/html5/thumbnails/7.jpg)
© S
YS
QA
Alm
ere
7
TMMi levels
1. Initial
2. Managed
Test Policy and StrategyTest PlanningTest Monitoring and ControlTest Design and ExecutionTest Environment
3. Defined
Test OrganizationTest Training ProgramTest Life Cycle and IntegrationNon-Functional TestingPeer Reviews
4. Management and Measurement
Test MeasurementSoftware Quality EvaluationAdvanced Peer Reviews
5. OptimizationDefect PreventionTest Process OptimizationQuality Control
![Page 8: Tester get out of your cave SIGIST 2012 London](https://reader035.fdocuments.us/reader035/viewer/2022062709/558e94b01a28ab52108b46ec/html5/thumbnails/8.jpg)
© S
YS
QA
Alm
ere
8
How I got my data
• Goals• Learn• Presales• Assignments
• 20 organizations• Telecommunication: 2• Government: 7• Financial services: 9• Industry: 2
• Analysis
![Page 9: Tester get out of your cave SIGIST 2012 London](https://reader035.fdocuments.us/reader035/viewer/2022062709/558e94b01a28ab52108b46ec/html5/thumbnails/9.jpg)
Results
Fasten your seatbelts
![Page 10: Tester get out of your cave SIGIST 2012 London](https://reader035.fdocuments.us/reader035/viewer/2022062709/558e94b01a28ab52108b46ec/html5/thumbnails/10.jpg)
© S
YS
QA
Alm
ere
11
Test policy and strategy - goals
• Establish a test policy• Establish a test strategy• Establish test performance indicators
![Page 11: Tester get out of your cave SIGIST 2012 London](https://reader035.fdocuments.us/reader035/viewer/2022062709/558e94b01a28ab52108b46ec/html5/thumbnails/11.jpg)
© S
YS
QA
Alm
ere
12
Test policy and strategy: A: 30% V: 14%
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 200
10
20
30
40
50
60
70
80
90
100
Test policy and strategy
Organizations
Perc
en
tag
e o
f sp
ecifi
c g
oals
met
![Page 12: Tester get out of your cave SIGIST 2012 London](https://reader035.fdocuments.us/reader035/viewer/2022062709/558e94b01a28ab52108b46ec/html5/thumbnails/12.jpg)
© S
YS
QA
Alm
ere
13
Test planning - goals• Perform a product risk assessment• Establish a test approach• Establish test estimates• Develop a test plan• Obtain commitment to the test plan
![Page 13: Tester get out of your cave SIGIST 2012 London](https://reader035.fdocuments.us/reader035/viewer/2022062709/558e94b01a28ab52108b46ec/html5/thumbnails/13.jpg)
© S
YS
QA
Alm
ere
14
Test planning: A: 41%, V: 13%
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 200
10
20
30
40
50
60
70
80
90
100
Test planning
Organizations
Perc
en
tag
e o
f sp
ecifi
c g
oals
met
![Page 14: Tester get out of your cave SIGIST 2012 London](https://reader035.fdocuments.us/reader035/viewer/2022062709/558e94b01a28ab52108b46ec/html5/thumbnails/14.jpg)
© S
YS
QA
Alm
ere
15
Test monitoring and control - goals
• Monitor test progress against plan• Monitor product quality against plan and
expectations• Manage corrective action to closure
![Page 15: Tester get out of your cave SIGIST 2012 London](https://reader035.fdocuments.us/reader035/viewer/2022062709/558e94b01a28ab52108b46ec/html5/thumbnails/15.jpg)
© S
YS
QA
Alm
ere
16
Test monitoring and control: A: 47%, V: 15%
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 200
10
20
30
40
50
60
70
80
90
100
Test monitoring and control
Organizations
Perc
en
tag
e o
f sp
ecifi
c g
oals
met
![Page 16: Tester get out of your cave SIGIST 2012 London](https://reader035.fdocuments.us/reader035/viewer/2022062709/558e94b01a28ab52108b46ec/html5/thumbnails/16.jpg)
© S
YS
QA
Alm
ere
17
Test design and execution - goals
• Perform test analysis and design using test design techniques
• Perform test implementation• Perform test execution• Manage test incidents to closure
![Page 17: Tester get out of your cave SIGIST 2012 London](https://reader035.fdocuments.us/reader035/viewer/2022062709/558e94b01a28ab52108b46ec/html5/thumbnails/17.jpg)
© S
YS
QA
Alm
ere
18
Test design and execution: A: 60%, V: 8%
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 200
10
20
30
40
50
60
70
80
90
100
Test design and execution
Organizations
Perc
en
tag
e o
f sp
ecifi
c g
oals
met
![Page 18: Tester get out of your cave SIGIST 2012 London](https://reader035.fdocuments.us/reader035/viewer/2022062709/558e94b01a28ab52108b46ec/html5/thumbnails/18.jpg)
© S
YS
QA
Alm
ere
19
Test environment - goals
• Develop test environment requirements• Perform test environment implementation• Manage and control test environments
![Page 19: Tester get out of your cave SIGIST 2012 London](https://reader035.fdocuments.us/reader035/viewer/2022062709/558e94b01a28ab52108b46ec/html5/thumbnails/19.jpg)
© S
YS
QA
Alm
ere
20
Test environment: A: 59%, V: 9%
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 190
10
20
30
40
50
60
70
80
90
100
Test environment
Organizations
Perc
en
tag
e o
f sp
ecifi
c g
oals
met
![Page 20: Tester get out of your cave SIGIST 2012 London](https://reader035.fdocuments.us/reader035/viewer/2022062709/558e94b01a28ab52108b46ec/html5/thumbnails/20.jpg)
© S
YS
QA
Alm
ere
21
Overview
Test
pol
icy
and
stra
tegy
Test
pla
nnin
g
Test
mon
itorin
g en
cont
rol
Test
des
ign
and
exec
utio
n
Test
env
ironm
ent
0102030405060708090
100
Per process area
![Page 21: Tester get out of your cave SIGIST 2012 London](https://reader035.fdocuments.us/reader035/viewer/2022062709/558e94b01a28ab52108b46ec/html5/thumbnails/21.jpg)
© S
YS
QA
Alm
ere
22
My conclusion
60%: Test design and execution
30%: Test policy and strategy
41%: Test planning
47%: Test monitoring and control
59%: Test environment
Inside
Outside
![Page 22: Tester get out of your cave SIGIST 2012 London](https://reader035.fdocuments.us/reader035/viewer/2022062709/558e94b01a28ab52108b46ec/html5/thumbnails/22.jpg)
© S
YS
QA
Alm
ere
23
We are in a cave!
![Page 23: Tester get out of your cave SIGIST 2012 London](https://reader035.fdocuments.us/reader035/viewer/2022062709/558e94b01a28ab52108b46ec/html5/thumbnails/23.jpg)
© S
YS
QA
Alm
ere
24
Get out of your cave!
![Page 24: Tester get out of your cave SIGIST 2012 London](https://reader035.fdocuments.us/reader035/viewer/2022062709/558e94b01a28ab52108b46ec/html5/thumbnails/24.jpg)
© S
YS
QA
Alm
ere
25
In case you disagree…
![Page 25: Tester get out of your cave SIGIST 2012 London](https://reader035.fdocuments.us/reader035/viewer/2022062709/558e94b01a28ab52108b46ec/html5/thumbnails/25.jpg)
© S
YS
QA
Alm
ere
26
Best practices ‘outside of your cave’
• Perform a product risk assessment and establish a test approach with relevant stakeholders
• Obtain commitment for your plan from relevant stakeholders• Plan stakeholder involvement in your project• Monitor stakeholder involvement in your project• Make release advice with people outside of testing• Establish and maintain a test strategy with relevant
management• Define, measure and report test performance indicators to
relevant stakeholders• Establish and maintain a test policy with higher management
(business and IT)Stakeholder m
anagement
![Page 26: Tester get out of your cave SIGIST 2012 London](https://reader035.fdocuments.us/reader035/viewer/2022062709/558e94b01a28ab52108b46ec/html5/thumbnails/26.jpg)
Stakeholder management
27
The basics
![Page 27: Tester get out of your cave SIGIST 2012 London](https://reader035.fdocuments.us/reader035/viewer/2022062709/558e94b01a28ab52108b46ec/html5/thumbnails/27.jpg)
© S
YS
QA
Alm
ere
28
Stakeholder
A person or group of persons who will be involved in or effected by your test project or improvement project
![Page 28: Tester get out of your cave SIGIST 2012 London](https://reader035.fdocuments.us/reader035/viewer/2022062709/558e94b01a28ab52108b46ec/html5/thumbnails/28.jpg)
© S
YS
QA
Alm
ere
29
Stakeholder management
• Stakeholder identification
• Stakeholder analysis
• Stakeholder involvement
![Page 29: Tester get out of your cave SIGIST 2012 London](https://reader035.fdocuments.us/reader035/viewer/2022062709/558e94b01a28ab52108b46ec/html5/thumbnails/29.jpg)
© S
YS
QA
Alm
ere
30
Stakeholder aspects
• Organizational level• Power• Business interest• Mindset• Ambition• Behavioral style• Stakeholder type
![Page 30: Tester get out of your cave SIGIST 2012 London](https://reader035.fdocuments.us/reader035/viewer/2022062709/558e94b01a28ab52108b46ec/html5/thumbnails/30.jpg)
© S
YS
QA
Alm
ere
31
Type of stakeholders
Demanding Discretionary
Sleeping
Dependent
Dangerous Dominant
Definitive
Urgency Legitimacy
Power
Mitchell, Agle, Wood, 1997
![Page 31: Tester get out of your cave SIGIST 2012 London](https://reader035.fdocuments.us/reader035/viewer/2022062709/558e94b01a28ab52108b46ec/html5/thumbnails/31.jpg)
© S
YS
QA
Alm
ere
32
Stakeholdercard – an example
![Page 32: Tester get out of your cave SIGIST 2012 London](https://reader035.fdocuments.us/reader035/viewer/2022062709/558e94b01a28ab52108b46ec/html5/thumbnails/32.jpg)
Please think this over
I’ll turn on some inspiring music
![Page 33: Tester get out of your cave SIGIST 2012 London](https://reader035.fdocuments.us/reader035/viewer/2022062709/558e94b01a28ab52108b46ec/html5/thumbnails/33.jpg)
© S
YS
QA
Alm
ere
34
![Page 34: Tester get out of your cave SIGIST 2012 London](https://reader035.fdocuments.us/reader035/viewer/2022062709/558e94b01a28ab52108b46ec/html5/thumbnails/34.jpg)
© S
YS
QA
Alm
ere
35
Yes, it’s all political
![Page 35: Tester get out of your cave SIGIST 2012 London](https://reader035.fdocuments.us/reader035/viewer/2022062709/558e94b01a28ab52108b46ec/html5/thumbnails/35.jpg)
© S
YS
QA
Alm
ere
36
Stuart Reid’s test competence model for testers
Test skills
IT skills
Domain knowledg
e
Soft skills
![Page 36: Tester get out of your cave SIGIST 2012 London](https://reader035.fdocuments.us/reader035/viewer/2022062709/558e94b01a28ab52108b46ec/html5/thumbnails/36.jpg)
© S
YS
QA
Alm
ere
37
My test competence model for test consultants & test managers
Test skills
IT skills
Domain knowledg
eSoft skills
Political skills
![Page 37: Tester get out of your cave SIGIST 2012 London](https://reader035.fdocuments.us/reader035/viewer/2022062709/558e94b01a28ab52108b46ec/html5/thumbnails/37.jpg)
© S
YS
QA
Alm
ere
38
![Page 38: Tester get out of your cave SIGIST 2012 London](https://reader035.fdocuments.us/reader035/viewer/2022062709/558e94b01a28ab52108b46ec/html5/thumbnails/38.jpg)
More interesting graphs
![Page 39: Tester get out of your cave SIGIST 2012 London](https://reader035.fdocuments.us/reader035/viewer/2022062709/558e94b01a28ab52108b46ec/html5/thumbnails/39.jpg)
© S
YS
QA
Alm
ere
40
TMMi level by percentage
TMMi Level
84%
10%6%
L1L2L3L4L5
![Page 40: Tester get out of your cave SIGIST 2012 London](https://reader035.fdocuments.us/reader035/viewer/2022062709/558e94b01a28ab52108b46ec/html5/thumbnails/40.jpg)
© S
YS
QA
Alm
ere
41
CMMI vs. Non-CMMI
TPG TP TMC TT TO0
10
20
30
40
50
60
70
80
CMMIno CMMI
![Page 41: Tester get out of your cave SIGIST 2012 London](https://reader035.fdocuments.us/reader035/viewer/2022062709/558e94b01a28ab52108b46ec/html5/thumbnails/41.jpg)
© S
YS
QA
Alm
ere
42
TMMi score by Industry
TPS TP TMC TDE TE0
10
20
30
40
50
60
70
GovernmentFinanceIndustry
Note: Telecom weg gelaten slechts 2 data punten
![Page 42: Tester get out of your cave SIGIST 2012 London](https://reader035.fdocuments.us/reader035/viewer/2022062709/558e94b01a28ab52108b46ec/html5/thumbnails/42.jpg)
© S
YS
QA
Alm
ere
43
Formeel vs. Informeel
14%
86%
FormeelInformeel
![Page 44: Tester get out of your cave SIGIST 2012 London](https://reader035.fdocuments.us/reader035/viewer/2022062709/558e94b01a28ab52108b46ec/html5/thumbnails/44.jpg)
© S
YS
QA
Alm
ere
46