Testing Lessons from Hockey (The World's Greatest Sport)
Transcript of Testing Lessons from Hockey (The World's Greatest Sport)
AmiBug.Com, Inc.
© Robert Sabourin, 2013 17-Jan-14 Slide 1
Testing Lessons from Hockey
(The World's Greatest Sport)
Robert Sabourin
President & Principal consultant
AmiBug.Com, Inc.
Montreal, Canada
AmiBug.Com, Inc.
© Robert Sabourin, 2013 17-Jan-14 Slide 3
Testing Lessons from Hockey
• Overview
– Learning, Metaphors
– The Players
– The Coaches
– The Fans
– The Score Board
– The Standings
– The Big Picture
AmiBug.Com, Inc.
© Robert Sabourin, 2013 17-Jan-14 Slide 5
1967 Stanley Cup
AmiBug.Com, Inc.
© Robert Sabourin, 2013 17-Jan-14 Slide 6
Learning and Metaphors
• Teaching
• Learning
• Retaining
• Applying knowledge
• Share experiences
• Don’t get carried away …
AmiBug.Com, Inc.
© Robert Sabourin, 2013 17-Jan-14 Slide 7
The Players
• Hockey cards
• Name & Position
• Achievements
– History & highlights
– Statistics & context
• Gum
AmiBug.Com, Inc.
© Robert Sabourin, 2013 17-Jan-14 Slide 8
Forward Games Played
Goals
Assists
Points
Penalty Minutes
Some History Junior
Professional
International
Averages
Highs and Lows
AmiBug.Com, Inc.
© Robert Sabourin, 2013 17-Jan-14 Slide 9
Goalie Games Played
Wins
Losses
Ties
Minutes Played
Goals Against
Shut Outs
Goals Against
Average
Save %
AmiBug.Com, Inc.
© Robert Sabourin, 2013 17-Jan-14 Slide 10
Testing Bugs
Bugs by type
Show stoppers
Bug isolation %
Estimate/Actual
Development Defect Density
Function points
K-LOCs
Dev/Rework
Estimate/Actual
History Agility – Context
AmiBug.Com, Inc.
© Robert Sabourin, 2013 17-Jan-14 Slide 11
Testing Cards
AMIBUG
WINGS
AMIBUG
WINGS
Collard
AMIBUG
WINGS
AMIBUG
WINGS
Bolton
AMIBUG
WINGS
AMIBUG
WINGS
Copeland
AmiBug.Com, Inc.
© Robert Sabourin, 2013 17-Jan-14 Slide 13
The Players Hockey Roles Testing Roles
Center Test Analyst
Wing Scripted Tester
Defense Man Test Automation
Goalie Explorer
Captain Subject Matter
Penalty Killer Security tester
Goon Load tester
AmiBug.Com, Inc.
© Robert Sabourin, 2013 17-Jan-14 Slide 14
The Players Hall of Fame
Meyers
Beizer
Collard
Gelperin
AMIBUG WINGS
AMIBUG WINGS
AMIBUG WINGS
AMIBUG WINGS
AmiBug.Com, Inc.
Learning how to play hockey?
© Robert Sabourin, 2013 17-Jan-14 Slide 15
Watching others
might help explain
some of the rules
AmiBug.Com, Inc.
Learning how to play hockey?
© Robert Sabourin, 2013 17-Jan-14 Slide 16
Years of dedication
and perseverance
by hockey Moms
and hockey Dads
AmiBug.Com, Inc.
Learning how to play hockey?
© Robert Sabourin, 2013 17-Jan-14 Slide 17
Hone your craft …
• Practise
• Practise
• And then
• Practise
some more …
AmiBug.Com, Inc.
The Play by Play
© Robert Sabourin, 2013 17-Jan-14 Slide 18
He Shoots He Scores!
AmiBug.Com, Inc.
© Robert Sabourin, 2013 17-Jan-14 Slide 19
The Coaches
• Team building – Hiring winners
– Player Development
– Junior Leagues, Training
• Management – Strategy, Tactics, Implementation
– Progress and status
• Feedback – Encouragement
– Redirect
AmiBug.Com, Inc.
© Robert Sabourin, 2013 17-Jan-14 Slide 20
The Coaches
• Direct the play play
– Line changes
– Defend players
– Argue with refs
– Motivate
– Drill
– Pull the goalie
– Bridge to stakeholders
AmiBug.Com, Inc.
© Robert Sabourin, 2013 17-Jan-14 Slide 21
The Test Lead
• Team building – Hiring winners
– Tester Development
– Training
• Management – Strategy, Tactics, Implementation
– Progress and status
• Feedback – Breakfast of champions
AmiBug.Com, Inc.
© Robert Sabourin, 2013 17-Jan-14 Slide 22
The Fans
• Hockey Fans – Watch games
– Buy the tickets
– Eat the food
– Exhibit loyalty
– Provide feedback
– Important stakeholders
AmiBug.Com, Inc.
© Robert Sabourin, 2013 17-Jan-14 Slide 23
The Hockey Fan
• Feedback – Anxiety
– Excitement
– Stress
AmiBug.Com, Inc.
© Robert Sabourin, 2013 17-Jan-14 Slide 24
The Hockey Fan
• Feedback – Applaud Progress
– Cheer success
– Boo the other team
AmiBug.Com, Inc.
© Robert Sabourin, 2013 17-Jan-14 Slide 25
Raving Fans of Testers
• Developers
• Database Admin
• Managers
AmiBug.Com, Inc.
© Robert Sabourin, 2013 17-Jan-14 Slide 26
Raving Fans of Testers
• Customers
• End Users
• Business Stakeholders
AmiBug.Com, Inc.
Keep it clean
© Robert Sabourin, 2013 17-Jan-14 Slide 27
Know the rules
Make the rules
Break the rules
Respect stakeholders
Play well with others
AmiBug.Com, Inc.
Keep it clean
© Robert Sabourin, 2013 17-Jan-14 Slide 31
Controlled environment
Clean surface
Prepared
Ready to play
AmiBug.Com, Inc.
The Right Gear
© Robert Sabourin, 2013 17-Jan-14 Slide 32
Helmet
Mask
Gloves
Pads
Skates
Stick
Other stuff
AmiBug.Com, Inc.
Getting Started
© Robert Sabourin, 2013 17-Jan-14 Slide 33
Face off
All ready
Get control
Understand
what you are
up against
Go for it
AmiBug.Com, Inc.
© Robert Sabourin, 2013 17-Jan-14 Slide 34
Hockey Score Board
• Visible to all – Score
– Period
– Time
– Key incidents
– Penalty time
– Ads
– Out of town scores
– Excitement
AmiBug.Com, Inc.
© Robert Sabourin, 2013 17-Jan-14 Slide 35
Testing Score Board
• Generally – Time
– Bugs
– Priority, Severity
• Regress – Confidence
– Pass Fail
• Exploratory – Opportunities
– On charter time %
AmiBug.Com, Inc.
© Robert Sabourin, 2013 17-Jan-14 Slide 36
Urgent
Severe
Urgent
Not Severe
Not Urgent
Severe
Not Urgent
Not Severe
Bug Sweet Spot
AmiBug.Com, Inc.
© Robert Sabourin, 2013 17-Jan-14 Slide 37
Testing Scoreboard
• Progress in the Project – When in project? Phase
– Bugs counts by severity, priority
– Objectives identified, elaborated
– Exploratory Test charters identified
– Tests run, passed, failed, blocked
– Test Project Statistics
– Testing effort done, effort to go
– Running totals (of all counts)
AmiBug.Com, Inc.
© Robert Sabourin, 2013 17-Jan-14 Slide 38
Testing Scoreboard
• Feedback – Big, Visible, Obvious
– Focus of attention
– Great place for Ads!
AmiBug.Com, Inc.
© Robert Sabourin, 2013 17-Jan-14 Slide 39
Testing Scoreboard
0
50
100
150
200
250
01/1
1/9
8
01/1
8/9
8
01/2
5/9
8
02/0
1/9
8
02/0
8/9
8
02/1
5/9
8
02/2
2/9
8
03/0
1/9
8
03/0
8/9
8
03/1
5/9
8
03/2
2/9
8
03/2
9/9
8
04/0
5/9
8
04/1
2/9
8
04/1
9/9
8
04/2
6/9
8
05/0
3/9
8
05/1
0/9
8
05/1
7/9
8
05/2
4/9
8
05/3
1/9
8
06/0
7/9
8
06/1
4/9
8
06/2
1/9
8
06/2
8/9
8
07/0
5/9
8
07/1
2/9
8
07/1
9/9
8
07/2
6/9
8
08/0
2/9
8
08/0
9/9
8
08/1
6/9
8
08/2
3/9
8
08/3
0/9
8
09/0
6/9
8
09/1
3/9
8
09/2
0/9
8
09/2
7/9
8
10/0
4/9
8
10/1
1/9
8
10/1
8/9
8
10/2
5/9
8
11/0
1/9
8
11/0
8/9
8
11/1
5/9
8
11/2
2/9
8
11/2
9/9
8
12/0
6/9
8
12/1
3/9
8
01/1
4/9
9
01/1
8/9
9
01/2
5/9
9
02/0
1/9
9
02/0
8/9
9
Open P1 & P2 Bugs Bugs Pending validation (Corrigé)
Trend Chart
Open Bugs
AmiBug.Com, Inc.
© Robert Sabourin, 2013 17-Jan-14 Slide 40
Hockey Standings
• How is the team doing? – Games played
– Games at hand
– Total Wins
– Total Loses
– Relative placement
– Division standing
– League standing
– Attendance
– Profit
AmiBug.Com, Inc.
© Robert Sabourin, 2013 17-Jan-14 Slide 41
Testing Project Standings
• How is the project doing? – Progress toward goals
– On Time – Quality – Budget
– Comparing all projects
– To go / Done effort
– Estimation accuracy
– Work breakdown
– Effort distributions
AmiBug.Com, Inc.
© Robert Sabourin, 2013 17-Jan-14 Slide 43
Hockey Big Picture
• Is the franchise healthy? – Revenues
– Expenses
– Profit
– Loss
– Contracts
– Media
– Civic responsibility
– Capital
AmiBug.Com, Inc.
© Robert Sabourin, 2013 17-Jan-14 Slide 44
Hockey Big Picture
• How is the franchise doing? – Value
– External factors
– Supply
– Demand
– Opportunity
– Image
– Brand
– Revenue
AmiBug.Com, Inc.
© Robert Sabourin, 2013 17-Jan-14 Slide 45
Testing Big Picture
• Is the company healthy? – Revenues
– Expenses
– Profit
– Loss
– Contracts
– Media
– Civic responsibility
– Capital
AmiBug.Com, Inc.
© Robert Sabourin, 2013 17-Jan-14 Slide 46
The Big Picture
• How is testing adding value to the organization?
– More sales revenue
– Fewer support calls
– Lower development cost
– Competitive time to market
– Best of breed technology
– Accountable and auditable!
– Attracts top talent, Fun team
– All know how testing ties to corporate values