Presentation
Fredrik Rydberg AddQ Consulting
Started employment in 2001 at the Med Tech
company Maquet Critical Care
(Stockholm Sweden) as Test Manager and later Unit Manager for testing.
During the last 3 years Fredrik has been a Test Management consultant within sectors as Banking & Finance, Utilities (electricity) and Transport.
Can exploratory testing
save lives?
Fredrik [email protected]
+46 735 142 143
Experiences from MAQUET
Product Descriptions
Anesthesia System
Ventilator ( =Respirator)http://www.youtube.com/watch?v=NbxxITf-N2Q
Description Ventilator Testning
Measuredvalue
Set value
P
Flow
V
Scripted requirement based testing at Maquet
• Authorities/ standards
• A ”Must” forced by security and quality
• Easy to evaluate when exit criteria is met
• Large amount of requirements to test – time consuming!
• Mostly manual test cases
• Old test cases result in few new defects!
Detailed requirements and
scripted testing is absolutely
needed but is not sufficient to
fully verify the requirements !
Exploratory testing at Maquet
• Started spontaneously approx. 16 years ago
• Both requirements and parts not specified as req’s
• Also non functional tests
• User oriented
• Cost effective
• Intellectual
• Suitable method for clinical experts and other expertise
Comparison Scripted testing - ET
Scripted testing1. Test Design with Test Steps
2. Execution
3. Logging in protocol
Exploratory Testing
• Parallel test design and execution
• Level of documentation is varying
Fully scriptedLess guidence
Fragmentic test cases charters
Freestyle exploratory testing
Exploratory testing
Comparison Scripted testing - ET
Pitfalls/ experiences ET at Maquet
• Different testers have different ET skills
• Risk of decreased motivation without management and control…
• …But management and control may influence creativity negatively
• Difficult to monitor what has been tested without SBTM
Important capabilities for ET, Maquet
• Clinical competence
• Domain and technical knowledge
• Experience of previous testing/ project
• Test competence (testing techniques)
• Curious, patient, communication and networking skills
Variation in the project cycle (ET/ scripted)
ET
Scripted
Time (months)
Test
Tim
e /
m
on
th (
ho
urs
)
Scripted testing
YINSlow, cold and calm
Exploratorytesting
YANGFocused, warm and aggressive
Important to find the right mix!
Time distribution
ET execution
18%Automatic execution (scripted)
10%
Script execution
27%Script test
reports5%
Designing Scripted
Test cases25%
Other15%
Efficient more times7 ET
7)urdefects/ho(5.0
)rdefect/hou(1
) test timeET%(18
) test timeScripted%(67
:Efficiency Comparison
Visit by James Bach (spring 2007)
• 2 days visit
• Inspiration talk for employees
• Participation in testing
• ”pep talk”
• Improvement advice
• Target of ET clearer
General Test tool support
• Maquet developed tool for session based testing (“Session Based Tester”)
• IBM Clear Quest, Requisite Pro
• Capture Replay tool
• Automatic loggings tool statistics
IBM Requisite Pro
SBTM- Session Based Test Management (Method)
• General method to manage, report and follow up ET
• Time box approx. 90 min (60-120 min)
• Supported by charters
• A result possible to evaluate
• Often combined with debriefing (approx. 15 min)
Session-based testing is developed by Jonathan and James Bach (first presented in year 2000).
See http://www.satisfice.com/sbtm for more info.
Session Based Testing Tool (Open Source)
•Maquet developed tool
•Started in use Aug. 2008
•Developed in Perl using SQL server
•Example field New session:
•Project
•Duration
•Which tests to be done?
•Which have been tested?
Example functionality:•Add new session• Report session• Metrics: Fault intensity• Archiving• Test Reports
Session Based Testing Tool (Open Source)
Advantage SBTM Maquet
• Easier to manage and follow up ET
• Reuse of sessions
• Statistics
• Complementing the Test Report
• Participation from other departments
• Learn from other test sessions
• Common ET process
ET today at Maquet
• ET recognized and powerful test approach
• ET has resulted in an increased test focus at Maquet
• ET is the most efficient test approach
• ET contribution to Market Leading product
Future possibilities
• Continue to improve ET/ SBTM• Improved debriefing/reporting• ET + SBTM training for new employees
Suggestions future functionality (SBTM):• Dynamic Metrics (parameter list)• Validation / write protection of sessions• iPhone/ Android version?• Other tools?
Inspiration Exploratory testing
Inspiration links:
www.satisfice.com
www.developsense.com
www.kaner.com
http://testingeducation.org/wp/
Maquet SBT Open Source:
http://sites.google.com/site/sessionbasedtester/
Join the “Linked in” group “Session based testing”:
http://www.linkedin.com/groups?mostPopular=&gid=3316116
Fredrik Rydberg
Summary• ET needed to fully verify requirements• Other defects with ET compared to ST• Important to find the right mix• Increased efficiency with ET• SBTM (with tool) made ET more
structured• ET significant quality contribution
Top Related