© 2016 by
Ingo Philip EvangelistProduct ManagerTricentis
The Future of Software Testing
© 2016 byIngo Philipp
© 2016 by .© 2016 by .
The Future of Testing
© 2016 byGeneral Testing Relativity
Your future depends on what you do in your present.Mahatma Gandhi
© 2016 by
80%Manual Testing
20%Automated
Testing
UI
API
TestingPresent
The reliance onmanual testing is the
top technical challengein app development.
World Quality Report, 2015/16
Test automationrequires developers.
Testing Present
© 2016 by
TestingPresent
TestingFuture
Exploratory Tests
Automated UI Tests
API Tests
Orchestrated Service Virtualization
80%Manual Testing
+85%
20%Automated
Testing - key enabler for high automation rates -
Testing Future
UI
API
© 2016 by
100%
0%
SprintStart
SprintEnd
API
UI
Start testing early.Shift left test automation.
API Testing
Degree ofCompletion
TimeEfficiency
Gain
+4xCreation
+6xMaintenance
+20xExecution
© 2016 by
*voke, market snapshot report on service virtualization - 2012
On average, organizations require access to 33 systems for development or testing.
18Average # of systems with
unrestricted access
96 % of testers have
restricted test lab access
Orchestrated Service Virtualization
TestingPresent
Enterprise system landscapes are alike disease gene networks.
Welcome to the tester’s hell.
Identify 60% to 90% more defects at leastone step earlier in the development process.
*Service Virtualization – Window into Advanced DevOps - 2014
© 2016 byDo the things right.
Automation is the dictate of today.Automation doesn’t make testing easy, it makes testing possible.
© 2016 by
It’s me, a problem!
Start Endsoftware delivery cycle
67%average level of redundancy in
enterprise test portfolios
40%average risk coverage achieved
inenterprise test portfolios
90%of all test automation isUI test automation
80%overall testing effort goes into manual
testing
55%of systems only
partially accessible by Dev/Test
56%of overall test effort goes into
test case maintenance
30%of bugs found in acceptance
& production stage
50%of manual testing goes into testdata preparation & organization
Albert Einstein, 1921
“The first step to solve a problem is to accept that you have one.”
Is it just about speed?
© 2016 by
By compressing the delivery cycle,do problems just move closer to each other?
Is it just about speed?
Start Endsoftware delivery cycle
© 2016 by
Start Endsoftware delivery cycle
No, they mutually reinforce each other!
The devil is inthe combination!
It’s about speed@quality.
Hence, the biggest strength of DevOps is not solving problems, but rather exposing buried
problems.
© 2016 byDo the right things right.
Testing harder isn’t the answer, testing smarter is.Wolfgang Platz
© 2016 by
LowRisk
HighRisk
MediumRisk
80%20%
Business RiskCoverage
TestCases
The time needed fortesting is infinitely
largerthan the time available.
Critical Limit
Risk-Coverage Optimization
Have the right test cases.
Do the right things.
© 2016 by
Risks
Your system under test.
Performance Issue
Usability Issue
Functional Issue
Stability Issue
Reliability IssueScalability Issue
Coherence Issue
Understandability Issue
Testability IssueConvenience Issue
Security Issue
Accessibility Issue
© 2016 by
SpecificationBased Testing
Exploratory Testing
Exploratory Testing
Analyze Potential RisksProblem vs. No Problem
Monitor Known RisksPass Result vs. Fail Result
Effective testing results from the combination of both.
*That’s an illustration. Don’t confuse it with reality.
Increase your testing crosssection. Actively attack risk.
Go beyond the obvious.Diversify your testing.
Enrich your test design.Find more critical bugs.
Fast error detection.Provide rapid feedback.
Make your testing intellectually rich.
Core Benefits
© 2016 by
100%ManualTesting
0%Automated
Testing
TestingPresent
Customer Case Study
There’s a way to do it better. Find it!
Project Charter
11Manual
Testers
4755Manual
Test Cases
?Unknown
Coverage
10Weeks
Execution
© 2016 by
Risk Coverage Optimization Test Data Management
48Hours
Execution
Single Agent
8Hours
Execution
Multiple Agents
Customer Case Study
11Manual
Testers
4755Manual
Test Cases
?Unknown
Coverage
10Weeks
Execution
89%Business Risk
Coverage
1193Manual
Test Cases
37%Business Risk
5Weeks
Execution
2.5Weeks
Execution
92%Automated
Test Cases
53%Business Risk
Coverage
Smoke Testing
34Minutes
Execution
Smoke Testing
Test Case Count 7%
Automation (UI & API) & OSV Continuous Integration & Distributed Execution
75% Redundancy 50% Effort Test Data
64% API Tests
© 2016 by
8Hours
Execution
Multiple Agents
Customer Case Study
72%Critical Defect Reduction
Production Defects
89%Business Risk
Coverage
1193Manual
Test Cases
5Weeks
Execution
2.5Weeks
Execution
92%Automated
Test Cases
34Minutes
Execution
Smoke Testing
53%Business Risk
Coverage
Smoke Testing
Test Case Count 7%
Test Case Design & Exploratory Testing
Risk Coverage Optimization Test Data Management Automation (UI & API) & OSV Continuous Integration & Distributed Execution
64% API Tests
© 2016 byBottom Line
The future starts today, not tomorrow.Start remodeling your traditional approaches for greater agility today.
Top Related