© 2016 by

Ingo Philip EvangelistProduct ManagerTricentis

The Future of Software Testing

© 2016 byIngo Philipp

© 2016 by .© 2016 by .

The Future of Testing

© 2016 byGeneral Testing Relativity

Your future depends on what you do in your present.Mahatma Gandhi

© 2016 by

80%Manual Testing

20%Automated

Testing

UI

API

TestingPresent

The reliance onmanual testing is the

top technical challengein app development.

World Quality Report, 2015/16

Test automationrequires developers.

Testing Present

© 2016 by

TestingPresent

TestingFuture

Exploratory Tests

Automated UI Tests

API Tests

Orchestrated Service Virtualization

80%Manual Testing

+85%

20%Automated

Testing - key enabler for high automation rates -

Testing Future

UI

API

© 2016 by

100%

0%

SprintStart

SprintEnd

API

UI

Start testing early.Shift left test automation.

API Testing

Degree ofCompletion

TimeEfficiency

Gain

+4xCreation

+6xMaintenance

+20xExecution

© 2016 by

*voke, market snapshot report on service virtualization - 2012

On average, organizations require access to 33 systems for development or testing.

18Average # of systems with

unrestricted access

96 % of testers have

restricted test lab access

Orchestrated Service Virtualization

TestingPresent

Enterprise system landscapes are alike disease gene networks.

Welcome to the tester’s hell.

Identify 60% to 90% more defects at leastone step earlier in the development process.

*Service Virtualization – Window into Advanced DevOps - 2014

© 2016 byDo the things right.

Automation is the dictate of today.Automation doesn’t make testing easy, it makes testing possible.

© 2016 by

It’s me, a problem!

Start Endsoftware delivery cycle

67%average level of redundancy in

enterprise test portfolios

40%average risk coverage achieved

inenterprise test portfolios

90%of all test automation isUI test automation

80%overall testing effort goes into manual

testing

55%of systems only

partially accessible by Dev/Test

56%of overall test effort goes into

test case maintenance

30%of bugs found in acceptance

& production stage

50%of manual testing goes into testdata preparation & organization

Albert Einstein, 1921

“The first step to solve a problem is to accept that you have one.”

Is it just about speed?

© 2016 by

By compressing the delivery cycle,do problems just move closer to each other?

Is it just about speed?

Start Endsoftware delivery cycle

© 2016 by

Start Endsoftware delivery cycle

No, they mutually reinforce each other!

The devil is inthe combination!

It’s about speed@quality.

Hence, the biggest strength of DevOps is not solving problems, but rather exposing buried

problems.  

© 2016 byDo the right things right.

Testing harder isn’t the answer, testing smarter is.Wolfgang Platz

© 2016 by

LowRisk

HighRisk

MediumRisk

80%20%

Business RiskCoverage

TestCases

The time needed fortesting is infinitely

largerthan the time available.

Critical Limit

Risk-Coverage Optimization

Have the right test cases.

Do the right things.

© 2016 by

Risks

Your system under test.

Performance Issue

Usability Issue

Functional Issue

Stability Issue

Reliability IssueScalability Issue

Coherence Issue

Understandability Issue

Testability IssueConvenience Issue

Security Issue

Accessibility Issue

© 2016 by

SpecificationBased Testing

Exploratory Testing

Exploratory Testing

Analyze Potential RisksProblem vs. No Problem

Monitor Known RisksPass Result vs. Fail Result

Effective testing results from the combination of both.

*That’s an illustration. Don’t confuse it with reality.

Increase your testing crosssection. Actively attack risk.

Go beyond the obvious.Diversify your testing.

Enrich your test design.Find more critical bugs.

Fast error detection.Provide rapid feedback.

Make your testing intellectually rich.

Core Benefits

© 2016 by

100%ManualTesting

0%Automated

Testing

TestingPresent

Customer Case Study

There’s a way to do it better. Find it!

Project Charter

11Manual

Testers

4755Manual

Test Cases

?Unknown

Coverage

10Weeks

Execution

© 2016 by

Risk Coverage Optimization Test Data Management

48Hours

Execution

Single Agent

8Hours

Execution

Multiple Agents

Customer Case Study

11Manual

Testers

4755Manual

Test Cases

?Unknown

Coverage

10Weeks

Execution

89%Business Risk

Coverage

1193Manual

Test Cases

37%Business Risk

5Weeks

Execution

2.5Weeks

Execution

92%Automated

Test Cases

53%Business Risk

Coverage

Smoke Testing

34Minutes

Execution

Smoke Testing

Test Case Count 7%

Automation (UI & API) & OSV Continuous Integration & Distributed Execution

75% Redundancy 50% Effort Test Data

64% API Tests

© 2016 by

8Hours

Execution

Multiple Agents

Customer Case Study

72%Critical Defect Reduction

Production Defects

89%Business Risk

Coverage

1193Manual

Test Cases

5Weeks

Execution

2.5Weeks

Execution

92%Automated

Test Cases

34Minutes

Execution

Smoke Testing

53%Business Risk

Coverage

Smoke Testing

Test Case Count 7%

Test Case Design & Exploratory Testing

Risk Coverage Optimization Test Data Management Automation (UI & API) & OSV Continuous Integration & Distributed Execution

64% API Tests

© 2016 byBottom Line

The future starts today, not tomorrow.Start remodeling your traditional approaches for greater agility today.