EuroSTAR presentation: What's in the cloud for testing, the sky is the limit

Edwin van Loon, Valid

What’s in the cloud for testing?The sky is the limit

www.eurostarconferences.com

@esconfs#esconfs

Introduction Edwin van Loon

• ISEB Practitioner

• Lean Six sigma green belt

• Almost 15 years of experience

within different testing roles

• Living in Belgium

• Working in the Netherlands

edwinvanloon

Edloon

[email protected]

Cloud

Millennium change

Agile manifesto

ISO SQuaRE (25010)

Web based development

Introduction of the Euro coin

Model based testing

Risk based testing

Regulatory compliance

Test Certification

Vote: What will be the impact of the cloud on our testing profession?

URL: http://piepe.co

http://vdeskvm.cloudapp.net:81/

Agenda

• The cloud in general

• The cloud and testing

• The cloud and it’s possibilities

• Testing the cloud

What’s in the cloud for testing

Testing the CloudCloud PossibilitiesCloud and TestingCloud General

Applications

Runtime

Security

Databases

Servers

Network

Storage

Hardware

Virtualization

Cloud layers

Applications

Runtime

Security

Databases

Servers

Network

Storage

Hardware

Virtualization


Cloud layers

History of the Cloud

1997 2000 2002 2004 2006 2008 2010 2012 -2015

Early SaaSadaptors

16.3% compound annual growth rate

through


Announcement Cloud in 1997“In the last 7 years, do you know how many times I have lost any personal data? Zero.

Do you know how many times I have backed up my computer? Zero…

I have computers at Apple, at NeXT, at Pixar, and at home. I walk up at any of them and log in as myself, it goes over the network, finds my home directory on a server, and I got my stuff where ever I am…Carrying around these non-connected computers or computers with tons of data and state in them is Byzantine by comparison.”

Steve jobs at WWDC 1997 (Apples Worldwide Developers Conference)(http://www.youtube.com/watch?v=3LEXae1j6EY)


Triple A: Any time, Any place, Any device, (Any data)

Advantages

1. Time to market

2. Scalability

3. Reduction of IT-costs


http://gigaom2.files.wordpress.com/2010/09/2-ycc-bldgs1.jpg

http://www.wired.com/wiredenterprise/wp-content/uploads/2012/10/ff_googleinfrastructure2_large.jpg

Cloud testing

• a form of software testing in which web applications use cloud computing environments to simulate real-world user traffic.

• allows you to use simulated web traffic to ‘load test’ a website or web application with a flexible, scalable and affordable testing environment.

Testing the CloudCloud PossibilitiesCloud GeneralCloud and Testing

en.wikipedia.org/wiki/Cloud_testing

www.iseb-istqbsoftwaretesting.co.uk/video-introduction-to-cloud-testing

Test tools:

- Functional and Performance testing

- Cross browser testing

- Test management

Runtime

Security

Databases

Servers

Network

Storage

Hardware

Virtualization


Cloud test tools

History of the Cloud

1997 2000 2002 2004 2006 2008 2010 2012 -2015

Early SaaSadaptors

16.3% compound annual growth rate

through


Advantages cloud test tools


• Accessible at Any place, Any time, Any device

• Scalability

• No infrastructural constraints

• No geographical constraints

• Low time to market

• Temporary contract / low costs

• No installation

• Availability

• Usability

• Possibilites for endurance testing

• ………


Demo

http://www.practitest.com/

http://keynote.com/

http://www.pushtotest.com/index.php

Cloud GeneralCloud and Testing

Test tools

Test portal

Templates

Standards

KPI’s

Virtual testmachines

Test servers

Network types(latency)

Testing the CloudCloud Possibilities

Test layersTesting as a Service

Portal

TaaS (or Quality as a Service)

Customer

Service provider

Testtools

Test results

Metrics / KPI’s

Test machines

InfrastructureTest

machines

Test Employees and Processes

Software andProcessesTools

Operational Data

On PremiseSoftware

Off PremiseSoftware

ProcessData

Test Service Level agreement

• Effort driven:

• Number of test cycles per period (including peak and off-peak)

• Through put time (test execution, test preparation, etc.)

• Test or QA activities in general

• Creation of Reports (operational and tactical)

• Result driven:

• Test coverage (quality level) or effort

• Defect detection percentage (DDP)

Cloud GeneralCloud and TestingTesting the CloudCloud Possibilities

Testing the cloud

• Compliancy statement• Security testing• Availability• Test of cost models• Test of migration• Fixed release dates • Connectivity testing of hybrid clouds.• Juridical aspects of the cloud• Availability of cloud solutions:

• Test of vendors (Cloudsleuth)• Two internet providers• Two instances / multi-region

Cloud GeneralCloud and TestingCloud PossibilitiesTesting the Cloud

http://ssae16.com/index.html

Resume

• The cloud is a TaaS enabler• The cloud will change the expectation of users

regarding quality • Cloud services require different test approach• Cloud test tools allow test teams to:

• avoid high costs on investments• execute test global tests

• The cloud allows the test community to cooperate and connect

The cloud has a already a high impact on Software Testing

…….. and the impact will become huge

Stay Ahead

QUESTIONS ?

EuroSTAR presentation: What's in the cloud for testing, the sky is the limit

Technology

Transcript of EuroSTAR presentation: What's in the cloud for testing, the sky is the limit