Webinar: Experitest & Syntel on Best Practices for Mobile Application QA in an Agile Environment

Dec 2015

Syntel & Experitest Co-webinar:

Best Practices for Mobile Application QA in an Agile Environment

Speakers

Tom Ben SimhonHead of Sales

Experitest

Ashok

BalasubramanianHead of Services

Transformation Group

Syntel

Agenda1 The Digital Transformation - mobility industry overview

How mobile QA adapt to the digital transformation

How Agility effects mobile DevOps ?

Demo- How SeeTest Suite enables agile methodology?

Case Study

Q & A

5 Min

5 Min

1 Min

30 Min

10 Min

10 Min

2

3

4

5

6

Symbian

2015: A prominent year

for Mobility

Mobile adoption on Rise

One view – Any platform

Device Proliferation

Industry wide adoption of Mobility

18%

of IT spending on

mobility by 2017

($600 Bn Approx.)

By 2017, Global

EMM market to

reach

$3.1

Billion

workforce to

depend on Mobile

solutions for work

by 2015

480

Million

2006 2012 2017

Millions

~60

~600

~1500

2.4% Entertainment information & Media

9.4% Manufacturing

9.0% Government & public

3.8% Healthcare

2.8% Communications

2.4% Legal

2.0% Retail

7.6% Other

46.8% Financial Services

13.8% Business & Professional Services

0%

10%

20%

30%

40%

50%

60%

Google\ Android Apple\iOS Microsoft BlackBerry

2013 Feb 2014 Feb 2015 Feb

Digital - Mobility Industry Overview

What is changing

5

Businesses are struggling with speed of technological change(World Quality Report )

Budget spent on the new

transformational work has decreased

by 1 percent and more spending is on

the continuous transformation.

Modernize the testing practices

and procedures. This demands

higher proportion of that budget

is now dedicated to DevOps and

Agile principles.

Digital transformation and

security testing has become

critical to business assurance

for many organizations.

Customer experience is now

a key consideration for their

digital quality assurance

testing.

Digital Quality Engineering View

Performed Manuallyfor DevOps

6

Environment

Provisioning

Build Unit Testing Code Review Deployment Regression

Testing

Environment

Availability

Requirements

Unit Test Scripts Code Quality Rules Regression Scripts

Integrated QA

Automated Testing (MTAF)

Administration, Governance and Reporting

How is Mobile DevOps adapting to the Digital Transformation

7

3.

Customer experience

driven quality

2.

Multiple

technologies and

platforms

1.

More Agility

Business organization - Digital Transformation is rebranding or

integrating digital characteristics?

Core aspects of the Digital Transformation for building digital QA test

strategy:

Simple and robust automation for complete application development

lifecycle – From design phase to post production1.

More Agility

How Agility effects Mobile DevOps?

SeeTest Suite allows agile process for

Mobile application testing

Shorter release cycle

Manual regression shortened

QA automation process is more relevant

Automation ROI increased

A M

C N

AGILE

DEVELOPMENT

• Device Lab located onsite (in the customer VPN)

• Devices can be reserved and accessed by any remote user

• Used in conjunction with SeeTestAutomation/Manual/Mobile Add on for UFT for testing of remote devices

SeeTestCloud

End-to-End Product Suite –Manual, Automation, Monitoring, Load, Network Virtualization, Manager

SeeTestCloud- Centralize your Device Hub

Allow remote access

Allow working on devices 24/7 with different teams

Allow scalability – Support all operating systems- IOS, Android, Blackberry, and WindowsPhone

Increased device governance leading to better test operation management

SeeTestCloud

U.K

U.S.A

India


• Productivity tool for manual users

• Report with screenshots of each

step

• Used in conjunction with

SeeTestCloud

• Allow remote debugging

SeeTestManual Free

Tool!

M




SeeTestCloud

SeeTestManual integrates to ALM assets

Works in conjunction with SeeTestCloud

Integrates to HP ALM and JIRA - defect management tool.

Manual Testing M

Manual Tester

Develop / Debug M

Mobile Developer

SeeTestCloud

M


• Automation tool

• Same test runs on different devices

• Plugs into all testing & CI environments

SeeTestAutomation

Mobile Add-On for UFT

• Full & complete integration into HP UFT:

• Record a test, edit it, run it, and view results

• Integration of object repository and more…

U




SeeTestCloud


• Report with screenshots of each step

• Used in conjunction with SeeTestCloud


SeeTestManual Free

Tool!

M

SeeTestAutomation works in conjunction with SeeTestCloud

14

Same test runs on all platforms:

• All device types

• All operating systems: iOS, Android, Blackberry, and WindowsPhone

Automation

engineer

India

SeeTestCloud

SeeTestAutomation has advanced Continuous Integration capabilities

15

On-the-Fly instrumentation

Dynamic allocation of devices for execution

Parallel Execution environment

Developers

Source Code

Repository

CI Server

YOUR

APPExecuter

Agent

Execute Test On Devices

xTest Results


Network Virtualization• Device performance under varying network conditions

• Simulating mobile network bandwidth latency and reception while on the move N

• Full integration to LoadRunner through

SeeTestAutomation

Mobile Add-On for LoadRunnerSeeTestLoad

• Real device generated mobile load

• Full integration to LoadRunner, Jmeter, etc.L

SeeTestLoad

• Automation tool

• Same test runs on different devices

• Plugs into all testing & CI environments :

SeeTestAutomation

Mobile Add-On for UFT

• Full & complete integration into HP UFT:

• Record a test, edit it, run it, and view results

• Integration of object repository and more…

U




SeeTestCloud


• Report with screenshots of each step

• Used in conjunction with SeeTestCloud


SeeTestManual Free

Tool!

M

Network Virtualization• Device performance under varying network conditions

• Simulating mobile network bandwidth latency and reception while on the move N

17

Works in conjunction with SeeTestManual and SeeTestAutomation

SeeTest NetworkVirtualization simulates different network conditions N

Manual Testing M

Manual Tester

Develop / Debug A

Automation Engineer

NN SeeTestCloud

18

Case Study: mobile application non-functional QA

• Increased NFR coverage by 40%, resulting in 70% overall NFR coverage

• 30% Reduced cycle time

• 40% overall reduction in NFR testing Costs

Business

Benefits

About the Client Challenges Syntel Solution

• UK based Leading investment

firm

• Non-functional testing of Mobile apps -

Hybrid

• Interruption testing

• Connectivity testing

• Session Management

• Caching

• Accessibility testing

• Network Simulation

• App profiling

• Leveraged SeeTest’s Network

virtualization feature for simulation

of networks & service providers

• Centralized managed lab for entire

portfolio

• UI driven Framework for early

automation

19

Case Study: mobile application functional QA

• Achieved 80% overall Functional coverage

• 40% effort saving in the test design phase

• Structural savings of 25% and overall reduction in IT Costs

Business

Benefits

About the Client Challenges Syntel Solution

• US based Leading Insurance firm • Real Device Testing for E2E functional

Testing

• Mobile Lab to be accessible all across the

globe

• Non-functional testing of Mobile apps -

Hybrid

• Interruption testing

• Connectivity testing

• Session Management & Caching

• Application Management - Project

Management as a part of a solution

• Centralized managed lab for entire

portfolio

• UI driven Framework for early

automation

• More secured private device hub

with seamless device sharing

• Leveraged SeeTestCloud for real

device sharing, remote access,

application management and

project management

Webinar: Experitest & Syntel on Best Practices for Mobile Application QA in an Agile Environment

Software

Transcript of Webinar: Experitest & Syntel on Best Practices for Mobile Application QA in an Agile Environment