Universal test solutions customer testimonial 10192013-v2.3

©2012 UTS Global, Confidential and proprietary. All rights reserved worldwide.

1

Redefining Test Automation by Innovating Possibilities

Universal Test Solutions

01 Apr 2013

Test Optimization to Align Business with IT


2

Agenda

and what did we do to “ make the it happen”

Which has helped in Business Value Realization of our client

and what has changed with it

How we accomplished it….

1

2

3

4

5

and who we are 6

What got us thinking …


3

Over past three decades, there has been an explosion of test

automation tools and heightened customer expectations…

Modularity driven testing

Data driven testing Keyword Driven Hybrid

Keyword/Data Driven

1994-2001 2001-2005 2005-2008 2008-2012

Variety of tools over generations

Frameworks for automation


4

but test automation is perceived as risky and failing to meet ROI expectations….

Cost of Failed Implementations 2004 2012 (Estimated)

Industry: Test Automation (net worth) $ 1 billion $ 6 billion

Automation Projects (failure cost) $ 1/2 billion $ 3 billion

*Ovum Study Projects the testing tool market to be worth 56 billion US dollars by 2013 growing at an rate of 9.5 %

Source A: ROI on Test Automation – http://www.keane.com Source B: HP pays 4.5 b illion to acquire mercury - http://www.mytimes.com/2006/07/26/technology/26hewlett.html


5

Test automation is not as easy as it seems to be: just buy one of the popular test

execution tools, record the manual tests, and then play them back whenever you

want to.

Need of Specialized Skills

(Scripting Knowledge + Testing + Domain)

High Startup Cost and Effort

(Tools, Frameworks, Converting Manual Test Cases to Automation)

Unforeseen Maintenance Cost

(Change in Application, Test Data, Test Environment)

Long Learning Curve and Team

collaboration

Change in Team Focus from Quality

to Solution

despite steep investment, high cost skill deployment and uncertainty of costs


6

Agenda





1

2

3

4

5

and who we are 6



7


7

Gen 3rd

Keyword Driven

Scripting

Gen 1st

Modular Scripting

Gen Zero

Record &

Play

Gen 4th

Hybrid Data + Keyword Scripting

Gen 2nd

Data Driven

Scripting

A Step towards innovating possibilities …..


8


8

Gen 3rd

Keyword Driven

Scripting

Gen 1st

Modular Scripting

Gen Zero

Record &

Play

Gen 4th


Gen 5th

Introducing Script less Automation for UI and Non

UI (Web Services)

Gen 2nd

Data Driven

Scripting

by redefining test automation…..


9


9

XPATH Check Regular Expressions

Descriptive Programming

Fuzzy Logic

Artificial Intelligence Social Intelligence

Gen 3rd

Keyword Driven

Scripting

Gen 1st

Modular Scripting

Gen Zero

Record &

Play

Gen 4th


Gen 5th

Introducing Script less Automation for UI and Non

UI (Web Services)

Gen 2nd

Data Driven

Scripting

We have redefined test automation…..

Artificial Intelligence

New Era in Testing- introducing revolution in test automation…


10

by eliminating challenges to Align business with IT

Test automation is not as easy as it seems to be: just procure one of the TestMagicTM

popular test execution tools, record navigate the manual tests, and then play them

back whenever you want to.

Need of Specialized Skills

(Scripting Knowledge + Testing + Domain)

High Startup Cost and Effort

(Tools, Frameworks, Converting Manual Test Cases to Automation)

Unforeseen Maintenance Cost

(Change in Application, Test Data, Test Environment)

Long Learning Curve and Team

collaboration

Change in Team Focus from Quality

to Solution


11


11

with drastically improved test automation creation and execution metrics

11

Key Parameters Other

Tools

Test

Magic

Remarks

Automation Script Creation % Effort of Overall Automation Effort

Automation Framework Approach & Architecture

Finalization & Creation/Customization of the Automation Framework

15% 0% It’s Inbuilt in eZscript and can be implemented to any web

based product directly.

Creation Of the object Repository (GUI/Objects

Learning)

10% 0% eZscript has intelligence to identify object directly from the web

page.

Creation of Reusable Function Library 10% 0% eZscript is having action based keywords hence grouping of

actions creates a functions/Business Component.

Creation of Keyword driven (KWD) automated test

scripts and converting it to data driven

40% 25% eZscript has the inbuilt capability and creates the KWD script

during manual testing.

KWD Review & Dry run 15% 10% Debug Mode Execution enable to test script with different set

of data.

Fixing and tuning of Object Repository/ Automated

Framework

10% 5% Artificial Intelligence; No Object Repository.

Automation Script Execution

Automation Test Management 10% 5% Test Magic has UI based test management.

Automation Execution 70% 40% Execution is faster because of the Artificial Intelligence

approach to identify object

Reporting the issues/defects from team and

merging/publishing reports of a release

20 % 15% Test Magic has huge web based Report Dashboard which can

be emailed or printed .

Approx. 60 %

Effort Saving

Approx. 40%

Productivity

Improvement


12

and improving product quality, increasing test infrastructure utilization and enhancing operational efficiency …

Product Quality

Operational Efficiency

Automate more regression testing, achieve greater test coverage

Automate testing both UI and non-UI including SOA architectures

Collaboration(manual & automation)

Eliminate repetitive manual tasks, minimize errors and troubleshooting

Share expensive assets across multiple projects and user groups

Max Resource Utilization- Manage and automate allocation of automation test lab assets, Test Sets, and execution of

automated test scripts.

Reduce capital and operating costs by improving scalability

Easy to use by all levels of testing staff

Test Infrastructure

Utilization

TestMagicTM enable IT

Cost savings

TestMagicTM Enable

Time savings


13

Agenda


Which has helped in Business Value Realization of our clients



1

2

3

4

5

and who we are 6



14


14

Background and client situation

Background

Client is a software product MNC in USA having complete solution for Cards and Payments. Their product

interfaces with multiple applications such as

–Visa/MasterCard - Analytics system

–General Ledger - Payment Gateway

–ACH - Embossing Vendor

–IVR - Credit Bureaus

–Dialer - Statement & Letter Production Vendor

Client Situation & Challenges

The Client faced the following challenges with respect to cards testing across their global delivery centers

- Real-time processing - Online, real-time access to data

- Complex authorization parameters and rules testing - Effective dating of all transactions and rules

– Flexible, user-defined billing cycles - Flexible pricing and payment terms

– Generic model for the organization – encompassing all applications - Multiple languages

– Multiple team support (over multiple locations) - Multiple currency capabilities

– Multiple environnent support (for multiple applications)


15


15

TestMagicTM Empowered

~10 %

improvement in

Schedule

~ 75 %

Automation

coverage

~ 23 %

improvement in

defect verification

of Showstopper

bugs

Overall 27%

reduction in cycle

time

Before TestMagicTM Implementation

• Resource-intensive and time-consuming Most of the

Testing exceed 50% of development cost

• Automation Test Script Creation, Execution and Result

Analysis was time consuming and need SME for all.

• Low Test Coverage 50% resulted in High Defect

Slippage in Production

• High Learning Curve

After TestMagicTM Implementation

• Test execution cost came down from 25 USD to 10 USD

in first release

• 40% reduction in cycle time

• 100% Test Coverage

• Accelerated Time To Production

• Increase in 10% Adhoc Bugs

• Reduces the learning effort by 82%


16


16

with acknowledgement and recognition from the client …….

Test Magic is comprehensive testing automation software that we have been using for

more than 2 years in Production. We are fully satisfied with Test Magic’s software and the services they have provided us.

Test Magic is a highly flexible automation solution designed for complete web application testing including Rule based File testing, validation of data in Database. TM’s team has

delivered numerous customizations we asked for with short turnaround time helping us meet our stringent delivery schedule. The software is capable of providing high throughput and is very scalable. Its processing speed is limited only by the number of

machines (processors) that are used. This is very critical for regression testing of complex financial software such as ours. The product is easy to use and can be

mastered in as less a couple of days. TM’s support team has also provided us prompt and excellent technical support.

I believe that the product derives its value from its use of latest technologies which are coherent with most current Operating Systems and web browsers. Test Magic

continuously evolves itself by adding new features such as SOAP based Web Service testing and can meet the challenges of the highly integrated and automated systems of today’s enterprise"

Service Category: IT Consultant

Year first hired: 2010

Top Qualities: Great Results, Expert, Good Value

Liliya Burshteyn Director CoreCard Software, Inc


17

and the “delight of being able to do what was thought…..


18

Agenda





1

2

3

4

5

and who we are 6



19


19

Typical ROI Mantra

ROI (%) = (Savings from automation) / (Costs of automation)

• Identification of the automation tool / Methodology.

• Test automation framework/solution creation based on

best suited automation methodology as per need such as o Record & Play or o Scripting/Functional Decomposition or

o Keyword/Data Driven or o Hybrid approach

o Customization of automation existing solution

• Define the automation test strategy & approach

• Framework/Solution validation to confirm its correctness

that It is rightly build

• Automation of the manual test cases selected as

automation candidates

• Automation Test Execution

• Reporting the issues/defects from team and


Hmmm…… ROI needs significant

investment of effort and

money


20


20

Our ROI Mantra

• Identification the automation tool / Methodology.

• Test automation framework/solution creation based on

best suited automation methodology as per need such as o Record & Play or o Scripting/Functional Decomposition or

o Keyword/Data Driven or o Hybrid approach

o Customization of automation existing solution

• Define the automation test strategy & approach

• Framework/Solution validation to confirm its correctness

that It is rightly build

• Automation of the manual test cases selected as

automation candidates

• Automation Test Execution

• Reporting the issues/defects from team and


Automatic

ROI Simplified By

Innovating Possibilities


21


21

Typical automation breakeven cycle


22


22

Our breakeven is achieved soon as you start and increases exponentially through various levers…


23

Agenda




How we have accomplished it….

1

2

3

4

5

and who we are 6



24


24

• TestMagic (SaaS Compliant)

– Automation Lifecycle Management (ALM)

• eZscript

– Scripting & Execution Engine

• MagicSchedular

– Distributed and Remote Scheduling

(Execution Load Balancing)

Test any application On any Windows OS

Test any applications Written in any language

VB. NET Win32 ActiveX Delphi PHP C# ASP

JavaScript Java Python C++ AJAX HTML Perl

TestMagicTM Enterprise Solution: A Snapshot


25


25

File Parsing/Testing Database Testing Application Under Test

SOAP Services

API

CSV XML Text

25

TestMagicTM in a nutshell

PDF

Unique Features:

• Automatic Script Generation (No-programming )

• Automatic Step Description Generation

• Automatic Load Distribution – Group Scheduling

• Multi Country Support

• Multi Lingual Support

• Robust Automation Life Cycle Management

• Test Data Creation and Data Quality Checks

http://www.google.co.in/imgres?imgurl=http://siliconangle.com/files/2010/10/sap-logo.jpg&imgrefurl=http://siliconangle.com/blog/2010/10/27/sap-had-strong-earnings-in-q3-still-facing-oracle-in-court/sap-logo/&usg=__rplz5Pxx5yeIbvpD4WD1W-QeaYw=&h=1264&w=2507&sz=207&hl=en&start=1&zoom=1&tbnid=Pg83oTgs8IXABM:&tbnh=76&tbnw=150&ei=Z_2FUcnFCcfjrAfnnIGYAQ&prev=/search%3Fq%3Dsap%2Blogo%26sa%3DX%26biw%3D1366%26bih%3D615%26tbm%3Disch&itbs=1&sa=X&ved=0CCwQrQMwAA


26


26

TestMagicTM Architectural View

26

TEST LAB CONFIGURATION

MANAGEMENT

Initialization of Parameters

Configuration settings

Test Lab Management

Super User

Create Projects

Backup & Recovery

Project Admin

Tester(s)

Assign Project Admin

Create/ Manage Tester(s)

Manage Test Suite

Create Scripts

Schedule Run Execute Test Suite View My Report

SERVER

DB

DISTRIBUTED EXECUTION

AUT 1 / AUT under Environment 1

REPORT DASHBOARD

TEST RESULTS

E-MAIL TEST RESULTS

User Status Report

Execution Status Report

Test Verification Report Blocked Test Case Report

Module Stability Report

Manage Test Environment

View All Reports

AUT n / AUT under Environment n


27


27

eZscript Business Component Snapshot


28


28

eZscript Business Process Management Snapshot


29

Evolution of TestMagicTM @ Cloud

• TestMagicTM not part of emerging or core technologies/application supported by

corporate IT of client.

• Well-suited for incubation as Server and Storage requirements not completely

known

• Scalability as per demand

• No extra configuration /cost required by TestMagicTM.

• Test Automation Development and Execution can be also done on a private cloud

Client Management

TestMagicTM @ Cloud : data-

intensive, compute-intensive,

storage-intensive India Office

Romania Office

Atlanta Office Centralized IT Support

Client’s Client


30


30

TestMagicTM @ Cloud/WAN and eZ Virtualization

MS SQL/MY SQL Automation Life Cycle Management eZscript

DB Server ALM Server Script Engine

eZ Virtualization


31


31

TestMagicTM - Strategic Benefits

Test Magic

is designed in a way that it reduces the need

of highly skilled automation experts for normal

day to day automation activities

like defining of business flow,

scripting of test cases etc

in less time.

Test Magic

Architecture is designed for

distributed processing and highly scalable

to support large set of test cases


32


32

TestMagicTM Demo Strategy

Today’s TestMagicTM

Demonstration focus

• eZscript Overview

• Business Component and Business

Process Workflow Creation overview

• Data-driven creation demonstration

• Multi-Country support demonstration

• Multilingual support demonstration

• TestMagic (SaaS-ALM) overview

• Q&A


33

Agenda




How we have accomplished it….

1

2

3

4

5

and who we are 6



34

Introduction – Universal Test Solutions

About Universal Test Solutions

• MNC operating from India and UAE.

• Formally Started in 2009 (work started in 2007)

• Specialize in Testing and Test Automation

Solutions to provide Sustainable, Scalable and

Adoptable Solutions

Our Strategy

– Simple and Complete Solution

– Innovation by implementing concept of

Artificial intelligence in Test Automation

– Simplified approach to achieve Quick ROI

– Automation Testing For Everyone

– Continuous Improvement

Our focus

• Business Value Realization by improving

– Product Quality

– Test Infrastructure Utilization and

– Operational Efficiency

• Test Automation to achieve:

– Reduction in Total Cost of Ownership

(TCO) by 45% to 60%

– Reduction in the total time to

automate and execute tests by 50%

to 70%

– Get ROI from Next Cycle

– Negligible maintenance costs


35

Introduction – Universal Test Solutions

Our Vision

To provide comprehensive solutions to meet various testing needs of our clients

Our Values and Beliefs

Our values of unflinching devotion to the client success and continuous innovation for the

client

Our belief in our ability to constantly generate new ideas that create sustainable value for

our clients

What drives us…..


36

Banking, Financial

Services and

Insurance

Manufacturing and

Logistics

HealthCare

Telecom

Retail

3

6

Services Spectrum for You

• Perform Feasibility Analysis

• Assess test automation requirements;

• Develop POCs;

• Define/Review Automation objective, approach /

strategy

• ROI Analysis

• Define Short term and Long term

automation roadmap

• Mentor/Manage implementation of test automation

Test Automation Consulting

• Technical support (L1, L2 and L3 including

Query resolution and Training )

• Continuous Research and Strategic TestMagicTM

Development including bug fixes and

customization as per client need.

• Seminar, Workshops,

Training and Certification

TestMagicTM Licensing and Support • Test Automation Management- Estimate, Plan and

manage test automation assignments

• Establish or support to implement Automation

Test Lab

• Develop and Maintain test automation using

TestMagicTM

• Define Automation methodology

• Formulates Scripting Standards,

• Develop Automation Templates and Traceability

Matrix

Test Automation Services

• Business Coverage Analysis

o Business Criticality o Risk Analysis

• Test Program Management

• Identification of End-to-End functionality

• Test Scenario Identification and Preparation

• Test Planning, Test Design and Execution

• Test Reporting and Defect Management

• Optimized Test Execution

• Test Metrics Management

Independent Functional Testing

System

Integration

testing

Regression Testing

Risk Based Testing

E2E Testing

Agile Testing

Mobile Testing

UAT Testing

Web Services

Testing


37

Milestones.….

2007- 2008

2009

2010

2011

2012

Approach, initial design finalized for a generic automation solution.

Development started

Release of TestMagic eZscript

mScheduler with Excel as

backend database

Release of TestMagic version with SQL

Server as backend database

Implemented

TestMagic Solution in 3 locations (India,

Atlanta and Romania)

Release of

Multilingual Multi Browser

Multi Windows OS MultiCountry

Enhanced eZscript UI

for improving User experience

Rule based

File Operation/ Parsing

Functionality

SOAP based Web Service Testing

Functionality for Report reconciliation

Distributed Centralized Scheduling Mechanism

Quick Script Creation

Creation of Manual

Steps while navigating


38

Q & A Average 25 % increase in Automation

Health Index


39

Thank you Average 25 % increase in Automation

Health Index

Universal test solutions customer testimonial 10192013-v2.3

Documents

Transcript of Universal test solutions customer testimonial 10192013-v2.3