© 2015 Cognizant Jan 2015 Spritz Scriptless Test Automation Platform.

18
© 2015 Cognizant © 2015 Cognizant Jan 2015 Spritz Scriptless Test Automation Platform

Transcript of © 2015 Cognizant Jan 2015 Spritz Scriptless Test Automation Platform.

Page 1: © 2015 Cognizant Jan 2015 Spritz Scriptless Test Automation Platform.

© 2015 Cognizant © 2015 Cognizant

Jan 2015

SpritzScriptless Test Automation Platform

Page 2: © 2015 Cognizant Jan 2015 Spritz Scriptless Test Automation Platform.

© 2015 Cognizant

Scripts are Non Business User Friendly

Increased Script Maintenance Effort

Increased Script Development Effort

How Scripts pose the bottle-neck to realizing ROI

Different tools have different scripting languages

Quality Dependent on individual scripting knowledge

Complex Scripting Languages

More documentation needed to make scripts understandable

Majority effort spent on maintaining scripts

Inability of Business Users to understand

test scripts

Programmers are expensive Specialized staff

Considerable time and effort involved in

learning tools

Frequent UI changes makes scripts brittle

Script based tools involve Steeper Learning Curve

Higher cost of Automation & lower

ROI

2

Page 3: © 2015 Cognizant Jan 2015 Spritz Scriptless Test Automation Platform.

© 2015 Cognizant

Script-lessAs Scripts are the bottle-neck when it comes to accelerating Automation

Go

3

Page 4: © 2015 Cognizant Jan 2015 Spritz Scriptless Test Automation Platform.

© 2015 Cognizant

IntroducingCognizant

Page 5: © 2015 Cognizant Jan 2015 Spritz Scriptless Test Automation Platform.

© 2015 Cognizant

Object Action Input

Eliminate ScriptsAbstract the user actions with three simple fields

Users perform actions on objects on the screen with their inputs

Scalability User FriendlyEase Of Use Agile Ready

Focus Areas

5

Page 6: © 2015 Cognizant Jan 2015 Spritz Scriptless Test Automation Platform.

© 2015 Cognizant

How Spritz works

1 DesignStart Automation design early before UI is ready with wireframes

2 UpdateAutomate just when UI is ready with Just-in time Object Mapping

3 ExecuteRun tests on multiple browsers and generate reports

4 MaintainMaintain Tests easily with Self-Documentation feature

Use inbuilt Action keywords to build tests with

parameterized test data

Test step design can begin even before application is

ready.

Update object repository in Spritz once the UI is

ready

Generate intuitive business friendly reports

Choose the browser type and run your tests

Spritz engine reads the keywords, interprets test

cases and executes tests – supports concurrent

execution

Use Object healer to dynamically update Object

Repository

Changes reflected across relevant test cases to reduce

maintenance effort

Before GUI is ready GUI is ready Changes in UITest Execution

6

Page 7: © 2015 Cognizant Jan 2015 Spritz Scriptless Test Automation Platform.

© 2015 Cognizant

Customized Reporting Data Driven Testing Robust Error Handling Batch Execution

Customized Reporting Data Driven Testing Robust Error Handling Batch Execution

Automation PlatformAutomation EngineUnderlying Framework

Intelligent & AdaptableObject Identifier

Exhaustive & Expandable

Library of Actions

Best In Class & Flexible

Data Parameterization

Inbuilt IDE with Recorder for ease of use

Features

Scalability User FriendlyEase Of Use Agile Ready

Selenium WebDriver

CRAFT

Multi-Browser Support Multi-Platform Support Distributed Execution Support

Sikuli Image Based Automation Image Based Automation

Appium

Mobile Browser Test Automation Responsive Web Design Mobile Browser Test Automation Responsive Web Design

Script-less Model for Business Users Object Repository & Spy Object Healing for Agile Exploratory Testing Support

Script-less Model for Business Users Object Repository & Spy Object Healing for Agile Exploratory Testing Support

7

Page 8: © 2015 Cognizant Jan 2015 Spritz Scriptless Test Automation Platform.

© 2015 Cognizant

Mobile Browser Test Automation

Cross Platform Support

Execute on native browsers

Automated tests for RWD sitesAutomate both on real devices and

Simulators/emulators

IOS – 6,7,8,8.1

Android – 2.3 and aboveiPhone/ iPad Simulator, Android emulators

iPhone 5, iPhone6, iPad, Chrome on AndroidSafari on iOS

Functional, Smoke and Regression testing

Reuse tests across multiple platforms/devices

Responsive web design test automation

Repurpose Spritz tests for mobile browser test automation

8

Page 9: © 2015 Cognizant Jan 2015 Spritz Scriptless Test Automation Platform.

© 2015 Cognizant

Exploratory Testing Support

Support ‘user acceptance’ without constraints scripted

testing

Integrate defect reporting to JIRA/QC

Record unstructured free-form tests to Spritz

Record Document Annotate

every step during manual execution

comments and notes on the fly

directly to defect management system

Submit defects

Screen capture for easy documentation

9

‘Exploratory testing is a free-form testing with a defined charter’ Exploratory testing is simultaneous learning, test design, and test execution

Repurpose tests between mobile & desktop applications

Page 10: © 2015 Cognizant Jan 2015 Spritz Scriptless Test Automation Platform.

© 2015 Cognizant 10

Platforms Supported

Operating Systems

Mobile Operating Systems

IOS – 6,7,8,8.1Android – 2.3 and above

Mobile Browsers

Chrome on AndroidSafari on iOS

*As Spritz uses Selenium engine for web application automation, it supports all versions of OS and browsers supported by Selenium.

Desktop Browsers

Page 11: © 2015 Cognizant Jan 2015 Spritz Scriptless Test Automation Platform.

© 2015 Cognizant

Two Roles, One PlatformUse Wireframe, come up with test cases

Create Business Components & define flow

Capture Objects & associate with tests

Inject custom scripts & expand library Debug, maintain objects & test cases

Heal objects in case of updates

Create Test Data & parameterize

Run test cases in different environments/platforms

Business User

Technical User

11

Page 12: © 2015 Cognizant Jan 2015 Spritz Scriptless Test Automation Platform.

© 2015 Cognizant

Case Study

12

Test Design Effort Saved

50% savings in test design efforts. Script-less approach and the intuitive UI simplified automation and enabled rapid test development

Execution Effort Saved

65% reduction in test execution time achieved through parallel and distributed execution on multiple browsers using Spritz.

Detailed Reporting

The detailed test coverage report generated by Spritz was also received well by the customers.

Rapid Test Development

User friendly IDE with drag-drop and auto complete features enabled rapid test development

Increased Reusability

60-70% reusability achieved using the component grouping feature in Spritz thus reducing the test design and maintenance efforts.

Faster Acceptance Tests

Enabled faster acceptance tests of end to end in 8 hours compared to 50 hours manually across all browsers

The client is an American electronics retail stores company

Business Challenges• The web application is an e-commerce website developed and tested using

an Agile methodology with 2 releases /month. • Additionally, the application needed to be tested across multiple browsers

which further magnified the execution effort involved. • Selenium was thus being considered. However the complex nature of the

tool that required resources with programming skills and the lack of an out of the box framework posed a challenge in its adoption.

The Objectives• Reduce the huge execution time and

effort involved in the manual approach• Perform multi browser testing through an

automated solution• Utilize the features of Selenium for

automation

Spritz was implemented resulting in the below tangible benefits

Page 13: © 2015 Cognizant Jan 2015 Spritz Scriptless Test Automation Platform.

© 2015 Cognizant

Case Study

13

Test Design Effort Saved15% savings in test design efforts when compared to the scripted approach using Selenium.

Execution Effort Saved

20% savings in test execution effort achieved through multi-threaded parallel execution features of Spritz.

Hybrid resource poolSpritz helped Manual & Dev teams to adopt automation for their testing purposes and has helped the organization to build a Hybrid resource pool set.

Maintenance Effort Saved18% savings in test maintenance effort compared to scripted approach achieved through object healing and component grouping features of Spritz.

High Automation CoverageSpritz enabled automation of 355 Tests out of the total of 425 test cases thus providing a high automation coverage of 83%.

Faster Acceptance Tests

Enabled faster acceptance tests of end to end in 8 hours compared to 50 hours manually across all browsers

The customer is an American retailer of home improvement and construction products and services

Business Challenges• A highly agile web application with around 425 tests required an automation

solution that aligned to their agility needs.• The customer was also looking for a tool with simple and rapid script

development capabilities.• The tools that were considered were Selenium and HP UFT however, the

tools needed programming knowledge and involved high maintenance effort.

The Objectives• Develop a hybrid resource pool

consisting of manual testers for performing automation.

• Identify and use an automated solution to meet the agile testing needs

• Perform cross browser testing using a single automation solution

Spritz was implemented resulting in the below tangible benefits

Page 14: © 2015 Cognizant Jan 2015 Spritz Scriptless Test Automation Platform.

© 2015 Cognizant

Competitive Market – Script-less Automation“Qualitia’s script less test automation platform is extremely supportive as it removes challenges around custom built frameworks by eliminating programming and enabling users/enterprises to build reliable functional test automation.” – Gartner

Odin Technology's Axe is a ground-breaking test automation platform for the enterprise. It uses a simple spreadsheet interface allowing non-technical testers to build effective test scenarios faster, automatically generating code and documentation for a wide range of both commercial and open source Test Automation and ALM toolsets.

Reduce total time to automate tests by 50% to 70%.Reduce total cost of ownership by 45% to 60%. No programming required.Increase ROI – Reliable & Scalable (Custom Object support)• Sample vendor of Gartner’s Hype Cycle, 2012.

14

Page 15: © 2015 Cognizant Jan 2015 Spritz Scriptless Test Automation Platform.

© 2015 Cognizant

Cost Effective

Script-less automation with object based design strategy results in earlier defect discovery and production defect rates dropping by as much as 80%. - Worksoft Certify

Script-less automation helps reduce the cost of resources by 54.7%, reduce the cost of training by 60% and the overall cost of automation decreases by 45% - Qualitia Software

Enhanced Productivity

Greater Stakeholder involvement reduces project cycle time - IBM report on Worksoft Certify

Time-to-automate shortens by almost 40% .Going script-less ensures your testing team(s) can automate large test suites 1.6 times faster than ever before - Qualitia Software

Script-less Automation -What does the industry say?

Effective Early Defect Detection

Reduced Project Cycle Times

Reduction in Overall Cost Of Automation45%

Reduction in Production Defect Rates80%

40% Reduction in Time to Automate

55% Reduction in Project Cycle Times

The training duration reduces by 50% when compared to standard test automation approach. It can reduce your cost of training by up to 60% - Qualitia Software

Flatter the Learning Curve50% Reduction in Training Duration

15

Page 16: © 2015 Cognizant Jan 2015 Spritz Scriptless Test Automation Platform.

© 2015 Cognizant 16

Script-less Testing Tools ComparisonTools Cognizant Qualitiasoft Odintech

Automation Anywhere

TOSCA

Spritz Qualitia Axe Testing Anywhere Tricentis

IDE

Platform Independent

Integration with CI tools

Object Repository / Spy

Data Driven

Intelligent Object Healer

Distributed Execution

Image Based Automation

Recorder

Exploratory Testing support

Independent executable test suite

Mobile RWD support

Licensing / Pricing Value-add Commercial($1200/month)

Commercial(Not Available)

Commercial($7000/year)

Commercial(€16,780)

All Prices are indicative

Features

*This is a generic comparison based on our experience. However its required that Cognizant perform tools and accelerator suitability assessment prior to commencement of the engagement and the implementation if found suitable

Page 17: © 2015 Cognizant Jan 2015 Spritz Scriptless Test Automation Platform.

© 2015 Cognizant 17

Spritz Vs Market leading tools

Note: Feature comparison of Spritz with some other tools is provided in the attachment. This is a generic comparison based on our experience. However its required that Cognizant perform tools and accelerator suitability assessment prior to commencement

of the engagement and the implementation if found suitable.

Tool Feature Comparison

Page 18: © 2015 Cognizant Jan 2015 Spritz Scriptless Test Automation Platform.

© 2015 Cognizant

Thank you