© 2015 Cognizant Jan 2015 Spritz Scriptless Test Automation Platform.
-
Upload
lynn-clark -
Category
Documents
-
view
429 -
download
24
Transcript of © 2015 Cognizant Jan 2015 Spritz Scriptless Test Automation Platform.
© 2015 Cognizant © 2015 Cognizant
Jan 2015
SpritzScriptless Test Automation Platform
© 2015 Cognizant
Scripts are Non Business User Friendly
Increased Script Maintenance Effort
Increased Script Development Effort
How Scripts pose the bottle-neck to realizing ROI
Different tools have different scripting languages
Quality Dependent on individual scripting knowledge
Complex Scripting Languages
More documentation needed to make scripts understandable
Majority effort spent on maintaining scripts
Inability of Business Users to understand
test scripts
Programmers are expensive Specialized staff
Considerable time and effort involved in
learning tools
Frequent UI changes makes scripts brittle
Script based tools involve Steeper Learning Curve
Higher cost of Automation & lower
ROI
2
© 2015 Cognizant
Script-lessAs Scripts are the bottle-neck when it comes to accelerating Automation
Go
3
© 2015 Cognizant
IntroducingCognizant
© 2015 Cognizant
Object Action Input
Eliminate ScriptsAbstract the user actions with three simple fields
Users perform actions on objects on the screen with their inputs
Scalability User FriendlyEase Of Use Agile Ready
Focus Areas
5
© 2015 Cognizant
How Spritz works
1 DesignStart Automation design early before UI is ready with wireframes
2 UpdateAutomate just when UI is ready with Just-in time Object Mapping
3 ExecuteRun tests on multiple browsers and generate reports
4 MaintainMaintain Tests easily with Self-Documentation feature
Use inbuilt Action keywords to build tests with
parameterized test data
Test step design can begin even before application is
ready.
Update object repository in Spritz once the UI is
ready
Generate intuitive business friendly reports
Choose the browser type and run your tests
Spritz engine reads the keywords, interprets test
cases and executes tests – supports concurrent
execution
Use Object healer to dynamically update Object
Repository
Changes reflected across relevant test cases to reduce
maintenance effort
Before GUI is ready GUI is ready Changes in UITest Execution
6
© 2015 Cognizant
Customized Reporting Data Driven Testing Robust Error Handling Batch Execution
Customized Reporting Data Driven Testing Robust Error Handling Batch Execution
Automation PlatformAutomation EngineUnderlying Framework
Intelligent & AdaptableObject Identifier
Exhaustive & Expandable
Library of Actions
Best In Class & Flexible
Data Parameterization
Inbuilt IDE with Recorder for ease of use
Features
Scalability User FriendlyEase Of Use Agile Ready
Selenium WebDriver
CRAFT
Multi-Browser Support Multi-Platform Support Distributed Execution Support
Sikuli Image Based Automation Image Based Automation
Appium
Mobile Browser Test Automation Responsive Web Design Mobile Browser Test Automation Responsive Web Design
Script-less Model for Business Users Object Repository & Spy Object Healing for Agile Exploratory Testing Support
Script-less Model for Business Users Object Repository & Spy Object Healing for Agile Exploratory Testing Support
7
© 2015 Cognizant
Mobile Browser Test Automation
Cross Platform Support
Execute on native browsers
Automated tests for RWD sitesAutomate both on real devices and
Simulators/emulators
IOS – 6,7,8,8.1
Android – 2.3 and aboveiPhone/ iPad Simulator, Android emulators
iPhone 5, iPhone6, iPad, Chrome on AndroidSafari on iOS
Functional, Smoke and Regression testing
Reuse tests across multiple platforms/devices
Responsive web design test automation
Repurpose Spritz tests for mobile browser test automation
8
© 2015 Cognizant
Exploratory Testing Support
Support ‘user acceptance’ without constraints scripted
testing
Integrate defect reporting to JIRA/QC
Record unstructured free-form tests to Spritz
Record Document Annotate
every step during manual execution
comments and notes on the fly
directly to defect management system
Submit defects
Screen capture for easy documentation
9
‘Exploratory testing is a free-form testing with a defined charter’ Exploratory testing is simultaneous learning, test design, and test execution
Repurpose tests between mobile & desktop applications
© 2015 Cognizant 10
Platforms Supported
Operating Systems
Mobile Operating Systems
IOS – 6,7,8,8.1Android – 2.3 and above
Mobile Browsers
Chrome on AndroidSafari on iOS
*As Spritz uses Selenium engine for web application automation, it supports all versions of OS and browsers supported by Selenium.
Desktop Browsers
© 2015 Cognizant
Two Roles, One PlatformUse Wireframe, come up with test cases
Create Business Components & define flow
Capture Objects & associate with tests
Inject custom scripts & expand library Debug, maintain objects & test cases
Heal objects in case of updates
Create Test Data & parameterize
Run test cases in different environments/platforms
Business User
Technical User
11
© 2015 Cognizant
Case Study
12
Test Design Effort Saved
50% savings in test design efforts. Script-less approach and the intuitive UI simplified automation and enabled rapid test development
Execution Effort Saved
65% reduction in test execution time achieved through parallel and distributed execution on multiple browsers using Spritz.
Detailed Reporting
The detailed test coverage report generated by Spritz was also received well by the customers.
Rapid Test Development
User friendly IDE with drag-drop and auto complete features enabled rapid test development
Increased Reusability
60-70% reusability achieved using the component grouping feature in Spritz thus reducing the test design and maintenance efforts.
Faster Acceptance Tests
Enabled faster acceptance tests of end to end in 8 hours compared to 50 hours manually across all browsers
The client is an American electronics retail stores company
Business Challenges• The web application is an e-commerce website developed and tested using
an Agile methodology with 2 releases /month. • Additionally, the application needed to be tested across multiple browsers
which further magnified the execution effort involved. • Selenium was thus being considered. However the complex nature of the
tool that required resources with programming skills and the lack of an out of the box framework posed a challenge in its adoption.
The Objectives• Reduce the huge execution time and
effort involved in the manual approach• Perform multi browser testing through an
automated solution• Utilize the features of Selenium for
automation
Spritz was implemented resulting in the below tangible benefits
© 2015 Cognizant
Case Study
13
Test Design Effort Saved15% savings in test design efforts when compared to the scripted approach using Selenium.
Execution Effort Saved
20% savings in test execution effort achieved through multi-threaded parallel execution features of Spritz.
Hybrid resource poolSpritz helped Manual & Dev teams to adopt automation for their testing purposes and has helped the organization to build a Hybrid resource pool set.
Maintenance Effort Saved18% savings in test maintenance effort compared to scripted approach achieved through object healing and component grouping features of Spritz.
High Automation CoverageSpritz enabled automation of 355 Tests out of the total of 425 test cases thus providing a high automation coverage of 83%.
Faster Acceptance Tests
Enabled faster acceptance tests of end to end in 8 hours compared to 50 hours manually across all browsers
The customer is an American retailer of home improvement and construction products and services
Business Challenges• A highly agile web application with around 425 tests required an automation
solution that aligned to their agility needs.• The customer was also looking for a tool with simple and rapid script
development capabilities.• The tools that were considered were Selenium and HP UFT however, the
tools needed programming knowledge and involved high maintenance effort.
The Objectives• Develop a hybrid resource pool
consisting of manual testers for performing automation.
• Identify and use an automated solution to meet the agile testing needs
• Perform cross browser testing using a single automation solution
Spritz was implemented resulting in the below tangible benefits
© 2015 Cognizant
Competitive Market – Script-less Automation“Qualitia’s script less test automation platform is extremely supportive as it removes challenges around custom built frameworks by eliminating programming and enabling users/enterprises to build reliable functional test automation.” – Gartner
Odin Technology's Axe is a ground-breaking test automation platform for the enterprise. It uses a simple spreadsheet interface allowing non-technical testers to build effective test scenarios faster, automatically generating code and documentation for a wide range of both commercial and open source Test Automation and ALM toolsets.
Reduce total time to automate tests by 50% to 70%.Reduce total cost of ownership by 45% to 60%. No programming required.Increase ROI – Reliable & Scalable (Custom Object support)• Sample vendor of Gartner’s Hype Cycle, 2012.
14
© 2015 Cognizant
Cost Effective
Script-less automation with object based design strategy results in earlier defect discovery and production defect rates dropping by as much as 80%. - Worksoft Certify
Script-less automation helps reduce the cost of resources by 54.7%, reduce the cost of training by 60% and the overall cost of automation decreases by 45% - Qualitia Software
Enhanced Productivity
Greater Stakeholder involvement reduces project cycle time - IBM report on Worksoft Certify
Time-to-automate shortens by almost 40% .Going script-less ensures your testing team(s) can automate large test suites 1.6 times faster than ever before - Qualitia Software
Script-less Automation -What does the industry say?
Effective Early Defect Detection
Reduced Project Cycle Times
Reduction in Overall Cost Of Automation45%
Reduction in Production Defect Rates80%
40% Reduction in Time to Automate
55% Reduction in Project Cycle Times
The training duration reduces by 50% when compared to standard test automation approach. It can reduce your cost of training by up to 60% - Qualitia Software
Flatter the Learning Curve50% Reduction in Training Duration
15
© 2015 Cognizant 16
Script-less Testing Tools ComparisonTools Cognizant Qualitiasoft Odintech
Automation Anywhere
TOSCA
Spritz Qualitia Axe Testing Anywhere Tricentis
IDE
Platform Independent
Integration with CI tools
Object Repository / Spy
Data Driven
Intelligent Object Healer
Distributed Execution
Image Based Automation
Recorder
Exploratory Testing support
Independent executable test suite
Mobile RWD support
Licensing / Pricing Value-add Commercial($1200/month)
Commercial(Not Available)
Commercial($7000/year)
Commercial(€16,780)
All Prices are indicative
Features
*This is a generic comparison based on our experience. However its required that Cognizant perform tools and accelerator suitability assessment prior to commencement of the engagement and the implementation if found suitable
© 2015 Cognizant 17
Spritz Vs Market leading tools
Note: Feature comparison of Spritz with some other tools is provided in the attachment. This is a generic comparison based on our experience. However its required that Cognizant perform tools and accelerator suitability assessment prior to commencement
of the engagement and the implementation if found suitable.
Tool Feature Comparison
© 2015 Cognizant
Thank you