Turbo boost your digital app test automation with … boost your...Turbo boost your digital app test...
Transcript of Turbo boost your digital app test automation with … boost your...Turbo boost your digital app test...
Speakers
2
Sheli AshkenaziSr. Product Manager
Experitest
Jonathan AharonSr. Sales Engineer
Experitest
Agenda
3
The need for high speed test automation
The continuous testing environment
Step-by-step demo
01
02
03
Q&A04
15 min
30 min
5 min
10 min
Business strategy triggers SDLC Paradigm shift
Speed, agility and risk reduction
5
Agile CI/CDDevOps
“Develop smaller chunks - we will probably change our mind”
“get your team talking…”
“make sure you didn’t break anything… automatically and often”
6
Short cycles imply more tests
Continuous Integration Continuous Testing
Image source: Forrester
Large scale execution
Part of CI/CD pipeline and toolchain
High level of automation
Rapid result analysis and feedback
Throughout development cycle –development & test
Digital platform segmentation growing Global data, April 2018
7
Mobile,
51.2%
Tablet, 4.1%
Desktop,
44.7%
Platform
Windows,
81.73OS X, 13.18
Unknown, 2.45Linux, 1.66 Chrome OS, 0.98
Desktop OS
Chrome, 66.2%
Firefox,
11.8%
IE, 7.2%
Safari, 5.5%
Edge, 4.3%Opera,
2.3%
Other,
2.8%
Desktop browsers
Source: Statcounter
Samsung, 30.8%
Apple,
19.2%Others, 29.9%
Unknown, 7.8%
Huawei,
6.2%
Xiaomi,
6.1%
Mobile device vendor
Android, 75.66%
iOS, 19.2%
Unknown, 3.05%
Other, 2.06%
Mobile OS
The dev-test process
Epic Story thinning PrototypeAcceptance
Criteria
Code (incl. White box Test)
Build & DeployAutomated
testingAcceptance
testingShowcase /
Demo Sign-off
Dev Engineer
Dev & Test EngineerDevOps EngineerDev & Test Engineer
Functional Spec
Product Owner
Analyst Product Owner
Analyst Designer Analyst Tester Test Engineer
TesterProduct Owner
CI/CD cycle
Agenda
9
Why do we need continuous testing?
The continuous testing environment
Step-by-step demo
01
02
03
Q&A04
Development Engineer
The Continuous Testing process
Commit tests
Trigger test execution
Load app to cloud
Test Engineer
Commit app code
Consolidate test results
Continuous Integration
reporttest
build Version approved?
no yes
Debug / update test suite
1Pull app source2
Build app3
Pull test source4
Build test project5
6 7 8
9
10
Trigger build
Today’s demo environment
• Appium & Selenium tests
• JUnit framework
• Jenkins server
Pre-prepared
• Appium* Studio for Eclipse
• Eclipse*
• Jenkins*
• Git
• Maven
• Experitest Digital Device Lab
• Experitest Reporter
Tools used
• Configure project & build using Jenkins
• Upload application to the cloud - Jenkins (shell script)
• Run Tests (Jenkins + Digital Device Lab)
• Link test results to Jenkins
What we will do
* Any test framework, IDE and CI tools can be used
Agenda
12
Why do we need continuous testing?
The continuous testing environment
Step-by-step demo
01
02
03
Q&A04
Writing a test using Appium Studio for Eclipse
Project structure in Eclipse
Required Jenkins plug-ins
Test parallelization using Jenkins
Application uploading to Digital assurance lab
Running test suites from Jenkins
Accessing test results from Jenkins
Automating execution timings using different approaches
What we will see
13
Recap
• Appium*
• JUnit*
• Eclipse*
• Jenkins*
• Git
• Maven
• Appium Studio for Eclipse
• Experitest Digital Assurance Lab
• Experitest Reporter
Tools / frameworks used
• Used CI server to build a test project from repository
• Used CI to upload application to digital device lab
• Used CI and digital device lab to install the application on numerous devices and run tests in parallel on
• Used Jenkins plugin to link test results to Reporter and analyzed test results
What we did
* Any test framework, IDE and CI tools can be used
Agenda
16
Why do we need continuous testing?
The continuous testing environment
Step-by-step demo
01
02
03
Summary & QA04
How the SeeTest platform support hands free continuous testing
17
Epic Story thinning PrototypeAcceptance
Criteria
Code (incl. White box Test)
Build & DeployAutomated
testingAcceptance
testingShowcase /
Demo Sign-off
Dev Engineer
DevOps EngineerDev & Test Engineer
Functional Spec
Product Owner
Analyst Product Owner
Analyst Designer Analyst Tester Test Engineer
TesterProduct Owner
Dev-Test Feedback cycle – 1 hour
Dev & Test Eng.
Digital assurance Lab (SeeTestCloud)
Test development
Grid Execution
Test Analytics
Manual Testing Grid Execution Dev & DebugTest Analytics Test Analytics
RESTful API to mass deploy application on targeted devices
Web / Mobile