Android Testing Approach - SiliconIndia · Elements of a Structured Testing Approach Android...
16
Structured Approach to Testing - Android in an Agile Environment
Transcript of Android Testing Approach - SiliconIndia · Elements of a Structured Testing Approach Android...
Structured Approach to Testing - Android in an Agile Environment
2 - Confidential2 - Confidential
Table of Contents
1 Mobile Marketplace
Top Challenges & Goals
Traditional vs Agile Mobile Testing Lifecycle
Elements of a Structured Testing Approach
Android Testing Methodology
Model Based Testing
Execution Tools
Test Accelerators
Test Service as a Platform
The Enablers
2
3
4
5
6
7
8
9
10
3 - Confidential3 - Confidential
Mobile Marketplace
4 - Confidential4 - Confidential
Meeting
Testing Goals
Functional Testing
Test CoveragePerforming Regression
Non Functional
Testing
Usability Compatibility Performance
Ensuring Zero Defects in ProductionDeveloping High Performance AppsMaximizing User Satisfaction
Top Challenges & Goals
5 - Confidential5 - Confidential
Traditional vs Agile Testing Lifecycle
4 Week Lifecycle Traditional
2 Week Lifecycle
Accelerators
Agile
Tools
Process
Assuming nearly 40% efforts goes into Testing in a mobile lifecycleA traditional 4 week cycle would have at least 8 days of testing requiredAn agile development cycle of 2 weeks would have only 4 days dedicated to testing Nearly 20% of TAT reduction – Standard Process Implementation, 40% - Automation using Industry Tools & 20% to Usage of Accelerators
6 - Confidential6 - Confidential
Elements of a Structured Testing Approach
Process
Tools
Accelerators
Process Elements includeBest Practices & Reusable AssetsW3C Industry StandardsContinuous Iterative ImprovementsDefined ControlsPost Implementation Checks
Tools includeTest Case DesignersRegression AutomationEmulatorsSimulatorsResearch Lab
Accelerators includeTest Accelerators Platform AcceleratorsDesign Accelerators
Test Accelerators
Reusable Test Design Models
AutomationTools
ScenariosTemplates
Data
Testing Lab
State of Art Lab
PARTNERSKEYNOTE
HP
ReportsRecommendation
Validations
Testing Results
State of Art Lab
Users | Content | Interface
Defect Reduction
Global Standard Baselines
Use
r p
rofi
le/T
race
D
ata
3i Infotech’s Mobile Testing Elements
DEVICE ANYWHERE
PERFECTO
7 - Confidential7 - Confidential
Examples of Best Practices
Maximum Coverage
Maximum Traceability
Maximum Reuse
Test Requirements Business Scenario Test Cases Test StepsPositive
Alternate
Negative
Test Requirements Business
Scenario / Test
scenario
Test CasesDefects
Design Test
Cases
Test
Requirements
Extract Existing
Test Cases
Review Test
Cases
Test
Management
Repository
Redefine Test
Conditions
Review Test
Cases
Redesign Test
Cases
Process Elements
8 - Confidential8 - Confidential
Android Testing Methodology[ATM]
Process Elements
Carrier/Operator Mobile Content, Services & Applications
Tester connects to smartphones in remote locations to test and troubleshoot mobile apps
Your Apps Here
Analyze Plan & Design Execute Report
9 - Confidential9 - Confidential
Manual Test execution
Automatedtest execution
Models for automated test generation
MBT Automated Traceability
production engine
MBT Test Production
Test Repository
BusinessNeeds
BusinessAnalyst
Collaboration
Test Repository
Model Based Testing
Process Elements
10 - Confidential10 - Confidential
Model Based Testing
Illustrative
11 - Confidential11 - Confidential
11
Test Design Automation
The test generation engine computes from the models all the test cases necessary to reach the defined coverage
Reporting - Traceability
0
100
200
300
400
500
600
700
800
900
1000
1 2 3 4 5 6 7
Cumulative effort per release
Project Maintenance
Source: Business Case Tool™
Smartesting
maintenancecost reduction
test productivity
increase
+50%
-70%
12 - Confidential12 - Confidential
BenefitsEasy and efficient script creationReduced manual testing efforts on all platformsFull flow controlIncluding conditions, loops, flow commands, expressions and data-tablesDetailed reportsReporting results, screen captures in digital format, continuous video recording of the entire script and graphs showing statistics about the executionEnhanced collaborationSave time and money on problem reproduction by using real time online handset sharing with multiple participates Open APIIntegration into 3rd party tools such as test management, monitoring and defect tracking
Tools for Execution
13 - Confidential13 - Confidential
Test Accelerators
OperatingSystem
File System
CommandLine
Networks
MailingWeb Specific
Logging
Utilities
Test Handlers
Excel Files
Library
FrameworkConfiguration
ApplicationConfiguration
TestConfiguration
ReportConfiguration
MailingConfiguration
LoggingConfigurations
Configurations
Execution Automation FrameworkProcess – Test Accelerators
Driver, Runtime, Logger, Exception Handler
Accelerators Elements
14 - Confidential14 - Confidential
Test Platform as a Service [TaaS] – Test Services on Hire
CLIENT ORGANISATION
Testing Team
COE
TOOLS (SaaS)
InfrastructureC
LIENT IN
TERFA
CE
Acco
un
t Mgm
tPay b
y Use
SME’s
DomainAssets
Process
Pro
ject Man
ager
Test DataHardware
Software
CLO
UD
Op
tion
2
Access to Tools Access to SME’s on various
testing techniques
Access to Domain Assets Proven Process/Methodology/Best
practices
15 - Confidential15 - Confidential
The Enablers
Domain & Automation Lab
Mobile Testing Lab
Performance & Compliance
Core Infrastructure2 IBM X3650, Xeon Quad Core 1.60 GHz16 GB RAM, 300 GB HDD*2
2 IBM X3650, Xeon Quad Core 1.60 GHz8GB RAM, 500 GB HDD*2
2 AIX 5.3, IBM P510 Series,416 GB RAM, 300 GB HDD*2
Ban
galo
reH
yde
rab
adC
he
nn
aiExtendable Infrastructure
Infrastructure Management Services
Cloud Infrastructure
Hardware
Tools (Software)Testing Tools Knowledge Management
MS SharePoint
Vir
tual
Lab
s
Ph
ysic
al L
abs
Communication
THANK YOU
