Accelerate Web and Mobile Testing for Continuous Integration and Delivery
-
Upload
soasta -
Category
Technology
-
view
823 -
download
1
description
Transcript of Accelerate Web and Mobile Testing for Continuous Integration and Delivery
© 2014 SOASTA. All rights reserved. 1
© 2014 SOASTA. All rights reserved. 2
© 2014 SOASTA. All rights reserved. 3
Agenda:
• The need for “Continuous”
• CI with mobile and performance testing
• SOASTA CloudTest and TouchTest with Jenkins (demo)
Questions:
Submit in chat box during event
© 2014 SOASTA. All rights reserved. 4
User Experience
Unpredictability Continuous
Mobile
100’s to millions
Local to global
100% availability
Agile development
Continuous delivery
DevOps principles
Fast
Seamless
Disposable
Online everything
Mobile commerce
Legacy modernization
© 2014 SOASTA. All rights reserved. 5
Does it work as
designed?
Does it perform
under extreme
circumstances?
Approve materials Real Drivers
What happens
in actual
conditions?
Assembly Line
© 2014 SOASTA. All rights reserved. 6
Functional validation
Performance,
reliability,
scalability tests
Real Users
Build
What happens
in actual
conditions?
Unit-tested code
© 2014 SOASTA. All rights reserved. 7
o Small Batch Sizes
o Comprehensive Version Control
o Simple Branch Strategies
o Automation
o Continuous Feedback
o Emphasis on working builds
o Consistent environments
o Developer – Tester Collaboration
© 2014 SOASTA. All rights reserved. 8CONFIDENTIAL – Not for Distribution
© 2014 SOASTA. All rights reserved. 9
© 2014 SOASTA. All rights reserved. 10CONFIDENTIAL – Not for Distribution
Ut
Unit Testing
Pe
Performance
Testing
Fu
Functional
Testing
Development Testing Operations
TIME
Traditional Linear Approach
© 2014 SOASTA. All rights reserved. 11CONFIDENTIAL – Not for Distribution
Ut
Unit Testing
Pe
Performance
Testing
Fu
Functional
Testing
Development Testing Operations
TIME
Test
Dev Ops
Traditional Linear Approach
Continuous Testing Approach
© 2014 SOASTA. All rights reserved. 12
Mobile Test
Automation
Performanc
e Testing
Real Test
Devices
Solid
Integration
© 2014 SOASTA. All rights reserved. 13
o Fully managed private device cloud
installed behind the firewall
o Real-time device inventory, status and
availability
o Online access for all your teams
o 24x7, secure, remote access to devices
o Mobile functional test automation
software
o Remotely access to selected mobile
device and any mobile app
• Use devices for manual testing and monitoring
• Remote screen-share devices for collaboration on
design or issues
© 2014 SOASTA. All rights reserved. 14
o Dedicated Public Device Cloud
o Access to the latest market leading
devices (iOS/Android)
o Automatic installation,
maintenance and upgrade
o Hosted devices in a secure data
center
o Stock devices, not jail
broken/rooted
o Seamless integration with
TouchTest and CI environments
o API available to install apps,
reboot/wake-up devices, launch
testsPerfect for 24x7 Automated Mobile Regression Testing
© 2014 SOASTA. All rights reserved. 15
s
Memory leaks
Test Scale
Sta
ge
/ T
ea
m
Dev
& Test
Release
& Deploy
Network
& OpsCDN file placement
Load Balancer configuration
Network bandwidth
Network configuration
DNS routing
Inadequate server resources
Default configuration settings
Unbalanced web serversAuto-scaling failures
Latency between systems
Slow third-party plug-ins
Garbage collection
Database thread counts
Inefficient database queriesSlow pages
Conflict with other apps
Test Lab Staging Production (100% +++)
Search technology limits
Method-level tuning
Max sockets exceeded
Firewall max capacity
Global latency variance
Security bottlenecks
Load Testing at All StagesPerformance validation from development to production
Continuous tuning for full-scale…and well beyond
© 2014 SOASTA. All rights reserved. 16
Use real user data to
iterate dev & test plans
Run iterative load
tests via Jenkins
Daily (or more frequent) updates
keep teams quality focused
Embedded failure
details & bottleneck
data isolate issues
Manage to a
performance
baseline
Mobile? Run functional
automation on real devices
for functional & performance
validation
Spin up suitable, consistent
test environments in the
cloud or the lab
Jenkins runs any
unit tests as usual
© 2014 SOASTA. All rights reserved. 17
© 2014 SOASTA. All rights reserved. 18
Expertise
Thanks
Contact SOASTA:
www.soasta.com/cloudtest/
866.344.8766
Follow us:
twitter.com/cloudtest
facebook.com/cloudtest
RESOURCES
Next Webinar: November 5, 2014
“How to Measure the Business Impact of Web Performance”
Register:
Webinars future and past: http://www.soasta.com/knowledge-
center/webinars/
Want to evaluate any SOASTA product or service?
- email [email protected]
- You’ll hear from us tomorrow (maybe today)
www.SOASTA.com