The Essentials of Mobile App Performance Testing and Monitoring
-
Upload
correlsense -
Category
Technology
-
view
3.383 -
download
3
description
Transcript of The Essentials of Mobile App Performance Testing and Monitoring
![Page 1: The Essentials of Mobile App Performance Testing and Monitoring](https://reader033.fdocuments.us/reader033/viewer/2022061219/54b91d6a4a7959bf7a8b4584/html5/thumbnails/1.jpg)
The Essentials of Mobile App Performance Testing and Monitoring
April 26, 2012
![Page 2: The Essentials of Mobile App Performance Testing and Monitoring](https://reader033.fdocuments.us/reader033/viewer/2022061219/54b91d6a4a7959bf7a8b4584/html5/thumbnails/2.jpg)
1. The Mobile Web Today2. Mobile Performance Testing3. Mobile App Monitoring4. Summary/Q&A
Agenda
![Page 3: The Essentials of Mobile App Performance Testing and Monitoring](https://reader033.fdocuments.us/reader033/viewer/2022061219/54b91d6a4a7959bf7a8b4584/html5/thumbnails/3.jpg)
Housekeeping
• Presentation will last 30 minutes• Submit questions via the chat window• Slides will be made available tomorrow
![Page 4: The Essentials of Mobile App Performance Testing and Monitoring](https://reader033.fdocuments.us/reader033/viewer/2022061219/54b91d6a4a7959bf7a8b4584/html5/thumbnails/4.jpg)
Featured Speakers
Stanton ChampionProduct Marketing ManageruTest
Frank DaysVP, MarketingCorrelsense
![Page 5: The Essentials of Mobile App Performance Testing and Monitoring](https://reader033.fdocuments.us/reader033/viewer/2022061219/54b91d6a4a7959bf7a8b4584/html5/thumbnails/5.jpg)
THE MOBILE WEB TODAY…
![Page 6: The Essentials of Mobile App Performance Testing and Monitoring](https://reader033.fdocuments.us/reader033/viewer/2022061219/54b91d6a4a7959bf7a8b4584/html5/thumbnails/6.jpg)
1.2 billion mobile web users world wide
-IDG Feb
2012
![Page 7: The Essentials of Mobile App Performance Testing and Monitoring](https://reader033.fdocuments.us/reader033/viewer/2022061219/54b91d6a4a7959bf7a8b4584/html5/thumbnails/7.jpg)
74% of users will bounce after waiting 5 seconds for a mobile site to load
![Page 8: The Essentials of Mobile App Performance Testing and Monitoring](https://reader033.fdocuments.us/reader033/viewer/2022061219/54b91d6a4a7959bf7a8b4584/html5/thumbnails/8.jpg)
Gartner predicts that by 2014, 90% of all corporations will support applications on personal devices – Feb 2012
![Page 9: The Essentials of Mobile App Performance Testing and Monitoring](https://reader033.fdocuments.us/reader033/viewer/2022061219/54b91d6a4a7959bf7a8b4584/html5/thumbnails/9.jpg)
Mobile’s Just Getting Started
0.5
1.0
1.5
2.0
2.5
Units$MM
2000 2016Year
Tablets
Smartphones
Personal Computers
![Page 10: The Essentials of Mobile App Performance Testing and Monitoring](https://reader033.fdocuments.us/reader033/viewer/2022061219/54b91d6a4a7959bf7a8b4584/html5/thumbnails/10.jpg)
So
Lo MoSocial Local Mobile
![Page 11: The Essentials of Mobile App Performance Testing and Monitoring](https://reader033.fdocuments.us/reader033/viewer/2022061219/54b91d6a4a7959bf7a8b4584/html5/thumbnails/11.jpg)
Web Testing Matrix Is Tough
OS & Browser
Features
Test Coverage
![Page 12: The Essentials of Mobile App Performance Testing and Monitoring](https://reader033.fdocuments.us/reader033/viewer/2022061219/54b91d6a4a7959bf7a8b4584/html5/thumbnails/12.jpg)
Mobile Testing Matrix Is Insane
OS & Browser
Features
Handset Makers& Models
Test Coverage
![Page 13: The Essentials of Mobile App Performance Testing and Monitoring](https://reader033.fdocuments.us/reader033/viewer/2022061219/54b91d6a4a7959bf7a8b4584/html5/thumbnails/13.jpg)
Mobile Testing Matrix Is Insane
OS & Browser
Features
Handset Makers& Models
WirelessCarriers
Test Coverage
![Page 14: The Essentials of Mobile App Performance Testing and Monitoring](https://reader033.fdocuments.us/reader033/viewer/2022061219/54b91d6a4a7959bf7a8b4584/html5/thumbnails/14.jpg)
Mobile Testing Matrix Is Insane
OS & Browser
Features
Handset Makers& Models
WirelessCarriers
Location
Test Coverage
![Page 15: The Essentials of Mobile App Performance Testing and Monitoring](https://reader033.fdocuments.us/reader033/viewer/2022061219/54b91d6a4a7959bf7a8b4584/html5/thumbnails/15.jpg)
Increasingly Complex Testing• The laughably simplistic notion of a “test matrix”
![Page 16: The Essentials of Mobile App Performance Testing and Monitoring](https://reader033.fdocuments.us/reader033/viewer/2022061219/54b91d6a4a7959bf7a8b4584/html5/thumbnails/16.jpg)
Not Just Testing, but More Complex Monitoring from Test to Production
Wider range of devices are connected to a more complex IT world
![Page 17: The Essentials of Mobile App Performance Testing and Monitoring](https://reader033.fdocuments.us/reader033/viewer/2022061219/54b91d6a4a7959bf7a8b4584/html5/thumbnails/17.jpg)
• Challenges
– Complaints performance
– No visibility into mobile app
transactions
– Limited/no load testing prior
to mobile rollout
– Huge headache for CIO
• Opportunities
– Mobile technologies to
Improve Productivity
– For “mobile workforce”
– Real-time data access
• Examples:
– CRM
– Order entry
– ERP
Both Are Needed to Improve End User Experience
![Page 18: The Essentials of Mobile App Performance Testing and Monitoring](https://reader033.fdocuments.us/reader033/viewer/2022061219/54b91d6a4a7959bf7a8b4584/html5/thumbnails/18.jpg)
ESSENTIALS FOR PERFORMANCE TESTING
![Page 19: The Essentials of Mobile App Performance Testing and Monitoring](https://reader033.fdocuments.us/reader033/viewer/2022061219/54b91d6a4a7959bf7a8b4584/html5/thumbnails/19.jpg)
Agile vs.Waterfall
Manual vs. Automation
Managing vs.Leading Teams
Exploratory vs.Test Cases
Testers vs. Engineers
In-House vs. Outsourced
Offshore vs.Nearshore
In T
he L
ab
Lab-Based Testing Innovation
![Page 20: The Essentials of Mobile App Performance Testing and Monitoring](https://reader033.fdocuments.us/reader033/viewer/2022061219/54b91d6a4a7959bf7a8b4584/html5/thumbnails/20.jpg)
In T
he L
ab
In
TheWild
Users Work & Live 'In The Wild'
![Page 21: The Essentials of Mobile App Performance Testing and Monitoring](https://reader033.fdocuments.us/reader033/viewer/2022061219/54b91d6a4a7959bf7a8b4584/html5/thumbnails/21.jpg)
• Recognize it will never again be sufficient on its own• Build your company’s plan for testing ‘In The Wild’
– Real-world conditions: Live testers, real devices, imperfect connectivity
– Mirror your user base• Technologically: OS, browser, anti-virus, device, carrier• Geographically: Continent, country, city, language• Demographically: Age, gender, education, employment, industry
Look Beyond The Lab
![Page 22: The Essentials of Mobile App Performance Testing and Monitoring](https://reader033.fdocuments.us/reader033/viewer/2022061219/54b91d6a4a7959bf7a8b4584/html5/thumbnails/22.jpg)
Your Connection to the Cloud
Big Fat Pipe
![Page 23: The Essentials of Mobile App Performance Testing and Monitoring](https://reader033.fdocuments.us/reader033/viewer/2022061219/54b91d6a4a7959bf7a8b4584/html5/thumbnails/23.jpg)
Your Automated Load Testing Tool’s Connection to the Cloud
Big Fat Pipe
![Page 24: The Essentials of Mobile App Performance Testing and Monitoring](https://reader033.fdocuments.us/reader033/viewer/2022061219/54b91d6a4a7959bf7a8b4584/html5/thumbnails/24.jpg)
Your Users’ Connections to the Cloud
![Page 25: The Essentials of Mobile App Performance Testing and Monitoring](https://reader033.fdocuments.us/reader033/viewer/2022061219/54b91d6a4a7959bf7a8b4584/html5/thumbnails/25.jpg)
Testing 'In The Wild' Finds New Bottlenecks
• Different users have different connection pathways– Mobile towers
– Network providers
– Backbone connections
– Content Delivery Networks
– DNS providers
• Above can add latency, making the user’s experience worse
'In The Wild' testing helps you identity down-stream network problems that you can’t find in the lab
![Page 26: The Essentials of Mobile App Performance Testing and Monitoring](https://reader033.fdocuments.us/reader033/viewer/2022061219/54b91d6a4a7959bf7a8b4584/html5/thumbnails/26.jpg)
Smarter Load Testing With Experts
• People don't load test often, few are experts • Professional testers are valuable• Technical understanding improves perception of
problems and root causes• When testing 'In The Wild', need professionals
with skills and experience
![Page 27: The Essentials of Mobile App Performance Testing and Monitoring](https://reader033.fdocuments.us/reader033/viewer/2022061219/54b91d6a4a7959bf7a8b4584/html5/thumbnails/27.jpg)
Coupled with end-to-end monitoring
• You need smart, adaptable monitoring that can work in the wild and inside your data center
![Page 28: The Essentials of Mobile App Performance Testing and Monitoring](https://reader033.fdocuments.us/reader033/viewer/2022061219/54b91d6a4a7959bf7a8b4584/html5/thumbnails/28.jpg)
ESSENTIALS FOR MOBILE APP MONITORING
![Page 29: The Essentials of Mobile App Performance Testing and Monitoring](https://reader033.fdocuments.us/reader033/viewer/2022061219/54b91d6a4a7959bf7a8b4584/html5/thumbnails/29.jpg)
1. Be Strategic
You need
measurable SLAs
To tie mobile
strategy to biz
goals
![Page 30: The Essentials of Mobile App Performance Testing and Monitoring](https://reader033.fdocuments.us/reader033/viewer/2022061219/54b91d6a4a7959bf7a8b4584/html5/thumbnails/30.jpg)
2. Be Transparent
Keep biz stakeholders in the loop and ensure SLA data is accessible
![Page 31: The Essentials of Mobile App Performance Testing and Monitoring](https://reader033.fdocuments.us/reader033/viewer/2022061219/54b91d6a4a7959bf7a8b4584/html5/thumbnails/31.jpg)
3. Be Paranoid
![Page 32: The Essentials of Mobile App Performance Testing and Monitoring](https://reader033.fdocuments.us/reader033/viewer/2022061219/54b91d6a4a7959bf7a8b4584/html5/thumbnails/32.jpg)
Datacenter
WEB
MQ/ESB
DCOM
CORBA
SERVER
APP SVR
PROXY
LDAP
WebServices
Watch Every Transaction for Every User
![Page 33: The Essentials of Mobile App Performance Testing and Monitoring](https://reader033.fdocuments.us/reader033/viewer/2022061219/54b91d6a4a7959bf7a8b4584/html5/thumbnails/33.jpg)
Total End-User Response TimeBrowser Rendering Time
Track Key User Experience Metrics
Rend
erin
g
Mobile Real User Monitoring
Datacenter TimeNetwork Latency
Mobile
![Page 34: The Essentials of Mobile App Performance Testing and Monitoring](https://reader033.fdocuments.us/reader033/viewer/2022061219/54b91d6a4a7959bf7a8b4584/html5/thumbnails/34.jpg)
4. Be Smart - Understand what is happening across the Space-Time continuum
![Page 35: The Essentials of Mobile App Performance Testing and Monitoring](https://reader033.fdocuments.us/reader033/viewer/2022061219/54b91d6a4a7959bf7a8b4584/html5/thumbnails/35.jpg)
Look Across Time
![Page 36: The Essentials of Mobile App Performance Testing and Monitoring](https://reader033.fdocuments.us/reader033/viewer/2022061219/54b91d6a4a7959bf7a8b4584/html5/thumbnails/36.jpg)
Look Across Locations
![Page 37: The Essentials of Mobile App Performance Testing and Monitoring](https://reader033.fdocuments.us/reader033/viewer/2022061219/54b91d6a4a7959bf7a8b4584/html5/thumbnails/37.jpg)
Know When There is a Problem
![Page 38: The Essentials of Mobile App Performance Testing and Monitoring](https://reader033.fdocuments.us/reader033/viewer/2022061219/54b91d6a4a7959bf7a8b4584/html5/thumbnails/38.jpg)
Summary
• When testing mobile
– Test outside the lab
– 'In The Wild'
– Use professionals
• When monitoring mobile
– Be strategic
– Be transparent
– Be paranoid
– Be smart
• Mobile web is complex
• New testing and monitoring tools
are needed
• End user experiences are still
critical
![Page 39: The Essentials of Mobile App Performance Testing and Monitoring](https://reader033.fdocuments.us/reader033/viewer/2022061219/54b91d6a4a7959bf7a8b4584/html5/thumbnails/39.jpg)
Questions
Get your free copy SharePath RUM!
http://www.real-user-monitoring.com/
Contact uTest:http://www.utest.com/Phone: 1-800-445-3914Follow us:
twitter.com/uTest
facebook.com/uTest
Contact Correlsense:www.correlsense.com/[email protected] us:
twitter.com/correlsense
facebook.com/correlsense
Contact Us At http://www.utest.com/contact-
customers GET STARTED
TODAY!