Introduction to Mobile Performance Testing

Introduction to Mobile Performance TestingWilson Mar, Angel Tran, Shlomi SalmaHOL330 in Sands 305, June 13, 2013

Mobile apps are now:Why performance test mobile apps?

• how customers locate stores and information• how brands get exposure many times a day• the “face” of the organization

Slow app = Slow product?

Baseline vs. impact of network latency, etc.

[P01]from HP Network Virtualization by Shunra

Possible points of risk in landscape

StorageDB

ServersApp

ServersWeb

ServersLoad

Balancers

3rd Party Cloud Services

CDNs & CoLo.

Carriers InternetBrowsers

Platforms& Versions Firewalls

VPNsDevice Features

2G,3G,4GCellular

Mobile Components

ScreenSizes

Web Services

DB Indexes& Logs

ResourceUsage

Latency& Loss

Pooling &Threading

ServerConfig.

SysAdmin: DBA:Back-end:Dev:Network:DataCaching

mDev:Encrypt,Compress.

Load Bal. Algorithm

Network:Network:

HP Live Network

Collaborate2

HP LoadRunner components and workflow

Virtualize Network5

End User Application Server(s)Internet/WAN Database

Analyze, Compare, Report8

Client(s)

Generate Load6

Author Scripts1

Measure Impact7

Test Scenario

Plan and Execute Tests3

Virtualize Services4

Scan for more information

LoadRunner

NetworkVirtualization

ServiceVirtualization

MobileTesting

HP Codescan app

http://www.hp.com/go/...

AppleApp

Play.googl

iPhone, iPadAndroid“featurephones”

WindowsPC

Mobile technology terms

Safari browser

m.ft.com

mobilesite

ft.com/wsweb

services

ft.comHTML5

responsive design

Native app

internetexplore

ft.comHTML4

minimal

browserURL

Hybridapp

Chromebrowser

Mobile LoadRunner Scripting Demos

https://connections.houston.hp.com/docs/DOC-15086

http://code.google.com/p/android-screen-monitor/Android Screen Monitor

Download to folder …\sdk\platform-tools\ASM.jarWithin Windows Explorer, double click on ASM.jar

Create a New Script, Mobile Category

HP LoadRunner VuGen 11.5 SP1+

Multiple Approaches Available

Browser or hybrid app:Ajax? > TruClient Ajax Mobile scripting protocol using User Agent

spoofing in FirefoxSimple > Mobile HTTP/HTML scripting protocol

Native app: > Mobile HTTP/HTML scripting protocolAndroid:

No device > Record Emulator using Android Virtual Device (AVD)

Have rooted device > Mobile Recorder generate lrpcap to Analyze

iOS & others:> LoadRunner Proxy on same subnet/Wi-Fi hub

(the newest technique) > Record & Analyze WinPcap capture on the

mobile app server

Recording Method TruClient Ajax

TruClient Ajax HP LoadRunner VuGen 11.51+

App web server

User Agent in Firefox >

TruClient recording

HP LoadRunner VuGen 11.51+

Devices with User Agent strings

Count: 27

HP LoadRunner VuGen11.52

Sample User Agent for Samsung Galaxy S3User Agent string example

Mozilla/5.0 (Linux; U; Android 4.0; xx-xx; GT-I9300 Build/IMM76D) AppleWebKit/534.30 (KHTML, like Gecko) Version/4.0 Mobile Safari/534.30

HP LoadRunner VuGen11.52More at http://www.useragentstring.com/

Android Versions

4.1 (16)4.2 (17)

2.3 (9,10)

4.0 (15)

Mobile Device Manager Tool in VuGen

VuGen Scripting Process

from HP Virtual User Generator User Guide 11.52 page 73

1. Configure recording settings2. Consider run-time settings3. Object identification using

script levels4. Specify Transaction Names 5. Specify Completion End

Events Logic6. Insert flow control7. Run-time logic8. Vary data based on

parameters9. Using C script functions in a

library

Random Think-time in TruClient

Arguments:

http://www.perftesting.co.uk/ajax-truclient-tips-and-tricks-part-ii/2012/05/02/

Math.floor( 11 * Math.random()+5 );

TruClient Toolbox drag and drop

window.alert( “randWait=” + randWait );

Arguments:

http://www.perftesting.co.uk/ajax-truclient-tips-and-tricks-part-ii/2012/05/02/

Math.floor( 11 * Math.random()+5 );

var randWait =

HTTP/HTML Mobile Recording

Mobile HTTP vs. HTML

HP LoadRunner VuGen

mode=“HTML”mode=“HTTP”Parse HTML to automatically identify additional resources to download

For use with web services calls.Does not parse for resource requests.

• CSS• JavaScript

Record Mobile HTTP/HTML

HTTP/HTML

TruClient

HTTP/HTML Recording Methods Wizard

Proxy Recordi

Record Emulato

AnalyzeTraffic

Record &

Analyze Traffic

Proxy Recording

HTTP/HTML

TruClient

Proxy Recordi

Proxy Recording

Android

LoadRunner

HTTP/HTML

Proxy Recordi

HP LoadRunner VuGen11.5x

App web server

Port 80/443

VuGenProxy IP:Port 8080

iOS IPA

Proxy Recording

HTTP/HTML

Proxy Recordi

Proxy Recording Setup on iOS

Source: http://www.amsys.co.uk/2012/blog/how-to-setup-proxy-servers-in-ios/

4.3. Scroll down2.

Eleanor

Password: ncjm-q3ey-t1dd

Eleanor 192.168.1.2255.255.255.0

192.168.1.1

192.168.1.38080

Proxy Recording Setup on Android Galaxy S3 (4.1.2)1. 4.3.2. Long press

Eleanorncjm-q3ey-t1dd

Record Emulator

HTTP/HTML

Record Emulato

Record Emulator Android Recording Method

Android

deviceemulator

HTTP/HTML

Record Emulato

App web server

Async.

@device ADT file

Android… \sdk\tools

File manager

Backup

Play.Google.com

Install

Record Emulator Requirements

1. USB cable to device2. USB driver for device 3. Android app APK file for Android app under test4. Android file download manager app to extract APK file from device

5. JDK (Java Development Kit)6. ADT (Android Development Toolkit) plug-in for Eclipse7. AVD (Android Virtual Device) within Eclipse for device under test8. JAVA_HOME and PATH Windows environment variables

9. HP LoadRunner 11.50 and SP2 patch to upgrade to 11.52

HTTP/HTML

Record Emulato

Emulator

Record & Analyze Traffic

HTTP/HTML

Record &

Analyze Traffic

Record & Analyze Traffic

Androidnetworksniffer

HTTP/HTMLRecord

& Analyze Traffic

Ad hoc network

.cap,.pcap

App web server

Analyze Traffic

HTTP/HTML

AnalyzeTraffic

Analyze Traffic

MobileRecorder

Android

.lrpcap

HTTP/HTML

AnalyzeTraffic

Android 4.1+(rooted)

App web server

Android Mobile Recorder1. Start Recording 3. Stop and send email2.

Perform user steps.

Android Mobile Recorder Settings

Recording Methods Recap

MobileRecorder

Android

.lrpcap

LoadRunner

deviceemulator

networksniffer

iOSVuGenProxy IP:Port 8080

HTTP/HTML

Proxy Recordi

Record Emulato

AnalyzeTraffic

Record &

Analyze Traffic

Port 80/443

User Agent in Firefox >

Android 4.1+(rooted)

Ad hoc network

.cap,.pcap

TruClient Ajax HP LoadRunner VuGen11.52

App web server

@device ADT file IPA

Play.Google.com

Mobile scenarios

How can we help?

Run test cases

Provision & deploy environment

Execute automated build

Application Security Assessment

Test results

Security Code ScanFortify Source Code Analysis

UFT / BPTLoadRunner

WebInspect

Continuous Delivery Automation (CDA)

(Jenkins)

HP integrated testing suite

ALM Analysis

Executive Scorecard

Performance Center

Service VirtualizationNetwork Virtualization

DevelopmentAgile Manager

Business Service ManagementMonitoring &

Diagnostics

Analytics

App. Lifecycle Intelligence

ALM Lab Management

Tear down environmentContinuous Delivery Automation

Shopping processInterconnected component services

PayBuy Ship Track

Product

Search

Customer profiles Payment Shipping

Composite

Managed cloud

Public cloud

Traditional

Track package

Privatecloud

Concurrency and rendezvous

[P10]Illustrative data

Key take-aways

• For mobile browser apps (jQuery Mobile, Sencha, PhoneGap, etc.), little scripting is needed using User Agent spoofing via Firefox TruClient Mobile

• JavaScript executes against a DOM for each virtual user• Traffic captured between native apps and server are converted to

VuGen scripts• Android native app traffic on rooted devices can be recorded

on device using LoadRunner Mobile Recorder

• iPhone and iPad (iOS) -- all non-rooted apps – can be recorded using LoadRunner Proxy

• Monitor and Diagnose using HP Business Service Management• Consider HP Network Virtualization and Services Virtualization

For more information

Attend these sessions

Mobile Performance Hands-on Lab HOL3330Sands Room 305

• Tuesday 1p – 3p• Thursday 3p-5p

After the event

• Contact your sales rep• Visit: http://

www.hp.com/go/mobiletesting http://www.hp.com/go/loadrunner

Your feedback is important to us. Please take a few minutes to complete the session survey.

Visit these demos

Applications: mobile performance testing RT3112• Wednesday June 12, 1030 am

Lido 3101A• Thursday June 13, 930 am

Lido 3101B

Thank you

Introduction to Mobile Performance Testing

Documents

Transcript of Introduction to Mobile Performance Testing

Best Practices for Performance Testing Mobile Apps · • iOS Instruments / Xcode Mobile test automation tools • TouchTest (SOASTA) ... performance activities . CoE performance

PERFORMANCE ENGINEERING€¦ · performance testing and other Non-functional testing aspects • Focused performance testing methodologies on Mobile, Enterprise network, Cloud and

Performance Testing for Mobile Apps & Sites using Apache JMeter

Mobile Performance Testing - Client - Network and Servers

Best Practices for Performance Testing Mobile Apps

Performance Mobile Agile The Future - Australia and New Zealand Testing … · 2016. 5. 31. · © Planit Software Testing Agenda 1. Traditional Performance Testing 2. Agile Performance

Mobile Apps Performance Testing Using Open Source Tool JMeter

The Essentials of Mobile App Performance Testing and Monitoring

Realistic Context Generation For Mobile App Testing and ... · Realistic Context Generation For Mobile App Testing and Performance Evaluation ... imitate internal hardware of mobile

Strategies for Performance Testing Custom Salesforce ... for Performance Testing Custom Salesforce Deployments Page 3 Executive Summary In many organizations, web and mobile …

Testing Packet Switched Network Performance of Mobile … · 2015-07-13 · Testing Packet Switched Network Performance of Mobile Wireless Networks. Introduction. 3G networks are

Webinar: Performance Testing for Mobile Applications by RTTS

Performance Testing Mobile Devices - ANZTB - …Firstly –what is Performance Testing? Simulating user behaviour of application Testing against Non Functional Requirements (NFRs )

Webinar on Performance Testing of Mobile Applications

The Cloud - A Game-Changer for Web and Mobile Performance Testing

Roland van leusden mobile performance testing rtc 2014 v0.6

Strategies for Performance Testing Custom Salesforce ... · Strategies for Performance Testing Custom Salesforce Deployments Executive Summary In many organizations, web and mobile

Mobile Application Performance Testing - …media.shunra.com/whitepapers/MobilePerfTesting_27913.pdf · Mobile Application Performance Testing Aluminum foil, elevators and other mobile

CMG imPACt2016 - Mobile performance testing - Vendor training - Federico Toledo, Sofia Palamarchuk

Best Practices for Performance Testing Mobile Apps - … 2015/Lee Barnes... · Best Practices for Performance Testing Mobile Apps Lee Barnes, ... Measuring Device Performance ...