Introduction to mobile performance testingIntroduction to mobile performance testing Igor Markov,...

© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

Introduction to mobile performance testing Igor Markov, Shlomi Zalma, Shane Evans, Wilson Mar June 11 & 13, 2013

© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 3

HP LoadRunner components

Virtualize the Network 4

Stay Connected

Analysis, Diagnostics and Reporting

Database Internet/WAN Application Server(s) Client(s) End User

Test Scenario

Measure Impact

6

Generate Load 3 Author Scripts 1

Plan and Execute Tests 2 HP Live Network 7

5


Incremental integrated development workflow

Deploy app

Run test cases

Provision devices

Execute build

Application Security Assessment

Test results

Check-in & Code Scan Fortify Source Code Analysis

UFT / LoadRunner

WebInspect

ALM Lab Management

Cloud Delivery Automation

Jenkins

HP integrated suite

LR Analysis

Executive Scorecards

Analytics Portal


Workflow for performance engineering

1. Plan 2. Provision 3. Verify 4. Script 5. Scenarios

Workload Templates Data Scenarios Attributes Cost vs.

Benefit

Domains Servers Ports IP Addresses SSL certs. Licenses

Batch Jobs Network

Variability Report

Samples

Transactions Resource

Usage Variations Retry and

Recovery

Report Templates

Reruns Baselines Comparisons Archival


Create a new script, mobile protocols

HP LoadRunner VuGen


Author mobile TruClient scripts

https://connections.houston.hp.com/docs/DOC-15086





Recording methods

TruClient Ajax

HTTP/HTML

HP LoadRunner VuGen

App web server

User Agent >


Create a new script, mobile TruClient protocol

HP LoadRunner VuGen


TruClient recording

HP LoadRunner VuGen 11.52


Devices with User Agent strings

Count: 27

HP LoadRunner VuGen11.52


Sample User Agent for Samsung Galaxy S3

User Agent string example

Mozilla/5.0 (Linux; U; Android 4.0; xx-xx; GT-I9300 Build/IMM76D) AppleWebKit/534.30 (KHTML, like Gecko) Version/4.0 Mobile Safari/534.30

720 x 1280



Invoke Firefox in VuGen for TruClient



HTTP/HTML mobile recording






Create a new script, HTML recording protocol



HTTP/HTML

TruClient

HTTP/HTML recording methods wizard

Proxy Recording

Record Emulator

Analyze Traffic

Record & Analyze Traffic

TruClient Ajax HP LoadRunner VuGen11.52


Record emulator recording method

Android

Device Emulator

HTTP/HTML

Record Emulator

APK

APK

TruClient Ajax HP LoadRunner VuGen11.5x

App web server


Record emulator requirements

Java Development Kit http://www.oracle.com/technetwork/java/javase/downloads/index.html

Android SDK with ADT http://developer.android.com/sdk/index.html

HTTP/HTML

Record Emulator

http://www.oracle.com/technetwork/java/javase/downloads/index.html



http://developer.android.com/sdk/index.html




Record emulator


HTTP/HTML

Record Emulator


Record emulator options


HTTP/HTML

Record Emulator


Proxy recording

Android

LoadRunner Proxy

iOS

Port 8080

HTTP/HTML

Proxy Recording

Port 80/443

APK

HP LoadRunner VuGen11.5x

App web server


Proxy recording


HTTP/HTML

Proxy Recording


Record and analyze traffic

Android

Wireshark

iOS

HTTP/HTML


Ad hoc network

APK .pcap

HP LoadRunner VuGen11.5x

App web server




HTTP/HTML



Analyze traffic

Mobile Recorder

Android

.lrpcap

HTTP/HTML

Analyze Traffic

Android 4.1+ (rooted)

App web server

APK



Analyze traffic


HTTP/HTML

Analyze Traffic


Analyze traffic—options


HTTP/HTML

Analyze Traffic


Scenario runs






Concurrency and rendezvous

[P10]


Wi-Fi vs. 3G response time

[P01] HP Network Virtualization by Shunra


3G vs. 4G latency spikes

HP Network Virtualization by Shunra


http://www.youtube.com/watch?v=7CGCief0EaU&hd=1&t=19m35s

Bandwidth Utilization In (Down)

Bandwidth Utilization Out (Up)

Response Time

Login with more VUsers


Ramp up and down

Resources

• Processes, Threads

• Memory (leaks?)

• CPU (saturation?)

• Disk I/O (thrashing?)

• Network I/O

• Transaction Throughput

• Etc.

[P04]

Response time

Resources per user

Clean-up Resources over time

Back-end Resources

HP LoadRunner Analysis 11.52


Capacity in 3 dimensions

[P04]


Scalability

[P01] http://wwwperftest.com


Isolate end-user performance by carrier

HP Business Service Management


Isolate end-user performance by device

HP Business Service Management


Thank you

Introduction to mobile performance testingIntroduction to mobile performance testing Igor Markov,...

Documents

Transcript of Introduction to mobile performance testingIntroduction to mobile performance testing Igor Markov,...