The Mobile Testing Checklist

1© 2014 SOASTA CONFIDENTIAL - All rights reserved.

The Mobile Testing Checklist

Ensure success of your mobile apps - don't overbuild or under test.


Today’s Presenters

Lee BarnesFounder and CTO Utopia Solutions

If you have questions during the webinar, submit in chat box during event

Mike OstenbergDirector Solutions EngineeringSOASTA

Moderator: Brad JohnsonVP of Product MarketingSOASTA


Agenda

1. Introduction

2. The Landscape of Mobile Testing

1. Why is Mobile Testing Different

2. Checklist for Mobile Testing

3. Mobile Testing Framework

3. SOASTA Solutions

1. TouchTest Key Capabilities

2. CloudTest for Mobile Load Testing

3. mPulse RUM for Mobile Monitoring

4. Resources and Conclusion


Mobile Is In the Enterprise2014 GigaOm Survey

Source: “Mobile In the Enterprise”, Zendesk 2014


Software Test Professionals Polls

“Do you currently have a mobile initiative”

1 Year of “Continuous Mobile Testing”

Spring 2013

Fall 2013 Spring 2014

25 attendees 28 attendees 21 attendees

56%

44%


Gartner On Mobile

CHALLENGES

o Most traditional dev practices don’t work with mobile

o Apps require constant refinement to tune the user experience

o Rapid change requires rapid development & deployment

Driven From Enterprise Requirements

Source: Gartner “Traditional Development Practices Will Fail for Mobile Apps” April 15, 2014


Gartner On Mobile

CHALLENGES

o Most traditional dev practices don’t work with mobile

o Apps require constant refinement to tune the user experience

o Rapid change requires rapid development & deployment

RECOMMENDATIONS

o Collaborate with business, users, devs…and observe work practices

o Use all test types: functional, performance & load, and user experience

o Analyze how apps are used in production by real users

o Adopt agile development and deployment

Driven From Enterprise Requirements

Source: Gartner “Traditional Development Practices Will Fail for Mobile Apps” April 15, 2014


Poll Question


Lee BarnesFounder and CTO

The Landscape of Mobile Testing

10

Mobile testing is…

…different

www.motivationalmemo.com


Multiple OS / Fragmentation

Source: OpenSignal Android Fragmentation Report August 2014

iOS 8iOS 7Earlier

4.44.34.24.14.03 - 4.042.3.3 - 2.3.72.2 & earlier


Device Diversity


Network Diversity


Diversity Increases Test Burden

Mobile Testing Iceberg

App Functionality



App Functionality

Mobile Specific Test Conditions



App Functionality



Mobile Specific ChecklistTest Conditions

Installation

Interrupt

Network

Device Integration

Performance


Mobile Testing ChecklistInterrupt Conditions

Incoming / Outgoing Calls

Popup Alerts (Calendar, Alarm, SMS, etc.)

Power Cycle

Extended Background


Mobile Testing ChecklistInstallation Conditions

Install

Uninstall

Reinstall

Update


Mobile Testing ChecklistNetwork Conditions

Network Type (Mobile variations and WiFi)

Network Quality

Network Loss

Network Transition


Mobile Testing ChecklistPerformance Conditions

Speed / Responsiveness

CPU and Memory Usage

Battery Drain

On-Device / Memory Card Storage


Mobile Testing ChecklistDevice Integration Conditions

Location / GPS

Video / Still Camera

Screen Size, Resolution, Orientation

Accelerometer


Mobile Test CaseSelection

App Type

App Usage

App/Device Integration


AppFunctionality& Technology

User Profile

BusinessObjectives

Device Selection

• Deployment platforms & versions

• App interaction with device• Integrated systems

• Prevalent Devices• Preferred Browser• Concurrent usage /

load profile

• Application value to the business

• Risk of application failure


Mobile Testing


Mobile Test Case Matrix


Test Automation

Execute test cases across a set of diverse devices


Mike OstenbergDirector Solutions Engineering

SOASTA Solutions


SOASTA SolutionsQuality Across the Mobile Delivery Lifecycle

Expertise


SOASTA Solutions

Expertise

Run local and remote private device clouds. Compress testing from weeks to overnight.

Quality Across the Mobile Delivery Lifecycle


SOASTA Solutions

Expertise


Performance test the mobile backend to any

scale or global distribution.

Continuously.


SOASTA Solutions

Expertise


Measure real mobile users in production to determine scale and usage patterns. Test better.


Questions?

Lee BarnesFounder and CTOUtopia Solutions

Email:[email protected]

Twitter:twitter.com/USI_LeeBarnes

LinkedIn: linkedin.com/in/leebarnesBlog:

www.RaiseYourMQ.com

Mike OstenbergDirector Solutions EngineeringSOASTA

Email:[email protected]


Poll Question

Thanks

Contact SOASTA:www.soasta.com/cloudtest/

[email protected]

Follow us:

twitter.com/cloudtest

facebook.com/cloudtest

RESOURCES

Next Webinar: Oct. 22, 2014“’Accelerating Web and Mobile Testing for Continuous Delivery”

Register: Webinars future and past:

http://www.soasta.com/knowledge-center/webinars/

Want to evaluate any SOASTA product or service?- email [email protected]

- You’ll hear from us tomorrow (maybe today)

http://www.soasta.com/knowledge-center/webinars/

mailto:[email protected]

38

www.SOASTA.com

www.utopiasolutions.com

The Mobile Testing Checklist

Documents

Transcript of The Mobile Testing Checklist