5 Secrets to a Successful Mobile Application Testing Strategy

25th Jun 2014

Ajay Balamurugadas / Sundaresan Krishnaswami

www.maas360.com

Today’s Agenda

• 5 key elements of a robust test repository

• Addressing Android testing pain points

• Android vs iOS: Do you change your

testing strategy?

• Best practices for cross platform testing

• Building the tacit knowledge in testing

teams

• Q & A

#MaaS360test

Poll Question #1:

• What are your prime challenges in mobile

application testing?

a. Device/Brand level fragmentation

b. API level fragmentation

c. Inconsistent UI and UX

d. Lack of test devices

e. Lack of knowledge of mobile application testing techniques

f. All of the above

#MaaS360test

Secret #1: 5 Key Elements of a Robust Test Repository

#MaaS360test

Resources For a Robust Test Repository

Credits: http://thetesteye.com/posters/TheTestEye_SoftwareQualityCharacteristics.pdf

#MaaS360test

Poll Question #2:

• Does your organization suffer from Android

fragmentation?

a. Yes

b. No

c. Somewhat

#MaaS360test

Secret #2: Addressing Android Fragmentation

Key Challenges:

• Many devices to test

• Several different form factors

• Different operating system flavors

• Application backward compatibility

• App architecture

• API compatibility

• Hardware integration

#MaaS360test

Android Fragmentation: How Do We Tackle It?

• Normalize the device for performance, latest OS, most used

• Listen to your users – Google Play, forums,etc.

• Application layout for different screen dimensions

• API behavior

• Mobile app functionality for different device hardware

• Follow AQuA best practices while building and testing apps

– http://www.appqualityalliance.org/

#MaaS360test

Secret #3: Android vs iOS: Do you Change Your Testing Strategy? • What type of app is this: hybrid or native?

– Hybrid apps

• Most hybrid apps are built for the browser

• You can start testing from a browser on your desktop

– Native apps

• Build a traceability matrix for your functionalities

• Identify key operating system differences

• Build your foundation (testing techniques)

• Build a Mobile testing ready reckoner

• Analyze & identify the tools you would require – Android Debug Bridge, iPhone Configuration Utility, Log collectors

• Understand the OS specific design guidelines and test for them – Example: Gestures for different screens

#MaaS360test

Secret #4: Best Good Practices for Cross Platform Testing • Device Settings

– Understand the device settings on each platform

– What is unique to each of the platforms

• Consistency heuristics – Do a side by side comparison of two devices – one platform each

– Note the differences and report them

• Test, Learn, Test Approach – Test on one platform, understand the feature, test on another later

• Compare and contrast approach – Use a mind map or simple checklist

– Have a cross-platform team test together

• Stop worrying about cross-platform much

#MaaS360test

Poll Question #3:

• If your organization were to conduct an

assessment test on your testing team or

yourself, will the score be 75% and above?

a. Yes

b. No

c. May be

#MaaS360test

• Bug blitz

• Dogfooding those apps

• Internal competitions

• Training sessions

• Virtual conferences

Secret #5: Tips to Build Tacit Knowledge in Testing Teams

#MaaS360test

MaaS360 App Works Because…

• Use case based approach – Why do we need this feature?

– Write complete end to end scenarios, stories

– Checklist of previous field issues

• Test on real devices (and not emulators)

• Bring Your Own Device (BYOD) to test

• Listen to users – App reviews on Google Play, App store, etc.

– Connect with users on app forums

• Bug blitz and internal contests – Other people’s views

#MaaS360test

MaaS360 App Works Because…

• Continuous learning – Testing feeds on Ministry of Testing

– Learn from platform-centric conferences like WWDC and Google I/O

– In-house workshops and hands-on training

– Field issue analysis

– Analytics based learning

#MaaS360test

MaaS360 App Security Test Checklist

1. Safeguard app data via secure containers

2. Data encryption – Database, passwords, payloads

3. Network communication – HTTPs URLs, MITM attacks

4. Inter-app communication – Certificate based trust, web-service based trust

5. Privacy and permissions – Respect user privacy, logging sensitive information, obtain only required

permissions

#MaaS360test

Mobile Application Testing: Ready Reckoner

• Test for app behavior in the cloud and secure wipe conditions

• Test for secure app data communications and platform specific design guidelines

• Test for app store pre-submission guidelines

• Test with your own ready reckoner; share it

• Test, test and test for more positive ratings on the app store

• Read the book: Tap into Mobile Application Testing by Johnathan Kohl for enhancing your testing skills

#MaaS360test

Q&A

#MaaS360test

Connect with the MaaS360 Community

• Past Webinars (http://www.maas360.com/maasters/webinars)

– Building Secure Mobile Applications Using MaaS360 SDK and IBM Worklight

– Android 4.3 and Windows 8.1 -The Next Milestones in Mobile Device Management & BYOD

– Achieve Enterprise Mobile Security with MaaS360 MDM and Dual Persona

– The Evolution of BYOD - Are You Set-Up for Success?

• Plus lots of How-To content in our Resources section

– The Ten Commandments of Bring Your Own Device (BYOD) • http://links.maas360.com/tenCommandments

– Does Android Dream of Enterprise Adoption? • https://links.maas360.com/doesAndroidDream

#MaaS360test

Get Started Today!

Set-up

Get access to a

free, fully

functional trial

for 30 days

Manage

Start managing,

securing, and

supporting devices,

apps, and docs

Provision

Instantly enroll

and configure

your mobile

devices

#MaaS360test