Mobile Application Testing Ben Symons ANZTB - SIGiST – Adelaide 30th October 2013

Who am I?

�  Principal Consultant at Access Testing

�  Almost 20 years working in IT with over 10 years focused on Testing

�  Worked across organisations ranging from tiny start-ups to some of the largest global enterprises

�  In my spare time I’m kept busy with kids, pets, studying and maintaining a ~100 year old cottage

Ben Symons http://au.linkedin.com/in/bensymons/

Mobile Application Testing

� Challenges

� Services in the market

� Flexible Approach

� Automation Framework Demo

Challenges of Mobile Testing �  Short development cycles / constant change

�  Proliferation of devices, form factors and versions

Android screen sizes and densities

Valid at 2nd October 2013 http://developer.android.com/about/dashboards/

Challenges (cont’d) � Ensuring consistent and engaging customer

experience (CX)

�  Differences in network, connectivity and bandwidth (2G/3G/4G/LTE/Wifi).

�  Expectations based on other apps in the market

�  Differences in device performance and capability

Challenges (cont’d)

�  Information access / security

� Device procurement and management

� Application through life support in a competitive market

Services in the market � Mobile Automation Tools

�  HP QTP/UFT �  Adobe Edge Inspect �  Anteater, MonkeyTalk, Frank, KIF, TouchTest, UI

Automation, Zucchini, et al.

� Open Device Labs ( opendevicelab.com)

� Mobile device clouds �  Perfecto Mobile, Gorilla Logic, et al.

Flexible Approach

�  Establish a platform coverage strategy based on actual market usage and most importantly, review the usage regularly.

Android Fragmentation

iOS Fragmentation

Valid at 2nd October 2013 http://developer.android.com/about/dashboards

Valid at 3rd June 2013 https://developer.apple.com/devcenter/ios/checklist/

Smartphone OS Sales Share (%)

http://techcrunch.com/2013/09/30/kantar-with-android-and-even-windows-phone-inching-up-in-smartphone-sales-get-set-for-an-iphone-spike/

Approach flexibility (cont’d) � Establish a test automation strategy

�  Continuous integration for automatic build verification.

�  Portable test scripts that can be run across platforms

�  Verify UI rendering across devices / platforms �  Performance profiling (CPU, Memory, Network)

�  Integrate with existing test management tools to simplify reporting

Approach flexibility (cont’d) �  Customer Experience (CX):

�  Does it perform? � SVP Testing � Performance Profiling

�  Can they use it?

� Eye Tracking � Accessibility

�  Are they engaged? � NPS

MALT �  Mobile Application Lifecycle Testing (MALT)

�  Integrates with Continuous Integration and can be adapted to work with most standard test management tools.

�  Portable test scripts can be run across platforms.

�  Supports capture of per device rendering.

�  Supports performance profiling.

Ben Symons ben.symons@accesstesting.com