Mobile Application Testing - ANZTB · Mobile Application Lifecycle Testing (MALT) ! Integrates with...
Transcript of Mobile Application Testing - ANZTB · Mobile Application Lifecycle Testing (MALT) ! Integrates with...
![Page 1: Mobile Application Testing - ANZTB · Mobile Application Lifecycle Testing (MALT) ! Integrates with Continuous Integration and can be adapted to work with most standard test management](https://reader034.fdocuments.us/reader034/viewer/2022050408/5f84ef262db51227fe4b7731/html5/thumbnails/1.jpg)
Mobile Application Testing Ben Symons ANZTB - SIGiST – Adelaide 30th October 2013
![Page 2: Mobile Application Testing - ANZTB · Mobile Application Lifecycle Testing (MALT) ! Integrates with Continuous Integration and can be adapted to work with most standard test management](https://reader034.fdocuments.us/reader034/viewer/2022050408/5f84ef262db51227fe4b7731/html5/thumbnails/2.jpg)
Who am I?
� Principal Consultant at Access Testing
� Almost 20 years working in IT with over 10 years focused on Testing
� Worked across organisations ranging from tiny start-ups to some of the largest global enterprises
� In my spare time I’m kept busy with kids, pets, studying and maintaining a ~100 year old cottage
Ben Symons http://au.linkedin.com/in/bensymons/
![Page 3: Mobile Application Testing - ANZTB · Mobile Application Lifecycle Testing (MALT) ! Integrates with Continuous Integration and can be adapted to work with most standard test management](https://reader034.fdocuments.us/reader034/viewer/2022050408/5f84ef262db51227fe4b7731/html5/thumbnails/3.jpg)
Mobile Application Testing
� Challenges
� Services in the market
� Flexible Approach
� Automation Framework Demo
![Page 4: Mobile Application Testing - ANZTB · Mobile Application Lifecycle Testing (MALT) ! Integrates with Continuous Integration and can be adapted to work with most standard test management](https://reader034.fdocuments.us/reader034/viewer/2022050408/5f84ef262db51227fe4b7731/html5/thumbnails/4.jpg)
Challenges of Mobile Testing � Short development cycles / constant change
� Proliferation of devices, form factors and versions
Android screen sizes and densities
Valid at 2nd October 2013 http://developer.android.com/about/dashboards/
![Page 5: Mobile Application Testing - ANZTB · Mobile Application Lifecycle Testing (MALT) ! Integrates with Continuous Integration and can be adapted to work with most standard test management](https://reader034.fdocuments.us/reader034/viewer/2022050408/5f84ef262db51227fe4b7731/html5/thumbnails/5.jpg)
Challenges (cont’d) � Ensuring consistent and engaging customer
experience (CX)
� Differences in network, connectivity and bandwidth (2G/3G/4G/LTE/Wifi).
� Expectations based on other apps in the market
� Differences in device performance and capability
![Page 6: Mobile Application Testing - ANZTB · Mobile Application Lifecycle Testing (MALT) ! Integrates with Continuous Integration and can be adapted to work with most standard test management](https://reader034.fdocuments.us/reader034/viewer/2022050408/5f84ef262db51227fe4b7731/html5/thumbnails/6.jpg)
Challenges (cont’d)
� Information access / security
� Device procurement and management
� Application through life support in a competitive market
![Page 7: Mobile Application Testing - ANZTB · Mobile Application Lifecycle Testing (MALT) ! Integrates with Continuous Integration and can be adapted to work with most standard test management](https://reader034.fdocuments.us/reader034/viewer/2022050408/5f84ef262db51227fe4b7731/html5/thumbnails/7.jpg)
Services in the market � Mobile Automation Tools
� HP QTP/UFT � Adobe Edge Inspect � Anteater, MonkeyTalk, Frank, KIF, TouchTest, UI
Automation, Zucchini, et al.
� Open Device Labs ( opendevicelab.com)
� Mobile device clouds � Perfecto Mobile, Gorilla Logic, et al.
![Page 8: Mobile Application Testing - ANZTB · Mobile Application Lifecycle Testing (MALT) ! Integrates with Continuous Integration and can be adapted to work with most standard test management](https://reader034.fdocuments.us/reader034/viewer/2022050408/5f84ef262db51227fe4b7731/html5/thumbnails/8.jpg)
Flexible Approach
� Establish a platform coverage strategy based on actual market usage and most importantly, review the usage regularly.
Android Fragmentation
iOS Fragmentation
Valid at 2nd October 2013 http://developer.android.com/about/dashboards
Valid at 3rd June 2013 https://developer.apple.com/devcenter/ios/checklist/
Smartphone OS Sales Share (%)
http://techcrunch.com/2013/09/30/kantar-with-android-and-even-windows-phone-inching-up-in-smartphone-sales-get-set-for-an-iphone-spike/
![Page 9: Mobile Application Testing - ANZTB · Mobile Application Lifecycle Testing (MALT) ! Integrates with Continuous Integration and can be adapted to work with most standard test management](https://reader034.fdocuments.us/reader034/viewer/2022050408/5f84ef262db51227fe4b7731/html5/thumbnails/9.jpg)
Approach flexibility (cont’d) � Establish a test automation strategy
� Continuous integration for automatic build verification.
� Portable test scripts that can be run across platforms
� Verify UI rendering across devices / platforms � Performance profiling (CPU, Memory, Network)
� Integrate with existing test management tools to simplify reporting
![Page 10: Mobile Application Testing - ANZTB · Mobile Application Lifecycle Testing (MALT) ! Integrates with Continuous Integration and can be adapted to work with most standard test management](https://reader034.fdocuments.us/reader034/viewer/2022050408/5f84ef262db51227fe4b7731/html5/thumbnails/10.jpg)
Approach flexibility (cont’d) � Customer Experience (CX):
� Does it perform? � SVP Testing � Performance Profiling
� Can they use it?
� Eye Tracking � Accessibility
� Are they engaged? � NPS
![Page 11: Mobile Application Testing - ANZTB · Mobile Application Lifecycle Testing (MALT) ! Integrates with Continuous Integration and can be adapted to work with most standard test management](https://reader034.fdocuments.us/reader034/viewer/2022050408/5f84ef262db51227fe4b7731/html5/thumbnails/11.jpg)
MALT � Mobile Application Lifecycle Testing (MALT)
� Integrates with Continuous Integration and can be adapted to work with most standard test management tools.
� Portable test scripts can be run across platforms.
� Supports capture of per device rendering.
� Supports performance profiling.
![Page 12: Mobile Application Testing - ANZTB · Mobile Application Lifecycle Testing (MALT) ! Integrates with Continuous Integration and can be adapted to work with most standard test management](https://reader034.fdocuments.us/reader034/viewer/2022050408/5f84ef262db51227fe4b7731/html5/thumbnails/12.jpg)
Ben Symons [email protected]