www.experitest.com | contact@experitest.com 1 Copyright protected. All rights reserved. Experitest Ltd.

WHITEPAPER Enterprise Mobile Testing

Trends in Mobile Test Automation for Enterprises

Executive Summary

Mobile test automation in enterprises requires special standards that enable scalability, portability

across mobile devices, etc. In this post we will cover some of the recent trends we see in enterprises

that are gearing up their mobile test automation, such as:

One test that can run on various language versions of the same application

End-to-end mobile testing from the application build process to the test execution results (i.e.

continuous integration)

Testing the most recent devices that have just come out on the market

Full coverage of mobile testing, including exploratory manual testing that complements the

automation testing and reports the test results to a common repository

Background

Every year brings new challenges to the fast-moving world of mobile application testing. Enterprises realize that

their mobile application testing tools need to be suited to large-scale systems.

Recent trends that reflect this need are: One test that can run on various language versions of the same

application; end-to-end mobile testing from the application build process to the test execution results (i.e.

continuous integration); testing the most recent devices that have just come out on the market and full

coverage of mobile testing, including exploratory manual testing that complements the automation testing and

reports the test results to a common repository. We will take a look at each of these trends below.

One test that can run on various language versions of the same application

One only needs to look at large enterprises such as SAP to see that the need for a multi-language solution is an

absolute requirement. If you have an application that you want to market to people from different countries

who speak different languages, you need a testing tool that uses one test and covers all the languages.

In other words, the test automation tool should have a script that can run the test against different language

variations using a dynamic translator. So, for example, if the test is created in English, it uses a translator that

would provide the equivalent word in other languages (so “yes” would be dynamically replaced with “Oui” for

French, “Si” for Spanish etc., without any need to change the test script itself).

www.experitest.com | contact@experitest.com 2 Copyright protected. All rights reserved. Experitest Ltd.

Requirement: Mobile Testing Devices that run the same test in multiple languages dynamically. SeeTest

provides such a service with the ability to run a test in a number of languages.

End-to-end mobile testing from the application build process to the test execution results (i.e.

continuous integration)

Enterprises are releasing mobile applications and new versions on a frequent – often monthly- basis. As a result

they require a quick and efficient end-to-end build-test-release process that can constantly feed the test results

into the R&D for approval for release to the market. This mandates an end-to-end automated solution, or in

other words – Continuous integration (i.e. the tool needs to be integrated with software tools such as Jenkins,

QC and TFS).

Requirement: Quality testing throughout the mobile application creation process, including build, launch,

install and uninstall application stages – all should be automatically done by the test tool without any human

intervention. SeeTest provides continuous integration with Jenkins, QC and TFS.

Testing the most recent devices that have just come out on the market

Enterprises need full coverage of the testing for all devices that are out in the market, including the latest

versions of the mobile OS and new mobile OS that are launched to the market.

The latest versions of the mobile OS: Some mobile OS – such as iOS – have mandatory updates of the software

version and the newer version usually mandates 80% of the market within a matter of few weeks of its release.

The mobile OS launched to the market: At the time of writing, an excellent example would be a tool that can test

the Windows Phone 8 which is an up-and-coming mobile OS released by Microsoft which is gaining and

increasing market share.

Requirement: The mobile test automation tool must support the latest mobile OS versions (such as iOS6 and

soon iOS7) as well as new mobile OS (such as WP8). SeeTest supports the latest devices such as WP8.

Full coverage by complementing test automation with exploratory manual testing

Automation testing tools are not always sufficient or don't justify the ROI (return on investment) for automation

- sometimes an exploratory manual testing tool is required too. Enterprises will be interested in using a set of

testing tools that provides both manual and automation testing capabilities and reports the result in a unified

way that can be communicated easily to the R&D for bug fixes.

Requirement: A complementary manual testing tool that enables complete coverage of the areas that could

not be automated and reports the results into one repository together with the automation results. SeeTest

offers a free exploratory manual testing tool that can be used together with the commercial automation tool to

produce unified results.