Android Automation Testing with Selendroid

Agenda

Testing? Mobile Testing Types & challenges Selenium

IDE RC Webdriver Grid Webdriver Demo

Selendroid Selendroid Architecture Selendroid standalone & server Selendroid Capabilities & Inspector Selendroid Demo

Testing

• A process of demonstrating that errors are not present ?

OR• A way of establishing confidence that a program

does what it is supposed to do ?OR

• A means of achieving an error-free program by finding all errors ?

A “DESTRUCTIVE”, yet creative process

TestingRequirements

Capture

Analysis

Test planning & Scenario

Design

Test Case Development

Test Execution

Test Result Analysis

Test Cycle Closure

Defect Fixing Cycle

Defects

New Version

The Scenarios Design and the Test Case Development could normally start in parallel with the Development Cycle.Test Execution Synchs up with the Development Cycle during the functional Testing Phases

Mobile Testing

Mobile Testing - Types UI testing Functional testing Interrupt testing

Internal interruptsExternal interrupts

Device specific testing Performance testing Security testing Compatibility testing Localization and i18n testing Automation testing Network testing Sound testing

Mobile Testing – Challenges Devices – The biggest Mobile Testing challenge

Diversity of the Mobile OSs and there flavors

Diversity in Hardware Configuration

Network related challenges

Competitive market

Change in market trend

Automation & Frameworks Why Automation? Frameworks –

Test Script Modularity• This can be achieved by creating small, independent scripts that

represent modules, sections, and functions of the application-under-test and later can be combined in a hierarchical fashion to construct larger tests.

Test Library Architecture• The test library architecture framework is very similar to the test

script modularity framework but it divides the AUT into procedures and functions or objects and methods instead of scripts.

Data-Driven Test Automation Framework• A data-driven framework is where test input and output values

are read from data files (ODBC sources, CVS files, Excel files, ADO objects, and such) and are loaded into variables in captured or manually coded scripts.

Automation & FrameworksKeyword-Driven Test Automation Framework This requires the development of data tables and

keywords, independent of the test automation tool used to execute them and the test script code that "drives" the AUT and the data.

Hybrid Test Automation FrameworkThe most commonly implemented

framework is a combination of all of the above techniques, pulling from their strengths and trying to mitigate their weaknesses.

The most successful automation frameworks generally accommodate both Keyword-Driven testing as well as Data-Driven scripts.

This allows data driven scripts to take advantage of the powerful libraries and utilities that usually accompany a keyword driven architecture.

The framework utilities can make the data driven scripts more compact and less prone to failure than they otherwise would have been.

Introduction To selenium What is selenium?

Selenium is a suite of tools to automate web browsers across many platforms.

Portable software testing framework for web apps. Test can be written in Java, C#, Groovy, Perl, PHP, Python and

Ruby. Tests can be executed on all modern browsers Platform Independent Open source software Latest release v2.44 (as on 23rd Oct 2014) Selenium extended to selendroid and ios-driver to automate mobile

applications

Selenium Components

1. Selenium IDE2. Selenium 1.0 – Remote Control3. Selenium 2.0 – WebDriver4. Selenium Grid

1. Selenium IDE

Helps you to develop Selenium test cases Easy to use firefox plug-in Supports record and playback Command , Target & Value Test Cases & test suites saved in “html” format Tests can be exported in other formats like java,

C# , php etc using formatters.

1. Selenium IDE – Test Case

Selenium IDE – Export Test Case

Java / Junit 4 / Webdriver tests

2. Remote Control

Selenium Remote Control (RC) is a test tool that allows you to write automated web application UI tests in any programming language against any HTTP website using any mainstream JavaScript-enabled browser.

Selenium RC comes in two parts.  A server which automatically launches and kills

browsers, and acts as a HTTP proxy for web requests from them.

Client libraries for your favorite computer language.

Selenium RC Architecture

3. WebDriver

Driving a browser natively as a user would either locally or on a remote machine using the Selenium Server

Selenium 1.0 + WebDriver = Selenium 2.0 WebDriver is designed in a simpler and more

concise programming interface along with addressing some limitations in the Selenium-RC API.

4. Selenium Grid

Selenium-Grid allows you run your tests on different machines against different browsers in parallel.

That is, running multiple tests at the same time against different machines running different browsers and operating systems.

Selenium-Grid support distributed test execution. It allows for running your tests in a distributed test execution environment.

4. Grid Architecture

Introduction To Selendroid Selendroid is a test automation framework which drives off the UI

of Android native and hybrid applications (apps) and the mobile web.

Tests are written using the Selenium 2 client API - that's it! Selendroid can be used on emulators and real devices and can be

integrated as a node into the Selenium Grid for scaling and parallel testing.

Features of Selendroid

Full compatibility with the JSON Wire Protocol/Selenium 3 Ready. No modification of app under test required in order to automate it Testing the mobile web using built in Android driver webview app Same concept for automating native or hybrid apps UI elements can be found by different locator types Gestures are supported: Advanced User Interactions API Selendroid can interact with multiple Android devices (emulators or

hardware devices) at the same time Existing Emulators are started automatically Full integration as a node into Selenium Grid for scaling and

parallel testing Multiple Android target API support (10 to 19) Built in Inspector to simplify test case development. Selendroid can be extended at runtime with your own extensions !

Getting Started with Selendroid System Requirements

Mac / Linux / Windows Java SDK (min 1.6)

Set JAVA_HOME

Latest Android-SDK http://developer.android.com/sdk/index.html Set ANDROID_HOME

Android Virtual Device or Android Hardware Device Selendroid standalone server

Selendroid Architecture

Major Components Selendroid-Client - the java client library (based on the selenium java client). Selendroid-Server - that is running beside your app on the Android device. AndroidDriver-App - a built in Android driver webview app to test the mobile web. Selendroid-Standalone - manages different Android devices by installing the selendroid-

server and the app under test.

Selendroid-Server

Selendroid-server is the main component responsible for the app automation.

The central driver class is DefaultSelendroidDriver. This class is responsible for doing the common activities (like taking screenshots) for both contexts NATIVE_APP and WEBVIEW

The web view related driver class is SelendroidWebDriver and native class is SelendroidNativeDriver.

Selendroid-Standalone

Central driver class is SelendroidStandaloneDriver that acts as a proxy between the selendroid-client and the selendroid-server

Starts an Android emulator, creates for the app under test a customized

selendroid-server and installs everything on the device. After the session

is initialized on the device, subsequent requests are directly forwarded to the

server on the device and the response routed back to the client.

Getting an AUT ready for automation Selendroid can be used to test already build apps.

(.apk) The .apk file must be existing on machine where

selendroid-standalone server will be stared. customized selendroid-server for the app under

test (AUT) will be created Both apps (selendroid-server and AUT) must be

signed with the same certificate in order to install the apks on the device

Launching Selendroid Java –jar <<selendroidstandalone.jar>> –app <<myApp.apk>>

java

-jar selendroid-standalone-0.12.0-with-dependencies.jar

-app selendroid-test-app-0.12.0.apk Selendroid-standalone will start a http server on port 4444 It will scan all AVDs that the user has created. The Android target version and the screen size will be identified. If an emulator is running, it can be used If there are Android hardware devices plugged in, they will also

be added to the device store. Check application status on :

http://localhost:4444/wd/hub/status.

First Tests

In order to create a new test session in the desired capabilities, the appId of the app under test must be provided in the format: io.selendroid.testapp:0.12.0.

Based on that information a matching Android device will be identified, otherwise the test session will throw an error and not start

After the found device has been initialized, a customized selendroid-server will be created and automatically installed on the device.

The app under test will also be installed and the selendroid-server on the device will then be automatically started.

After the test session has been successfully initialized, the test commands such as 'find an element' and 'element interactions' are routed to this device. If the test session has ended, the emulator will stop automatically

Desired Capabilities (SelendroidCapabilities) Mandatory properties new SelendroidCapabilities( ... ):

This requests an app for the test session without any preference about emulator or hardware device.

SelendroidCapabilities.emulator( ... ): This requests an emulator and will fail the test session if

no emulator is available. SelendroidCapabilities.device( ... )

This requests a hardware device and will fail the test session if no device is plugged in.

SelendroidCapabilities.android( ... ) This starts a mobile web testing session.

Desired Capabilities (SelendroidCapabilities) For testing native or hybrid apps:

aut Specify the app id of the app under test (aut). E.g.

io.selendroid.testapp:0.12.0 For testing Mobile Web:

browserName Value must be android to start the 'Android driver

webview app'.

Desired Capabilities (SelendroidCapabilities)Optional Properties emulator

If True, an emulator will be requested. If False, a hardware device will be requested.

platformVersion Specify the Android target API version of the device.

E.g. for KitKat it is: 19 locale

Specify the locale of an emulator to be used in the test session. During the start the locale will be automatically configured. E.g. de_CH

Desired Capabilities (SelendroidCapabilities)Optional Properties screenSize

Specify the screen size of the device: e.g. 720x1280 display

Specify the display number that is used to start the emulator on. Supported only in Linux platforms. E.g. 1

preSessionAdbCommands Specify a list of adb commands that will be executed

on the target device before selendroid-server will be started. E.g. shell setprop name selendroid,

Selendroid Inspector

Selendroid Inspector

It helps to inspect current state of app’s UI. http://localhost:4444/inspector Features

View hierarchy View UI element properties UI screenshot with view locator Record the click actions Display the source html of a web view XPath helper

Thank You …

By Vikas Thange(Automation Testing consultant)vikasthange@gmail.com