022416 3 qi_short_overview_joanna_redesigned_v2 (1)

Confidential. Do not distribute.

INTRODUCTION


“NEARLY 1 MILLION NEW MALWARE THREATS RELEASED EVERY DAY.” “Sydney cash machine glitch gives customers

extra money”

THE COST OF QUALITY… OR LACK THEREOF…

CNN, APRIL 14, 2015BBC, MARCH 1,

2011‘UNACCEPTABLE’ COMPUTER FAILURE”“RBS FINED £56M OVER

BBC, NOVEMBER 20, 2014

“Hackers stole $1 billion in high-techbank heists, researchers say”CS MONITOR, FEBRUARY 17,

2015

“PROVIDENT BANK HITBY SOFTWARE GLITCH”

WOLD NEWS, MAY 6, 2015

“The Year 2010 Bug Strikes German Bank Cards”

TIME.COM, JANUARY 7, 2010

POPSCI.COM, SEPTEMBER 22, 2015

“VW: 11 MILLION DIESELS HAD CHEATING SOFTWARE, $7.3 BILLION SET ASIDE”

“Amazon sellers hit by nightmare beforeChristmas as glitch cuts prices to 1p”THE GUARDIAN, DECEMBER 14,

2014“DEUTSCHE BANK FINED £4.7 MILLIONOVER CODING ERRORS”

ITPRO.COM.UK, SEP 1, 2014

“AXA Rosenberg paying $242M BUSINESSWEEK, FEB 3,

2011“IS KNIGHT’S $440 MILLION GLITCH THE COSTLIEST COMPUTER BUG EVER?” CNN AUG 9, 2012“Bloomberg glitch causes chaos in finance sector”

COMPUTER WEEKLY, APR 17, 2015“APPLE PAY SEES PROBLEMS AS USERS GET

CHARGED TWICE” CNET, OCTOBER 22, 2014“ICICI Bank computer ‘bug’, cripples banking

operations”

to settle case on case”

BUSINESSTODAY.IN, MAY 14, 2015


AND IT CONTINUES TO INTENSIFY…

Supported Platforms

Software Velocity

Release Frequency

Cost of Defects

Increased Stress on Quality

There is More Feature/Functionality to Test on More Platforms, More Often and in a More

Compressed Timeframe


Plan Code Deploy

Continuous Delivery

Continuous Integration

Agile Developmen

t

OperateBuild Test Release

Devops & TESTING

DevOps


Plan Code Release

Continuous Delivery

DeployBuild Test Release

Devops & TESTING

DevOps


Test

Agile Developmen

t

Confidential. Do not distribute. Continuous Testing is essential to achieve Continuous Delivery

Devops & TESTING

Plan Code Deploy

Continuous Delivery


Agile Developmen

t

OperateBuild Release

DevOps

Testautomation


TEST AUTOMATION BENEFITS

Start @ the Start…Continue Throughout the SDLC

Maintenance

Planning

Acceptance

Test

Analysis

Design

Implement

Software Development

Life Cycle

Continuous Testing Early Detection

Consistent Results

Reusability• Releases• Environment

s• Platforms

Time Savings

Cost Savings


HELPING TEAMS ADOPT AUTOMATION… EFFECTIVELY...

# of validations & fails


AND OUR COMPREHENSIVE SERVICES OFFERINGS

Consulting

Operating

Offshore

Training

We provide consulting services that evaluate how you can best implement Awetest.

We offer full-scale QA services to your company.

We will train you in Awetest, as well as any testing tools and technologies that you wish to use.

Our offshore team provides comprehensive manual and automated QA services at a fraction of the cost.


BY SUPPORTING VARIOUS TYPES OF TESTS

Responsive

Mobile APIs Browsers

Data


Platforms Technologies 3rd Party Integrations

MAKING OPEN SOURCE AUTOMATION ENTERPRISE-READY


SIMPLE, SCALABLE ARCHITECTURE

TomcatRuby/Rails

MySQL

Redis

Shamisen Desktops + Physical Devices

Awetest Device Lab

Test Assets

Results, Logs

1

2 3

4

5

23

4


Defect Defect Rate & Distribution Analysis

Full Video Recording/Playback

WITH DETAILED, ACTIONABLE “INTELLIGENCE”

Detailed Click-by-Click Reporting w/ Screenshots


Application Team/Reference

CCER Mark Ellefson, Felix Lau

iHub Jay Mendicino

Global Wires Bryan Millmore

NX/WRIA Joan Redwing, Tom Johnson

Mobile Wallet Bipin Sahni, Nik Stroke

RELMS Monnie Mcmohan, Mike Rugh

IBM BPM Kelly Liston, Matt Bach

Profit View Maureen Davoren, Greg Cooper

Innovation Team (WMS APIs) Bipin Sahni, Nik Stroke

CEO Mobile Bryan Millmore, Julie Pua

3Qi Labs & AWETEST @ WELLS FARGO


CASE STUDY: MOBILE WALLET


MOBILE WALLET: TESTING REQUIREMENTS

Application Mobile Wallet/Payment Application

Dev. Process/Setup

Testing Requirements

Distributed (Onsite-Offshore) Development Team

Agile/Scrum Development Process

Multiple Handoffs w/ External & Internal Vendors & Partners

10+

Platforms (Device-SDK Combinations) To Be Tested

Functional Test Case/Scenarios400

+1,000+ scenarios

Integration with 8 External APIs

Man Week End-To-End Manual Test Cycle…Per Device-SDK Combination

1


TDD using Cucumber & Ruby

Data Driven Framework Using Excel & Ruby

Open Source Automation Libraries (Appium, Calabash & Watir-WebDriver)

REST & SOAP Scenarios Automated

MOBILE WALLET: 3Qi Labs IMPLEMENTATION

Awetest

On-Device Parallel Execution across iOS & Android Devices

Awetest Device Lab


RESULTS

over 75%

20x Increase In Coverage

Automated

Manual

In progress

of Functional Tests Automated

API/Web Services Scenarios Covered

1,000+Zero P0/P1 Defects across last 5 Releases

Automation Started in Advance of Dev. Release

Automation Reused across Multiple (Development, UAT, Pre-Prod, Production) Environments


AWETEST DEMO

022416 3 qi_short_overview_joanna_redesigned_v2 (1)

Education

Transcript of 022416 3 qi_short_overview_joanna_redesigned_v2 (1)