Test Automation in the Cloud

Next Generation Testing: Innovations and Challenges (18th May 2011)

Who are we?

TaaaS.net

Three decades in Automation

Automation is a Silver Bullet?

“The term has been adopted into a general metaphor, where „silver bullet‟ refers to any

straight forward solution perceived to have extreme effectiveness.

The phrase typically appears with an expectation that some new technology or practice

will easily cure a major prevailing problem.”

- Wikipedia

Automation is prone to failure?

Automation is expensive business?

“The cloud offers a low software maintenance cost, reusable test

components lower tester's hardware specifications and moves

away from expensive fixed-seat licensing.” Jonathon Wright

TaaaS

Manual‟mation is time consuming

“Implementing screen-scrapers and a universal

testing language within the cloud promotes more

maintainable and portable solutions.” David Fox

Who wants to do Automation?

@Dunnhumby 17th May 2011

Apprentice Marketing Graduates Ambassadors of Business Data

Testers are testers, not programmers

Developers are developers, not testers

“Many of the best testers are technically minded and can program but a testers

real skill is applying domain knowledge to generate insightful test cases and

avoid duplication. Put your players in their best positions.” - Gordon Marsh

CurrentReports

Frm

D0

CurrentReports

CompletedReports

Frm

R0

CompletedReports

Flex Reports Excel

F0 E0

MyGroupFrm

RecurringReports

Frm

S0

RecurringReports

MyGroups

G0

ModifyGroupFrmG1

OrderDetailsFrmR1

LoginFrmLoginChangePassword

FrmA0 A1 A2

MyShopHome

Frm

B0

EditProfileFrmB3

ShopHome

ShopLogin

CreateNewReport

CreateNewReport

Frm

C0

ReportType

FrmC1

ProductGroups

FrmC2

RunReport

FrmC7

TimePeriods

FrmC3

ProfileFrmC4

C8

C9

Geographies

FrmC5 C10

ReportSche

duleFrmC12

TermsConditions

Frm

D0

B1

B2

ShopperPan

elsFrmC6 C11

Index

- Executed

- Supported

- Out of Scope

Market

(i.e Tesco, Kroger or PAM)

WorkStream

(i.e UK, US or France)

Application

(i.e Shop or ShelfReview)

Language

(i.e en-GB or en-US)

520

7

867

615

0

122

0

603 487

588 789

67

139

32

97

Businesses should focus on business,

not be automation framework experts

A1

B1

Login.Process

Buy.Tickets

Check.Tickets

My.Account

Logout.Process

D1

C1

B2B4

C3B3C2

B5

D3C4 D2

D4 D5

C5Tesco (MCT) - Phase C

Number of Passed Steps:

Number of Warnings:

Number of Failed Steps:

Kroger (MCT) - Phase C

Number of Passed Steps:

Number of Warnings:

Number of Failed Steps:

Automation meets the Cloud

A match made in heaven?

No upfront investment

Pay as you use means cost management is easier

Don't invest heavily upfront in something that may FAIL

Instant scalability

Enabling realistic geo-performance testing

99.9% Availability (100% Web)

Easier Process Integration

Enabling 100% businesses focus

Automation should be a Global Marketplace

“For many small-to-medium sized

firms getting agent machines

installed globally for performance

test purposes is tricky /

impossible. A highly scalable

service to simply allow them to

select a target location would add

considerable value.”

The future of testing?

“As founder of remind365, I had no idea the

benefits that Testing in the Cloud could bring.

TaaaS opened my eyes to the importance of

performance and cross-browser testing”

– Darren Halford, Entrepreneur.

Possible Risks?

Data Security

Cloud provider

restricts freedom

Continuity & DR

Cloud provider

goes bust

Access/control