Catching a high speed trainEnd-2-End testing at FYRA

Manchester, November 2011Nathalie Rooseboom de Vries van Delft

2

Who am I?

Nathalie Rooseboom de Vries van Delft

FunTESTic

Testing Fanatic at Capgemini since 2004

Married, no kids, casualty simulation victim and film enthusiast, like metal music

Agenda

• What is Fyra?• The assignment• How hard can it be?• Theory, learned stuff, processes and pragmatics• One of the testcases• The hard stuff, tips & tricks and learned’s• The real deal• The PornTrain, the White swan, sliding momentum and

proving the media wrong• Questions and Closure

3

What’s is FYRA?

4

CODENAME: ALBATROS

The assignment

• Perform the End-2-End tests for the FYRA vending, control and financial systems

• Perform acceptance tests for any component that is build or developed within the same landscape

• Planned go live: December 2007

5

6

HOW HARD CAN IT BE??

How hard it can be …

7

Theory, learned stuff, processes and pragmatics

8“The more I got to the execution, the more I relied on pragmatics”

One of the testcases

9

S. Hady buys a home-print ticket from Alkmaar to Dordrecht, second class, with the part Amsterdam-Rotterdam via Fyra. To be sure he has a seat, he makes an

additional reservation. {customer has print, product is in PCS, correctness of product}

During his travel he is validated on the Fyra{Railpocket/valid validation}

When arriving in Rotterdam, he goes to the desk and wants to return his ticket, nothing better than a free ride!

{This is not possible, message ‘ticket validated’}Finally the product is traceable in the financial reporting (and MIS)}

The hard stuff, tips & tricks and learned’s

• The hard stuff

– Politics, – Hidden agenda’s, – Changing environments and components, – Changing policies (regulation) and ‘saboteurs’– Dealing with planning

10

The hard stuff, tips & tricks and learned’s

• Tips and Tricks– Be visible, – Organise a team fun event in advance (in stead of celebrating

afterwards), – Communicate & communicate!!, – Organise a kick-off with all stakeholders and share information,

intentions and expectancies– Use checklists – TOPping – SpeakUp!– NoTest Situation

11

The hard stuff, tips & tricks and learned’s

• Learned’s

– Start with a generic strategy and plan, communicate this extensively, keep repeating the message

– If possible try to set up a seperate, exclusive use E2E environment if not; have a really good release calendar in place and very strict usage-rules

– Commitment of people is essential. It helps to work on those relationships

12

The hard stuff, tips & tricks and learned’s

• Learned’s

– The more time on the way in the project, the more you rely on pragmatics in stead of processes and procedures, methods and techniques, although they can still help a bit

– The perception of E2E testing is that of ‘it has to be right, there shouldn’t be any defects or issues at all’ , some people don’t get the idea of ‘testing’ and get in a state of panic when there’s an issue found.

13

The hard stuff, tips & tricks and learned’s

• Learned’s

– As tester in an End2End test, you probably are one of the few people who know exactly how the whole organisation works, if you don’t want the attention share your knowledge!

– Don’t get lured into the politics that are involved, keep true to your reporting values and don’t colour the world more beautiful than it is.

14

The real deal

15

Closed User Group

Using camera’s for usability purposes

FYRA try-out days

Also marketing, information and communicationparticipated as well as cateringservices

The Porn Train

16

Hilarious mix up when sending an invitation for the tests of the train

The White Swan

17

When nature calls…

Sliding Momentum

18

Tilting till spilling

Proving the media wrong

19

High speed train almost causes a collission…

Questions

20

21

More information

Please contact:

• Nathalie Rooseboom de Vries van Delft funtestic.fanatic@gmail.com

• Twitter: FunTESTic

• Blog: funtestic.blogspot.com