Better

Evolution not Revolution – Transforming your TestingJulie GardinerEmail: Julie@testingrainmaker.comTwitter: @cheekytester

1© Julie Gardiner

1.1 Evolution

© Julie Gardiner

1.2 Evolution = change

© Julie Gardiner

1.3 Let’s go on a journey

© Julie Gardiner

More to come…

Digital Evolution

1.4 Journey of Technology

© Julie Gardiner

1.5 Story - Automation…

Transformation step…

© Julie Gardiner

Year 1- Initiative started by testersStarted with a team of 2 (increased to 4)Automation framework established Scripts created

Year 4 - Questions started to be asked?Is it really adding value?“seems to be taking too long”“can you look into it?”

DataTime Invested 2 x 4 years + 2 x 2 yearsTotal 12 years of effortNumber of regression tests created?% of time needed to maintain each script?

Questions for you• Is your automation

really adding value?• Where is your

automation in terms of maturity?

• Will it address technology challenges ?

Sometimes you have to take a step back

before you can take a step forward

1.6 Transforming test execution tools

Transformation step…

© Julie Gardiner

Capture screen

Linear

Data driven

Keyword driven

Visual AutomationML and AI

Structured approach

1.7 Evolution of our toolset

Enforcers of Quality

Old role

Enablers of Quality

New role

1.8 Evolution of our role

© Julie Gardiner

1.9 Evolution of our purpose

Dan Ashby

1.10 The skills of QA

Business Technical

Usability / Accessibility

Quality AssuranceUAT advisors -

BPMBetter

requirementsProcess

ImprovementLeadership

Assessments

Business Facing Technical

Collaboration tools e.g. BDD

Exploratory testingMBT

Visual testing AI Domain

modelling

Test DesignTest Tool Knowledge / usage

Domain knowledgeSoft Skills e.g. EI, Communication,

InfluencingFundamentals of practices

e.g. Git / CI / CD, AutomationAgile, Cloud, DB, Mobile, IoT

Env Management, SV

set up, TDM Engineer

Dev in TestAutomation FrameworksAPI testing

AI/ML Data Scientists

RPASecurity

PerformanceEmerging Tech

Business Ninjas

Functional Core Techie Uber Techie

Fundamentals

Trusted Advisor ImplementerConscience Trainer/Coach GuidanceGuru Quality Rep

1.11 The role of QA

© Julie Gardiner

Emotional Intelligence

1.12 Transform how we communicate and get ready for change Communication style analysis

Things to note• there is no right or wrong answer• try not to think too much• Understand ourselves and others• Two parts

• answer questionnaire • plot the values on the graph

© Julie Gardiner

1.13 The questionnaire - how to complete (x axis)

Formal Retiring Business Like Guarded Organised Introvert Logical Focused Cool Insensitive

x

Friendly Approachable Casual Open Unstructured Social Intuitive Random Warm Perceptive

X - Axisx

x

xx xx

x

x

x

6

x

x

© Julie Gardiner

1.14 The questionnaire - how to complete (y axis)

To the point Challenging Quick Insistent Lively Impatient Adventurous Confronting Competitive Strong Minded

Indirect Accepting Leisurely Thoughtful Relaxed Patient Cautious Receptive Co-operative Analytical

Y - Axis

x

x

xx

x

x

x

15

xx

x

x

2© Julie Gardiner

Plot your score on the grid

X (6,2)

16

0 1

5

6 7 8 9 102 3 4

X-axis

y-axis

0

1

6

7

8

9

10

2

3

4

1.15

© Julie Gardiner

1.16 The Model

The Pragmatist

The Pioneer

The Analyst

The Facilitator

© Julie Gardiner

Questions:• What’s your style?• What about your team?• What’s your Manager’s

style?• How will you approach

change to transform what you do?

How this has evolved

1.17 Evolution of process/value of testing

• Formation of a Test Strategy/ Charter

• Test team Attitudes• Tools introduced• Metrics being captured such

as DDP, Test environment downtime

• Product risk assessment introduced

• Results became more visible

• Talked the Business Language

• First release to go live with no bugs being reported after the first month of live operation

Question for you…

What information are you providing? Why?

• CIO didn’t appreciate the value of testing

• Test Manager asked for help

Business wanted more and trusted the Test Manager more

© Julie Gardiner

ExecutiveProductTeam

OpenClose

d

Risks

Open

OpenClose

dClose

d

Open

Obj

ectiv

e

Obj

ectiv

e

Obj

ectiv

e

Obj

ectiv

e

Bene

fit

Bene

fit

Bene

fit

Bene

fit

Bene

fit

Benefits available for release

Obj

ectiv

e

Bene

fit

Closed

0 100Morale

Revenue by release v cost

Cost savings to date

Summary

Top 5 risks and issues

1.18 Dashboards from Team to Company

© Julie Gardiner

Progress through the test plan

today end date

residual risks of releasing TODAYR

esid

ual R

isks

start

all risks ‘open’ at the

start

Source: Risk Based E-Business Paul Gerard and Neil Thompson

1.19 My secret weapon…Product Risk Reporting

1.20 Change is happening

Are you ready?

1.21

RBCSYou