Fractal test planning

46
@gil_zilberfeld @gil_zilberfeld Fractal test planning

Transcript of Fractal test planning

@gil_zilberfeld@gil_zilberfeld

Fractal test planning

@gil_zilberfeld

@gil_zilberfeld

Hello!

I AM GIL ZILBERFELD

www.gilzilberfeld.com

www.everydayunittesting.com

@gil_zilberfeld

@gil_zilberfeld

@gil_zilberfeld

@gil_zilberfeld

@gil_zilberfeld

Different perspectives

◉ Product life cycle

◉ Development life cycle

◉ Risk and value

◉ Quality status

◉ And many more…

@gil_zilberfeld@gil_zilberfeld

Kent Beck’s 3X

@gil_zilberfeld

@gil_zilberfeld

Original post: https://www.facebook.com/notes/kent-beck/comparing-explore-expand-and-

extract-topics-in-3x/1241983035834558

Image: https://ideas.riverglide.com/3x-explore-expand-extract-b9aad6402a5a

@gil_zilberfeld

Explore

◉ Idea validation

◉ Success is unpredictable

◉ Reduce cost of experimentation

◉ Bet on many small experiments

@gil_zilberfeld

Expand

◉ Success!

◉ Focus on more

◉ Faster and better

◉ Remove blockers as we find them

@gil_zilberfeld

Extract

◉ Milking it

◉ We know how to do it

◉ Reduce cost and risk

◉ Don’t break what works

@gil_zilberfeld

@gil_zilberfeld

Exercise: Testing role in each phase

◉ Purpose

◉ Value

◉ Risk management

@gil_zilberfeld

Exercise: Testing in each phase

◉ What does it look like?

◉ What are the guiding principles?

◉ What can affect our plans?

@gil_zilberfeld

@gil_zilberfeld

Explore

◉ MVPs as tests

◉ Minimal stability

◉ Short releases

◉ “Good enough”

@gil_zilberfeld

Expand

◉ Don’t break what’s working

◉ More with less

◉ Learn how to improve

◉ Automated regression

◉ Incremental testing of new features

◉ Exploratory testing

@gil_zilberfeld

Extract

◉ “Don’t break anything”

◉ Automate in order to free testers for other

products

◉ Optimize processes

◉ Monitoring

@gil_zilberfeld@gil_zilberfeld

Parameters to consider

@gil_zilberfeld

@gil_zilberfeld

Existing automation coverage

Exploration vs automation

Feedback from customers

Feedback speed

Reporting depth

Testing depth

Product knowledge

You can also split your content

Product testing skills

Budget for tools, training, VMs

Technical debt

Ability to ship

Ability to measure

Ability to respond

Risks mitigation

Parameters like…

@gil_zilberfeld

@gil_zilberfeld

Testicorn – A killer app

The ghost of the

testing unicorn

that terrorizes the

city of Tallinn

@gil_zilberfeld

Testicorn App

◉ Augmented reality game where you control a

killer pony around the city

◉ Map shows where the targets are

◉ You can kill or spare the targets

◉ Killing more targets raises your Horror level but

they can escape more easily

@gil_zilberfeld

Testicorn App

◉ Sparing more targets raises your Honor level but

you become more vulnerable to attacks

◉ Single player campaigns and PvP leaderboards

◉ The goal is to survive longer, get better scores

and win cool loot

@gil_zilberfeld

Testicorn App

◉ The real goal is to make money from whales by

offering trophies, boosts, etc.

◉ Get as many users as we can

◉ Onboarding should be easy

◉ Retention of users is crucial

@gil_zilberfeld

@gil_zilberfeld

Exercise: Parameters in each X level

What are our…

Problems

Constraints

What we…

Think

Know

What is our…

Output

Strategy

For example…

Examples

@gil_zilberfeld

Existing automation coverage

Exploration vs automation

Feedback from customers

Feedback speed

Reporting depth

Testing depth

Product knowledge

You can also split your content

Product testing skills

Budget for tools, training, VMs

Technical debt

Ability to ship

Ability to measure

Ability to respond

Risks mitigation

Parameters like…

@gil_zilberfeld

@gil_zilberfeld

@gil_zilberfeld

Zooming in

@gil_zilberfeld

Regression suite coverage

Stability

Predictability

Accessible knowledge

Systems integration

You can also split your content

Known behaviors

New users and flows

Incremental development

Holistic perspective

Future vision

Parameters like…

@gil_zilberfeld

Exercise: Parameters in each zoom level

What are our…

Problems

Constraints

What we…

Think

Know

What is our…

Output

Strategy

Where are we…

3X Stage

For example…

Examples

@gil_zilberfeld

Regression suite coverage

Stability

Predictability

Accessible knowledge

Systems integration

You can also split your content

Known behaviors

New users and flows

Incremental development

Holistic perspective

Future vision

Parameters like…

@gil_zilberfeld

@gil_zilberfeld@gil_zilberfeld

Development lifecycle phases

@gil_zilberfeld

@gil_zilberfeld

Phases in the development cycle

◉ “Regular” sprints

◉ Hardening and stabilization

◉ Testing

◉ Releasing

◉ Post-release

@gil_zilberfeld

Exercise: Parameters in each development stage

What are our…

Problems

Constraints

What we…

Think

Know

What is our…

Output

Strategy

Where are we…

3X Stage

Zoom level

For example…

Examples

@gil_zilberfeld

Phases in the development cycle

◉ “Regular” sprints

◉ Hardening and stabilization

◉ Testing

◉ Releasing

◉ Post-release

@gil_zilberfeld

@gil_zilberfeld

Summary

◉ Test planning is complex

◉ Different contexts affect our approach

◉ Perspectives can overlap or scale

◉ Need to confirm our assumption and use

capabilities effectively

@gil_zilberfeld

Thanks!

ANY QUESTIONS?

You can find me at:

@gil_zilberfeld

http://www.GilZilberfeld.com

http://www.EverydayUnitTesting.com