How To Talk About Coverage

Matt Heusser

2016 Edition

What are estimates for?Car Insurance Calculator - Story #1

Story #1 introduces a single input and a single output - Age and Monthly Fee.

This is the fee schedule:

Age 0-15: No Insurance

Age 16-20: $800/Month

Age 21-30: $600/Month

Age 31-40: $500/Month

Age 41-50: $400/Month

Age 51-70: $500/Month

Age 71-90: $700/Month


Story 2: Add a type of Insurance Dropdown

Comprehensive /w No Deductible 3x Cost

Comprehensive /w deductible 2x Cost

Minimal Coverage 1x Cost


Story 3: Add a Vehicle Value Dropdown

< 2,000€ +10%

2000-10000€ -10%

10000-20000€ no change

20001-70000€ +10%

70001-90000€ no change

90000-200000€ +20%

200000+€ +100%


Story 4: Driving Record Dropdown

No tickets past 10 years -20%

No tickets past 5 years -10%

No tickets 4-2 years no change

Tickets within 2 years +10%


Story #5: Years with No Accident Discount

No accidents past 10 years -20%

No accidents past 5 years -10%

No accidents 4-2 years no change

Accident within 2 years -10%

What are estimates for?Coverage … of what?

Features?

Requirements?

Test ideas?

Emergent Risks?

Lines of code?

Branches?

(Code) Functions?

APIs?

Sessions?

“We’ve identified 100 (things) and have covered

the 35 most important” - What does that tell you?

What are estimates for?Don’t Forget - Other Test Ideas

What about:

* Platform - Chrome, FF, Safari, IE?

* Resizing browser?

* Memory Leaks?

* Mobile Devices?

* Flaky Wifi?

* Special characters? Null input? Security attacks?

What are estimates for?How are we going to find the bugs?

What are estimates for?Scripted Regression Testing

What are estimates for?Scripts - For Regression

What are estimates for?Don’t Forget - Other Test IdeasWhat are estimates for?Scripts - For Regression

What are estimates for?Preparing for a release


Source: Guide Your Development with Traceable Tests by Lisa Crispin

What are estimates for?Decision Trees

What are estimates for?Test Heat Map

What are estimates for?Combinations Map (Hexawise)

https://hexawise.com/users/197/plans/88688/edit

https://hexawise.com/users/197/plans/88688/edit

What are estimates for?Isolated Components

What are estimates for?Test KanBan

What are estimates for?Putting it together

Start with visuals

Agree on a model

Educate that the map is not the territory

Publish the model

Update it continuously

Consider results of prior regression runs

Timebox and ship!

Improve your process until the model is obsolete

… then get a new model!

Long-term: Release continuously. Track the highest

risks and test for them all the time. Sometimes in

production!

What are estimates for?Q&A on QA

Tomorrow

What is the bottom line here? Write down these things:

(A) Potentially Shippable Code each sprint

(B) Measure Failure demand. If it is high, it is the #1 thing to work on.

(C) Limit Failure Demand through three amigos and tools.

(C) Limit work in progress

I’ve been doing this with professional passion for years. Your problems may be different than this. If

that’s the case - you might want a different solution. Given that I don’t know you, I’ve given the

advice that I hope might be the most valuable for the most people.

Thank you, and God Bless you.

Tomorrow

How To Talk About Coverage

Software

Transcript of How To Talk About Coverage