Lighting Talk - Performance Metrics for Quality - Measures of Quality

24
© 2015 SOASTA. All rights reserved. CONFIDENTIAL – Not for Distribution The Measure s of Quality Brad Johnson SOASTA @bradjohnsonsv

Transcript of Lighting Talk - Performance Metrics for Quality - Measures of Quality

Page 1: Lighting Talk - Performance Metrics for Quality - Measures of Quality

© 2015 SOASTA. All rights reserved.CONFIDENTIAL – Not for Distribution

The Measures of Quality

Brad JohnsonSOASTA @bradjohnsonsv

Page 2: Lighting Talk - Performance Metrics for Quality - Measures of Quality

How do do non-tech people define quality?

CutColorClarityCarat

Page 3: Lighting Talk - Performance Metrics for Quality - Measures of Quality

Award winning quality

EconomyService callsReliability

Page 4: Lighting Talk - Performance Metrics for Quality - Measures of Quality

Award winning quality

HorsepowerTop SpeedHandling

Page 5: Lighting Talk - Performance Metrics for Quality - Measures of Quality

Most company metrics tie to BUSINESS

Icon by jcabezas / CC BY

Page 6: Lighting Talk - Performance Metrics for Quality - Measures of Quality

FINANCE

ProfitabilityROI

MarginAsset allocation

Page 7: Lighting Talk - Performance Metrics for Quality - Measures of Quality

SALES

MeetingsDemos

DealsQuota

Tommy Boy

Page 8: Lighting Talk - Performance Metrics for Quality - Measures of Quality

What makes IT so special?

Page 9: Lighting Talk - Performance Metrics for Quality - Measures of Quality

OPS

AvailabilityThroughputAverage response timeSynthetic transactions

Page 10: Lighting Talk - Performance Metrics for Quality - Measures of Quality

DEV

Lines of codeVelocityDefect

reductionCode coverage

Page 11: Lighting Talk - Performance Metrics for Quality - Measures of Quality

TEST

Defect countTests executedTest coverageVelocity

Page 12: Lighting Talk - Performance Metrics for Quality - Measures of Quality

Functionality

LoadVuln

era

bili

tyIntegration

95

th P

erc

en

tile

Iteration

Explo

rato

ry

para

mate

riza

tion

Test

-Dri

ven

Bla

ck B

ox

BuildB

ran

ch

Coverage

Unit

Saturation

Cyclomatic Complexitysecurity

correlation acc

ep

tan

ce

waterfall

agile

Our Jargon Cloud

Page 13: Lighting Talk - Performance Metrics for Quality - Measures of Quality

Functionality

LoadVu

lnera

bili

ty

Integration

95

th P

erc

enti

le

Iteration Explo

rato

ry

para

mate

riza

tion

Test

-Dri

ven

Bla

ck B

ox

Build

Bra

nch

Coverage

Unit

Saturation

Cyclomatic Complexity

security

correlation

acc

epta

nce

waterfall

agile

Is meaningless to end users

Page 14: Lighting Talk - Performance Metrics for Quality - Measures of Quality

And everyone in other business units

Page 15: Lighting Talk - Performance Metrics for Quality - Measures of Quality

Biz users are pretty binary (trinary?)

Page 17: Lighting Talk - Performance Metrics for Quality - Measures of Quality

500%Productivity Increase

Page 18: Lighting Talk - Performance Metrics for Quality - Measures of Quality

50%Operational cost

reduction

Page 19: Lighting Talk - Performance Metrics for Quality - Measures of Quality

25%Faster time to market

Page 20: Lighting Talk - Performance Metrics for Quality - Measures of Quality

$20MSaved with

100ms

Page 21: Lighting Talk - Performance Metrics for Quality - Measures of Quality

Find your metrics

Page 22: Lighting Talk - Performance Metrics for Quality - Measures of Quality

Then adjust

Page 23: Lighting Talk - Performance Metrics for Quality - Measures of Quality

Then SHARE!

Page 24: Lighting Talk - Performance Metrics for Quality - Measures of Quality

Monitor * Measure * Optimize

Brad Johnson@bradjohnsonsv