Lighting Talk - Performance Metrics for Quality - Measures of Quality

Post on 03-Aug-2015

63 views 1 download

Tags:

Transcript of Lighting Talk - Performance Metrics for Quality - Measures of Quality

© 2015 SOASTA. All rights reserved.CONFIDENTIAL – Not for Distribution

The Measures of Quality

Brad JohnsonSOASTA @bradjohnsonsv

How do do non-tech people define quality?

CutColorClarityCarat

Award winning quality

EconomyService callsReliability

Award winning quality

HorsepowerTop SpeedHandling

Most company metrics tie to BUSINESS

Icon by jcabezas / CC BY

FINANCE

ProfitabilityROI

MarginAsset allocation

SALES

MeetingsDemos

DealsQuota

Tommy Boy

What makes IT so special?

OPS

AvailabilityThroughputAverage response timeSynthetic transactions

DEV

Lines of codeVelocityDefect

reductionCode coverage

TEST

Defect countTests executedTest coverageVelocity

Functionality

LoadVuln

era

bili

tyIntegration

95

th P

erc

en

tile

Iteration

Explo

rato

ry

para

mate

riza

tion

Test

-Dri

ven

Bla

ck B

ox

BuildB

ran

ch

Coverage

Unit

Saturation

Cyclomatic Complexitysecurity

correlation acc

ep

tan

ce

waterfall

agile

Our Jargon Cloud

Functionality

LoadVu

lnera

bili

ty

Integration

95

th P

erc

enti

le

Iteration Explo

rato

ry

para

mate

riza

tion

Test

-Dri

ven

Bla

ck B

ox

Build

Bra

nch

Coverage

Unit

Saturation

Cyclomatic Complexity

security

correlation

acc

epta

nce

waterfall

agile

Is meaningless to end users

And everyone in other business units

Biz users are pretty binary (trinary?)

500%Productivity Increase

50%Operational cost

reduction

25%Faster time to market

$20MSaved with

100ms

Find your metrics

Then adjust

Then SHARE!

Monitor * Measure * Optimize

Brad Johnson@bradjohnsonsv