HBT Solution - Part 3 of 6

BETTER DEFINITION OF QUALITY

LEVELS AND TEST ADEQUACY

M C Nagaraj

Director – Customer Excellence

in.linkedin.com/in/mcnagaraj

Copyright STAG Software Private Limited, 2009 2

Six-stage evaluation model (S1-S6)

Hypothesis Based Testing (HBT)A goal focused methodology to validation

Understand

EXPECTATIONS

Understand

CONTEXT

Formulate

HYPOTHESISDevise

PROOF

Tooling

SUPPORT

Assess &

ANALYZE

S1

S2

S3S3

S5

S6

HBT

The central theme of HBT is

“hypothesize potential defects that

can cause loss of expectations

and

prove that they will not exist”

The focus is on the goal and

how we shall achieve it

rather than the various activities

“goal-centric vs. activity-based”

Copyright STAG Software Private Limited, 2009 3

HBT and STEM

Understand

EXPECTATIONS

Understand

CONTEXT

Formulate

HYPOTHESISDevise

PROOF

Tooling

SUPPORT

Assess &

ANALYZE

S1

S2

S3S3

S5

S6

D1

D2

D3

D4D5D6

D7STEM

D8

STEM

HBT

“method”

“methodology”

GOAL

a particular way of doing something

‘defect detection technology

from STAG’

a system of ways of doing

‘goal centered scientific

approach to validation’

‘deliver clean software

quickly & cost-effectively’

“outcome”

• Key focus in each stage

• Empowered by scientific approach using eight disciplines (D1 to D8) of STEM

• 32 core concepts address factors like effectiveness, consistency, scalability, efficiency, visibility and agility of test methodology

• The outcome of each stage are well defined

HBT - six stages effectiveness guaranteed

Copyright 2011. STAG Software Pvt Ltd. All rights reserved. 4

Key focus: Staged quality, Test assets organization, STEM discipline D3 (Test strategy and planning)

Problems addressed:

• Defects are uncovered late in life cycle delaying the release and impacting revenue plan

• Specialization in specific types of test for an individual will help but focus is missing

• Poor estimation resulted in cost over run in many projects

• Test execution taking more time and money but unable to show ROI (Return on investment)

HBT Stage 4 (Devise Proof) - Part 1


Key focus: Test design techniques, Test case architecture, STEM discipline D4 (Test design)

Problems addressed:• Test design is evolving and test cases are added continuously till the end

of project resulting in re-planning many times

• Test design phase taking significant time

• Defect escapes are traced to poor design quality

• Unable to demonstrate adequacy of test assets

• There is a feeling that tests are more conformance oriented (+ve only not robust)

• Test cases attributes captured not helping in prioritizing during execution and selection for automation focus

HBT Stage 4 (Devise Proof) – Part 2


Using D3 (Strategy & Planning) and D4 (Test design), we were able to address problems stated in previous slides

• Each of the above discipline has well defined steps

• Key deliverables: Test strategy, Test plan, Test scenarios/cases, Fault traceability matrix, Requirement traceability matrix

• STEM core concepts: Orthogonality principle, Tooling needs assessment, WBS, Quality growth principle, Techniques landscape, Process landscape, Cycle scoping, Reduction principle, Input granularity principle, Box model, Behavior stimuli approach, Complexity assessment, Operational profiling, Test coverage evaluation

Summary


Copyright STAG Software Pvt. Ltd., 2011

Thank You

M C Nagaraj

in.linkedin.com/in/mcnagaraj

@mcnagaraj

HBT Solution - Part 3 of 6

Technology

Transcript of HBT Solution - Part 3 of 6