02 the Test Process (v2.4)

18
© SIM Group Ltd., SQS Group AG, 2002 ISEB Foundation Certificate in Software Testing The Test Process The Test Process

Transcript of 02 the Test Process (v2.4)

© SIM Group Ltd., SQS Group AG, 2002

ISEB Foundation Certificate in Software Testing

The Test ProcessThe Test Process

© SIM Group Ltd., SQS Group AG, 2002

The Test Process

In this session we willIn this session we will

Look at the steps involved in the test processLook at the steps involved in the test process

Look in detail at each stepLook in detail at each step

© SIM Group Ltd., SQS Group AG, 2002

The Test Process

What is the objective of a test?What is the objective of a test?

A “successful” test is one that A “successful” test is one that doesdoes detect a fault detect a fault

© SIM Group Ltd., SQS Group AG, 2002

The Test Process

CO

MPL

ETIO

N

EXEC

UTI

ON

TEST MANAGEMENT

TEST ENVIRONMENT MANAGEMENT

TEST ASSET MANAGEMENT

REC

OR

DIN

G

PLA

NN

ING

SPEC

IFIC

ATI

ON

© SIM Group Ltd., SQS Group AG, 2002

The Test Process

Five steps in the Test Process areFive steps in the Test Process are

Test PlanningTest Planning

Test Analysis and SpecificationTest Analysis and Specification

Test ExecutionTest Execution

Test Recording (Verification)Test Recording (Verification)

Checking for CompletionChecking for Completion

© SIM Group Ltd., SQS Group AG, 2002

Test Planning

The Test Plan describes how The Test Plan describes how the Test Strategy is the Test Strategy is implementedimplemented

© SIM Group Ltd., SQS Group AG, 2002

Test Planning

Contents of a Test Plan includeContents of a Test Plan include

BackgroundBackground

Reference documentsReference documents

ApproachApproach

MethodMethod

TimetableTimetable

ResourcesResources

DependenciesDependencies

ReportingReporting

Test Asset IdentificationTest Asset Identification

Exit CriteriaExit Criteria

© SIM Group Ltd., SQS Group AG, 2002

Test Planning

The most critical stage of the The most critical stage of the processprocess

Effort spent now will be Effort spent now will be rewarded laterrewarded later

The foundation on which The foundation on which testing is builttesting is built

© SIM Group Ltd., SQS Group AG, 2002

Test Specification

Three step processThree step process

Preparation & analysisPreparation & analysis

Building test casesBuilding test cases

Define expected resultsDefine expected results

© SIM Group Ltd., SQS Group AG, 2002

Test Specification

Test preparationTest preparation

Analyse the ApplicationAnalyse the Application

Identify good test conditionsIdentify good test conditions

Identify test casesIdentify test cases

Document thoroughlyDocument thoroughly

Cross-referencingCross-referencing

© SIM Group Ltd., SQS Group AG, 2002

Test Specification

Build Test Cases Build Test Cases

Test cases comprise:Test cases comprise: Standing DataStanding Data Transaction DataTransaction Data ActionsActions Expected ResultsExpected Results

© SIM Group Ltd., SQS Group AG, 2002

Test Specification

Expected Results Expected Results

The outcome of each actionThe outcome of each action

The state of the application The state of the application during & afterduring & after

The state of the data during The state of the data during & after& after

© SIM Group Ltd., SQS Group AG, 2002

Test Specification

Cross-Referencing & Cross-Referencing & Classification Classification

Enables maintainability of Enables maintainability of Test AssetsTest Assets

Allows testing to be Allows testing to be performed in a focussed performed in a focussed manner directed at specific manner directed at specific areasareas

© SIM Group Ltd., SQS Group AG, 2002

Test Execution

Test Execution checklistTest Execution checklist

Test execution schedule / logTest execution schedule / log

Identify which tests are to be runIdentify which tests are to be run

Test environment primed & readyTest environment primed & ready

Resources ready, willing & ableResources ready, willing & able

Back-up & recovery procedures in placeBack-up & recovery procedures in place

Batch runs planned & scheduledBatch runs planned & scheduled

Then we are ready to run the testsThen we are ready to run the tests

© SIM Group Ltd., SQS Group AG, 2002

Test Recording

Test verificationTest verification

If planning and preparation is sufficiently detailed this is the If planning and preparation is sufficiently detailed this is the easy part of testingeasy part of testing

The test is run to verify the application under testThe test is run to verify the application under test

The test itself either passes or fails! The test itself either passes or fails!

© SIM Group Ltd., SQS Group AG, 2002

Test Recording

The test log should recordThe test log should record

Software and test versionsSoftware and test versions

Specifications used as test baseSpecifications used as test base

Test timingsTest timings

Test resultsTest results Actual resultsActual results Expected resultsExpected results

Defect details for erroneous testsDefect details for erroneous tests

© SIM Group Ltd., SQS Group AG, 2002

Test Completion

Test Exit CriteriaTest Exit Criteria

Used to determine when to Used to determine when to implement the softwareimplement the software

Key Functionality testedKey Functionality tested

Test coverageTest coverage

Budget used?Budget used?

Defect detection rateDefect detection rate

Performance satisfactoryPerformance satisfactory

© SIM Group Ltd., SQS Group AG, 2002

The Test Process

SummarySummary

There are five steps in the Test ProcessThere are five steps in the Test Process

Test PlanningTest Planning Test Analysis and SpecificationTest Analysis and Specification Test ExecutionTest Execution Test Recording (Verification)Test Recording (Verification) Checking for CompletionChecking for Completion