Friday 23 November 2001 F5 - EuroSTAR Conference...Course duration 1 - 3 days 1 - 3 days catering...

International Conference On

Software Testing, Analysis & ReviewNovember 19 - 23 Stockholm, Sweden

P r e s e n t a t i o n

F5Friday 23rd November, 2001

How to AchieveMaintainability,

Manageability andTraceability

Rudolf van Megen

Friday 23 November 2001

F5 How to achieve Maintainability, Manageability & Traceability Rudolf van Megen Name Rudolf van Megen Date of Birth June 27th 1954 Graduation Diplom-Kaufmann (holder of a diploma in commerce) Contact SQS Software Quality Systems AG, Stollwerkstr. 11, D-51149 Cologne,

Tel: ++49 2203 9154-0, Fax: ++49 2203 9154-15

Function CEO of SQS, Responsibilities: Strategy, Sales & Marketing, M&A, Investor Relations, F&A

1977 Diploma in commerce, University of Cologne

1977-1980 Researcher at University of Cologne, Department of Computer Science, within a project supported by the German Government (via BMFT) and Siemens AG working on software testing and cost estimation

1981 Independent Consultant in cooperation with Heinz Bons

1982-2001 Co-founder and managing director of SQS Gesellschaft für Software-Qualitätssicherung

mbH, now SQS Software Quality Systems AG

Work areas

• Project manager of various QA projects, especially financial sectors,

industry and telco companies

• Both analytical and constructive QA

• Project responsibility in numerous software development projects

• Seminars and training on the above topics

Publications Author and Co-author of several articles and a book on Software Testing

Rudolf van Megen

HowHow to to AchieveAchieveMaintainability, ManageabilityMaintainability, Manageability& Traceability& Traceability

Quality fo

r Success

Quality fo

r Success

Stockholm, November 2001

How to Achieve Maintainability, Manageability & Traceability

Agenda

n SQS: Who we are

n Small Scale and large Scale integration

n What requirements exist for integration

q Traceability

q Manageability

q Maintainability

n What is possible NOW? What requirements will therebe in the FUTURE?

q Small Scale

q Large Scale

n Summary


SQS: Who we are

Las Arenas(Bilbao)

BarcelonaMadrid

Woking(London)

Edinburgh

Norwich

Cologne

Headquarters:Cologne

SQS Locations:Berlin, Frankfurt, Ham-burg, Hanover, Munich, Münster, Stuttgart

Affiliates in:Zaltbommel (NL)Bilbao (E)London (UK)

Subsidiary in:Vienna (A)

Vienna

Zaltbommel

Employees SQS-Group: 570 (01.10.2001)


Agenda

n SQS: Who we are

n Small Scale and Large Scale Integration


q Traceability

q Manageability

q Maintainability


q Small Scale

q Large Scale

n Summary


Software Life Cycle: Task + Tools (examples)

Integration Manager

Support Process

Project Planning(MS Project)

Conf. Manag.(ClearCase)

Defect Manag.(ClearQuest)

DataWarehouse(Rochade)

ContentManagement

Development Process

Req.analysis(DOORS)

BP Model. (ARIS)

SA/SD-CASE(Innovator SA)

UML CASE(Rose)

Databases (Oracle)

Dev. environ.(Visual C++)

ERM Model.(case/4/0)

Uniface

Test Process

Functional Test (SQS-TEST/TCD)

Testmanagement(TestDirector)

Test Proc. Aut.(SQS-TEST/TPA)

Testautomation (Corba Skript)

Integration Test (SQS-TEST/BIT)

Gui Testautom. (tMosaic)

Capture/Replay (Robot)


Integration Manager

Support Process





ContentManagement

Development Process

Req.analysis(DOORS)

BP Model. (ARIS)


UML CASE(Rose)

Databases (Oracle)



Uniface

Test Process








Integration Manager

Support Process





ContentManagement

Development Process

Req.analysis(DOORS)

BP Model. (ARIS)


UML CASE(Rose)

Databases (Oracle)



Uniface

Test Process








Integration Manager

Support Process





ContentManagement

Development Process

Req.analysis(DOORS)

BP Model. (ARIS)


UML CASE(Rose)

Databases (Oracle)



Uniface

Test Process








Integration Manager

Support Process





ContentManagement

Development Process

Req.analysis(DOORS)

BP Model. (ARIS)


UML CASE(Rose)

Databases (Oracle)



Uniface

Test Process








Integration Manager

Support Process





ContentManagement

Development Process

Req.analysis(DOORS)

BP Model. (ARIS)


UML CASE(Rose)

Databases (Oracle)



Uniface

Test Process








Integration Manager

Support Process





ContentManagement

Development Process

Req.analysis(DOORS)

BP Model. (ARIS)


UML CASE(Rose)

Databases (Oracle)



Uniface

Test Process








A1.2

HP UX

A1.2

AIX

Definition: Small Scale / Large Scale

Time

OS

A CBA1.2B1.1

0.9A1.2

NT

Support

Integration Manager

Support Process





ContentManagement

Development Process

Req.analysis(DOORS)

BP Model. (ARIS)


UML CASE(Rose)

Databases (Oracle)



Uniface

Test Process








1.0


Small Scale IntegrationRequirement

AnalysisRequirement

Analysis

Use CaseAnalysis

Use CaseAnalysis

AnalysisAnalysis

DesignDesign

ImplementationImplementation

Test ItemDefinitionTest ItemDefinition

Test protocol

Test CaseSpecification


Test DataDefinitionTest DataDefinition

Test ExecutionTest Execution

Requirement

Use case model

Analysis model

Design model

Test plan

Test cases

Test data

Implementation

Pro

cess sup

po

rt (CM

, man

agem

ent)

Pro

cess sup

po

rt (CM

, man

agem

ent)


Evaluation of Small Scale Integration

1 Continuity

q Integration of transitions between single activities? (verysmall)

q Purely “cut & paste”, i.e. one-off integration

² Complexity

Even on the small scale repeated adjustments can not behandled manually

³ Criticality

Applications are being published on the web the next day- and therefore have extremely high external impact


Deployed HP UXDeployed HP UX

Version release A

Version release B

Deployed AIXDeployed AIX

Version release A

Version release BIntegration TestIntegration Test

Product A V1.0

Product B V2.8

Integration TestIntegration Test

Product A V1.0

Product B V2.8

Maintenance “Contract Management”

Maintenance “Contract Management”

Large Scale Integration

Development “CRM”

Development “CRM”

Comp. 4

Comp. 1

Comp. 2

Comp. 3

Comp. 4

Comp. 4Comp. 3

Comp. 5

No changeNo change

ChangeChange

Newversion Deployed NT Deployed NT

Release A21V1.0 CRMV2.8 Contract-

ManagementIntegration TestIntegration Test

V1.0 CRM

V2.8 Contract - Management


Large Scale Integrationn Ratio between cost of software development and software

maintenance is 1 : 3

è There is significantly higher potential for improvement in:q Impact analysis, i.e. to know what needs to be reworkedq repeatability of tasks, e.g. automated tests in maintenance

n Re-Use is necessary

q Re-Use is not often applied during maintenance cycles.Requirements, class libraries, tests - everything is (re-)done each time

n The “people’s factor”

q Continuity - do you still have the ‘old’ employees - and theirknowledge?

q Enjoyment - motivate your employees by new demands

q Quality - instead of fault-prone, semi-monotonous activities


Agenda

n SQS: Who we are



q Traceability

q Manageability

q Maintainability


q Small Scale

q Large Scale

n Summary


Traceability: Requirements

Use case model

Requirements

....

....

....

....

....

....

....

....

....

Item model

Test plan

C1

C2

C3

C4

C5

C6

C7

F

F

F

E/C1A

E/C2AO

Element TF 100 TF 101

Course location D CH

Course duration 1 - 3 days 1 - 3 days

catering Yes Yes

Number of Par-ticipants

1 - 2 1 - 2

Customer reve-nue

< 50.000,- > 50.000,-

Effect EffectDaily rate 620,- DM 620,- SFR

VAT Yes No

Rebate 0% 10%

Test cases

Test data

Course

No=10001revenue=49999,99

Customer

ID=10001location

Which requirements are already covered by use cases?

Which use cases are not yetcovered by any test case?


n Design

n Planning

n Monitoring

n Controlling

Manageability: Requirements

Use case model

Requirements

....

....

....

....

....

....

....

....

....

Item model

Test plan

C1

C2

C3

C4

C5

C6

C7

F

F

F

E/C1A

E/C2AO




catering Yes Yes


1 - 2 1 - 2

Customer reve-nue

< 50.000,- > 50.000,-


VAT Yes No

Rebate 0% 10%

Test cases

Test data

Course

No=10001revenue=49999,99

Customer

ID=10001location Which requirements have been

confirmed as fulfilled by testing?

For which use cases do test cases still have to be specified?

Which degree of quality can be reached with the supplied resources?


n Planning of effort

n Process (re-)organization

n Adjustment of process fundamentals

n Adjustment of results

Maintainability Requirements

Use case model

Requirements

....

....

....

....

....

....

....

....

....

Item model

Test plan

C1

C2

C3

C4

C5

C6

C7

F

F

F

E/C1A

E/C2AO




catering Yes Yes


1 - 2 1 - 2

Customer reve-nue

< 50.000,- > 50.000,-


VAT Yes No

Rebate 0% 10%

Test cases

Test data

Course

No=10001revenue=49999,99

Customer

ID=10001location

The item model has been reworked -what are the effects of these changesto the test items?

Can newly obtained results be automatically taken over for later project phases?

A Use Case has been modified - which test items have to be reworked and how much effort will this cost?


Agenda

n SQS: Who we are



q Traceability

q Manageability

q Maintainability


q Small Scale

q Large Scale

n Summary


Current state of Small Scale Integration

SW DevelopmentAnalysis


Requirements

Design

Product

Test DataDefinition

TestExecution

Support processes (CM, Project Planning, etc.)

Increment planning


TestDirector

TI4

TI2

TI6

TI1

Integration in the Test Environment

Requirements/Analysis Results

Rose, RequisitPro

SQS-TEST/ Integration

Manager

Test Itemdefinition

Case specification

Project

TI3TI2TI1

Critical test items

Test automation

Project

TI6TI2TI4

Distributedtest execution

WINRunner

C/R Script

Defects

C/R script

Test cases

Rational

SQS

Integration

TI reference

Activation

Mercury

TI6

TI4

TI2

TI1


Test Repeatability Through Automation

Test archive

Test environment

Applicationundertest

ExecuteInput data

Provide

InitializeResetLoad

Comparisonresults

Comparison

Save

Actualresults

Expectedresults

ExecutionExecutionPre-ProcessingPre-Processing Post-ProcessingPost-Processing


Module specification

Physical data model

User assistance

Module

Design

Configuration Management

Implementation


Test DataDefinition

Change requestSpecification document

Test Data

Structure information

Test cases

Interfaces

Process documents

Actual result Input data

Change request

Problem

Requirements

Application


Current state of Large Scale Integration

Promote

Promote Promote

What is the status of a version and in which environment is it located?

Promote

Integration environment

32

Status: Integrated

Test environment

32

Status: Tested

Development environment 2

12

3 Status: Working

File 2

Development environment 1

12

3 Status: Working

File 1

Product

Status: Released

Production environment


Different Target Environments

n Need for support:

q Client/server architectures

q Heterogeneous networks

q Networking of a wide variety of computer architectures

n Difficulties:

q Local adjustments (e.g. individual user interfaces,translations, additional functionality, ...) have to be workedinto the next global update

q Customer-specific adjustments have to be consideredand implemented in updatesEffort rises with the number of customer-specificconfigurations


Requirements/AnalysisResults

Rose, RequisitPro

Critical test items

Distributedtest execution

Rational Robot

C/R Script

Defects

C/R script

Integration

TI reference

Activation

Which use cases arenot yetcovered by any testcase?

Which requirementshave been confirmed asfulfilledby testing?

A Use Case has beenmodified - which testitems have to bereworked and how mucheffort will this cost?

Example of SQS-TEST/Integration Manager


Summaryn (Very) Small Scale Integration

There is already a lot

Potential for savings: approx. 10 %

n Large Scale Integration

THE challenge

It’s an absolute need in the future

n Integrated solutions from one company are good but

NOT enough:

Platform- and task-specific integration is needed

n Organizational/ methodical solutions are also available

where no tool support exists


SQS ss Software Quality Systems AG ss Stollwerckstraße 11 ss 51149 Köln ss Germany ss Tel. 02203-91 54-0ss Fax 02203-91 54-15ss eMail: [email protected] Internet:www.sqs.de

Quality fo

r Success

Quality fo

r Success

[email protected]

Thank you very much!

Friday 23 November 2001 F5 - EuroSTAR Conference...Course duration 1 - 3 days 1 - 3 days catering...

Documents

Transcript of Friday 23 November 2001 F5 - EuroSTAR Conference...Course duration 1 - 3 days 1 - 3 days catering...