Software Research, Inc. Setting the Standard for Software Testing UNIX Solution.

Software Research, Inc.

Setting the Standard for Software Testing

UNIX Solution

Software Research, Inc.Experts in Software System

Testing

1977 Founded as a consulting and R&D firm

1987 First products released

1991 Released Software TestWorks (STW), an integrated testing system

1996 Over 5,000 sites using STW

Why Use Quality Evaluation Tools?

It’s the most cost-effective way to verify that software and tests are

high quality

Evaluation Method Risk

Let customer check quality

Check quality manually

Check quality with tools

High defect rateLow customer satisfaction

High labor costError prone

Cost of toolSetup time

The Complete Solution STW Provides The Best Code

Testing System For Unix Developers

Capture/Playback

Coverage analysis

Static source code analysis

Flexible ToolsTailor the tools to fit your needs

Both GUI and command-line driven Incorporate new functions as needed Total integration into your testing

environment– Multiple platforms and languages – Network tested

Configurable to meet developer’s special needs

Full UNIX Platform Support

SUN IBM HP

DEC SGI and many others

C, C++, ADA, Fortran

Multiple Language Support

Software TestWorksTM (STW)Integrated Tool Suite for Unix

Regres s ion"B lack B ox"

Coverage"W hite B ox"

Advis orS tatic/M etr ic

STW P roduc t Su i te

STW/RegressionTM

Test capture and playback Test management facilities Differencing utility Language independent

STW/RegressionSTW/Regression

STW/RegressionTM

Automating the Testing Process

CapbakCap ture and Playback

SM ARTSSoftware Maintenance

and Tes ting Sys tem

Exd iffTes t Ver ifica tion

STW /R egres s ionToo l B und le


CAPBAKTM

Capture and Playback Tool for UNIX

Records all activities during testing session– Keyboard strokes– Mouse movements– Widget/object activity

–Screen bitmap images–ASCII values


0

10

20

30

40

50

60

Manual

Automatic

1st Test Reruns

Minutes

30 30

60

Typical Run/Record Test Time

3 Substantial time savings on reruns!

STW/RegressionSTW/RegressionCAPBAKTM Saves Time and Resources

CAPBAK/XTM 5.1Capture-Playback System For X

Windows XvirtualTM feature allows simultaneous

running of multiple tests (and alternative environments)

XflightTM recorder option for implementing “black box” diagnostic systems

XdemoTM for creating OEM product demos

Both True-Time and Object-Mode functionality

Five synchronization modes

New Release!New Release!

SMARTSTM

Streamlining the Testing Process

Organizes tests into hierarchical tree Customizable evaluation tools and test

criteria Comprehensive report generation

– Status reports– Regression reports– History reports– Certification reports


Pixel-by-pixel comparison of image files

Detects color differences Line and byte comparisons for

ASCII files Extensive masking capabilities

EXDIFFTM

Advanced Differencing Utility for UNIX


STW/CoverageTM Ensuring That Tests Are

Complete

STW /Regress ion"B lack B ox"

STW /Coverage"W hite B ox"

STW /Advis orS ta tic/M etr ic

Softw areTestw orks Product Su ite

STW/CoverageSTW/Coverage

STW CoverageTM

Advanced Coverage Utility for UNIX

Measures the completeness of test cases

Improves quality by focusing the creation of additional tests

Saves time by not creating tests for code that is already exercised

Improves process by providing measurements


STW/CoverageTM ToolsThe Best Coverage System

Available

TCATTes t C overageA na lys is Too l

TCAT- P ATHPath Coverage Analysis

and Tes ting Sys tem

T- SCOP EG raph ic D isp lay o f

C overage D a ta

STW /C overa geToo l B und le


TCATTM Test Coverage Analysis Tool

Coverage for True Time, OCR, Widgets Language dependent Developers’ unit test (Branch) Test/QA during integration test (Call-Pair) Test/QA during system test

(Branch/CallPair) Mission-critical module testing (Path

Analysis)


TCAT 9TM The State-of-the-Art in Coverage

Testing

Combined C and C++ language support

New, easy-to-use graphical user interface

Large variety of reports Language-specific

options (tasking, exceptions)

New Release!New Release!

TCAT-PATHTM Intensive Path Coverage for

Critical Modules Groups paths into

equivalence classes Ct metric testing Shows how to design

better path tests Invisible path detection Graphic displays of path


T-SCOPETM Test Data Observation and

Analysis System Real-time display of logical branches

and call-trees as they are being exercised

Customizable threshold values Digraphs and call-trees highlighted

when hit Especially useful in determining why

certain parts of a program are not being covered


STW/AdvisorTM Test Data Observation and Analysis

System

STW/AdvisorSTW/Advisor

STW /Regress ion"B lack B ox"

STW /Coverage"W hite B ox"

STW /Advis orS ta tic/M etr ic

Softw are TestWorksProduct Su ite

STW/AdvisorTM The Complete Tool Set for Evaluating

Program Modules and Source Code

M ETRICM etr ics Processor

STATICS ta tic A na lyzer

TDGENTest Data Generator

STW /Advis orToo l B und le


METRICTM

Software Metrics Processor and Generator

Quantitatively determines quality of code Wide selection of metrics to choose from

– Halstead Software Science (data complexity)– Cyclomatric Complexity (logic complexity)

Customizable, easy-to-read reports– Exception reports (code that exceeds

thresholds)– Graphical Kiviat charts


STATICTM

Static Analyzer For C and C++

Shortens to time between error creation and error detection

Analyzes source code for full range of errors– Over 300 syntactical, warning and other

messages Customizable message filters for

efficiency Extensive bug detection capabilities


Static Saves Time by ... Identifying code that may be error-prone Identifying code that may not be portable Identifying code that does not need

coding standards Identifying code that may have memory

management problems: e.g., uninitialized pointers, array-bound errors, memory utilization


TDGENTM Test Data Generator

Auto-generates additional tests to more fully exercise the program

Substitutes new data values into test script

Template files act as placeholders for auto-generated values

Hundreds of new tests created quickly


Ensuring Quality

Deliver tested code

Build quality — don’t test it in

Include testing and QA as part of product development

Software TestWorks Suite The Total Solution

Regression — We have it. Coverage — We have it. Advisor — We have it. One package. One vendor. One

decision

Software Research, Inc. Setting the Standard for Software Testing UNIX Solution.

Documents

Transcript of Software Research, Inc. Setting the Standard for Software Testing UNIX Solution.