Automating Test Generation

8/2/2019 Automating Test Generation

1/16

International Conference OnS ft T ti A l i & R i

P R E S E N T A T I O N

Thursday, May 4, 20001:30PM

AUTOMATI NG TEST GENERATI ON TO M INIMIZE

TEST WRI TI NG

Linda MierTaratec Development Corporation

T11

Presentation

Bio

Return to Main Menu
http://cover.pdf/http://cover.pdf/


2/1628-Feb-2000 Linda Mier, Taratec Development Corp. 1

Copyright 1996 Dale Carnegie &

Automating TestGeneration to Minimize

Test Writing

Linda Mier

Taratec Development Corp.
http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/



Test Generation

Automation Overview

Automation objectives

When to automate

What to automate

Automation prep work

Automated test writing example
http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/



Objectives of Test

Writing Automation

Reduce test writing/update times

l

Eliminate repetitive typingDecrease the number of errors in

the test

l Missing test cases

l Missing test steps

l Cut-and-paste errors

Standardize test set wording

Ensure requirements coverage

Assist with test documentation
http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/



When to Automate

Test Writing

Multiple test sets

Multiple applications requiringthe same type(s) of testing

Consistent end-user interface

l Predictable application behavior
http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/



What to Automate

Test writing automation depends

on:

l Test step granularity

Keystroke by keystroke

High level information (experienced

testers)

l Test reuse potential

l Best return on investment

Test step numbering

Test setup

Standard test information Text of frequently repeated steps

Test section layout/formatting
http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/



Automation Prep Work

Data evidence requirements

Test set content requirements.

Agreement on standard wording

Requirements to be tested

Test organizationl by application component

l by testing requirement

l by application unit

Material lot in an inventory system

Patient in a Clinical Trial system

Product in a manufacturing system
http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/



Automation Example:Application Being Tested

Access 97 Pharmaceutical

clinical trial applicationl Remote data entry of patient

information

l Separate component for data

validation

No messages during data entry

Requirements based on patient

data validationl Data ranges and consistency

l Missing data
http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/



Automation Example:

Test Layout Requirements

Test number and description

Requirements verified by the test

Test executer information fields

Instructions for testers

l Global - included in each test

Special Instructions for testers

l Unique to that test set

Numbered test steps

l Patient creation and data entry

l Running the validation component

l Verification of data checks
http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/



Automation Example:

Test Writing AutomationDesign (Access 97)

Patients are the primary test

componentl Test writer types in the data

entered into the application for

each patient

l Test writer links each patient to

the requirement(s) proved by that

patient

Tests created by linking patientsto tests

Supports manual test step entry
http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/



Automation Example:Test Writing Automation

Design (Word 97)

Word template divided into

sections required in the test

l Wording standard for each test

included

Imports test content from the

Access 97 databasel Test number and description

l Special instructions

l Patient creation and data entry

l Running the validation component

l Verifying the requirements
http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/



Automation Example:

CoverageReports/QueriesRequirements Coverage

l Requirements by Patient

l Patients by Requirement

Test/Patient Coverage

l Patients by Test

l Tests by Patient

Missing/Unused Components

l Requirements without a link to a

patient

l Requirements not linked to a test

l Patients not linked to a test
http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/



Automation Example:

Test Building Tool Structure

Screen for corrections

Requirements

Data entry System Time

Data entry Screen/Path

Patient data

PatientTypical entry

Data entry System Tim

Data entry Screen/Pat

Typed Test StepsFree-style entry

Test
http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/



Automation Example:Test Writing Main Menu
http://cover.pdf/http://cover.pdf/http://cover.pdf/



Test Writing Tool:

Summary of Benefits

Decreased typing

l Automatically inserted canned teststep text

Automatically generated

requirement checksEasy creation of new tests by

selecting different patient

combinations

Easily obtained statistics on the

test content/coverage
http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/


16/16

Linda Mier

About a year ago, Linda Mier joined the Software Testing Solutions division ofTaratec Development Corp., a consulting organization specializing in regulatedindustries. In the last year Ms. Mier worked with Y2K testing, module testing, useracceptance testing, and testing tool development.

Ms. Mier designed and developed a prototype of an application to automategeneration of user acceptance tests for an Access 97 clinical trial application. Shealso designed, wrote, reviewed, and executed module tests for Presidio RDCclinical trial applications. Additionally, as part of a process improvement team, Ms.Mier created MS Office product templates to automate various module testing andevidence collection activities.

Before working for Taratec, Ms Mier spent about 4 years working withpharmaceutical MES products at Base Ten Systems, Inc. in a Client/Serverenvironment (Win95 and WinNT using Oracle and SQL databases). In addition toworking on all phases of unit and system testing, Ms. Mier also did some factoryand site acceptance testing, on-site customer support, customer training, andcreation/modification of Standard Operating Procedures (SOPs).

Ms. Mier hasnt always worked with PCs, however; she started out in the LargeSystems Performance area at IBM Corp. in Poughkeepsie, NY. Ms Mier worked ona variety of things during her 11 years there, including channel performance, batch

performance and batch workload development for both hardware and MVSoperating system announcements and multi-level cache simulation modeling for theTPF operating system used by the airlines, and she acted as the performance arearepresentative to IBMs GUIDE Users Group.
http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/

Automating Test Generation

Documents

Transcript of Automating Test Generation