SkillCategory-2B

8/3/2019 SkillCategory-2B

1/24

07-Apr-2011

BuildingBuilding the Testthe Test EnvironmentEnvironment

ASHISH VATS


2/24

Page 2

AgendaAgenda

Test Tools

Tool Development & Acquisition

Tools Usage

Testers Competency

Questions from CSTE

Discussion


3/24

Page 3

Test Tool sTest Tool s

Testing :is the proc ess of evaluating system or system co mpo nent by manual or aut omatedmeans t o ve r if y that it satis f ies s pe cif ied r equi r ement or identity di ff e r en ces betweenex pe cted and a ctual r esults.

Tools:is an entity that inte rf a ces between tw o or mor e d omains; that f a cilitates m or e e ff e ctivea ction of one d omain u po n the othe r .

Testing Tool:

It is diff icult t o pe rfor m testing e co nomically with out the aid of aut omated t oo ls.Too ls a r e sele cted t o su ppor t the test meth odology and thus thei r use sh ould bemandat or y and n ot op tional.A too l is a vehi cle for pe rfor ming a test proc ess.A too l is a r es ource t o the teste r, but by itsel f is insu ff icient t o co ndu ct testing


4/24

Page 4

Ar ea of Difficulties fo r new Tool1. O r ganizati onal Obsta cles

2. P roblem a r ising from the t oo ls

3. Obsta cles in the co mpute r envi ronment

4. Othe r sDoes n ot meet the r e co gnized needs of the or ganizati onIs diff icult t o useRequi r es ex cessive co mpute r r es ourcesLack s adequate d oc umentati on

Tool Deve lopm ent & Acquisiti onTool Deve lopm ent & Acquisiti on


5/24

Page 5

Tool Tool Deve lopm ent &Deve lopm ent & Acquisiti on (C ont.)Acquisiti on (C ont.)

R ole of Test ManagementIdentif y too l obje ctive

Appro ve the Acquisiti on Plan

Def ine sele ction cr ite r ia

Make f inal sele ction of Too l/S ource

R oles of Test Manage r

Identif ying candidate t oo ls

App lying the sele ction cr ite r ia

Pr e pa r ing a r an ked list of too ls or s ourcesCondu cting any detailed evaluati ons or co nf e r en ce roo m pilots


6/24

Page 6

Tool Deve lopm ent & Acquisiti on (C ont.)Tool Deve lopm ent & Acquisiti on (C ont.)

Dist r ibution of r esponsibilities r educes the chances of selecting atool that:

Does n ot meet the r e co gnized needs of the or ganizati on

Is diff icult t o use

Requi r es ex cessive co mpute r r es ourcesLacks adequate d oc umentati on


7/24

Page 7


S equence of Events to S elect Testing Tools:1. Em ploy a meth odical proc ess of identi f ying candidate t oo ls and sele cting

am ong these based on established cr ite r ia.

2. Dete r mine the assignment and t r aining of a Too l Manage r who can ma ke min or modif icati ons t o both the co mpute r envi ronment and the t oo l.

R ecommended Event S equence1. Infor mal proc ur ement (by purchase or de r)

2. F or mal proc ur ement (by a r equest for propo sal -RFP )


8/24

Page 8

Steps :Event 1: Goals

Event 2: Too l Obje ctive

Event 3 : P roc ur e Too l

Event 4 : Evaluati on Plan

Event 5 : Implementati on PlanEvent 6 : Tr aining Plan

Event 7: Too l Re ceived

Event 8 : Acc e ptan ce Test

Event 9 : Or ientati on

Event 10: Modif icati onsEvent 11: Tr aining

Event 12: Use in the O pe r ating Envi ronment

Event 13: Evaluati on Re por t

Event 14: Dete r mine i f the G oals a r e Met



9/24

Page 9


Event 1: Goals

Must be in a for mat that pe r mits late r dete r minati on that theyhave been met or notIdentif y r es po nsibilities(the ro le that pro je ct devel op ment mayhave and coor dinati on with othe r a ctivities )It may in clude a n ot-to-ex ceed budget and a desi r ed co mpletiondateTypical g oal statements a r e :

Redu ce the ave r age test time by one -f if th.Achieve co mplete inte rchange ability of test data sets.Adhe r e t o an established standa r d for doc umentati on for mat.


10/24

Page 10


Event 2: Tool Objectives

Acquisiti on Activities for Infor mal P roc ur ement :

Event 2: A1 Acquisiti on Plan :1. Budgets and s chedules for subsequent ste ps in the t oo l introdu ction.

2. Justi f ication of r es ource r equi r ements in light of ex pected bene f its.3. C ontr ibutions t o the int rodu ction ex pected from othe r or ganizati ons (e.g. the t oo l itsel f, modif icationpat ches , or tr aining mate r ials ).

4. Assignment of r es po nsibility for subsequent events within the IT or ganizati on, pa r ticula r ly theidenti f ication of the Test Manage r .

5. Minimum t oo l doc umentati on r equi r ements.

Event 2: A2 Sele ction C r ite r ia :

1. Acco mplishment of s pe cif ied t oo l obje ctives2. Ease of use3. Ease of installati on4. Minimum proc essing time5. C ompatibility with othe r too ls6. Low purchase or lease co st7. Doc umentati on, Tr aining , and Su ppor t availability


11/24

Page 11



Acquisiti on Activities for Infor mal P roc ur ement :

Event 2: A3 Identi f y Candidate T oo ls1. The f ir st list co ntains all t oo ls meeting the f unctional r equi r ements with out co nside r ing the co nst r aints

2. The se co nd list co ntains t oo ls that meet b oth the f unctional r equi r ements and the co nst r aints.

Event 2: A4 Use r Review of Candidates1. Will this t oo l handle the pr esent f ile for mat?2. Ar e t oo l co mmands co nsistent with th ose of the edit or ?3. H ow mu ch t r aining will be r equi r ed?

Event 2: A5 S cor e Candidates1. Infor mati on obtained from a vend or' s lite r atu r e.2. Dem onst r ation of the t oo l.3. The use r's r eview.4. Obse r vati on in a w ork ing envi ronment.5. C omments of pr ior use r s.

Event 2: A6 Sele ct Too l


12/24

Page 12



Acquisiti on Activities for For mal P roc ur ement :

Event 2: B1 Acquisiti on Plan :1. A1 Acquisiti on Plan + .

2. The co nst r aints on the proc ur ement proc ess.3. The detailed r es po nsibilities for all proc ur ement d oc uments (statement of work, te chni cal andadminist r ative pro visions in the r equest for propo sal (RFP ), et c.).

Event 2: B2 Te chni cal Requi r ements D oc ument :1. Infor mal des cr iption of the t oo l r equi r ements and the co nst r aints unde r which the t oo l has t o op e r ate2. Utilize mu ch of the mate r ial from the a cquisiti on plan but sh ould add en ough detail t o su ppor t a

meaning f ul r eview by the t oo l use r .

Event 2: B3 Use r Review of Requi r ements

Event 2: B4 RFP Gene r ati on1. S pe cif ication2. Statement of Work3. P ropo sal Evaluati on C r iter ia and F or mat Requi r ements


13/24

Page 13



Acquisiti on Activities for For mal P roc ur ement :

Event 2: B5 S olicitation of P ropo sals1. Ca rr ied out by Administ r ative and purchasing pe r s onnel

2. Names of P otential Bidde r s a r e made known t o proc ur ement off ice r 3. When r es po nses a r e r eceived , they a r e s cr eened for co mpliance with maj or legal pro visions of theRFP

Event 2: B6 Te chni cal Evaluati on sh ould be C onsistent1. Evaluate ea ch propo sals r e ceived in r es po nse t o the RFP.2. Th ose deemed t o be in the co mpetitive r ange" a r e assigned po int s cor es.3. These po int s cor es a r e used t ogethe r with co st and s chedule f actor s that a r e being se pa r ately

evaluated by administ r ative pe r s onnel.

Event 2: B7 S ource Sele ction1. S ource is sele cted on the basis of co mbined co st , s chedule , and te chnical f actor s


14/24

Page 14


Event 3: P r ocu r e ToolDete r mine whethe r the co st of the sele cted t oo l is within thea ppro ved budgetConside r s the adequa cy of licensing and othe r co ntr a ctualpro visions and co mplian ce with the " f ine pr int" ass oc iated with allthe or ganizati ons proc ur ements.

Identif ies the vend or' s r es po nsibility for f ur nishing the s ourcepro gr am , meeting s pe cif ic test and pe rfor man ce r equi r ements , andtoo l maintenan ce.

Event 4: Evaluation Plan

Based on the Event 1: Goals & Event 2: Too l Obje ctivesMilestones for installati onDatesPerfor man ce levels for the initial op e r ati onal ca pability and for subsequent enhan cementsIdentif y the r e por ts and su ppor ting data that add r ess ex pe ctedimpro vements in th rough put , r es po nse time , or tur na round timeAssign r es po nsibility for tests , r e por ts , and othe r a ctions

A top ical outline of the evaluati on r e por t


15/24

Page 15


Event 5: Implementation PlanDescr ibes the r es po nsibilities and tas ks for the im plementati on of the t oo l, and the t r aining that will be r equi r ed

Event 6: T r aining Plan

Fir st co nside r the t r aining inhe r ently pro vided with the t oo lStanda r d t r aining aids su pp lied by the vend or for Inte r net and in -house t r aining su ch as audi o or vide oc assettes and le ctur esNumbe r of pe r s onnel t o r e ceive for mal t r aining and adequa cy of in-house f a cilities sh ould als o be s pe cif ied in the plan

Event 7: Tool R eceivedFrom P roc ur ing O r ganizati on t o the T oo l Manage r or SystemP rogr amme r


16/24

Page 16


Event 8: A cceptance TestPerfor med by T oo l Manage r and Test Sta ff Perfor med on as r e ceived stateFor mal Acc e ptan ce Re por t is issued

Event 9: O r ientation

Or ientati on meeting is or ganized by Test ManagementCommuni cate as di r e ctly as po ssible the obje ctives of the t oo l use , su ch as in cr eased th rough put or impro ved legibility of listings.

Highlights of the evaluati on plan sh ould als o be pr esented , and anychanges in duties ass oc iated with the int rodu ction of the t oo l sh ouldbe des cr ibed


17/24

Page 17


Event 10: ModificationPerfor med by Systems pro gr amme r and T oo l Manage r Modif icati ons of the following is pe rfor med

The Too lDoc umentati onOper ating system

Event 11: T r aining

Joint r es po nsibility of Too l Manage r and t oo l use r Motivate use r to use the t oo lOppor tunity t o talk ab out the pro blems of the t oo l

Event 12: Use in the Ope r ating Envi r onment

Fir st use must inv olve m ost quali f ied test pe r s onnelFir st use must n ot be on Tight S chedule P ro je ct


18/24

Page 18


Event 13: Evaluation R epo r tToo l mange r pr e pa r e Evaluati on Re por t based onEvaluati on PlanIt includes :

User co mments and obse r vati ons of the systems pro gr amme r .Whethe r the gene r al g oals and t oo l obje ctives we r e met.Obse r vati ons on the installati on and use of the t oo l.Coop e r ation r e ceived from the vend or in installati on or tr aining.Any othe r "less ons lea r ned.Too l and h ost co mpute r modif ications.A se ction of co mments use f ul to f utu r e use r s of the t oo l.

Event 14: Dete r mine if the goals a r e MET

Funding management r e ceives the evaluati on r e por t anddete r mines whethe r the g oals established in Event 4 : Evaluati onPlan have been met.Attainment of te chni cal obje ctives.Adhe r en ce t o budget and othe r r es ource co nst r aints.Timeliness of the e ffor t.Coop e r ati on from othe r de pa r tments.Reco mmendati ons for f utu r e t oo l a cquisiti ons.


19/24

Page 19

Tool s UsageTool s Usage

Most commonly used tools can be g r ouped into these eight a r eas:1. Automated Reg r essi on Testing T oo ls - QTP, WinRunne r, SilkTest , vTest , Selenium

2. De f e ct Management T oo ls - Bugt r ack, Bugzilla , De f ect Tr ack e r, De f ect Manage r, Siebel

3. Pe rfor man ce/L oad Testing T oo ls - WebLO AD, Fun kLoad , Pylot, Load Runne r

4. Manual T oo ls - Che ck List , De cision Tables , Test S cr ipts5. T r a ceability T oo ls - Requi r ement T r a ceability

6. C ode C ove r age - BullseyeC ove r age , IBM Rati onal Pu r e C ove r age , Clove r, Jtest , Nco ve r, DevPa r tne r

7. Test Case Management T oo ls - Quality Cent r e , TFS(Test Manage r)

8. C omm on too ls that a r e a pp licable t o testing - Wor d P roc essing , S pr ead Sheets , Excel, Compute r Gr a phics


20/24

Page 20

Tool s UsageTool s Usage

Guidelines fo r effective and efficient usage of testing tool

Guideline 1:

Teste r s sh ould n ot be pe r mitted t o use t oo ls for which they have n ot r e ceived for maltr aining.

Guideline 2:

The use of test t oo ls sh ould be in corpor ated int o test proc esses s o that the use of too ls is mandat or y, not op tional.

Guideline 3 :

Teste r s sh ould have a cc ess t o an individual in thei r or ganizati on, or the or ganizati onthat devel op ed the t oo l, to answe r questi ons or pro vide guidan ce on using the t oo l.


21/24


22/24

Page 22

Testers C omp etencyTesters C omp etency

Measu r ing the C ompeten cy of S of twa r e Teste r s


23/24

Page 23

M o ck Questi o nsM o ck Questi o ns

D escribe automated capture/playback tools and list the benefits of using them.

Briefly explain the difference between automated & manual tools. Give 2 examples each.

What 3 tools would you purchase for your company in testing and justify why would you want them?

Y ou a r e t o introdu ce aut omated testing t oo ls. List any four aut omated test t oo ls with vend or name and why did y ou choo sethem

L ist five skills a competent tester should have.1) Test proc ess knowledge;

2) Ex cellent w r itten and or al co mmuni cation s kills;

3) Analyti cal ability;

4) Knowledge of test t oo ls; and

5) Unde r standing of de f e ct management.

D escribe the use of a traceability tool, Code Coverage Tool

Tester should know A) Test planningb) Automati on t oo lc) De f e ct tr a cking t oo ld) P rogr amming language

A ns. D efect Tracking tool

What is one of the most powerful quality control tools?

A ns. CHECK LI ST


24/24

Page 24

Dis cussi onDis cussi on

SkillCategory-2B

Documents

Transcript of SkillCategory-2B