Automation on the go ict
-
Upload
indiumsoft -
Category
Technology
-
view
45 -
download
0
Transcript of Automation on the go ict
INDIUM SOFTWAREAn Independent Software Testing Firm
Automation on the Go - ICT
“Business Assurance through Quality Assurance”
© 2014 Indium Software
ENHANCING SOFTWARE QUALITY
Agenda
2
Out
line
Industry Expectations
Overview
Automation in Agile Environment
Approach – ICT (In Cycle Testing)
Phases in ICT
Metrics
Value Additions
Conclusion
© 2014 Indium Software
ENHANCING SOFTWARE QUALITY
3
Industry Expectations
• Increased Test Coverage
• Test More
• Test Fast
• Defect Free System
• Improved Accuracy
© 2014 Indium Software
ENHANCING SOFTWARE QUALITY
4
Overview
Maintenance – Points of Concern
Solution
Frequent releases - Increased need of regression executionExtensive regression suite – Unfeasible test effortLess regression time – Reduced test coverage / Defect leakage
Manual
Hurried development – Fragile non scalable scriptsLast minute modifications – Costly to fixFrequent change in requirements - Unstable tests
Automation
An automation suite thatgrows in parallelhas control over current featuresensures additional test coverage of new features
The only way out is
AUTOMATION ON THE GO
© 2014 Indium Software
ENHANCING SOFTWARE QUALITY
5
Automation in Agile Environment
Usually automation happens at the end but with quick turnaround time required forfrequent release testing becomes strenuous. That means just manual testing maynot suffice.
Application Updates
Write Functional Test cases
Execute Functional Test cases
Analyze test results &
Report Defects
Code Freeze & Deployment
Identify Test case for
Automation
Develop & Execute Test
script
Add the Script to Existing
Suite
© 2014 Indium Software
ENHANCING SOFTWARE QUALITY
6
Approach – ICT (In Cycle Testing)
Why not automate as soon as the test cases are identified and written?
.
Application Updates
Write Functional Test cases
Execute Functional Test cases
Analyze test results &
Report Defects
Code Freeze & Deployment
Identify Test case for
Automation
Develop & Execute Test
script
Add the Script to Existing
Suite
© 2014 Indium Software
ENHANCING SOFTWARE QUALITY
Merge
7
• Tester = Automation + ManualRole
• Testing = Automation + ManualProcess
© 2014 Indium Software
ENHANCING SOFTWARE QUALITY
8
Phases in ICT
• IM prioritizes requirements
• ICT Automation QA assesses requirements for ICT feasibility
Kick Off
Effort Estimation & Schedule
Planning
Functional Verification
Automation Script Development
Automation Script Sign-Off
Script Integration
Script Execution
ICT
1
2
1
2
3
4
5
6
7
8
3
45
6
7
8
© 2014 Indium Software
ENHANCING SOFTWARE QUALITY
9
Phases in ICT
Planning
Functional Verification
Automation Script Development
Automation Script Sign-Off
Script Integration
Script Execution
ICT
1
2
3
4
5
6
7
8
Kick Off
• ICT Automation QA provides estimation for Automating
• QA Lead / IM schedules and prioritizes
Effort Estimation & Schedule2
1
1
2
3
45
6
7
8
© 2014 Indium Software
ENHANCING SOFTWARE QUALITY
10
Phases in ICT
Functional Verification
Automation Script Development
Automation Script Sign-Off
Script Integration
Script Execution
ICT
1
2
3
4
5
6
7
8
Kick Off
2
1
Effort Estimation & Schedule2
• ICT Automation QA identifies / writes manual tests
• ICT Automation QA emails Developers & BAs to review the tests
Planning31
2
3
45
6
7
8
© 2014 Indium Software
ENHANCING SOFTWARE QUALITY
11
Phases in ICT
Automation Script Development
Automation Script Sign-Off
Script Integration
Script Execution
ICT
1
2
3
4
5
6
7
8
Kick Off
2
1
Effort Estimation & Schedule2
• BA signs off
• ICT Automation QA begins testing
Functional Verification4
Planning31
2
3
45
6
7
8
© 2014 Indium Software
ENHANCING SOFTWARE QUALITY
12
Phases in ICT
Automation Script Sign-Off
Script Integration
Script Execution
ICT
1
2
5
6
7
8
Kick Off
2
1
Effort Estimation & Schedule2
• ICT Automation QA begins script development
• QA Lead coordinates with ICT Automation QA on issues / concerns
Automation Script Development5
Planning3
Functional Verification4
1
2
3
45
6
7
8
© 2014 Indium Software
ENHANCING SOFTWARE QUALITY
13
Phases in ICT
Script Integration
Script Execution
ICT
1
2
5
6
7
8
Kick Off
2
1
Effort Estimation & Schedule2
• Peer reviews are conducted
• ICT Automation QA modifies scripts if any
Automation Script Sign-Off6
Planning3
Functional Verification4
Automation Script Development5
1
2
3
45
6
7
8
© 2014 Indium Software
ENHANCING SOFTWARE QUALITY
14
Phases in ICT
Script Execution
ICT
1
2
5
6
8
Kick Off
2
1
Effort Estimation & Schedule2
• Regression Automation QA integrates ICT
Automation scripts with existing regression scripts
Script Integration7
Planning3
Functional Verification4
Automation Script Development5
Automation Script Sign-Off6
1
2
3
45
6
7
8
© 2014 Indium Software
ENHANCING SOFTWARE QUALITY
15
Phases in ICT
ICT
1
2
7
Kick Off
2
1
Effort Estimation & Schedule2
• Regression Automation QA executes ICT
scripts before regression scripts
Script Execution8
Planning3
Functional Verification4
Automation Script Development5
Automation Script Sign-Off6
Script Integration7
1
2
3
45
6
7
8
© 2014 Indium Software
ENHANCING SOFTWARE QUALITY
16
Metrics
Schedule
R95 R96 R97 R98 R99 R100 R101 R102 R103 R10402468
1012141618
1412
1416 15
7 6 7 8 8
Releases
# Sc
ript
s
Backlog Scripts
R95 R96 R97 R98 R99 R100 R101 R102 R103 R1040123456789
10
7 8 79
8
54 4
54
Releases
# D
ays
With ICT
Without ICT
R95 R96 R97 R98 R99 R100 R101 R102 R103 R1040
5
10
15
20
25
30
35
2 31 2 3
1820
15
20
13
22
29 30 3028
85
74 5
Defect Detection
Releases#
of D
efec
ts
Defects found in the QA environment
Defects found in the BA environment
© 2014 Indium Software
ENHANCING SOFTWARE QUALITY
17
Value Additions
Key Levers With ICT Value Addition Before After
Test Execution Faster by 30% Delivery ahead of schedule
8 – 10 Days 5 – 7 Days
Retesting Effort Decreased by 40%
Multiple execution of automation scripts 2 – 3 Days Less than 1
Day
Backlog Decreased by 50% Increased productivity 12 – 14 Scripts
per Release6 – 8 Scripts per Release
Regression Effort
Decreased by 35%
Instant Sign-OffStable Code 3 – 5 Days 1 – 3 Days
Defect Catch Rate Faster by 60% High quality service
delivery25 – 30 Defects
in QA5 – 8 Defects
in QA
© 2014 Indium Software
ENHANCING SOFTWARE QUALITY
18
Conclusion
Clean and Rapid
Delivery
Good Framework
Coding Standards
Stable Process
Reusable Code
© 2014 Indium Software
ENHANCING SOFTWARE QUALITY
19
Thank You
USA: [email protected]
EMEA & APAC: [email protected]@indiumsoft.com
INDIA: [email protected]
SunnyvaleSuite 210, 1250 Oakmead ParkwaySunnyvale, CA – 94085.Phone: +1(408) 501-8844Fax: +1(408) 501-8808
Atlanta Crown Office Suites1870 The Exchange, Suite 100 Atlanta, GA 30339Phone: +1 (678) 608-0809, +1(770) 989-7302
New DelhiF-1/5 Okhla Industrial Area Phase-I, New Delhi – 110 020.Phone: +91-11-6613 0400
BengaluruSRS Plaza, No. 246, 2nd & 3rd Floor13th Cross, Indira Nagar 2nd StageBengaluru – 560 038.Phone: +91-80-4914 7777
ChennaiVDS House41, 2nd Floor, Cathedral RoadChennai – 600 086.Phone: +91-44-2811 6330Fax: +91-44-4210 4033