WORST-CASE SCENARIOS OPTIMIZATION AS A FINANCIAL STRESS TESTING
Testing Services · 2018-04-26 · 3. Testing Life Cycle A range of testing scenarios are covered...
Transcript of Testing Services · 2018-04-26 · 3. Testing Life Cycle A range of testing scenarios are covered...
Testing Services
NashTech offers a pure testing service, from its centres in Vietnam, which is distinct from the testing cycle that works alongside an application development project. NashTech can test the client’s applications using remote access tools to the client’s local environment, cloud or replicate the client’s environment offshore to test against. NashTech can also test 3rd party applications, relieving resources from being tied up in acceptance testing.
The Quality Management Team (QMT) is totally separate from NashTech’s development centre, providing best practice objectivity to the test process. NashTech deploys it in all of its development projects and has subsequently set up a service line to provide the same capability to clients who only require testing services. This service covers:
1. CMMI NashTech is one of only a few companies worldwide whose development and testing processes are accredited at CMMI level 5, the gold standard of independent quality management certification. Crucial to this is the QMT’s complete independence from development teams with the QMT defining and overseeing all quality management procedures. Testing is a major component of NashTech’s “right first time” philosophy so a key part of the QMT’s remit is to undertake testing for all projects. Individual developers test their own code and then QMT double check the system to take the responsibility for all levels of testing thereafter”
Introduction
System Testing
Penetration Testing
User Acceptance Testing
Performance Testing
2. The “V” ModelThis process incorporates a highly developed and well proven form of the industry standard “V” model, which results in:
• Systems which meet requirements
• Improved quality and reliability
• Minimised rework
• Reduced time spent on correcting problems
• Efficient testing by focusing on the objectives of the various tests
• Improved risk management
• Increased likelihood delivering releases on schedule
• A more focused effort due to advance determination of success criteria for each development stage.
Define & Manage Business Case
Business Case
Application Requirements Specifications
Testing checks that the specification is properly implemented and assembled based
on the requirements
Application Conceptual Design
Application Architecture
Program Specifications
Validation checks that the deliverables satisfy the requirements specified in the previous, or earlier, phase and that the business case continue to be met
Verification checks that the deliverables are correctly derived from the inputs of corresponding stage and are internally consistent
Gather User & Usabilitity Requirements
Perform Roll-Out Verification Test
Analyse System Requirements
Perform Operational Readiness Test
Analyse System Quality Requirements
Design Application Architecture
Prepare & Execute Integration Tests
Design Automated Processes
Prepare & Execute Component Tests
Prepare & Execute Component Tests
Prepare & Execute System Test
Prepare & Execute User Acceptance Test
3. Testing Life Cycle
A range of testing scenarios are covered including levels of manual testing, automation test, performance testing and security testing. The generic test process is illustrated in Figure 2.
Testing life-cycle starts as soon as the software life-cycle starts
The whole process will be repeated for the next iteration
What: create a test plan to identify and describe the testing that will be implemented and executed
When: requirement analysis phase
Who: Test Leader
Plan Test
Design Test
Implement Test
Execute Test
Sum Up and Report
FINISH
START
Create Test Log Evaluate Test
What: identify test model and its artefact: test cases, test procedures and test data
When: design phase
Who: Test Leader & Testers
What: Implement (record, generate or program) the test procedures that were defined in Design test (test scripts)
When: coding phase
Who: Test Leader & Testers
What: Capture all actual inputs, actions, system behaviors while executing test
When: testing phase
Who: Testers
What: Evaluate test results
When: before making test report
Who: Test Leader & Testers
What: Generate final test coverage summary
When: before delivering, report to SQA by the Final inspection
Who: Test Leader
What: Execute test programs/scripts that were generated in Implementation test
When: test phase
Who: Testers
6. Flexible ResourcingWith 550 (and growing) dedicated specialist testers organised into a discrete technical discipline, NashTech can provide maximum flexibility to support routine ongoing requirements as well as unexpected spikes or dips in workload. For example, one client with international operations suddenly needed a team of ten testers urgently to complete intensive offshore volume testing of a new software product. A team was established within a few days and the task was completed in the required timescales. While a number of testers were retained by the client for further testing work, the rest returned to NashTech’s pool for re-assignment.
4. Continual ImprovementContinual improvement is an integral part of CMMI operations. NashTech constantly monitor the work of all testers by gathering a wide range of performance metrics including:
- Schedule Deviation: Provides information on project performance with respect to its schedule commitment
- Timeliness: Measures the ability to deliver fully work products / release package to customer on time
- Effort Deviation: Measures the ability to deliver fully work products / release package to customer on time
- Effort Distribution: Collect distribution effort of project to orrganisation database and PPM
- Defect Leakage: Measure quality of the product after delivery for client
- Defect Removal Efficiency: Measure the efficiency test processes
- Invalid Bug Ratio: Measures quality of opened bugs by Testers
The metrics are regularly reviewed to identify opportunities to develop / enhance processes and / or people. Most importantly they are also used every six months to recalibrate workload estimation models so that all estimating reflects current actual performance.
5. Testing CapacityThe QMT employs approximately over 550 specialist testers who are allocated to projects on an as required basis, generally on a ratio of 1 tester to 4 developers. They effectively operate as 3rd party testers in everything they do. They also provide specialist testing consultancy and services direct to clients. For example, NashTech recently advised Fasthosts, one of the UK’s leading internet service providers, on overall testing strategies and on best practice for individual testing approaches. NashTech were then engaged to undertake user acceptance testing and stress testing for a major international launch of software to be used by Fasthosts’ online clients in Europe and the USA. Based on the success of that work NashTech are now undertaking wider software development projects.
CONTINUAL IMPROVEMENT
CONTINUAL IMPROVEMENT
QUALITYACCREDITATIONS
ToolsPeople
Pr
ocess Execution
7. Technical CapabilitiesNashTech’s testing group must be able to support whatever test automation tools clients use so processes and people must allow us to develop new skills and quickly become proficient in new technologies, of which QMT may have little or no previous knowledge. In responding to such challenges. NashTech has developed skills in e.g. Selenium WebDriver, SpecFlow, Cucumber, Jbehave, Protractor, Appium, HP UFT, RanoRex, Jmeter, BlazeMeter, Acunetix.
NashTech can provide the full range of testing skills from very senior test managers able to plan and manage the most complex testing activities, to basic testers. NashTech’s recruitment arm (and the current state of the market) enables the QMT to find the very best people if very specific expertise is needed. Junior developers and testers are not deployed on offshore work until they have competed a significant period of training and mentoring on local Vietnamese assignments. Testers can operate on or offshore as required. They can be integrated into client teams or operate as an independent group as appropriate.
For more details, please send your enquiry to [email protected] or contact your nearest office:
UK 110 Bishopsgate, London, United Kingdom, EC2N 4AY Tel: +44 20 7333 8778
USA 1680 Route 23 North, Suite 300, Wayne, New Jersey, 07470, USA Tel: +1 201 914 2388
SINGAPORE One Raffles Quay, Level 25, North Tower, Singapore, 048583 Tel: +65 6622 5783
VIETNAM Hanoi 6th Floor HITC Building, 239 Xuan Thuy Road, Cau Giay District, Hanoi, Vietnam Tel: +84 24 3834 2050
FINLAND Unioninkatu 22, 00130 Helsinki, Finland Tel: +358 40 727 9727
SWEDEN World Trade Center, Kungsbron 1, Box 843, 101 36 Stockholm, Sweden Tel: +46 8 20 09 10
IRELAND Lower Ground Floor 100 Mount Street Dublin 2 Tel: +353 1 674 1400
JAPAN 8F Shinagawa Grand Central Tower 2-16-4 Konan, Minato-ku Tokyo 108-0075 Tel: +81 3 6863 4407
AUSTRALIA Level 57, MLC Centre 19-29 Martin Place Sydney 2000, Australia Tel: +61 2 8007 5703
Ho Chi Minh 364 Cong Hoa Street, Tan Binh District, Ho Chi Minh City, Vietnam Tel: +84 28 3810 6200
About NashTechNashTech enables innovative business and digital transformation through IT services spanning Advisory, Software, Business Processes and Infrastructure. It operates globally to support organisations with both outsourcing and consultancy requirements
www.nashtechglobal.com