Auto Desk - Testing Ppt _11th June

download Auto Desk - Testing Ppt _11th June

of 14

Transcript of Auto Desk - Testing Ppt _11th June

  • 8/4/2019 Auto Desk - Testing Ppt _11th June

    1/14

    Independent Testing Capability

  • 8/4/2019 Auto Desk - Testing Ppt _11th June

    2/14

    Copyright 2007 Satyam Computer Services Ltd. All rights reserved.

    Satyam s Independent Testing Practice

    Ready Pay on Usage Testing Labs | Leading Tools | Business Process Automation Script| CoEs

    + + + % &3000 Associates | 400 Certified | 50 PMP | 7 R D

    Test Process | Functional | Non Functional | Business Process | Test Automation |Infrastructure | Platform | Deployment | Security | Compliances | Test Business

    Consulting

    Delivery: Test Factory | Managed Services | Projects| StaffingEngagements: - ( / / /Single | Multi Vendor | Multi Location | Onsite offshore near shore

    )offsiteCommercial: & & &T M | Fixed Bid | Risk Reward | Capped T M

    & ( )Domain Knowledge Technology Focus | Alliances | Test Business School TBS

    +20 Customers | %0 Repeat Business | 2 Countries Onsite Delivery |+00 Proje cts

    lobal Clients

    Models

    Reusable &nfrastructure Investments

    &olutions Services

    Competency

    Skills

  • 8/4/2019 Auto Desk - Testing Ppt _11th June

    3/14

    Copyright 2007 Satyam Computer Services Ltd. All rights reserved.

    Project Nature Services Portfolio Business ValueNew technology implementation, upgrading corevendor packages to current release

    System Integration Testing Deployment Assurance, Defect densityreductionDelivering business driven enhancements & new

    systemsRegression Testing Reassurance with limited time &

    budget, Improved Test coverageCapacity planning, infrastructure

    Performance Testing System availability, improvedperformance

    Agile development, multiple builds Continuous Integration Testing (CIT),Build Testing

    Testing along with Development Test early, Test often

    Legislation-Corporate-Regulatory Compliance

    Functional Domain Testing

    (Telecom, Insurance, Banking, Finance & Retail)

    Guarantee stability & reliance of core

    systems, fully documented in auditready formatRe-engineering existing systems atTest Database Migration Testing Data integrity & performance

    Multi-linqual, Regional,

    Multi-country, Global deploymentL10N/I18N Testing Country specific readiness

    Hardware, devices, mobile

    Embedded Testing Interface AssuranceERP Implementation roll-outs, upgrades Test Center for Enterprise Applications Certified Business ProcessSecurity Audits Security Testing Threat protection &

    secured environmentData Protection & Cleaning Test Data Management Reusability & Protection

    Test Process|Functional|Non Functional|Business Process|Infrastructure|Platform|Deployment|Security|Compliances |Satyam Test Business Consulting@QEdge

    Solutions & Service Business Value

  • 8/4/2019 Auto Desk - Testing Ppt _11th June

    4/14

    Copyright 2007 Satyam Computer Services Ltd. All rights reserved.

    Managed Services Model Components

    Model:t -QA strategy as a whole and creates higher value for business

    he execution cycle time, standardize the processes and ensures consistent customer experience

    ngagement success and best practices cascaded across the Managed Service

    obilization, higher offshore % and improved governance, scoping & reviews

  • 8/4/2019 Auto Desk - Testing Ppt _11th June

    5/14

    Copyright 2007 Satyam Computer Services Ltd. All rights reserved.

    Satyams Proposed Solution

    anagementProcessesOperations

    ManagementWorkflow

    ManagementSLA

    Management

    &Standard CustomizedReporting

    RiskManagement

    estProcessesRequirements

    anagement

    All Types oftesting

    in life Cycle

    &Test Data AssetManagement

    &

    Data PrivacySecurity

    DefectManagement

    ustomerInterface&Application Owners Business

    Teams

    Leadership

    Technical( &Teams QA Test

    )Manager

    Infrastructure( - / - / -Communication Network On Site Off Shore Off)Site

    (

    &Test Environment Hardware)Software

    Facility

    Client SatyamManaged Test Center (MTC)

  • 8/4/2019 Auto Desk - Testing Ppt _11th June

    6/14

    Copyright 2007 Satyam Computer Services Ltd. All rights reserved.

    Service Coverage Using Managed TestCenter

  • 8/4/2019 Auto Desk - Testing Ppt _11th June

    7/14Copyright 2007 Satyam Computer Services Ltd. All rights reserved.

    Verification Strategies

    Verification Strategy Explanation Deliverable

    Requirements Review The study and discussions of the computersystem requirements to ensure they meet stated

    user needs and are feasible.

    Reviewed statement of requirements.

    Design Review The study and discussion of the computersystem design to ensure it will support thesystem requirements.

    System Design Document, HardwareDesign Document.

    Code Walkthrough Informal analysis of the program source code tofind defects and verify coding techniques.

    Software ready for initial testing by thedeveloper.

    Code Inspection Formal analysis of the program source code to

    find defects as defined by meeting systemdesign specification.

    Software ready for testing by the testing

    team.

    Unit Testing Testing of single program, modules, or unit ofcode.

    Software unit ready for testing with othersystem component.

    Integration Testing Testing of related programs, modules, or units ofcode.

    Portions of the system ready for testingwith other portions of the system.

    System Testing Testing of entire computer system. This kind oftesting can include functional and structuraltesting.

    Tested computer system, based on whatwas specified to be developed.

    Performance Testing Testing of the application for the performance atstipulated times and stipulated number of users.

    Stable application performance.

    User Acceptance Testing (UAT) Testing of computer system to make sure it willwork in the system regardless of what the

    system requirements indicate.

    Tested and accepted system based onthe user needs.

  • 8/4/2019 Auto Desk - Testing Ppt _11th June

    8/14Copyright 2007 Satyam Computer Services Ltd. All rights reserved.

    Test Center

    Requirement

    Analysis&

    Test Plan

    BuildAccepta

    nceTesting

    Functional

    Testing

    End toEnd

    Testing Compatibility

    testing

    AutomationRegressi

    onTesting

    Performance

    Testing

    Regression

    Testing

    Execution of Testcases andlog defects

    DefectManagementQuarterly reviewprocess andSuggestimprovements

    Stage I Stage II Stage III Stage IV

    Regression testingAutomated scripts

    Performance testscriptsClosureof defectsMetricsanddashboards

    Planning ExecutionSpecialized

    TestingRegression

    Prepare automationstrategy

    Identify tool for

    automationAutomation, Dry runEnhance the scripts

    Test Planpreparation

    Test Plan

    ReviewTest CaseDesign

    Test Datapreparation

    Release Planningand Estimates

    TestingTools

    Testing

    Activities

    TestingStages

  • 8/4/2019 Auto Desk - Testing Ppt _11th June

    9/14Copyright 2007 Satyam Computer Services Ltd. All rights reserved.

    Satyam QEdge Test Automation Approach & Methodology

  • 8/4/2019 Auto Desk - Testing Ppt _11th June

    10/14Copyright 2007 Satyam Computer Services Ltd. All rights reserved.

    Sample Metrics/Dashboard

  • 8/4/2019 Auto Desk - Testing Ppt _11th June

    11/14Copyright 2007 Satyam Computer Services Ltd. All rights reserved.

    Sample Metrics/Dashboard

  • 8/4/2019 Auto Desk - Testing Ppt _11th June

    12/14Copyright 2007 Satyam Computer Services Ltd. All rights reserved.

    Reuters Siebel Case Study

    EnvironmentvvSiebel eBusiness 7.5 Order Management CRM Portal , BizTalk

    UAN

    vDuration: Engagement lasted for 9 months TestingvTotal test scenarios use cases 179,Test cases1500+

    vComplexity- Total 5 solution stream under test v12 cycles in 3 months System Test - 4 environmentsvTotal FTEs 15:28 [Onsite: Offshore]vOnsite offshore testing activity- 35:65vTools: Manual / Segue Silk / Mercury Interactive/ MS

    ChallengesvTotal Defects detected 4369 in 4 months Fast

    track Testing- 31% Critical / 42 % Major Severity-51 % High Priority 77 % Defect closed, >1.2 %defect rejected by Development team- 2 % defectreopened

    vMulti vendor Multi Time Zone- Multi GeographiesTest & Defect Management

    vStringent SLA driven test Dashboards tracking fordefect closure cycle

    vTest Environment uptime 98 %vSevere Defect closure in 2 hrsv95 % Test case Pass rate

    SolutionvIndependent Evaluation- Onsite Offshore setup- 24 X 7vParallel & Fast track & Multiple Dry Run TestingvTest Process improvement Metrics AnalysisvEarly Integration Testing for Environment proving

    vEarly involvement in all SDLC phases thru V ModelvRisk Based Testing

    enefits to the ClientvResource: Minimize test resource costs to

    55% by transitioning to offshorevDelivery Model: Time zone leverage

    increased productivity by 200% 16 X 7

    testing in shiftsvOffshore transition cost benefited in 2

    months 40 % cost reductionvPerformance Test: Performance tuning

    recommendation brought down h/winvestment by 30% in right hardwarecapacity.

    vCreated reusable test assets-35 % testscripts reused- Cycle time reduction to 2

    days form 6 days in test design work.

  • 8/4/2019 Auto Desk - Testing Ppt _11th June

    13/14Copyright 2007 Satyam Computer Services Ltd. All rights reserved.

    SAP Test Automation - Sony SAP Case Studies

    ustomer Profilev Sony has one of the largest SAP systems in the world which

    is capable of processing transactions worth more than 100million. Sony uses the following SAP modules: Sales andDistribution, Materials Management, Production Planning,Financial Accounting, Controlling, Asset Management, WorkflowManagement, Human Resources.vv The project consists of developing regression scripts forcomplete Sales and Distribution module and executing them asa part of monthly regression cycle.

    Customer Requirements

    v Automation of Standard SAP Business flows usingBusiness Process Testing Methodology

    v Creation of Manual Business Process testsv Execution of Automated and Manual BPTs eachmonth and updating managers with the daily progressv Building tool in VB.NET for test analysis andrequirements reporting.v Quality Center Support

    Solution

    v Provided Automated and Manual BPTs for the given SAP

    flowsv Provided Quality Center supportv Built the tool required for reporting purposesv Executed the BPTs on a monthly basis as a part ofregression cycle

    Benefits to the Client

    v Automated solution of the existing Standard flows

    v Manual test cases complying with the Business ProcessTesting standardsv Handling Quality Center support responsibilityv Better result reporting with the help of tool

  • 8/4/2019 Auto Desk - Testing Ppt _11th June

    14/14Copyright 2007 Satyam Computer Services Ltd All rights reserved

    Enterprise Data warehouse Transformation Case StudiesEnvironmentvTechnical Environment: Data Stage Enterprise Edition

    v7.5.2, SUSE Linux 9, Perl 5.8.3(Perl-DBI 1.50, DBD-ODBC-1.13, UNIX ODBC-2.2.8, Teradata Database V2R6.2, Shell

    Scripts BashvMercury Quality Center 9.0

    v Duration: 1.5 YearsvComplexity- Analyzing Business scenarios and

    working in cLDM( Communications Logical DataModel)

    vTotal FTEs 10:40 [Onsite: Offshore]vOnsite offshore testing activity- 30:70vTools: Data Stage ,Mercury Quality Center,

    Teradata.

    Challengesv A total of 1110 defect was detected in 90days

    of which 12.7% critical ,44% High,40.7% lowseverity .Of all the defects 96.8% defectsclosed 2% rejected and 1.2% deferred to

    TR1.1v One environment to be accessed by Multipleusers (Ecap, Data-Out , Data-In)

    v Multi Vendor Multi Time Zone Multigeographies Test & Defect Management.

    v Testing of jobs which had undergone 85%changes according to the CRs in TR 1.1achieved successfully in a very short period.

    v A total of 282 defects were detected in TR1.1in 40 days out of which 5% defects were

    critical, 44% high and 3% defects rejected

    SolutionvSystem Testing of Field Validation job , validating the source

    system files.vSystem Testing of PCS, Validating the Files using

    PCS(Process Control System).vSIT Shakeout (Setting up the Environment for Offshore

    Testing).vSIT Support for 24 X 7 Offshore.vProgression and Regression Testing.v24 X 7 UAT support from Offshore.Testing of the Business

    ScenariosvTracking all the defects and status by maintaining defect

    tracking using Quality Center 9.0.vMultiple Cycles of ETL System testing performed in TR 1.1vReferential Integrity testing (RI).Data Quality Check for the

    source files.

    enefits to the Clientv Minimize test resource costs to 60% by

    transitioning to offshore.vDetecting the Defects in initial stages by

    following the V Model approach.

    vDefect Management Process made easy withQC.

    v 24 X 7 supporthelped in delivering thedeliverables in the Stipulated time and helped inresource management by reducing the numberof resources required to 50%.

    v By reusing PCS Scriptsfor validating the CC&Bfiles the re-usability was achieved

    v 60% of the Test cases were re-usable, hence

    reduced the rework on the test cases from 4days to 2 days.