Hexaware Webinar Series Presentshexaware.com/casestudies/acceleratedtesting.pdf · 10 STRATEGY...

31
Vaughn Paladin-CEO, FocusFrame The Presentation Will Begin Momentarily Andy Balistrieri- SAP Alliance Manager, FocusFrame Hexaware Webinar Series Presents: Mitigating Risk: Accelerated ROI on SAP Testing

Transcript of Hexaware Webinar Series Presentshexaware.com/casestudies/acceleratedtesting.pdf · 10 STRATEGY...

Page 1: Hexaware Webinar Series Presentshexaware.com/casestudies/acceleratedtesting.pdf · 10 STRATEGY APPLICATIONS OPERATIONS SAP, Oracle, SOA, J2EE, .NET HP Quality Center HP Project &

1

Vaughn Paladin-CEO, FocusFrame

The Presentation Will Begin Momentarily

Andy Balistrieri- SAP Alliance Manager, FocusFrame

Hexaware Webinar Series Presents:Mitigating Risk: Accelerated ROI on SAP Testing

Page 2: Hexaware Webinar Series Presentshexaware.com/casestudies/acceleratedtesting.pdf · 10 STRATEGY APPLICATIONS OPERATIONS SAP, Oracle, SOA, J2EE, .NET HP Quality Center HP Project &

2

Hexaware Webinar Series Presents:Mitigating Risk: Accelerated ROI on SAP Testing

Vaughn Paladin-CEO, FocusFrameAndy Balistrieri- SAP Alliance Manager, FocusFrame

Page 3: Hexaware Webinar Series Presentshexaware.com/casestudies/acceleratedtesting.pdf · 10 STRATEGY APPLICATIONS OPERATIONS SAP, Oracle, SOA, J2EE, .NET HP Quality Center HP Project &

3

Strategies and Strengths

Page 4: Hexaware Webinar Series Presentshexaware.com/casestudies/acceleratedtesting.pdf · 10 STRATEGY APPLICATIONS OPERATIONS SAP, Oracle, SOA, J2EE, .NET HP Quality Center HP Project &

4

Mitigating Risk: Accelerated ROI on SAP Testing

Vaughn Paladin CEO

Andy Balistrieri SAP Alliance Manager

May 31, 2007

Page 5: Hexaware Webinar Series Presentshexaware.com/casestudies/acceleratedtesting.pdf · 10 STRATEGY APPLICATIONS OPERATIONS SAP, Oracle, SOA, J2EE, .NET HP Quality Center HP Project &

5

Agenda

FocusFrame Introduction

Customer Pain Point – Accurate Testing

Accelerated Testing – Background, Benefits and Solution

Customer Results – How FocusFrame Can Help

Q&A

Page 6: Hexaware Webinar Series Presentshexaware.com/casestudies/acceleratedtesting.pdf · 10 STRATEGY APPLICATIONS OPERATIONS SAP, Oracle, SOA, J2EE, .NET HP Quality Center HP Project &

6

FocusFrame Introduction

End-to-End ServicesValidate and optimize enterprise systems for CRM, ERP, and web-based technologies

FocusFrame, a Hexaware company, is a leading global provider of business technology optimization (BTO) consulting and services.

Risk Cost

FocusFrame servicesreduce risk and cost

Page 7: Hexaware Webinar Series Presentshexaware.com/casestudies/acceleratedtesting.pdf · 10 STRATEGY APPLICATIONS OPERATIONS SAP, Oracle, SOA, J2EE, .NET HP Quality Center HP Project &

7

FocusFrame Introduction

Strategic APT™ MethodologyPatented center of excellence approach for QA and testing

Customized SolutionsPatented business process testing (BPT) acceleratorsCustom solutions for SAP, Oracle, PeopleSoft, and Siebel applications

Global PresenceWorldwide development centersFlexible options for onsite, near-shore, off-shore, and outsourcing capabilities

Deep-Testing CompetenciesSpanning industries including financial services, insurance, telecommunications, healthcare, transportation, manufacturing, and hospitality

FocusFrame has helped hundreds of global customers optimize their IT investments with:

Page 8: Hexaware Webinar Series Presentshexaware.com/casestudies/acceleratedtesting.pdf · 10 STRATEGY APPLICATIONS OPERATIONS SAP, Oracle, SOA, J2EE, .NET HP Quality Center HP Project &

8

FocusFrame’s APT™ Methodology Overview

Page 9: Hexaware Webinar Series Presentshexaware.com/casestudies/acceleratedtesting.pdf · 10 STRATEGY APPLICATIONS OPERATIONS SAP, Oracle, SOA, J2EE, .NET HP Quality Center HP Project &

9

APPLICATIONS OPERATIONSSTRATEGY

SAP, Oracle, SOA, J2EE, .NET

HP QualityCenter

HP Project & Portfolio

Management Center

CIO Office

CTO Office

HP SOACenter

HP PerformanceCenter

Universal C

MD

BHP Business Availability

Center HP ServiceManagement

Center

HP Operations

Center

HP Change & Configuration

CenterHP Network Management

Center

HP Software BTO Offerings

Page 10: Hexaware Webinar Series Presentshexaware.com/casestudies/acceleratedtesting.pdf · 10 STRATEGY APPLICATIONS OPERATIONS SAP, Oracle, SOA, J2EE, .NET HP Quality Center HP Project &

10

APPLICATIONS OPERATIONSSTRATEGY

SAP, Oracle, SOA, J2EE, .NET

HP QualityCenter

HP Project & Portfolio

Management Center

CIO Office

CTO Office

HP SOACenter

HP PerformanceCenter

Universal C

MD

BHP Business Availability

CenterHP ServiceManagemen

tCenter

HP Operations

Center

HP Change & Configuration

CenterHP Network Management

Center

APPLICATIONS OPERATIONSSTRATEGY

• Center Of Excellence (COE) Design & Implementation Services

• PPM Strategy & Design Services

• QA Strategy Design Services

• Application Specific QA Strategy Services

• BPT Accelerators:•SAP•Siebel•Oracle•PeopleSoft

• Performance Validation & Optimization Services

• QA Dashboard Design Services

• PPM Implementation

• QA Outsourcing

• Application Monitoring Design and Implementation Services:

•BAC•UCMDB•SiteScope•Openview

• BAC Outsourcing and Maintenance Services

• PPM Deployment Management Design & Implementation Services

• PPM Outsourcing and Maintenance Services

HP Software BTO Offerings

Page 11: Hexaware Webinar Series Presentshexaware.com/casestudies/acceleratedtesting.pdf · 10 STRATEGY APPLICATIONS OPERATIONS SAP, Oracle, SOA, J2EE, .NET HP Quality Center HP Project &

11

Agenda

FocusFrame Introduction

Customer Pain Point – Accurate Testing

Accelerated Testing – Background, Benefits and Solution

Customer Results – How FocusFrame Can Help

Q&A

Page 12: Hexaware Webinar Series Presentshexaware.com/casestudies/acceleratedtesting.pdf · 10 STRATEGY APPLICATIONS OPERATIONS SAP, Oracle, SOA, J2EE, .NET HP Quality Center HP Project &

12

Source: SAP Upgrade Survey (700 interviews)

Project management

Technical upgrade/ minimum downtime

Adapt application/modification adjustment

Efficient testing

End-user training20%

30%

40%

50%

60%

Other

IT infrastructure

Challenges in Executing an SAP ERP Transition and Upgrade

Page 13: Hexaware Webinar Series Presentshexaware.com/casestudies/acceleratedtesting.pdf · 10 STRATEGY APPLICATIONS OPERATIONS SAP, Oracle, SOA, J2EE, .NET HP Quality Center HP Project &

13

Cost per Fault 1x 1x 1x 5x 10x 50x

Fault Stream Analysis: Why Testing is Critical

TestingUser

AcceptanceTesting

Deploy toProduction

Fault Stream Analysis Savings: 48%

Source – Software Engineering Institute; Carnegie Mellon University; Handbook CMU/SEI-96-HB-002; page 56-58

Software Development Lifecycle

Planning &Requirements Design Development

Fault Origination10% 40% 50%

RequirementsTest Planning

DesignReview

DevelopmentUnit Testing

FunctionalTesting

SystemTesting Production

Current Cost $6K $13K $20K $101K $363K $252K

20%13%6% 20% 5%36%Fault Discovery

With BTO Results $8K $25K $35K $76K $151K $101K

With BTO Results 8% 25% 35% 15% 15% 2%

Page 14: Hexaware Webinar Series Presentshexaware.com/casestudies/acceleratedtesting.pdf · 10 STRATEGY APPLICATIONS OPERATIONS SAP, Oracle, SOA, J2EE, .NET HP Quality Center HP Project &

14

Challenges in Scaling Test Automation

Non-Technical Subject-Matter Experts Studies show 80% of non-technical subject-matter experts deploy manual testing.

Test Documentation is Separate from Test AutomationBuilding manual tests is a separate effort from building automated scripts. This duplicates work.

Cost of Test Maintenance is HighQuality assurance teams expend a huge effort maintaining automated and manual test assets.

Test Automation Scope is MinimizedBecause test automation requires a stable application, there is often not enough time left to automate before deployment.

Page 15: Hexaware Webinar Series Presentshexaware.com/casestudies/acceleratedtesting.pdf · 10 STRATEGY APPLICATIONS OPERATIONS SAP, Oracle, SOA, J2EE, .NET HP Quality Center HP Project &

15

Agenda

FocusFrame Introduction

Customer Pain Point – Accurate Testing

Accelerated Testing – Background, Benefits and Solution

Customer Results – How FocusFrame Can Help

Q&A

Page 16: Hexaware Webinar Series Presentshexaware.com/casestudies/acceleratedtesting.pdf · 10 STRATEGY APPLICATIONS OPERATIONS SAP, Oracle, SOA, J2EE, .NET HP Quality Center HP Project &

16

]

]

]

Test Strategies for SAP Applications

Hope for the Best

BusinessProcessTestScript

Accelerated Testing Solution

ManualTesting

Automated Record and

Replay

Business Process Testing

The Evolution of Testing

Page 17: Hexaware Webinar Series Presentshexaware.com/casestudies/acceleratedtesting.pdf · 10 STRATEGY APPLICATIONS OPERATIONS SAP, Oracle, SOA, J2EE, .NET HP Quality Center HP Project &

17

Accelerator Testing Infrastructure

Application Library

Business Components

Business Process Scripts

Components

SAPLibrary

SiebelLibrary

OracleLibrary

WebLibrary

CBASETM Foundation Library

Page 18: Hexaware Webinar Series Presentshexaware.com/casestudies/acceleratedtesting.pdf · 10 STRATEGY APPLICATIONS OPERATIONS SAP, Oracle, SOA, J2EE, .NET HP Quality Center HP Project &

18

Accelerated Testing Customization and Implementation

ImportAccelerator

Libraries

1

HP Quality Center

UITransaction

Export

2

AcceleratorImport Tools

Auto-GenerateBusiness

Components

3Create

End-to-EndBusiness

Processes

4

Page 19: Hexaware Webinar Series Presentshexaware.com/casestudies/acceleratedtesting.pdf · 10 STRATEGY APPLICATIONS OPERATIONS SAP, Oracle, SOA, J2EE, .NET HP Quality Center HP Project &

19

Order to Cash

Procure to Pay Process

Create PO from Purchase RequisitionCreate Shipping NotificationEnter Good ReceiptEnter and Check Invoice

Create Purchase RequisitionRelease the Purchase Requisition

Accelerated Testing Framework

Page 20: Hexaware Webinar Series Presentshexaware.com/casestudies/acceleratedtesting.pdf · 10 STRATEGY APPLICATIONS OPERATIONS SAP, Oracle, SOA, J2EE, .NET HP Quality Center HP Project &

20

Benefits of Accelerated Testing

Non-Technical Subject-Matter Experts Business analysts can create and execute automated functional tests (drag and drop).

Test Documentation Reduces Maintenance EffortsThe duplicated work of updating manual scripts and creating automated scripts is eliminated.

Cost of Test Maintenance is Reduced by up to 80%The re-use of components accelerates script creation, and centralized functional objects propagate throughout all scripts that use them.

Test Automation Scope is MaximizedTest automation does not require a stable application because scripting is done within HP Quality Center, outside the record-replay functionality.

Page 21: Hexaware Webinar Series Presentshexaware.com/casestudies/acceleratedtesting.pdf · 10 STRATEGY APPLICATIONS OPERATIONS SAP, Oracle, SOA, J2EE, .NET HP Quality Center HP Project &

21

Accelerating Automation Through Test Acceleration

Start Project

Document Test Steps Run Tests Modify Tests

Document Test Steps Record Tests Run Tests Modify Tests

Build Components, Flows Map Objects Run Tests Modify Tests

BPTAccelerator Run Tests Modify Tests

Deploy Accelerator

BusinessProcessTesting

Record / Replay

Manual Testing

Project Time Line

Half the Time

Page 22: Hexaware Webinar Series Presentshexaware.com/casestudies/acceleratedtesting.pdf · 10 STRATEGY APPLICATIONS OPERATIONS SAP, Oracle, SOA, J2EE, .NET HP Quality Center HP Project &

22

Accelerated Testing: Reducing Time/Cost of Testing

200

300

400

500

600

700

800

900

1 2 3 4 5 6 7 8 9 10 # of Test Cycles

Agg

rega

ted

Effo

rt (h

ours

)

Total Effort (Hours) Per Approach(Assumption: 35 Business Processes)

Manual

Traditional Automation

Test Accelerator

Test AcceleratorROI within 2 Test Cycles

Traditional AutomationROI within 6 Test Cycles

Page 23: Hexaware Webinar Series Presentshexaware.com/casestudies/acceleratedtesting.pdf · 10 STRATEGY APPLICATIONS OPERATIONS SAP, Oracle, SOA, J2EE, .NET HP Quality Center HP Project &

23

Speeds up functional testing cycles Easy to manage pre-packaged contentIncrease test coverageIncrease re-usability and utilization of toolsReduce test maintenanceIncrease ROI and lower TCO

The Value Proposition

Page 24: Hexaware Webinar Series Presentshexaware.com/casestudies/acceleratedtesting.pdf · 10 STRATEGY APPLICATIONS OPERATIONS SAP, Oracle, SOA, J2EE, .NET HP Quality Center HP Project &

24

Agenda

FocusFrame Introduction

Customer Pain Point – Accurate Testing

Accelerated Testing – Background, Benefits and Solution

Customer Results – How FocusFrame Can Help

Q&A

Page 25: Hexaware Webinar Series Presentshexaware.com/casestudies/acceleratedtesting.pdf · 10 STRATEGY APPLICATIONS OPERATIONS SAP, Oracle, SOA, J2EE, .NET HP Quality Center HP Project &

25

HoneywellResults

Delivered over 150 test scripts which utilized over 1000 componentsReplaced over 2,000 pages of manual test scripts

Estimated SavingsManual Testing: 15+ consultants, 2-3 weeks per execution iterationManual BPT: 3200 hours of build/maintenance, 20+ hours executionAccelerated BPT: 80 hours of build/maintenance, unattended execution

Customer Results

Page 26: Hexaware Webinar Series Presentshexaware.com/casestudies/acceleratedtesting.pdf · 10 STRATEGY APPLICATIONS OPERATIONS SAP, Oracle, SOA, J2EE, .NET HP Quality Center HP Project &

26

GreenPoint MortgageResults

Delivered entire regression test suiteEstimated Savings

Manual Testing: 27 consultants, 4 days per regression iteration, 864 hours total per regression runAccelerated Testing: 5 consultants, execute overnight

Customer Results

Page 27: Hexaware Webinar Series Presentshexaware.com/casestudies/acceleratedtesting.pdf · 10 STRATEGY APPLICATIONS OPERATIONS SAP, Oracle, SOA, J2EE, .NET HP Quality Center HP Project &

27

FocusFrame Customers

Page 28: Hexaware Webinar Series Presentshexaware.com/casestudies/acceleratedtesting.pdf · 10 STRATEGY APPLICATIONS OPERATIONS SAP, Oracle, SOA, J2EE, .NET HP Quality Center HP Project &

28

How FocusFrame Can Help

ERP QA STRATEGY WORKSHOP AGENDA

FOCUSFRAME

IntroductionsReview Current ApproachReview Current QA Pain Points

Discuss Best Practice ApproachRecommendationsAccelerated TestingPerformance Testing

Review Strategic ApproachQuick WinsLeverage Current Process/ToolsRoadmap to Best PracticesNext Steps

Page 29: Hexaware Webinar Series Presentshexaware.com/casestudies/acceleratedtesting.pdf · 10 STRATEGY APPLICATIONS OPERATIONS SAP, Oracle, SOA, J2EE, .NET HP Quality Center HP Project &

29

Agenda

FocusFrame Introduction

Customer Pain Point – Accurate Testing

Accelerated Testing – Background, Benefits and Solution

Q&A

Page 30: Hexaware Webinar Series Presentshexaware.com/casestudies/acceleratedtesting.pdf · 10 STRATEGY APPLICATIONS OPERATIONS SAP, Oracle, SOA, J2EE, .NET HP Quality Center HP Project &

30

Q&A

Learn more at www.focusframe.com

Visit FocusFrame at HP Software Universe

from 6/18 – 6/22 in Las Vegas

Page 31: Hexaware Webinar Series Presentshexaware.com/casestudies/acceleratedtesting.pdf · 10 STRATEGY APPLICATIONS OPERATIONS SAP, Oracle, SOA, J2EE, .NET HP Quality Center HP Project &

31

Thank You For Attending

http://www.hexaware.com/webcastarchive.htmlFor a recording of this webinar please visit:

Hexaware Webinar SeriesUpcoming Webinars

Download Case Studies & Whitepapers at: www.hexaware.com

Register Today!

PeopleSoft Upgrade & Fusion--Are You Prepared?

G