Hexaware Webinar Series Presents - Hexaware - IT, BPO...

25
The Presentation Will Begin Momentarily Hexaware Webinar Series Presents: Agile Framework for Calibrating the Enterprise Data Warehouse Karthikeyan Sankaran - Hexaware Technologies Nov 15 th , 12 pm Eastern Time

Transcript of Hexaware Webinar Series Presents - Hexaware - IT, BPO...

Page 1: Hexaware Webinar Series Presents - Hexaware - IT, BPO ...hexaware.com/casestudies/agileframeworkforcalibratingthe_edw.pdf · - SIT, UAT & Regression Testing is performed once all

1© Copyright, Hexaware Technologies

The Presentation Will Begin Momentarily

Hexaware Webinar Series Presents:

Agile Framework for Calibrating the Enterprise Data WarehouseKarthikeyan Sankaran - Hexaware Technologies

Nov 15th, 12 pm Eastern Time

Page 2: Hexaware Webinar Series Presents - Hexaware - IT, BPO ...hexaware.com/casestudies/agileframeworkforcalibratingthe_edw.pdf · - SIT, UAT & Regression Testing is performed once all

2© Copyright, Hexaware Technologies

Our mission : To build value for clients through innovative use of technology and talent

Business

Areas

Transportation

ERP/HRIT

Insurance

BFS

IndiaIndia’’s s Fastest Fastest

Growing MidGrowing Mid--Sized Sized

CompanyCompany

32 offices worldwide

18 Global locations

17 years of technology outsourcing expertise

55 Global 500 clients

166 Clients served worldwide

187 USD mil Revenues, 06

6900 Employees worldwide

A Global IT and BPO Service Provider

Page 3: Hexaware Webinar Series Presents - Hexaware - IT, BPO ...hexaware.com/casestudies/agileframeworkforcalibratingthe_edw.pdf · - SIT, UAT & Regression Testing is performed once all

3© Copyright, Hexaware Technologies

Strategies and Strengths

Core CompetencyManagement of business-

critical applications offshore

Organization TraitsConsultative approach, Responsive and Result-

oriented

Robust BackboneWorld-class infrastructure, Flexible delivery models, SEI CMMi Level 5, BS7799

Track Record88% Repeat Business

Offshore transition expertiseGlobal Delivery

Leading BFSI service provider with proprietary products (Operational Risk, Collections, Leasing, Wealth Management

# 1 Airlines services provider in India

8 of top 10 airlines are our clients

# 1 provider of HR-IT services in India

500+ projects, 750+ resources

Specialized Insurance service provider Content management, Fraud Mgmt, Work flow, SOX, BPO

LEADERSHIP

THROUGH

FOCUS

LEADERSHIP

THROUGH

FOCUS

ENHANCING

VALUE

ENHANCING

VALUE

Page 4: Hexaware Webinar Series Presents - Hexaware - IT, BPO ...hexaware.com/casestudies/agileframeworkforcalibratingthe_edw.pdf · - SIT, UAT & Regression Testing is performed once all

4© Copyright, Hexaware Technologies

Agenda

Enterprise Data Warehouse (EDW) – Critical Leverage Points

Managing EDW Evolution – Agile Approach

EDW Calibration

Data Warehouse Estimation using Function Points

Hexaware’s Maintenance & Support Model for BI CoE

Real life Case Study

Summary

Q & A

Business Intelligence & Analytics Practice @ Hexaware

Page 5: Hexaware Webinar Series Presents - Hexaware - IT, BPO ...hexaware.com/casestudies/agileframeworkforcalibratingthe_edw.pdf · - SIT, UAT & Regression Testing is performed once all

Business Intelligence & Analytics Practice

The primary horizontal competency center within Hexaware, with more than 100% CAGR for the last four years

Experience of more than 50 customer engagements covering the entire business intelligence and analytics services space

Our Core Expertise lies in helping organizations :-

To define and execute the Enterprise Data Warehouse Roadmap

In setting up large/medium/small size BI COE, Offshore Development Centers

To solve Analytics articulation and deployment

To solve point BI needs across multiple tools in- Reporting- Data Integration- Data Management

Page 6: Hexaware Webinar Series Presents - Hexaware - IT, BPO ...hexaware.com/casestudies/agileframeworkforcalibratingthe_edw.pdf · - SIT, UAT & Regression Testing is performed once all

6© Copyright, Hexaware Technologies

Enterprise Data Warehouse – The Focus

Page 7: Hexaware Webinar Series Presents - Hexaware - IT, BPO ...hexaware.com/casestudies/agileframeworkforcalibratingthe_edw.pdf · - SIT, UAT & Regression Testing is performed once all

7© Copyright, Hexaware Technologies

EDW – Critical Leverage Points

EDW needs to be measured & calibrated against pre-set goals

Tremendous cost & scalability benefits in outsourced EDW scenario

Power of an EDW ∞ (Number of consumers)n

Keeps Evolving over time – Enterprise DW can never be completely built

BI systems drive business decisions – “Total Alignment” with corporate vision

Page 8: Hexaware Webinar Series Presents - Hexaware - IT, BPO ...hexaware.com/casestudies/agileframeworkforcalibratingthe_edw.pdf · - SIT, UAT & Regression Testing is performed once all

8© Copyright, Hexaware Technologies

Setting the Context

Assumptions

Enterprise Data Warehouse (EDW) - Data repository that acts as the single version of truth for downstream analytical applications (data marts, reporting, data mining etc.)

Organization has got an EDW in place - Can be a Normalized structure (Inmon’s school) or can be a dimensional structure with conformed dimensions (Kimball’s view)

Process Architecture - Set of standards / policies / procedures that dictate the evolution of the Enterprise Data Warehouse is already defined

Technical Architecture which encompasses the tools / products to be used for engineering the EDW has already been selected and standardized within the organization

Page 9: Hexaware Webinar Series Presents - Hexaware - IT, BPO ...hexaware.com/casestudies/agileframeworkforcalibratingthe_edw.pdf · - SIT, UAT & Regression Testing is performed once all

9© Copyright, Hexaware Technologies

Process Methodologies – An OverviewProblems in DW/BI contextDefinition

Waterfall

Software development flows steadily through the phases of requirements analysis, design, implementation, testing (validation), integration & maintenance

Requirements can never be completely defined for enterprise wide BI systems

Combines elements of both design and prototyping-in-stages, in an effort to combine advantages of top-down and bottom-up concepts.

Spiral

Establishes the feed-back loop so that changing user requirements can be accommodated by iterating over analysis-design-coding-testing phases

Rapid delivery of business functionality in small bursts is not addressed

Iterative

The Answer Development based on

Does not relate to the overall “vision” of the system being developed

Agile Framework

Page 10: Hexaware Webinar Series Presents - Hexaware - IT, BPO ...hexaware.com/casestudies/agileframeworkforcalibratingthe_edw.pdf · - SIT, UAT & Regression Testing is performed once all

10© Copyright, Hexaware Technologies

Introduction to Agile Philosophy

Agile Methodology – Definition

Agile development is a software development approach that "cycles" through the development phases, from gathering requirements to delivering functionality into a working release.

Salient Points

Shared Vision and Small Teams working on specific functionalityFrequent Releases that make business senseRelentlessly manage scope – Managing the scope-time-resources triad effectivelyCreating a Multi-Release Framework with master plan and supporting architectureAccommodate changes “gracefully”

BI – Agile Fitment

The ultimate goal of any DW/BI project is to roll out new business functionality on a regular and rapid basis with a high degree of conformance to what was already there Fits in well with the “Agile” philosophy

Page 11: Hexaware Webinar Series Presents - Hexaware - IT, BPO ...hexaware.com/casestudies/agileframeworkforcalibratingthe_edw.pdf · - SIT, UAT & Regression Testing is performed once all

11© Copyright, Hexaware Technologies

Agile Framework – Planning Phase

Start End Activities Deliverables

Create & Prioritize the Stories

Conduct JAD sessions and collect user requirements

Have stakeholders sign-off on BI vision document

Functionality List (Stories) –With approximate effort estimates

Create the phase plan Identify Phases for completing the “Story” “Story – Phase” Mapping Document

Identify the “Cycles” Identify number of development & stabilization cycles required to complete the Phase

“Story – Phase – Cycles”Mapping Document

Create the Release Plan Identify the cycles (across stories) that can fit into a particular release

Monthly Release Plan

Planning Phase – Salient Points

- Enterprise Data Warehouse is already present- Technology & Process Infrastructure are already in place- Planning is usually done as soon as the BI budget for the forthcoming year and

business level objectives are finalized

Page 12: Hexaware Webinar Series Presents - Hexaware - IT, BPO ...hexaware.com/casestudies/agileframeworkforcalibratingthe_edw.pdf · - SIT, UAT & Regression Testing is performed once all

12© Copyright, Hexaware Technologies

Agile Framework – Execution Phase

Start End Activities Deliverables

Execute the Cycles Each cycle will have its own specifications, design & test plan documents

Develop the code to satisfy the requirements for each cycle

Design Document

Test Plan

Test Results

Deliver the Release All the cycles combined into a working release (typically delivered once a month)

Code Release Plan

Deliver the Phase When all cycles for particular phase are completed, perform a regression test on some of the critical cycles

Phase Release Plan

Complete the Story When all the phases for a particular story are completed, perform the regression test on some of the critical phases

Complete the documentation of the business functionality achieved by that particular story

Execution Phase – Salient Points

- Execution of each cycle: Waterfall model (Requirements Design Coding Unit Testing)- System Integration Testing (SIT) and User Acceptance Testing (UAT) are typically performed once all the cycles in a particular phase are completed- SIT, UAT & Regression Testing is performed once all the phases for a story are completed

Page 13: Hexaware Webinar Series Presents - Hexaware - IT, BPO ...hexaware.com/casestudies/agileframeworkforcalibratingthe_edw.pdf · - SIT, UAT & Regression Testing is performed once all

13© Copyright, Hexaware Technologies

‘Agility’ in DW context

Phase 1 Phase 2 Phase 3Stories

D1 D2 S1 S2 S3 D1 D2 D3 D4 S1 S2

Story 1: Integrating Sales & Marketing data from Siebel into DW

D1 D2 D3 S1 S2 S3

Loading Dimension Data

Loading Actual Facts

Loading Forecast Data

Phase 1 Phase 2 Phase 3Stories

D1 D2 D1 D2 D3 S1 S2

Story 2: Project Accounting Analytics

D1 D2 D3 S1 S2 S3

Constructing the BO Universe

Finalizing analytic measures

Developing Dashboards

Release Month

Includes Deliverables (Spec + Design doc + Code)

January D1 of Phase 1 for Story 1 Contacts Dimension created in DW

D1 of Phase1 for Story 2 BO Universe developed without timesheet data

February D2 of Phase 2 for Story 1 Opportunities Dimension included in DW

S1,S2 of Phase 1 for Story 2 Performance optimization for the load processes

D2 of Phase 1 for Story 2 Timesheet data included in the BO Universe

Release Plan

The “Agile” Vision

Page 14: Hexaware Webinar Series Presents - Hexaware - IT, BPO ...hexaware.com/casestudies/agileframeworkforcalibratingthe_edw.pdf · - SIT, UAT & Regression Testing is performed once all

14© Copyright, Hexaware Technologies

Critical Success Factor 1 - Calibrating the EDW

Calibration = “Measurement” - Can be defined as the alignment of process to certain Calibration – General Definition

calibration factors so that the health of the process can be measured with respect to those factors

Strategic tool to prioritize and align the EDW with the corporate visionMeasure the evolution of EDW against pre-set goalsMechanism to identify technology pain areas and take appropriate corrective actions Is a way to objectively communicate the progress of EDW to business stakeholdersHelps the DW project manager in tactically planning for the immediate future

Calibration – In Enterprise Data Warehouse Context

Next few slides would illustrate the calibration process that is developed and perfected by Hexaware over multiple BI - Maintenance & Support engagements

Page 15: Hexaware Webinar Series Presents - Hexaware - IT, BPO ...hexaware.com/casestudies/agileframeworkforcalibratingthe_edw.pdf · - SIT, UAT & Regression Testing is performed once all

15© Copyright, Hexaware Technologies

EDW Calibration – Level 1 Scorecard

Enterprise Data Warehouse - Calibration for '07

MonthPlanned Rating

Revised Rating

Actual Rating Remarks

January 8% 8% 10% Siebel Integration initiated earlier than expectedFebruary 15% 15% 12% ETL Upgrade - Not proceeding as per planMarch 23% 23% 21% All projects going as per planApril 32% 32% 33% Sales Forecasting project - Good ProgressMay 41% 41% 38% New high priority project - Executive DashboardsJune 50% 47% 45% All projects going as per planJuly 62% 55% 56% All projects going as per planAugust 70% 68% 68% All projects going as per planSeptember 78% 75% 73% OLAP migration having resourcing issuesOctober 87% 82% 78% HR Analytics - Data Quality IssuesNovember 96% 94%

December 100% 100%

1 2

Level - 1 scorecard – End result of the Calibration Process

3

Level -2 scorecard – Let’s focus on Oct ’07 in the next slide

4

Page 16: Hexaware Webinar Series Presents - Hexaware - IT, BPO ...hexaware.com/casestudies/agileframeworkforcalibratingthe_edw.pdf · - SIT, UAT & Regression Testing is performed once all

16© Copyright, Hexaware Technologies

EDW Calibration – Level 2 Scorecard

Enterprise Data Warehouse Scorecard for October '07S.No Component Goal Actual Rating Weightage

1 Sales Forecasting Integration 100% 98% 0.05

2 Master Data Management 88% 85% 0.15

3 Informatica Upgrade to 8.5 87% 86% 0.2

4 CEO Dashboard 85% 81% 0.3

5 Commissions Warehouse 55% 53% 0.02

6 Reports consolidation Project 78% 73% 0.08

7 HR Analytics 70% 56% 0.1

8 Project Accounting Warehouse 70% 67% 0.1

Overall 82% 78%

EDW – Calibration of ‘07Drill down

1

2

3

Overall Rating = ΣActual Rating * Weightage

4

Weightages are arrived at using Analytic Hierarchy process

Level 3 Scorecard – Actual Rating computation for each component

5

Page 17: Hexaware Webinar Series Presents - Hexaware - IT, BPO ...hexaware.com/casestudies/agileframeworkforcalibratingthe_edw.pdf · - SIT, UAT & Regression Testing is performed once all

17© Copyright, Hexaware Technologies

EDW Calibration – Level 3 Scorecard

Component - HR AnalyticsSub-Components Calibration Factors Sub-Component Scores

Functionality Performance Data QualitySub-component

rankSub-component

scores

Developing Dimensions 90% 95% 12% 0.2 13.6%Developing Facts 75% 47% 10% 0.4 18.8%Semantic Layer 85% 75% 10% 0.2 11.9%HR Reports 85% 70% 10% 0.2 11.6%

Calibration Factor Rank 0.4 0.3 0.3Calibration Factor Scores 32.8% 20.0% 3.1% 56.0%

1 2

3

4

4

Calibration Factors – Defined as per organization needs

Developing Facts: (Sub-component Score) = (75% * 0.4 + 47% * 0.3 + 10% * 0.3) * 0.4 = 18.8%Data Quality: (Calibration Factor Score) = (12% * 0.2 + 10% * 0.4 + 10% * 0.2 + 10% * 0.2) * 0.3 = 3.1%

Functionality (Dimensions) = Number of Dimension tables created / Total number of targeted dim tablesFunctionality (Facts) = Number of use cases completed / Total number of identified use casesPerformance (Facts) = (1 / Actual Time taken by Fact load) / (1 / Targeted load time as per standards)Data Quality (Facts) = Actual ‘System of Record’ identified for HR measures / Total number of measures

5

Page 18: Hexaware Webinar Series Presents - Hexaware - IT, BPO ...hexaware.com/casestudies/agileframeworkforcalibratingthe_edw.pdf · - SIT, UAT & Regression Testing is performed once all

18© Copyright, Hexaware Technologies

Analytical Hierarchical Process(AHP)

What is AHP?

AHP is a systematic procedure that helps to:Represent the elements of any problem, breaking it down into smaller constituents Assign weightages to each constituent by following a pairwise comparison techniqueLeverages expert judgment and intuitive feel into a coherent framework for problem solving

AHP – How is it used in the Calibration Framework?

AHP is used at 2 levels in the Calibration FrameworkAssign weightage to each component (Stories) that forms part of the EDW –

In our example: MDM had a weightage of 0.15, Informatica Upgrade of 0.2 and CEO dashboard had a weightage of 0.3

Within each component (Stories) assign weightages to the Sub-components (Phases) and Calibration Factors

In our example: For the HR Analytics component, sub-component - Develop dimensions had a weightage of 0.2, Developing Facts had 0.4 etc. Also each of the calibration factors had their weightages assigned: Functionality - 0.4, Performance -0.3, Data Quality – 0.3

Page 19: Hexaware Webinar Series Presents - Hexaware - IT, BPO ...hexaware.com/casestudies/agileframeworkforcalibratingthe_edw.pdf · - SIT, UAT & Regression Testing is performed once all

19© Copyright, Hexaware Technologies

Critical Success Factor 2 – Estimation Model

Robust Estimation Process – Critical for Implementing the Agile FrameworkAgile Framework – Rapid execution of Development & Stabilization cyclesSize & Effort has to be determined for each Cycle/Phase/StoryFunction Points (FP) is a well established scientific way to estimate for applications that are rich in business functionallyFP – Not used extensively in Data Warehousing context due to limitations

Hexaware’s Estimation Model for EDW

Hexaware has developed a unique estimation model that facilitates adoption of Function Points for Data Warehousing applicationsThe estimation model won the second prize in the International Software

Estimation Colloquium 2007:

http://www.qaiasia.com/Conferences/sec2007/leadership.htm

Page 20: Hexaware Webinar Series Presents - Hexaware - IT, BPO ...hexaware.com/casestudies/agileframeworkforcalibratingthe_edw.pdf · - SIT, UAT & Regression Testing is performed once all

20© Copyright, Hexaware Technologies

Estimation Methodology

Before

Size Computation

• Compute size of the component using Function Points

BI Complexity Assessment

• Identify list of specific environment factors that affect the overall effort

Regression Analysis

• Using historical data formulate the regression equation that provides the effort for given inputs

Model Implementation

• Implement the model and compute the pre and post effort variance sigma values

After

Page 21: Hexaware Webinar Series Presents - Hexaware - IT, BPO ...hexaware.com/casestudies/agileframeworkforcalibratingthe_edw.pdf · - SIT, UAT & Regression Testing is performed once all

21© Copyright, Hexaware Technologies

Hexaware - DW & BI Support Model

Phase Salient Points

Planning • Comprehensive Due Diligence & Portfolio Analysis

Knowledge Transfer •Information gathering focused on eliciting the “tacit”knowledge from subject matter experts

Responsibility Transfer

•Reverse Knowledge Transfer in a structured fashion

•Shadow & Reverse-shadow for Service Requests

Steady State •SLA based project control, Clear communication channels, DW Calibration, Deployment of Solution Accelerators

Page 22: Hexaware Webinar Series Presents - Hexaware - IT, BPO ...hexaware.com/casestudies/agileframeworkforcalibratingthe_edw.pdf · - SIT, UAT & Regression Testing is performed once all

22© Copyright, Hexaware Technologies

Business SituationClient is a world-leading IT company with over USD 6 Billion in revenues. The Business Intelligence group captures millions of business transactions and supports over 8000 users across the globe.

Solution & Engagement Model

BI applications within the Sales & Marketing IT support area was outsourced to Hexaware to be managed using an onsite – offshore model

Hexaware’s rich experience in managing enterprise applications like DW/BI, ERP, CRM helps in bringing operational efficiencies for “Business-as-usual”support and economies of scope for future enhancements

Technologies

Business Benefits

Statistics

Team Size : 50 member team

Onsite / Offshore ratio: 15:85

53 Critical Applications supported

8000 users spread across 51 countries

1500 ETL Mappings supported

900 ASP/JSP Screens supported

Close to 140,000 BO reports executed monthly

One of the World’s Largest IT Companies

Decrease in total cost for customer on a Y-o-Y basis by leveraging the onsite-offshore model for application managementIncrease in throughput of service requests on a monthly basis leading to faster turn-around time for new user requirementsSignificant benefits associated with converting Fixed cost into Variable costs in deploying Hexaware personnel as & when required for new projectsSignificant productivity improvement on Y-o-Y basis

OLAP Tools – Business Objects XI, Microstrategy

ETL Tools – Informatica 7.1, Microsoft DTS 2000

Databases – Oracle 9i, SQL Server 2000

Other Technologies – JSP, ASP, PL/SQL

Source Systems – PeopleSoft, Siebel, Oracle ERP, Legacy systems

Real-life Scenario

Page 23: Hexaware Webinar Series Presents - Hexaware - IT, BPO ...hexaware.com/casestudies/agileframeworkforcalibratingthe_edw.pdf · - SIT, UAT & Regression Testing is performed once all

23© Copyright, Hexaware Technologies

SummaryThe “Take-aways”

Enterprise Data Warehouses are complex to manage as they constantly evolve over timeAgile Framework + EDW Calibration + FP based Estimation Model Provides a powerful way

of measuring and enhancing Business Intelligence application performanceCalibration can also be used for managing standalone datamarts and other BI applicationsAnalytical Hierarchy Process (AHP) – Is a simple yet comprehensive way of determining relative

importance / weightages among the sub-projects that make up the EDWFunction Points can be adapted to the Data Warehousing scenario

If you are interested in this topic, you might also be interested in :

Hexaware’s consulting assignment (6-8 weeks) that helps organizations set up the process for Agile Framework deploymentDeep-dive session on Data Warehouse CalibrationDeep-dive session on Function Point based Estimation for Data WarehousingDeep-dive session on Hexaware’s model for building BI CoE

Page 24: Hexaware Webinar Series Presents - Hexaware - IT, BPO ...hexaware.com/casestudies/agileframeworkforcalibratingthe_edw.pdf · - SIT, UAT & Regression Testing is performed once all

24© Copyright, Hexaware Technologies

Q & A

Q & A

You can also reach us at

[email protected]

Page 25: Hexaware Webinar Series Presents - Hexaware - IT, BPO ...hexaware.com/casestudies/agileframeworkforcalibratingthe_edw.pdf · - SIT, UAT & Regression Testing is performed once all

25© Copyright, Hexaware Technologies

Thank You