Overview Approaches to Oracle Data Warehousing_v1

8/14/2019 Overview Approaches to Oracle Data Warehousing_v1

1/42


2/42


3/42

S292621

Overview: Approaches to Oracle Data Warehousing

Robert Stackowiak

Vice President, Business Intelligence, Oracle Technology Business Unit


4/42

The following is intended to outline our general

product direction. It is intended for information

purposes only, and may not be incorporated into any

contract. It is not a commitment to deliver any

material, code, or functionality, and should not be

relied upon in making purchasing decisions.

The development, release, and timing of any

features or functionality described for Oracles

products remains at the sole discretion of Oracle.


5/42

Best Practices from.

And you!!!


6/42

Starting Out: On the Same Page?Different Agendas Typical in IT & Lines of Business

It is about

managing and

delivering quality

data consistently

and at low cost

Information Technology

It is about

immediate access

to information

needed for

business

decisions

Lines of Business


7/42

Finding BenefitsIT Benefits are only Somewhat Motivating

ROI = Present Value of Benefits - Costs

Increasing ROI for information producers by

Reducing current costs of analysis for LOBs

Empower LOBs with tools, applications, and automated

analysis rather than manually creating custom reports

Reducing ongoing costs of analysis for IT Faster and simpler development of analytic applications

Centralized management


8/42

Finding BenefitsLines of Business produce the Big Wins

ROI = Present Value of Benefits - Costs

Increasing ROI for information consumers (LOBs) by

Enabling top-line growth

New customers/markets, most profitable customers,

React faster than the competition

Enabling bottom-line savings Optimize operations, financial management,


9/42

Typical Business Drivers

Financial Cross-sell, targeted marketing, more efficient processes

Manufacturing

Supply chain analysis / just in time inventory

Retail

Supply chain analysis / inventory control

Media & Telecommunications

Revenue across multiple channels


10/42

Typical Business Drivers

Transportation Optimized logistics management

Healthcare

Cost containment / quality of care

Civilian Government

Budget spend and reporting to constituents

Military & Intelligence

Logistics management, threat analysis


11/42

Business Strategy Map


12/42

Deploy within Scope Quickly

Pick a strategic business area Should have potentially highly visible ROI

Build business / IT partnership Limit scope, deliver projects incrementally

Assemble team with the right skills Engage systems integrators as if employees

Organization

Strategy

Assessment

& Scope

Discovery Solution

Development

& Presentation

Approval &

Budget


13/42

FRAGMENTED

DATA SOURCES

AD-HOC

PROCESS

MULTIPLE

ROLES

DISPARATE BI TOOLS AND

REPORTING SYSTEMS

DIFFERENT

METRICS

FINANCE

PLANNING

OPERATIONS

HIRINGQUALITY

EBITDA

BRAND

?

?

SERVICELEVELS

COMPANYHEALTH

?

?

?GOAL

PLAN

REPORT

MODEL

MultiplePOINT

APPLICATIONS

MultipleLEGACY

APPLICATIONS

MultipleSUPPLYCHAIN

MultipleERP

MultipleDATA

WAREHOUSES

Your Infrastructure?

CUSTOMERSERVICE

MARKETING

EXECUTIVE

FINANCE

HUMANRESOURCES

ANALYZE


14/42

A Re-architecture ApproachData Marts

Reporting

Data WarehouseApplications

ETL

DW

B

usinessIntelligence

EAI

DW

DW

Data

Warehouse

BI Tools

& Dashboards

Master Data &

Data WarehouseDatabase

MasterData Hub

ETL

EAI

Analytical

Data

Orchestration

Sales

Marketing

Call Center

Financials

Providers

Eligibility

Claims

Self Service


15/42

0

20

40

60

80

100

1998 1999 2000 2001 2002 2003 2004 2005

Database

Size

(TB)

Size of the largest data

warehouse in TopTen

Programs

Source: 2005 TopTen Program, November 2005 Winter Corporation, Waltham, MA, USA

1,487% Increase in Size from 1998 to 2005

245% Increase just from 2003 to 2005

Plan for Data Growth


16/42

Grid Control

Fusion Middleware

Automatic Storage Management

Real Application Clusters

Time to Consider Grid Deployment?


17/42

Configuring the Platform

CPU,Node

* 2Gbit based

Host Bus Adapter

Interconnect

Host Bus Adapter

Interconnect

Controller

Disk

Switch

Maximal Number ofSwitches = Numberof HBAs

Number of HBAs +No. of Controllers

Rule of Thumb:200MB/s per CPU Number of HBA pernode = number CPUs

per node

Number of nodes


18/42

Typical Platform Sizing Questions

Highest level basic questions

How much data needs to be stored in the system?

What is the mix of query types (e.g. simple, intermediate,

complex)?

How many concurrent users are there?

Technical questions

What is the expected read / query rate from the system in GB

/ second?

What is the expected read / query rate from the system in GB

/ second?

Do queries run concurrently with the data load?


19/42

Goal: Consistent Sustained Performance

30 - 50 MB/sDisk (spindle)80 MB/s*2 Gbit/sGigE NIC (interconnect)

2 Gbit/s

2 Gbit/s

8 * 2 Gbit/s

1/2 Gbit/s

-

Hardware spec

200 MB/sDisk controller

200 MB/sFiber channel

1,200 MB/s16 port switch

100/200 MB/s1/2 Gbit HBA

100 - 200 MB/sCPU core

SustainedComponent

* Limited by the protocol


20/42

Simplify: Use Optimized Warehouses

Oracle Optimized Warehouse

Reference Configurations

Documented best-practice balanced

configurations for data warehousing

Available Today!

Dell / EMC, HP, IBM, Sun

Oracle Optimized Warehouses

Scalable systems pre-installed and pre-configured: ready to run out-of-the-box

Recent announcements


21/42

Materialized Views

Salesby Region

Salesby Date

Salesby Product

Salesby Channel

QueryRewrite

Leverage Oracle Database FlexibilityMaterialized Views, Hybrid Schema

Region Date

Product Channel

SQL Query

RelationalStar Schema


22/42

and New Database CapabilitiesCube Organized Materialized Views

Materialized Views

Region Date

Product Channel

SQL Query

QueryRewrite

AutomaticRefresh

OLAP Option Cube


23/42

Analyze Large Data Sets in DatabaseBetter Performance for Sophisticated Users

Analytic Functions in the Database

OLAP Option in the Database

Data Mining Option Algorithms in the Database Nave Bayes, Associations, Adaptive Bayes

Network, Clustering algorithms, Support Vector

Machines, Nonnegative Matrix Factorization,

Decision Trees, Generalized Linear Models

You can leverage existing mining tools

SPSS Clementine InforSense


24/42

Optimizing Oracle BI Suite EE PlusLeverage the BI Server as a Cache

OLTP & ODSSystems

DataWarehouseData Mart

SAP, OraclePeopleSoft, Siebel,

Custom Apps

FilesExcelXML

BusinessProcess

FinancialPerformanceManagementApplications

InsightPerformance

Action

SetGoals

Plan

Monitor

Analyze

Report

Align

HyperionEssbase

Oracle BI Server

Common Enterprise Information Model

Reporting & Publishing

Financial Reporting

BI Publisher

Interactive Reporting

SQR Production ReportingWeb Analysis

Ad hocAnalysis

ProactiveDetectionand Alerts

MicrosoftOffice

InteractiveDashboards


25/42

Match Solutions to Needs

BI ToolsData SourcesHot-pluggable

IT ManagedUser OwnedMetadata Mgt.

ITLoBSystem Ownership

Oracle-centricHeterogeneousData Mgt. Strategy

Oracle Database OLAPHyperion Essbase

EnhancedData Warehousing

PerformanceManagement

HyperionEssbase

Oracle DatabaseOLAP Option


26/42

Still Managing Oracle like it is 1999?

Consider leaving init.ora parameters set asdefaults

Adaptive degree of parallelism, etc.

Leverage Enterprise Manager

Database Resource Manager

CPU allocation by groups of users,proactive query governing, automaticqueuing, dynamic re-prioritization

Automatic Database Diagnostics Monitoralerting & advisors

Partitioning, SQL Access, SQL Tuning,Segment, Mean Time to Recovery, andother advisors


27/42

Storage Management through ASM

Portable, high performance,

cluster file system & volume

manager

Files spread across disks to

balance load

Integrated mirroring

SAME vs. RAID 5

Accessible through Enterprise

Manager

File #1 File #2

File #1

Database 1

Database 2


28/42

Change Management ConsiderationsLeverage Change Assurance Capabilities

Capture andReplay Workload

Set Up TestEnvironments

Detect and TunePerformance Changes

Package Incidentsfor Support

Online Hot Patching

Configure and MaintainProduction System

Provision - Upgrade orClone


29/42

Partitioning Strategies

New: Interval partitioning, more composites (list-list, list-range, list-hash,

range-range), partitioning on virtual columns

Large Table

Difficult to Manage

Partition

Divide and Conquer

Easier to Manage

Improve Performance

Composite Partition

Higher Performance

More flexibility to matchbusiness needs

ORDERS ORDERS

Jan Feb

ORDERS

Jan Feb

Europe

USA


30/42

Data must be AvailableInformation Lifecycle Management to contain Cost

Management parameters: Data classification

Age / date, product, privacy, etc.

Storage Tiers

High performance, low cost,

historical Advanced Compression in tiers

Access Management & Migration

By class

ILM Assistant simplifies:

Policy management, datamanagement, compliance &security


31/42

The Data Warehouse and Availability

Disaster Recovery

Identical RAC Clusters in distance separated sites

Other Strategies: Active Data Guard, Total Recall

Extract

Servers

1. Extract

from source

systems

2. Integrate,

transform, and

denormalize

3. Query and

analyze

BI Tool

4. Data access

and publishing

STG1

(ETL/Staging) Data Warehouse 1

ETL

Manager

Users

STG2

(ETL/Staging) Data Warehouse 2


32/42

Share Data and Protect it?

DatabaseDatabaseVaultVault

MultiMulti--factorfactorDBA ControlsDBA Controls

AdvancedAdvancedSecuritySecurity

EncryptedEncryptedDataData

LabelLabelSecuritySecurity

DataDataClassificationClassification

SecureSecureBackupBackup

EncryptedEncryptedData on TapeData on Tape

ConfigurationConfigurationMgmt PackMgmt Pack

SecureSecureDeploymentsDeployments

AuditAuditVaultVault

Monitor, Alert,Monitor, Alert,ConsolidateConsolidate


33/42

SELECT * FROM orders

SELECT * FROM orders

orders

Example: Virtual Private DatabaseTransparent Security inside the Database

Server dynamically rewrites SQL

Query modification based on PL/SQL package assigned to an

object

Where clause appended to SQL statement

Where territory_id = 12

Where product_id - 22

Western

Sales Rep

Product

Manager


34/42

Deploying Pervasive BI

OKCancelHelp

Execute Action

Provide values for the following action parameters:

WestRegion

Begin Marketing Campaign

Campaign ID 42684

OBI Suite EE Plus

&

BPEL


35/42

Build from Scratch

with Traditional BI ToolsOracle Analytic Applications

Prebuilt Business Adapters forOracle, PeopleSoft, Siebel, SAP,others

Prebuilt DW design, adapts to yourEDW

Role-based dashboards andthousands of pre-defined metrics

Easy to use, easy to adapt

Weeks or Months

Back-endETL andMapping

DW Design

Define Metrics& Dashboards

Back-endETL andMapping

DW Design

Define Metrics& Dashboards

Training / Roll-out

Training / Rollout

Months or Years

Oracle Analytic Applications

solutions approach:

Faster time to value

Lower TCO

Assured business value

Source: Patricia Seybold Research, Gartner, Merrill Lynch, Oracle Analysis

Consider Analytic Applications


36/42

Oracle BI ApplicationsCheck alignment to Business Requirements

Travel

& Trans

Travel

& TransAutoAuto Comms

& Media

Comms

& MediaComplex

Mfg

Complex

MfgConsumer

Sector

Consumer

Sector EnergyEnergy Financial

Services

Financial

ServicesHigh

Tech

High

TechInsurance

& Health

Insurance

& HealthLife

Sciences

Life

SciencesPublic

Sector

Public

Sector

Other Operational& Analytic Sources

BI Tools, Database, Complementary Vertical Models / Applications

Prebuilt adapters:

SalesService &

Contact

Center

MarketingOrder

Management

& Fulfillment

Supply

ChainFinancials

Human

Resources

PipelineAnalysis

TriangulatedForecasting

Sales TeamEffectiveness

Up-sell /Cross-sell

Cycle TimeAnalysis

LeadConversion

EmployeeProductivity

CompensationAnalysis

HR ComplianceReporting

WorkforceProfile

TurnoverTrends

Return onHuman Capital

A/R & A/PAnalysis

GL / BalanceSheet Analysis

Customer& Product

Profitability

P&L Analysis

ExpenseManagement

Cash FlowAnalysis

SupplierPerformance

SpendAnalysis

ProcurementCycle Times

InventoryAvailability

EmployeeExpenses

BOM Analysis

OrderLinearity

Ordersvs. Available

Inventory

Cycle TimeAnalysis

BacklogAnalysis

FulfillmentStatus

CustomerReceivables

CampaignScorecard

ResponseRates

ProductPropensity

Loyalty andAttrition

Market BasketAnalysis

Campaign ROI

ChurnPropensity

CustomerSatisfaction

ResolutionRates

Service RepEffectiveness

Service CostAnalysis

ServiceTrends


37/42

Master Data

Business Rules

Metrics/KPIs

Targets, Plans & Actuals

Set Strategic

Objectives

Corporate

Development

Treasury

Strategies

Long-Term

Planning

Strategic Planning

Define Costing

Methods

Perform

Allocations

Report &

Analyze

Define Cost

Drivers

Cost and Profitability Management

A BI Applications Suite SpotHyperion Financial Performance Management

Data

CleansingConsolidate

Internal

Reporting &

Analysis

External

Reporting &

Compliance

Financial Close Process

Cascade Targets

Allocate

Resources

ForecastingDetailed

Budgeting

Planning and Budgeting


38/42

Good News: Improving Technology

Faster Time to Deployment

Analytic applications, SOA components, Optimized Warehouses

Pervasive Business Insight

Automated business processes, guided decisions

Right Time Predictive Insight

Advanced predictive analytics

Highly Available and Secure Solutions

On-line data accessible all of the time

Decreasing TCO

Lower-cost, self-managed, less tuning needed


39/42

Challenges

Understanding business needs & priorities

Navigating sponsorship & politics

Getting info to design and size properly

Planning for future using corporate vision

Finding architects skilled in business, technology

Unforeseen developments


40/42

Presentation Review

Business and IT must be on the same page Deploy quickly in well-scoped increments

Evaluate re-architecture as needed

Choose the right tools for the right users

Data volume, access determines where to analyze it Use newer database features in design, management

Design to meet security, availability needs

Insist on Optimized Warehouse configurations

Plan ahead: data growth & changing business Evaluate applications as aligned to business


41/42

For More Information

search.oracle.com

or

oracle.com/bi

business intelligence


42/42

Overview Approaches to Oracle Data Warehousing_v1

Documents

Transcript of Overview Approaches to Oracle Data Warehousing_v1