1 Brett Hanes 30 March 2007 Data Warehousing & Business Intelligence 30 March 2007 Brett Hanes.

21
1 Brett Hanes 30 March 2007 Data Warehousing & Business Intelligence 30 March 2007 Brett Hanes

Transcript of 1 Brett Hanes 30 March 2007 Data Warehousing & Business Intelligence 30 March 2007 Brett Hanes.

Page 1: 1 Brett Hanes 30 March 2007 Data Warehousing & Business Intelligence 30 March 2007 Brett Hanes.

1Brett Hanes30 March 2007

Data Warehousing &Business Intelligence

30 March 2007

Brett Hanes

Page 2: 1 Brett Hanes 30 March 2007 Data Warehousing & Business Intelligence 30 March 2007 Brett Hanes.

2Brett Hanes30 March 2007

Agenda• Overview• Data Warehousing

• Definition & Purpose• Varieties• General Architecture• Modeling• More Information

• Business Intelligence• Definition & Purpose• Common Components

• How It All Works Together• Why Is It Useful?• How To Convince The Business• Summary

Page 3: 1 Brett Hanes 30 March 2007 Data Warehousing & Business Intelligence 30 March 2007 Brett Hanes.

3Brett Hanes30 March 2007

Data Warehousing (DW)• Definition

• A subject-oriented, integrated & non-volatile database updated on a typically rhythmic cycle from an enterprise’s various transaction databases.

• Purpose• Accumulate data from disparate data sources

for querying purposes• Separate reporting and analysis operations from

transaction systems to maximize the performance of both

Commonly very large repositories that house historical data

Page 4: 1 Brett Hanes 30 March 2007 Data Warehousing & Business Intelligence 30 March 2007 Brett Hanes.

4Brett Hanes30 March 2007

Common Data Warehouse Components• Staging Area

• A preparatory repository where transaction data can be transformed for use in the data warehouse

• Data Mart • Traditional dimensionally modeled set of dimension and

fact tables• Per Kimball, a data warehouse is the union of a set of

data marts

• Operational Data Store (ODS)• Modeled to support near real-time reporting needs• Contains traits of both relational and dimensional

modeling techniques

Page 5: 1 Brett Hanes 30 March 2007 Data Warehousing & Business Intelligence 30 March 2007 Brett Hanes.

5Brett Hanes30 March 2007

Data Warehouse Modeling

• Data warehouses typically use a denormalized method called dimensional modeling made up of the following components:

• Dimension• An entity defined in its entirety with a single primary key• Examples: Customer, Product, Sales Force, Calendar

• Fact• Details (often numerical) regarding a set of dimensions• Example: Order Details

Page 6: 1 Brett Hanes 30 March 2007 Data Warehousing & Business Intelligence 30 March 2007 Brett Hanes.

6Brett Hanes30 March 2007

Data Flow from Transaction to Warehouse

Complex Structure

Necessary for Accurate

Transactions

Simplified Structure

Necessary for Fast,

Powerful Reports

1 - Data Input viaApplications to transaction databases

2 - Data transfer from transaction system to data warehouse via Extract-Transform-Load (ETL) Tool (i.e. Informatica)

3 - Data Output via Business Intelligence Tool (i.e. Cognos, Business Objects, Hyperion)

Separation of Transactions and Reporting Improves Performance and Enhances Capabilities

Page 7: 1 Brett Hanes 30 March 2007 Data Warehousing & Business Intelligence 30 March 2007 Brett Hanes.

7Brett Hanes30 March 2007

Learning More About Data Warehousing• Pre-eminent Data Warehousing Minds

– Bill Inmon -> Normalization• Building the Data Warehouse• Corporate Information Factory

– Ralph Kimball -> Dimensional• The Data Warehouse Lifecycle Toolkit• The Data Warehouse Toolkit

Word is they don’t really get along

Page 8: 1 Brett Hanes 30 March 2007 Data Warehousing & Business Intelligence 30 March 2007 Brett Hanes.

8Brett Hanes30 March 2007

Business Intelligence Software• Definition

• A set of tools that allow users to access enterprise data via reports, Online Analytical Processing (OLAP) cubes, graphs/charts, ad-hoc queries and dashboards

• Purpose• Allow users to view the data from all levels of

the enterprise• Provide users with information necessary to

make timely, well-informed business decisions

The tools must be easy for the end user to understand and manipulate

Page 9: 1 Brett Hanes 30 March 2007 Data Warehousing & Business Intelligence 30 March 2007 Brett Hanes.

9Brett Hanes30 March 2007

Some Components In The BI Toolkit• Reports (Example)

• Commonly needed data can be structured in a set of canned reports made available to large numbers of users

• Flexibility can be given to users through ad-hoc querying and filters

• Cubes (Example)• Multi-dimensional, allowing the user the view

the data from multiple angles• Interactive, giving the user the ability to

change what is viewable on the fly

Page 10: 1 Brett Hanes 30 March 2007 Data Warehousing & Business Intelligence 30 March 2007 Brett Hanes.

10Brett Hanes30 March 2007

Some Components In The BI Toolkit• Charts & Graphs (Example)

• Graphical Representation of data • Commonly used in presentations and statistical

analysis

• Dashboards (Example)• Actively updating graphical displays that

provides business users with updates on key metrics

• Some dashboards provide drill through capability, allowing users to start with summary data and dive in to the details

Page 11: 1 Brett Hanes 30 March 2007 Data Warehousing & Business Intelligence 30 March 2007 Brett Hanes.

11Brett Hanes30 March 2007

How It All Works TogetherExtract

TransformLoad

Data Input

OLTP

ATRRS

OLTP

RECBASS

OLTP

AIMSPC

RATSSRFMSS

Other Possible Data Sources

Disparate Data Sources

TIMS DW

SingleReportingRepository

Real-timeDashboards

Static and Ad-hoc Reporting

GraphicalData Analysis

Page 12: 1 Brett Hanes 30 March 2007 Data Warehousing & Business Intelligence 30 March 2007 Brett Hanes.

12Brett Hanes30 March 2007

Why Is It Useful?

ODS

DW

The data transmitted from the engine in flight can alert a service

team of an engine component in need of repair so they can meet the plane

at the gate.

Engineers can analyze the data to find ways of designing engine

components with longer life spans.

Page 13: 1 Brett Hanes 30 March 2007 Data Warehousing & Business Intelligence 30 March 2007 Brett Hanes.

13Brett Hanes30 March 2007

Convincing The Business

• Consider the Previous Example– Having a team waiting at the gate to

service an engine reduces flight delays– Engineering analysis helps create higher

quality engines that:• Requires less servicing• Stay on wing longer

• In Other Words….You Save $$$$$$$$$!!!!!

Learn to speak the language of the business users…Understand what is

important to them

Page 14: 1 Brett Hanes 30 March 2007 Data Warehousing & Business Intelligence 30 March 2007 Brett Hanes.

14Brett Hanes30 March 2007

Keys To Success• Sponsorship

• High level endorsement is essential to ensuring you have the authority to drive the effort

• Funding• You have to spend money to save/make money

• Time• This can be a years long effort to implement• Maintenance is ever-present

• Central Governance• Without strict governance over components of

your enterprise data warehouse, you risk stove piping

Page 15: 1 Brett Hanes 30 March 2007 Data Warehousing & Business Intelligence 30 March 2007 Brett Hanes.

15Brett Hanes30 March 2007

Summary• Data is Key

• Whether coming in or going out, data is the foundation of all business applications and should be structured to properly meet the need

• Solutions are Complex• There are many components to a good BI

strategy…and they all have to work

• Diligence Required• Data will change• Technology will change• Be assured…user requirements will change

Page 16: 1 Brett Hanes 30 March 2007 Data Warehousing & Business Intelligence 30 March 2007 Brett Hanes.

16Brett Hanes30 March 2007

Questions?

Page 17: 1 Brett Hanes 30 March 2007 Data Warehousing & Business Intelligence 30 March 2007 Brett Hanes.

17Brett Hanes30 March 2007

Appendix

Page 18: 1 Brett Hanes 30 March 2007 Data Warehousing & Business Intelligence 30 March 2007 Brett Hanes.

18Brett Hanes30 March 2007

Report Example

Page 19: 1 Brett Hanes 30 March 2007 Data Warehousing & Business Intelligence 30 March 2007 Brett Hanes.

19Brett Hanes30 March 2007

Cube Example

Dimensions and facts can be dragged and dropped on the to

display to view the data in different ways

Page 20: 1 Brett Hanes 30 March 2007 Data Warehousing & Business Intelligence 30 March 2007 Brett Hanes.

20Brett Hanes30 March 2007

Chart/Graph Example

Page 21: 1 Brett Hanes 30 March 2007 Data Warehousing & Business Intelligence 30 March 2007 Brett Hanes.

21Brett Hanes30 March 2007

Dashboard Example