Data Warehousing: What's Available on System z Today

© 2010 IBM Corporation

Session IM03:

Data Warehousing:What's Available on System z Today

Willie Favero – Data Warehouse on System z Swat Team (DB2 SME)

09 September 2010

Total Solution Event for System z: Brussels 2010

Copyright © 2010 IBM CorporationAll rights reserved Slide 2 of 63IM03 - Data Warehousing: What's available on System z today

NoticesThis information was developed for products and services offered in the U.S.A.

Note to U.S. Government Users Restricted Rights — Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp.

IBM may not offer the products, services, or features discussed in this document in other countries. Consult your local IBM representative for information on the products and services currently available in your area. Any reference to an IBM product, program, or service is not intended to state or imply that only that IBM product, program, or service may be used. Any functionally equivalent product, program, or service that does not infringe any IBM intellectual property right may be used instead. However, it is the user's responsibility to evaluate and verify the operation of any non-IBM product, program, or service.

IBM may have patents or pending patent applications covering subject matter described in this document. The furnishing of this document does not give you any license to these patents. You can send license inquiries, in writing, to: IBM Director of Licensing, IBM Corporation, North Castle Drive Armonk, NY 10504-1785 U.S.A.

The following paragraph does not apply to the United Kingdom or any other country where such provisions are inconsistent with local law: INTERNATIONAL BUSINESS MACHINES CORPORATION PROVIDES THIS PUBLICATION "AS IS" WITHOUT WARRANTY OF ANY KIND, EITHER EXPRESS OR IMPLIED, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF NON-INFRINGEMENT, MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE. Some states do not allow disclaimer of express or implied warranties in certain transactions, therefore, this statement may not apply to you.

This information could include technical inaccuracies or typographical errors. Changes are periodically made to the information herein; these changes will be incorporated in new editions of the publication. IBM may make improvements and/or changes in the product(s) and/or the program(s) described in this publication at any time without notice.

Any references in this information to non-IBM Web sites are provided for convenience only and do not in any manner serve as an endorsement of those Web sites. The materials at those Web sites are not part of the materials for this IBM product and use of those Web sites is at your own risk.

IBM may use or distribute any of the information you supply in any way it believes appropriate without incurring any obligation to you.

Information concerning non-IBM products was obtained from the suppliers of those products, their published announcements or other publicly available sources. IBM has not tested those products and cannot confirm the accuracy of performance, compatibility or any other claims related to non-IBM products. Questions on the capabilities of non-IBM products should be addressed to the suppliers of those products.

This information contains examples of data and reports used in daily business operations. To illustrate them as completely as possible, the examples include the names of individuals, companies, brands, and products. All of these names are fictitious and any similarity to the names and addresses used by an actual business enterprise is entirely coincidental.

COPYRIGHT LICENSE:

This information contains sample application programs in source language, which illustrates programming techniques on various operating platforms. You may copy, modify, and distribute these sample programs in any form without payment to IBM, for the purposes of developing, using, marketing or distributing application programs conforming to the application programming interface for the operating platform for which the sample programs are written. These examples have not been thoroughly tested under all conditions. IBM, therefore, cannot guarantee or imply reliability, serviceability, or function of these programs. You may copy, modify, and distribute these sample programs in any form without payment to IBM for the purposes of developing, using, marketing, or distributing application programs conforming to IBM's application programming interfaces.


Trademarks

This presentation contains trade-marked IBM products and technologies. Refer to the following Web site:

http://www.ibm.com/legal/copytrade.shtml

http://www.ibm.com/legal/copytrade.shtml


Agenda

Why Data Warehouse and Business Intelligence on System z? – Industry Trends– Changing Business Requirements– System z Features

An Introduction to Data Warehousing on System zIBM Smart Analytics System 9600IBM Smart Analytics Optimizer


Why System z and

zEnterprise 196for

Data Warehousing and BI?

zEnterprise 196 processor chip


Regulatory Compliance

Marketing/Sales Interactions

Online Sales

Supply Chain Optimization

Financial Trading

Financial Planning

Fraud Avoidance

Customer Service/

Care

Customer Self Service

The focus is on having the right information at the right time

To enable the right business decision

Applications are Moving to Optimized Business ProcessesCreating a New Set of Requirements


Operational Business Intelligence TraditionalWarehousing

Caring for high value customers

Identifying seats for rerouted passengers due to flight delays before the flight arrives

--------------- Travel and Transportation

Crime statisticsand reporting

Identifying related incidents and potential suspects prior to arriving at the crime scene

--------------- Transforms law enforcement

CustomerAnalysis

Understanding relevant customer info to identify cross sell and up sell opportunities and improve value of sale at the point of sale

--------------- Transforms sales effectiveness

Insurance fraudanalysis & reporting

Identifying potentially fraudulent claims prior to approval and payment rather than after the fact

--------------- Transforms insurance fraud

Providing the Right Information .....To the right person, at the right time –

... Changes the Way We Do Business Delivering Information When it Has the Most Impact


Industry Trends that Favor the System z Platform

Cost efficiencies of a consolidated, virtual environment– Reduced: labor costs, energy consumption, data center footprint– Improved: ability to manage operations, upgrades, performance

Mixed workload environments and operational business intelligence– When warehouse and analytics become more operational, System z platform

qualities of service become more critical:• Availability, Reliability, Security

Compliance pressures– Centralized data can dramatically improve ease of data governance by

reducing the number of servers and copies of data to be managed– Single version of the truth


The Changing Data Warehouse Market

The data warehouse is a mission-critical system, with data warehouses serving in an increasingly mixed workload capacity, including as a data source for online applications. "Deep mining“ analysts and business analysts are running less-structured but equally complex queries and fast running tactical queries, each with differing service-level expectations. These differing workloads are all competing for CPU, memory and disk access. At the same time, data latency continues to progress from batch to continuous loading demands.

Publication Date: 23 December 2008/ID Number: G00163473; © 2008 Gartner, Inc. and/or its Affiliates. All Rights Reserved.


WarehouseWarehouse

Present

Acquire

ETLETLData QualityData Quality ELTELT

ReplicationReplicationEAIEAI**

EIIEII****

Store CubingCubing

Operational Source SystemsStructured/ Unstructured Data

Operational Applications

Transform/Optimize

Excel

Where does your System z fit?

Data Warehouse/BI Basics- 4 stages between Data and Information

* Enterprise Application Integration** Enterprise Information Integration


Cost effective alternative to masses of commodity servers

– Management/Administration costs are already exceeding new server spending– Power and energy costs growing dramatically

2000 –Raw processing “horsepower” is the primary goal, while the infrastructure to support it is assumed ready

2010 –Raw processing “horsepower” is a given, but the infrastructure to support deployment can be a limiting factor

Source: IDC, Virtualization 2.0: The Next Phase in Customer Adoption, Doc #204904, Dec 2006

$0

$50

$100

$150

$200

$250

$300

199719981999

2000

200120022003200

420052006200720082009201

0

Installed Base(M Units)

Spending(US$B)

0

5

10

15

20

25

30

35

40

45

50

1996

Power and cooling costs

Server mgmt and admin costs

New server spending

Worldwide IT Spending TrendW orldwide IT Spending Trend

$0

$50

$100

$150

$200

$250

$300

199719981999

2000

200120022003200

420052006200720082009201

0


Spending(US$B)

0

5

10

15

20

25

30

35

40

45

50

1996

$0

$50

$100

$150

$200

$250

$300

199719981999

2000

200120022003200

420052006200720082009201

0


Spending(US$B)

0

5

10

15

20

25

30

35

40

45

50

1996

$0

$50

$100

$150

$200

$250

$300

199719981999

2000

200120022003200

420052006200720082009201

0


Spending(US$B)

0

5

10

15

20

25

30

35

40

45

50

1996



New server spending



New server spending

Worldwide IT Spending TrendW orldwide IT Spending Trend


Processor Performance and Scalability

z990

z9

z10

Capacity

Cus

tom

er E

ngin

es

Additional Capacity using hybrid Technologies

z900

IFLCrypto

+zAAP

+zIIP

+Accelerators

zEnterprise

+Compute Intensive

Decimal FP

System z is no longer your father’s mainframe system!!!


IBM zEnterprise System – Best in Class Systems & Software Technologies

Part of the IBM System Director family, provides platform, hardware and workload managementUnifies management of resources, extending IBM System z® qualities of service across the infrastructure

Ideal for large scale data and transaction serving and mission critical applicationsMost efficient platform for Large-scale Linux®

consolidation Leveraging a large portfolio of z/OS® and Linux on System z applicationsCapable of massive scale up, over 50 Billion Instructions per Second (BIPS)

Selected IBM POWER7™

blades and IBM x86 Blades1 for tens of thousands of AIX® and Linux applications

High performance optimizers and appliances to accelerate time to insight and reduce cost

Dedicated high performance private network

1 All statements regarding IBM future direction and intent are subject to change or withdrawal without notice, and represents goals and objectives only.

Unified management for a smarter system:zEnterprise Unified Resource Manager

Unified management for a smarter system:zEnterprise Unified Resource Manager

The world’s fastest and most scalable system:IBM zEnterprise™ 196

(z196)

The world’s fastest and most scalable system:IBM zEnterprise™ 196

(z196)

Scale out to a trillion instructions per second:

IBM zEnterprise BladeCenter® Extension

(zBX)

Scale out to a trillion instructions per second:

IBM zEnterprise BladeCenter® Extension

(zBX)

HMCHMC

A system of systems that unifies IT for predictable service delivery


The z/OS Workload Manager (WLM) is the most mature and sophisticated workload manager available today

Granular WLM policies provide improved performance for mixed workloads

0

100

200

300

400

500

600

700

800

900Throughput Effects Response Time Effects

Que

ries

Com

plet

ed /

min

ute

Policy:Equal Priority

WLM Policy in effect

Policy:Equal Priority

WLM Policy in effect

Triv.Mod/ Med LargeTriv. Mod Med Large 0

20

40

60

80

100

120

140

160

180

Avg

Res

pons

e Ti

mes

Moderate/ Med /Large Triv small mod l Large

88% +faster

3 x

Proven Ability to Handle Mixed Workloads


50TB System z Data Warehouse Benchmark

Poughkeepsie Lab / Silicon Valley Lab joint effort

Deliver proof points of System z scalability in Business Intelligence environment

Establish capability of System z to scale to larger volumes

Develop best practices of managing large data warehouses

Drive unique value of System z– Workload Manager: capabilities to manage mixed workloads– Operational BI: large volumes of users, smaller queries– zIIP: lower cost BI solution– Data compression: minimal overhead with hardware compression

SG24-7674

http://www.redbooks.ibm.com/abstracts/sg247674.html



Cost Benefits of System z

Reduce Operational CostsSave on storage using DB2 for z/OS System z hardware based data compression without compromising performance

– Typical savings in the 50-60% range

Index compression, DB2 9, software based Save on labor, energy, and floor space through consolidation to System z

– Save up to 85% on floor space**

– Save up to 80% on energy costs**

– Save up to 50% on labor resource**

Reduce overall Risk ExposureHighly sensitive personal or financial data is secure and auditableDB2 for z/OS data sharing and GDPS provide unparalleled availabilityMixed workloads benefit from the capability of the world class System z workload managerReduced latency and duplication provide a sound basis for timely and consistent business analysis

Position for GrowthApplication growth on System z scales well, while cost savings increaseParallel Sysplex and DB2 for z/OS data sharing enable incremental growthSystem z provides a non-disruptive upgrade path; System z tech dividends make that upgrade path more cost effective

** Based on calculations of savings realized in internal IBM System z consolidation projects


An Introduction to Data Warehouse and BI on System z & zEnterprise

InfoSphereWarehouse

InformationServer

IndustryModels

MDM Server

DB2 for z/OSCognos 8 BI


The Data Warehouse and BI Solution on System z

Combining the Reliability and Availability of DB2 for z/OS with Cost Effective Applications running on Linux for System z

InfoSphere Information Server for System z

DB2 for z/OS

OLTPdata

Data Warehouse

Cognos 8 BIfor Linux on

System z

Serving Up Consolidated Enterprise BI

Complete ETLSolution

The Enterprise Data Warehouse

InfoSphere Warehouse Cubing

Services

InfoSphere Warehouse

SQW

Source Systems :DB2IMS

VSAM

New ‘09 New ‘09

InfoSphere Replication Server

http://www-03.ibm.com/systems/z/os/linux/ve/

http://www-03.ibm.com/systems/z/os/linux/ve/


Warehouse/BI Highlights of DB2 for z/OS V8

Materialized Query Tables –Improved performance for query

Multi-row insert and fetch–Improved speed of warehouse ETL and query

Online Schema evolution–Improves availability and efficiency

Longer Table and Column names–Increased compatibility with ETL and BI tools

Increased SQL vocabulary–Increased compatibility with ETL and BI tools

64 bit support –Expanded size capability

http://www-306.ibm.com/software/data/db2/zos/db2zosv8.html


Warehouse/BI Highlights of DB2 9 for z/OS

Index over Expression –Improved performance on ETL and BI tools

Index Compression–Improved use of space (up to 50%)

Not Logged Tablespace–More efficient for temporary tables such as Staging tables

Universal Table Space – partition by growth–Easier to manage growth–Best of segmented tables and partitioning

Utility Improvements–More online utility operations, reduced CPU

Overall DB2 9 for z/OS– reduced CPU


1. CPU reductions for transactions, queries, & batch

2. Ten times more users by avoiding memory constraints

3. More concurrency for catalog, utilities, and SQL

4. More online changes for data definition, utilities and subsystems

5. Improved security with more granularity

6. Temporal or versioned data

7. SQL enhancements improve portability

8. pureXML performance and usability enhancements

9. Hash, index include columns, access path stability, skip migration, …Pick your favorite!

10.Productivity improved for database & systems administrators, andapplication programmers

2121

Top 10 in DB2 10 for z/OS


InfoSphere Information Server on System z

Business Glossary DataStage

Parallel Processing

Rich Connectivity to Applications, Data, and Content

Enterprise Data Dictionary

Extract, Transform, and Load in Batch or Real-

time

Information Services Director

Metadata Workbench / FastTrack

Publish SOA services for informationintegration and access

Information AnalyzerData Source Profiling &

Problem Diagnosis

Manage and track consistent metadata across information integration tasks and automate generation of data flow logic

Federation ServerVirtualize access to

disparate information

CDC & ReplicationDeliver and replicate

changed data

QualityStage

Global Name RecognitionRecognize & ClassifyMulti-cultural names

Data Quality: Standardize,Correct & Match Data


Maintaining a Low Latency Warehouse or ODS

Replication, InfoSphere CDC, Event Publisher, Classic Event Publisher

Provides incremental near real time feed to InfoSphere DataStage from IMS, VSAM, IDMS, Adabas, DB2 all platforms, Oracle, MS SQL Server, Sybase


The core Cognos 8 BI components for Linux on System z

Reporting• Provides full breadth of report types • Ensures consistent information to all users • Engages business users with simplified role-based

interface• Delivers personalized content via email, portal, MS-

Office, search and mobile devices etc• Enables collaboration across users, communities and

with ITAnalysis

• Provides guided exploration across multiple dimensionsof information

• Performs complex analysis and scenario modelingeasily and quickly

• Exposes the “why” behind trends to reveal symptomsand causes

• Moves from summary level to detail levels ofinformation effortlessly


Dashboards

• Provides at-a-glance, high impact viewsof complex information

• Helps quick focus on issues that needattention and action

• Are highly visual and intuitive

• Combines information across disparate sources

Right time Information


Cognos 8 BI for Linux on System z

SERVICES

DATA TIER

PRESENTATION TIER

APPLICATION TIER

Broad Range of Capabilities

Open Data Access(Transactional, Warehouses or Modern data sources)

Common Set of Services

Right time Information


SELECT DEPT,(SUM) SALARY AS SUMSALFROM BIG_PERSONNEL_TABLEGROUP BY DEPT

BI analyses most often involve aggregates andcalculations such as …

“I want to see all departments where the totalsalary is greater than $xx and if they exceed theprevious year by 15% then …”

Let’s start with a simpleexample … just the sum of the salaries …

DB2

DB2 will do a vast scan of the table… form the aggregate values … and present the result set to the end user

or application…and frequently many business users are

looking at the same data over and over

OLAP – Online Analytical Processing


Multidimensional Analytics

Multidimensional Analytics (aka OLAP)– Multidimensional view of the business: customers, products, time and

measures– Analysis of business metrics/measures over time, previous to “current”– Maps well to Star Schema concepts (Dimensions, Facts, Aggregates)

Key Aspects– Dimensions, Hierarchies, Measures, Summarizations– Cross dimensional calculations– Time Series, Parallel Period analysis– Dimensional navigation – slice, dice, drill, pivot


Different methods for different uses

OLA

P

Read/write user communities64 bit in-memory fast performanceLarger highly dynamic data sets

--------------------------------------------Dynamic changing dimensions and hierarchy, what-if scenarios, data contribution Common dimensions shared across multi-cube modelsBudgeting and planningPersonal and corporate data sources

Large read only user communitiesModerate ‘focused area’ data setsPre-aggregated static fast results

--------------------------------------------Off-line portable/ partitioned storageRapid startup for advanced business user self service modelingAutomatic time series analysis & trendingPoint in time dataPersonal and corporate data sources

Large user communitiesLarge data setsPlanned performance/optimization facilities

--------------------------------------------Optimized ROLAPZero LatencyHigh volume concurrencyLargest Data VolumesCentralized IT management of information

IBM Cognos PowerCube

Optimized for broad, general purpose BI usage

IBM Cognos TM1

Optimized for write back and high volatility applications

IBM IW CubingServices

Optimized for very large datasets with very large dimensions

Specialized OLAP Modeling ToolsSpecialized OLAP Modeling Tools

Turbo IntegratorTurbo IntegratorMO

DEL

ING

TransformerTransformer Data ArchitectData Architect

OLAP Portfolio from IBM


InfoSphere Warehouse on System z

Adds core data warehouse and analytics capability to DB2 for z/OS:– Advanced physical database modeling and design– In-database data movement and manipulation capabilities of SQL Warehouse

Tool (SQW)– Optimize multidimensional reporting and analysis of data with Cubing Services

30

Cognos

MS Excelz/OS Linux on System z

OLTP DB2 DWH DB2

SQW

MDX QueriesCubing Services

IW Design Studio


InfoSphere Warehouse on System z - Architecture

DB2 for z/OSDB2 for z/OS

Source SystemsDB2 for z/OSDB2 for z/OS IMSIMS VSAMVSAM RDBMSRDBMS

Data Warehouse Server

Linux on System z Partition / IFL

WebSphere Application Server

WebSphere Application Server

Windows / Linux

Design StudioDesign Studio

Admin ConsoleAdmin Console

Application Server

Cognos 8 BI for System zExcel

Client Layer• Design and admin client• BI / Reporting tools and

apps

MQT AdvisorMQT

Advisor

JDBC/DB2 Connect/Hipersockets

IE/Firefox

Eclipse

SQL

Cubing Services EngineCubing Services Engine

SQW RuntimeSQW Runtime

MDX

MQT Cube Metadata Control DB


Cubing Services Supports Microsoft Excel 2007

IBM OLE DB Provider for OLAP

Uses Excel Pivot Table Services


Cubing Services Supports Cognos

All Cognos Studios can access Cubing Services

Query Studio Report StudioAnalysis Studio

Integrate cube data into Cognos Dashboards and Reports

Cognos 8 BI uses metadata directly from Cubing Services – no duplicate metadata development


Modernize an Existing Reporting ServerTransform it into a DB2 for z/OS Warehouse

34

1. Model your data for OLAP access using the InfoSphere Warehouse Design Studio

2. Populate your star schema using InfoSphere Warehouse SQW Scripts

3. Build one or more Cube structures using the InfoSphere WarehouseDesign Studio

4. Access data through Excel or Cognos MDX queries

InfoSphere WarehouseDesign Studio Cognos

Excel

System z Environment Improved with InfoSphere Warehouse

z/OS Linux on System z

OLTP DB2 DWH DB2

SQW

MDX QueriesCubing Services

1

2

3

4


Modernize an Existing Reporting ServerAdd Cubing Services to enhance business user experience

workload contains 30 MDX queries

Cube Server Performance

02000400060008000

1000012000

1.run no cache 1.run cache 2.run cache

cube server cache re

spon

ds ti

me

in s

ec

Series1

Data can remain in one single repository – DB2 for z/OS

Increasing ease of data compliance, security and governance

Analysis can be performed with high speed through in-memory caching

CPU on System z can be reduced when more queries can be answered through the in-memory caching


ProblemWasted I/O or resource contention because of multiple programs reading the same transaction data

Scalable Architecture for Financial Reporting (SAFR)

SalesTrans

ProgramB

ProgramA

ProgramC

SAFR SolutionGenerate multiple extracts or reports simultaneously with a single pass of the transaction data

SalesTrans

SAFR ViewsA/B/C

“Scan sharing”


IBM Smart Analytics System 9600


Solution Editions

Solution Edition for Data Warehousing –Legendary System z quality, priced aggressively to fit within a shrinking budget

Complete Offering:– Solution – based offering– Customized hardware to meet your business requirements– Pre-determined software stack tuned for Data Warehousing

workloads– Maintenance for the hardware

For a highly available, energy efficientData Warehousing infrastructure designed for growth

Created to simplify your IT decision!


New! IBM® Smart Analytics System 9600

What’s new:– Delivers a complete end-to-end software, hardware, and services solution for a rapid deployment of business analytics on System z at a

compelling price point.

Features / Business Value:– Provides unprecedented value for an end-to-end analytics solution on System z– Inherits the unique System z quality of service, for new business analytic workloads– Delivers continuous availability to a centralized single view of the business to support enterprise wide business analytics– Leverages customers existing disaster recovery and backup processes to simplify deployment without requiring additional backup and

recovery processes.

Delivers - unprecedented value in deploying new business analytics

Powerful Data Warehouse SoftwareInfoSphere Warehouse on System zCognos 8 BI for Linux on System zDB2 for z/OS Value Unit Edition (MLC Option)DB2 Utilities Suite

z/OS Operating System Stack

Client Benefits:–To deliver enterprise-wide business analytics to operational users –Deliver business insights to the right person, at the right time, in the right context


Meeting clients where their information is…

7600Based Power System

9600Based on System z

5600Based System x

40

Consistent value, Right fitted to your needs

IBM Smart Analytics System Offerings Deliver Analytics Value Across Platforms

Faster Time to Value, Faster Business Results


IBM Smart Analytics System 9600

How is it different?Secure, Available Business Analytics

– Rapidly delivers analytic information to decision makers at the time of decision.

– New environment for the availability, reliability and scalability necessary to stay aligned with the operational systems

Simplified administration– Appliance-like delivery– Faster deployment at lower cost.– Leverages customers existing disaster recovery, and

backup processes

Proven Operational Characteristics– Extends the qualities of service of System z.– Reduces risk through extending System z manageability

and security across the entire system.

High Value Operational BI– Cost effective way to drive daily operational decisions

What is it? The IBM Smart Analytics System 9600 is an integrated solution of hardware, software and services that enables customers to rapidly deploy cost effective game changing analytics across their business.

Delivering business results in days, not months


IBM Smart Analytics System 9600High Value Dynamic Warehousing


Cubing Cubing ServicesServices

Cognos 8 BI

ELTELT

Operational Source SystemsStructured/ Unstructured Data

Data Data WarehouseWarehouse

System z

Implementation Services

DB2 for z/OS VUE(option for MLC)

DB2 Utilities SuiteImage Copy, LOAD, UNLOAD, REORG, etc

PowercubePowercubeServicesServices


Optional Value Priced Add-onsTivoli OMEGAMON for DB2 Performance ExpertTivoli Directory ServerInfoSphere Master Data Management Server InfoSphere Information ServerInfoSphere Replication ServerQ-Rep, CDC and Event Publisher eligibleInfoSphere Federation Server plus Classic Federation on System zSPSSTivoli ITCAM, ITUAMCognos Now! For Linux on System zCognos Blueprints for Healthcare, Banking and others…BI User on-boarding application (as proposed for Smart Analytics Cloud)

Powerful Data Warehouse and BI SoftwareDB2 for z/OS Value Unit Edition (primary) V9 - Option for MLCDB2 Utilities Suite V9DB2 ConnectInfoSphere Warehouse on System z V9.5.2IBM Cognos 8.4 BI for Linux on System zIBM Cognos® 8 BI reporting, IBM Cognos® 8 BI analysis, IBM Cognos® 8 BI dashboard, Cognos 8 Go! Mobile, Cognos 8 Go! Search, Cognos 8 Go! Officez/OS Operating System Stack V1.11z/VM 6.1

43

Deeply Optimized by IBM Experts… Flexible Growth…

IBM Smart Analytics System 9600 Software


Database Size

Amt Usable Disk*Amt

User Data*

244TB 100TB

122TB 50TB

61TB 25TB

27TB 12TB

10TB 4TB

Data Capacity Sizing

*Usable = Disk for compressed table data, indexes, work files, MQTs etc.

*User Data = Raw, uncompressed, user data

IBM Smart Analytics SystemPre-Set Configurations Sized to Meet Business Requirements


Cognos Workload

Named Users Max Concurrent Users

5000 - 10,000 100

50

5-2500 25

BI Capacity Sizing

IBM Smart Analytics SystemPre-Set Configurations Sized to Meet Business Requirements


Choosing A Deployment Style

Virtual Upgrade Delivery

Standalone Delivery

Server delivered in “appliance-like” fashion

Capacity delivered as a “bolt-on” to existing server(s) or as new server(s) depending on customer needs in a “virtual appliance-like”fashion


Scales for Your Unique Needs

Rapidly & easily add new capacity as

information & new analytic capabilities grow

Rapidly & easily add new users as business

needs expand

Building blocks for each growth increment

Deployed in scalable increments to match each type of need


Faster ResultsLess Risk

June Jan.

5

4

3

2

Jan.

Build from Scratch

Months Days

Pre-Built

Pre-implementation System Sizing

Acquire Components

Installation & Configuration

Testing & Validation

Faster Time to ValueResults in Days Versus Months


IBM Smart Analytics Optimizer


IBM Smart Analytics Optimizer

How is it differentPerformance: Unprecedented response times to enable 'train of thought' analyses frequently blocked by poor query performance.Integration: Connects to DB2 through deep integration providing transparency to all applications. Self-managed workloads: queries are executed in the most efficient way Transparency: applications connected to DB2, are entirely unaware of the acceleratorSimplified administration: appliance-like hands-free operations, eliminating many database tuning tasks

What is it? The IBM Smart Analytics Optimizer is a workload optimized, appliance-like, add-on, that enables the integration of business insights into operational processes to drive winning strategies. It accelerates select queries, with unprecedented response times.

Breakthrough Technology Enabling New Opportunities

Capitalizing on the best of relational and the best of columnar databases


Smart Analytics Optimizer– Deep DB2 Integration

DB2

DataManager

BufferManager IRLM Log

Manager

SmartAnalyticsOptimizer

Application Interfaces(standard SQL dialects)

Operation Interfaces(e.g. DB2 Commands)

Applications DBA Tools, z/OS Console, ...

. . .


Smart Analytics Optimizer- Platform View

DB2

DataManager

BufferManager IRLM Log

Manager

SmartAnalyticsOptimizer

Application Interfaces(standard SQL dialects)

Operation Interfaces(e.g. DB2 Commands)

Applications DBA Tools, z/OS Console, ...

. . .z/OSz/OS

Pric

e/P

erfo

rman

ce

Pric

e/P

erfo

rman

ce

optim

ized

op

timiz

ed

Har

dwar

eH

ardw

are


Extreme performance for complex queries

Game Changing PerformanceRapidly delivers information to decision makers through breakthrough technologies providing dramatic performance improvement.

The best of row and columnar store technologies Highly compressed dataCompressed data operationsIn-memory processingMassively parallel architecture

Enables decision makers to submit queries they never dared in the past, that analyze trends, predict outcomes, and produce better business results.


Target Market: Business Intelligence (BI)

Characterized by:– “Star” or “snowflake” schema:

– Complex, ad hoc queries that typically• Look for trends, exceptions to make actionable business decisions• Touch large subset of the database (unlike OLTP)• Involve aggregation functions (e.g., COUNT, SUM, AVG,…)• The “Sweet Spot” for IBM Smart Analytics Optimizer!

CityRegion

Store

SALES

Product

Time

Brand

Month

Quarter

Category

Dimensions

Fact Table


Database Performance Appliance

Appliance-like, add-on device

Application transparent, install and begin reaping the benefits of higher performance

Rapidly add new applications and user requirements driving immediate value to the bottom line

No need for indices, materialized query tables (MQTs), query plans or query hints

Significantly reduces costs and enables quick time to value

Copyright © 2010 IBM CorporationAll rights reserved Slide 56 of 63IM03 - Data Warehousing: What's available on System z today 56

Orders of Magnitude Faster for Queries

... and its acceleration factor : :

163 s2311 s25 s1593 s35 s 8s5435 s

48

Runtime of queries w/o ISAOpt with ISAOpt

511

12

206

4

1424

Factor

8s

4s

2s5s3s

For customers who have struggled with gaining the required performance out their complex queries of full table scans, multiple compares, and complex logic – the results are astounding!

Beta Customer Results


Combining the Smart Analytics offerings in System z:IBM Smart Analytics System 9600 IBM Smart Analytics Optimizer

Complete, end-to-end environment for BI workload Processes ALL queries submitted by end-users Software:

Includes z/OS, DB2 for z/OS, Linux, InfoSphere Warehouse, Cognos, DB2 Connect

Supports: Data movement / ETLEnd user tools (Cognos) / BI queries/reportsData Storage (Data warehouse)

Runs in z/OS-DB2 LPAR, Linux for System z LPAR for ToolingIs an all purpose environment to deploy any BI workload

Workload optimized, appliance-like, add-on to a Data Warehouse on System z MUST connect TO a DB2 for z/OS environment that is running a BI workloadWill enhance a Smart Analytics System 9600Software:

Includes ISAO software running on blades and connects to DB2 for z/OS to enable query routing to ISAO

Supports: (Subset of) complex and long-running BI queries with access to data in a star or snowflake schemaOrder of magnitude acceleration of a SUBSET of queries that are selected/routed to ISAO by DB2 for z/OS

GA June 2010 GA 4Q 2010

For acceleration of multidimensional star schema queries, use IBM Smart Analytics Optimizer as add on option

Must Connect to D W


Co-locating Transactional and Data Warehouse Workloads

Poughkeepsie Lab / Silicon Valley Lab joint effort

Managing analytic and traditional workload best practices

Using workload manager (WLM) to manage mixed workloads

OLAP vs data warehouse workloads

Data sharing vs non data sharing considerations

Single vs multiple LPAR configurations

Implementation considerations

Benchmark results

SG24-7726

http://www.redbooks.ibm.com/redpieces/abstracts/sg247726.html

http://www.redbooks.ibm.com/redpieces/abstracts/sg247726.html


Other Significant System z Data Warehouse Redbooks

SG24-7637Enterprise Data Warehousing with DB2 9 for z/OS

REDP-4606Using IBM System z As the Foundation for Your Information Management Architecture

SG24-7813InfoSphere Warehouse: A Robust Infrastructure for Business Intelligence





http://www.redbooks.ibm.com/abstracts/redp4606.html













More Significant System z Data Warehouse Redbooks

REDP-3927Workload Management for DB2 Data

REDP-4668IBM zEnterpriseBladeCenter Extension

SG24-6489Best Practices for SAP BI using DB2 9 for z/OS

http://www.redbooks.ibm.com/redpapers/pdfs/redp3927.pdf



http://www.redbooks.ibm.com/redpieces/pdfs/redp4668.pdf










Reference Materials

Relevant System z DW/BI Redbooks:– 3 more currently in progress: Cognos on System z, Data Collocation,


Cognos 8 BI Performance Whitepaper:– http://www-03.ibm.com/support/techdocs/atsmastr.nsf/WebIndex/WP101437

WLM Magazine Article:– http://www.ibmsystemsmag.com/mainframe/novemberdecember09/tipstechniq

ues/26908p1.aspx

More info:– http://www-01.ibm.com/software/data/businessintelligence/systemz/

http://www-03.ibm.com/support/techdocs/atsmastr.nsf/WebIndex/WP101437


More information on zEnterprise

IBM zEnterprise Announcement Landing Page: ibm.com/systems/zenterprise196IBM zEnterprise HW Landing Page: ibm.com/systems/zenterprise196IBM zEnterprise Events Landing Page: ibm.com/systems/breakthroughIBM Software: ibm.com/software/os/systemz/announcementsIBM System Storage: ibm.com/systems/storage/product/z.htmlIBM Global Financing: ibm.com/financing/us/lifecycle/acquire/zenterprise/Global Technology Services:

– vanity: ibm.com/services/zenterprise

http://www.ibm.com/systems/zenterprise196

http://www.ibm.com/systems/zenterprise196

http://www.ibm.com/systems/breakthrough

http://www.ibm.com/software/os/systemz/announcements

http://www.ibm.com/systems/storage/product/z.html

http://www.ibm.com/financing/us/lifecycle/acquire/zenterprise/

http://www.ibm.com/services/zenterprise


Thank YouMerci

Bedankt

Gracias

Obrigado

Danke

Japanese

English

French

Russian Spanish

GermanNederlands

Brazilian PortugueseArabic

Traditional Chinese

Simplified Chinese

Thai

Data Warehousing: What's Available on System z Today

Technology

Transcript of Data Warehousing: What's Available on System z Today