Data Consistency in SAP BW Know How Network Conference Call May 29 th 2003 Mike Eacrett BW RIG, SAP...

Data Consistency in SAP BW

Know How Network Conference Call May 29th 2003

Mike EacrettBW RIG, SAP Labs, LLC

SAP AG 2003, Data Consistency, M. Eacrett / 2

Agenda

Motivation

Measures

Consistency Check

Important Check Tools

Summary


Why a Data Consistency Project?

SAP BW has grown to be the most important information system for many companies

SAP BW provides key information for all core business areas

Confidence in correct data is essential to the success of a data warehouse

Delivery of information must be trusted on an ongoing basis


What does SAP do?

In relation to other vendors, SAP BW get high marks in the field of data consistency.

All information on data consistency questions are published in SAP notes which can be accessed very easily via OSS or SAP Service Marketplace.

To provide an additional service for our customers, partners, and consultants, SAP has compiled these notes into a comprehensive document, made available on the SAP Service Marketplace.

Furthermore, a Guideline document on usage of the check tools is provided.

Thus, SAP assures that customers, partners, and consultants have a fast access to:

the needed information in case of questions in the area of data consistency

the appropriate tools to validate your data consistency


Agenda

Motivation

Measures

Consistency Check


Summary


Analysis

Analysis of SAP BW for potential improvements Consideration for erroneous user behavior Misperceptions regarding functionality Design optimization

Groups involved in design Developers Customer Support Customers Consultants Partners


Improvements

BW Developments Protects system better against inexperienced or erroneous

user behavior Automatic checks implemented Check tools

Scheduled checks Manual checks

Continuous improvements

Consistency Check Service Check relevant notes Use check tools Recommendations for customers


Agenda

Motivation

Measures

Consistency Check


Summary


Information in SAP Service Marketplace

Results of the Data Consistency Project are available on the SAP Service Marketplace:

Alias BW -> Section: Data Consistency


Information in SAP Service Marketplace

A Guideline Document describes the necessary steps for performing a system check and introduces the available check tools.

A Notes List provides you the following information:

Tables detailing SAP note checklists by SAP BW release

A list of existing check tools (incl. documentation notes)

A list of SAP notes arranged by functional areas


Agenda

Motivation

Measures

Consistency Check


Summary


RSRV: Analysis and Repair of BW Objects

Transaction RSRV Referential integrity of the star schema Correctness of master data / hierarchy tables Technical parameter validation for correctness

Information on each check is provided via check descriptions (right click on ‘check’)

Combined Tests with multiple related checks provided Reduces scheduling and administration time More through testing

Checks can be run manually (immediately)

Checks can be scheduled via packages Results are made available in application log



A sample of the extensive selection of checks available:

Functional Master Data: Data structure and value consistency Transaction Data: InfoCube Dimension, DB, and data consistency.

ODS Object key relationships etc.. Hierarchy: Definition and data consistency Aggregates: Definition and Data consistency PSA and Documents can also be checked

Technical Database parameters and partition integrity Database Indices, statistics, DB and Star schema Information

Additional check tools are provided on an ongoing basis via support packages.



Scheduling RSRV checks:

1. Create a Test Package Test packages can be reloaded & edited in the future)



Scheduling RSRV checks:

2. Execute the Package



Repair functionality is made available wherever possible

Based of results stored in the application logs Analysis of the errors found should be performed before just

clicking repair. Loss of diagnostic information as data and/or object is corrected Difficulty in resolving issue’s real cause if resolved Repair should be executed after analysis

Repairs for some checks are not available due to: Technical issues

e.g. DB constraints or shutdown/restart required

Functional issuesDesign or Configuration issuesData consistency may be effected and automatic repair rules do not

exist


Analysis of Aggregates (SAP BW 3.x)

Automatic Aggregate Check (Note 584609) Check report available (as of 3.0B SP9 / 3.1 SP3)

Can be scheduled to run in background via a variantCan also be scheduled in process chains via ‘ABAP’

process chain

Automatic scheduling possible after aggregate maintenance processes


Details: Three Check Modes For Aggregates

Complete Check (Mode A): Rebuild aggregate out of InfoCube or parent aggregate as internal table and compare with aggregate on DB.

Check time approximately the same time as for rebuilding the aggregate.

Check of key figure sums (Mode Q): Summarizes aggregate and source (InfoCube or parent aggregate) over all characteristics and compare the sum of each key figure.

Check time approx. 3-4 times faster than mode A.

Check-Aggregates (Mode C): Create new aggregates summarized over all characteristics (except package and unit dimension) with the fixed value combination of the aggregate to be checked.

Very fast, but additional aggregates are created and have to be maintained.


Analysis of Aggregates - Execution

Execution via ABAP

The ABAP can be executed online or via a background job.

Recommendation: Execute weekly for critical aggregates with check mode C. (Do not execute during aggregate maintenance or rollup!)

Aggregate Technical name

Check the Parent InfoCube/Aggregate

Write a log file

Check mode*


Analysis of Aggregates - Execution

Execution automatically during aggregate functions

Check mode C, Q, A respectively

Execution timing:1. After a change run2. After a roll up3. After data deletion

Aggregate selection


Agenda

Motivation

Measures

Consistency Check


Summary


Recommendations & Outlook

How to proceed: Read the Guideline Documents carefully Check your BW system using the Notes List

provided in SAP Service Marketplace Please be aware of regular updates of this list!

Check your system regularly to ensure data consistency and maintain data confidence

Future Outlook: Integration check tools in Process Chain Process

types. Ongoing deployment of check tools in RSRV


Questions


No part of this publication may be reproduced or transmitted in any form or for any purpose without the express permission of SAP AG. The information contained herein may be changed without prior notice.

Some software products marketed by SAP AG and its distributors contain proprietary software components of other software vendors.

Microsoft®, WINDOWS®, NT®, EXCEL®, Word®, PowerPoint® and SQL Server® are registered trademarks of Microsoft Corporation.

IBM®, DB2®, DB2 Universal Database, OS/2®, Parallel Sysplex®, MVS/ESA, AIX®, S/390®, AS/400®, OS/390®, OS/400®, iSeries, pSeries, xSeries, zSeries, z/OS, AFP, Intelligent Miner, WebSphere®, Netfinity®, Tivoli®, Informix and Informix® Dynamic ServerTM are trademarks of IBM Corporation in USA and/or other countries.

ORACLE® is a registered trademark of ORACLE Corporation.

UNIX®, X/Open®, OSF/1®, and Motif® are registered trademarks of the Open Group.

Citrix®, the Citrix logo, ICA®, Program Neighborhood®, MetaFrame®, WinFrame®, VideoFrame®, MultiWin® and other Citrix product names referenced herein are trademarks of Citrix Systems, Inc.

HTML, DHTML, XML, XHTML are trademarks or registered trademarks of W3C®, World Wide Web Consortium, Massachusetts Institute of Technology.

JAVA® is a registered trademark of Sun Microsystems, Inc.

JAVASCRIPT® is a registered trademark of Sun Microsystems, Inc., used under license for technology invented and implemented by Netscape.

MarketSet and Enterprise Buyer are jointly owned trademarks of SAP AG and Commerce One.

SAP, SAP Logo, R/2, R/3, mySAP, mySAP.com and other SAP products and services mentioned herein as well as their respective logos are trademarks or registered trademarks of SAP AG in Germany and in several other countries all over the world. All other product and service names mentioned are trademarks of their respective companies.

Copyright 2003 SAP AG. All Rights Reserved

Data Consistency in SAP BW Know How Network Conference Call May 29 th 2003 Mike Eacrett BW RIG, SAP...

Documents

Transcript of Data Consistency in SAP BW Know How Network Conference Call May 29 th 2003 Mike Eacrett BW RIG, SAP...