IBM DB2 on SAP V11.1 Update and Recent Developments · PDF fileSAP Convergent Invoicing on BLU...

49
IBM DB2 on SAP V11.1 Update and Recent Developments September 26, 2016 Karl Fleckenstein ([email protected]) SAP / DB2 Lead Architect, IBM Boeblingen Lab, Germany, SAP St. Leon-Rot, Germany

Transcript of IBM DB2 on SAP V11.1 Update and Recent Developments · PDF fileSAP Convergent Invoicing on BLU...

Page 1: IBM DB2 on SAP V11.1 Update and Recent Developments · PDF fileSAP Convergent Invoicing on BLU Function push-down via SAP Core Data Services (CDS) Faster ABAP Selects SAP Rapid Replenishment

IBM DB2 on SAP –V11.1 Update and Recent Developments

September 26, 2016

Karl Fleckenstein ([email protected])SAP / DB2 Lead Architect,IBM Boeblingen Lab, Germany,SAP St. Leon-Rot, Germany

Page 2: IBM DB2 on SAP V11.1 Update and Recent Developments · PDF fileSAP Convergent Invoicing on BLU Function push-down via SAP Core Data Services (CDS) Faster ABAP Selects SAP Rapid Replenishment

2

IBM DB2 on SAP – V11.1 Update and Recent Developments

Please Note• IBM’s statements regarding its plans, directions, and intent are subject to change or

withdrawal without notice at IBM’s sole discretion.

• Information regarding potential future products is intended to outline our general product direction and it should not be relied on in making a purchasing decision.

• The information mentioned regarding potential future products is not a commitment, promise, or legal obligation to deliver any material, code or functionality. Information about potential future products may not be incorporated into any contract.

• The development, release, and timing of any future features or functionality described for our products remains at our sole discretion.

• Performance is based on measurements and projections using standard IBM benchmarks in a controlled environment. The actual throughput or performance that any user will experience will vary depending upon many factors, including considerations such as the amount of multiprogramming in the user’s job stream, the I/O configuration, the storage configuration, and the workload processed. Therefore, no assurance can be given that an individual user will achieve results similar to those stated here.

Page 3: IBM DB2 on SAP V11.1 Update and Recent Developments · PDF fileSAP Convergent Invoicing on BLU Function push-down via SAP Core Data Services (CDS) Faster ABAP Selects SAP Rapid Replenishment

3

IBM DB2 on SAP – V11.1 Update and Recent Developments

Acknowledgements and Disclaimers Availability. References in this presentation to IBM products, programs, or services do not imply that they will be available in all countries in which IBM operates.

The workshops, sessions and materials have been prepared by IBM or the session speakers and reflect their own views. They are provided for informational purposes only, and are neither intended to, nor shall have the effect of being, legal or other guidance or advice to any participant. While efforts were made to verify the completeness and accuracy of the information contained in this presentation, it is provided AS-IS without warranty of any kind, express or implied. IBM shall not be responsible for any damages arising out of the use of, or otherwise related to, this presentation or any other materials. Nothing contained in this presentation is intended to, nor shall have the effect of, creating any warranties or representations from IBM or its suppliers or licensors, or altering the terms and conditions of the applicable license agreement governing the use of IBM software.

All customer examples described are presented as illustrations of how those customers have used IBM products and the results they may have achieved. Actual environmental costs and performance characteristics may vary by customer. Nothing contained in these materials is intended to, nor shall have the effect of, stating or implying that any activities undertaken by you will result in any specific sales, revenue growth or other results.

© Copyright IBM Corporation 2014. All rights reserved.

— U.S. Government Users Restricted Rights – Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp.

IBM, the IBM logo, ibm.com, DB2 and AIX are trademarks or registered trademarks of International Business Machines Corporation in the United States, other countries, or both. If these and other IBM trademarked terms are marked on their first occurrence in this information with a trademark symbol (® or TM), these symbols indicate U.S. registered or common law trademarks owned by IBM at the time this information was published. Such trademarks may also be registered or common law trademarks in other countries. A current list of IBM trademarks is available on the Web at

•“Copyright and trademark information” at www.ibm.com/legal/copytrade.shtml

•SAP and other SAP products and services mentioned herein as well as their respective logos are trademarks or registered trademarks of SAP SE (or an SAP affiliate company) in Germany and other countries. Please see http://global12.sap.com/corporate-en/legal/copyright/index.epx for additional trademark information and notices.

•Other company, product, or service names may be trademarks or service marks of others.

Page 4: IBM DB2 on SAP V11.1 Update and Recent Developments · PDF fileSAP Convergent Invoicing on BLU Function push-down via SAP Core Data Services (CDS) Faster ABAP Selects SAP Rapid Replenishment

4

IBM DB2 on SAP – V11.1 Update and Recent Developments

Agenda

• Overview

• DB2 BLU Extensions

• Database Performance Optimizations for SAP Business Suite

• DB2 Native Encryption

• SAP on DB2 Cloud Solutions (IaaS)

• High Availability and Disaster Recovery

• Other DB2 V11.1 Features for SAP

• SAP Technical Monitoring Cockpit

• Summary

Page 5: IBM DB2 on SAP V11.1 Update and Recent Developments · PDF fileSAP Convergent Invoicing on BLU Function push-down via SAP Core Data Services (CDS) Faster ABAP Selects SAP Rapid Replenishment

5

IBM DB2 on SAP – V11.1 Update and Recent Developments

DB2 V11.1 Highlights

Simple Fast Deployment

• Up and running in hours

Even Greater Availability

• Zero data loss DR with HADR *

• More online management

More Platforms Supported

• Power Linux (LE)

• Virtualization for RDMA (x86) *

Very Large Database Performance

• Higher user throughput

Simpler, Faster, More Online Upgrades

• Faster, no need for offline backup *

• Streamlined HADR upgrade *

• DB2 Version 9.7 direct to 11.1 *

Comprehensive Enterprise Security

Availability Enhancements

Significant Core Database Advances

Core Mission Critical Workloads :

Extending DB2 Leadership

Massive Scale Warehousing at

In-Memory Performance

MPP BLU Scalability

• PB scale in-memory warehousing *

Next Gen In-Memory Performance,

Function & Workloads

• Faster ETL performance *

• More Query Workloads Optimised *

• More Function supported• Generated Columns

• RCAC

• OLAP + BLU Performance *

Enhanced Compatibility

Multi-Lingual SQL Advances

• PostgresSQL

Support for European Languages

• Codepage 819

Warehousing Workloads :

Most Consumable, Most Scalable

In-Memory Warehousing Platform

Enterprise Encryption

• Centralized Key Managers (KMIP) *

Note: * means SAP

supported items

Page 6: IBM DB2 on SAP V11.1 Update and Recent Developments · PDF fileSAP Convergent Invoicing on BLU Function push-down via SAP Core Data Services (CDS) Faster ABAP Selects SAP Rapid Replenishment

6

IBM DB2 on SAP – V11.1 Update and Recent Developments

BW on BLU

scalability

Faster BW queries

with processing push-

down

Faster SAP Core

Data Services (CDS)

Extended DB2

administration

High availability

extensions

BLU support for Master Data,

DSO, Flat InfoCube, PSA

Faster BW queries on BLU

Faster BW NLS on BLU

SAP Convergent Invoicing

on BLU

Function push-down via SAP

Core Data Services (CDS)

Faster ABAP Selects

SAP Rapid Replenishment

using SAP CDS

DB2 Optimized for SAP – DB2 11.1 GA Enhancements

Streamlined install Streamlined

admin

Version 8.2.2Automatic storageDeployment optimized for SAP

Embedded install Reduced storage

costs Enhanced DBA

Cockpit Self tuning Minimal admin

Version 9.1Storage limits removedAutonomic /TCO featuresCompression

Turn-key HA solution Turn-key compression Integrated MDC advisor Deferred Table Creation

Version 9.5Integrated & automaticHA+DRIntegrated Flash CopyThreaded ArchitectureDPF Scaling Improvements

Integrated Nearline StorageTop-Down, Revamped

Monitoring Next generation DBA Cockpit Improved End-To-End SupportDatabase Performance

Warehouse Integrated Workload

Management Initial integration of DB2

pureScaleMDC Advisor Stage 2

Version 9.7Deeper Deep Compressiono40+% reduction in Indexeso40+% reduction in TempsoCompressed LOBsNear-0 Storage Admin

• Sparse MDC tables for simple space reclaim

• Easy table space reclamation• Ease the path to Automatic StorageExtending Online Operations

• Change schema definitions online• Reorganization improvementsFull 360° Monitoring

DB2 9.8 pureScaleContinuous availabilitySeamless OS and hardware maintenanceOLTP scale out

MPP-optimized DSO activation for DB2 DPFSeparation of dutiesERP partitioning

engineIntegrated HA for SAPGraceful maintenance

DB2 10.12 X warehouse performance improvementAdaptive compressionExtended multi core supportNo touch space reclamationGeographically dispersed pureScaleclusterMultiple temperature storageMultiple standby with time delayExtended transparent fail over

DB2 10.5BLU Acceleration

- Faster queries- Better compression pureScale extension - Online rolling

FixPack updates- Comprehensive DR

solution - Topology changing

DB2 backup/restore - Online Add MemberREORG-free databaseHardware-agnostic

integrated flash copy

Multi-temperature managementDeep integration of

DB2 pureScaleSeamless space

reclamationIdentity Management

with DB2Cloud readinessExploitation of SoH

optimizations on DB2De-clustering and de-

pooling

DB2 10.5 support for SAP NW 7.0 and higher

BLU support for- SAP BW InfoCubes- BW Nearline

Storage - SAP SEM

SAP Convergent Charging support on DB2 pureScale

Full SAP GUI DBA Cockpit coverage for DB2 10.5

2006

2007

2008

2009

2010

2012

2013

2011

2014

2005

Focus areas• Easy Deployment, Configuration, Administration

• TCO reduction

• Performance improvements

• Backup & recovery improvements

• High Availability & Disaster Recovery

2015

DB2 10.5 FPsSignificant BLU extensions

- Faster SEL/INS/UPD/DEL

- HADR support

- Better compression

- Windows support (FP5)

POWER8 exploitation

pureScale enhancements

- Support of Vmware, KVM

- TCP/IP (sockets)

Native DB2 Encryption (FP5)

SLES12 support (FP6)

db2sap lib extensions (FP7)

Memory table (FP7)

20172016

DB2 11.1 BLU extensions (MPP,

Load, SQL functions)

Encryption with

centralized key mgr

db2sap lib extensions

AMT extensions

DB2 Upgrade

simplification

pureScale / HADR

extensions

Database relocation

HW acceleration for log

file+backup compression

Page 7: IBM DB2 on SAP V11.1 Update and Recent Developments · PDF fileSAP Convergent Invoicing on BLU Function push-down via SAP Core Data Services (CDS) Faster ABAP Selects SAP Rapid Replenishment

7

IBM DB2 on SAP – V11.1 Update and Recent Developments

DB2 V11.1 - SAP Support

• DB2 V 11.1 GA on June 15th, 2016

• SAP certification of DB2 V11.1 on August 11th, 2016

• Important SAP Notes

SAP Note 2303763 - DB6: Using DB2 11.1 with SAP Applications

• Support for SAP NetWeaver 7.00 and higher releases

SAP Note 2311008 - DB6: Upgrade to Version 11.1 of DB2 for LUW

SAP Note 2303771 - DB6: DB2 11.1 Standard Parameter Settings

• Database upgrades to DB2 11.1 are possible from following DB2 start

releases

DB2 V9.7

DB2 V10.1

DB2 V10.5

Page 8: IBM DB2 on SAP V11.1 Update and Recent Developments · PDF fileSAP Convergent Invoicing on BLU Function push-down via SAP Core Data Services (CDS) Faster ABAP Selects SAP Rapid Replenishment

8

IBM DB2 on SAP – V11.1 Update and Recent Developments

SAP on DB2 10.5 and DB2 V11.1 – Supported OS Platforms

DSAP on DB2 V10.5 SAP on DB2 V11.1

AIX 6.1, 7.1, 7.2 AIX 7.1, 7.2

Linux x86 64 Bit

RHEL 5+, RHEL 6+, RHEL 7+

SLES 10 SP4+ , SLES 11 SP2+, SLES 12

Linux x86 64 Bit

RHEL 6.7+ , RHEL 7.1+

SLES 11 SP4+ , SLES 12

Linux POWER Big Endian

RHEL 5+, RHEL 6+, RHEL 7+

SLES 10 SP4+ , SLES 11 SP2+

-

Windows x86 64 Bit

Windows Server 2008 R2

Windows Server 2012/2012 R2

Windows x86 64 Bit

Windows Server 2012/2012 R2

HP-UX 11i v3 -

Solaris 10, 11 on SPARC -

Solaris 10 on x86 64 Bit -

DB2 V10.5 details on IBM website System requirements for IBM DB2 for Linux, UNIX, and Windows http://www.ibm.com/support/docview.wss?uid=swg27038033#105AES

SAP supported OS virtualization described in SAP Note 1492000 - General Support Statement for Virtual Environments

Page 9: IBM DB2 on SAP V11.1 Update and Recent Developments · PDF fileSAP Convergent Invoicing on BLU Function push-down via SAP Core Data Services (CDS) Faster ABAP Selects SAP Rapid Replenishment

9

IBM DB2 on SAP – V11.1 Update and Recent Developments

SAP NetWeaver 7.50 – DB2 Support

• Data abstraction with Core Data Services (CDS)

• ABAP programming model significant extended

• SAP Fiori as cross-application user experience

• Requires DB2 11.1 or

DB2 10.5 FP6SAP or higher

DB2 for LUW

Latest technology platform and foundation for the SAP Business Suite and the SAP NetWeaver hubs such as SAP Enterprise Portal, SAP Business Warehouse and SAP Process Orchestration

Page 10: IBM DB2 on SAP V11.1 Update and Recent Developments · PDF fileSAP Convergent Invoicing on BLU Function push-down via SAP Core Data Services (CDS) Faster ABAP Selects SAP Rapid Replenishment

10

IBM DB2 on SAP – V11.1 Update and Recent Developments

Agenda

• Overview

• DB2 BLU Extensions

• Database Performance Optimizations for SAP Business Suite

• DB2 Native Encryption

• SAP on DB2 Cloud Solutions (IaaS)

• High Availability and Disaster Recovery

• Other DB2 V11.1 Features for SAP

• SAP Technical Monitoring Cockpit

• Summary

Page 11: IBM DB2 on SAP V11.1 Update and Recent Developments · PDF fileSAP Convergent Invoicing on BLU Function push-down via SAP Core Data Services (CDS) Faster ABAP Selects SAP Rapid Replenishment

11

IBM DB2 on SAP – V11.1 Update and Recent Developments

• Innovative new technology for analytical queries– Columnar storage

– New run-time engine with vector (aka SIMD) processing, deep multi-core optimizations and cache-aware memory management

– “Active compression” - unique encoding for further storage reduction beyond DB2 10 levels, and run-time processing without decompression

• “Revolution by Evolution”– Built directly into the DB2 kernel

– BLU tables can coexist with traditional row tables, in same schema, tablespaces, bufferpools

– Query any combination of BLU or row data

– Memory and CPU cache optimized

• Value: Order-of-magnitude benefits in ….– Performance

– Storage savings

– Time to Value

What is DB2 with BLU Acceleration?

BLU Acceleration

Page 12: IBM DB2 on SAP V11.1 Update and Recent Developments · PDF fileSAP Convergent Invoicing on BLU Function push-down via SAP Core Data Services (CDS) Faster ABAP Selects SAP Rapid Replenishment

12

IBM DB2 on SAP – V11.1 Update and Recent Developments

PSA

Info

Cube

Source Systems

Reporting

DSO

SAP on DB2 BLU Support

Reporting

Layer

Enterprise

Data

Warehouse

Layer

Data

Acquisition

Layer

BW Near-Line

Storage (NLS)PSA

Flat

Info

Cube

DSODSO

PSA PSA

Master

Data

Aggr

egate

Flat

Info

Cube

Flat InfoCube is also known as „HANA optimized IC“

Supported SAP Applications

SAP BW based applications

• SAP NetWeaver BW 7.0 and higher

• SAP Strategic Enterprise Management

• SAP Solution Manager

DB2 Near-Line Storage (NLS)

SAP Convergent Invoicing• Billing application for Telco Industry

and large Web shops

Advantages

Faster reporting

Faster ETL processing

Faster NLS archiving

Flat InfoCube with

even better performance

Space reduction

DB2 BLU Support for SAP BW and NLS

Page 13: IBM DB2 on SAP V11.1 Update and Recent Developments · PDF fileSAP Convergent Invoicing on BLU Function push-down via SAP Core Data Services (CDS) Faster ABAP Selects SAP Rapid Replenishment

13

IBM DB2 on SAP – V11.1 Update and Recent Developments

DB2 V11.1 BLU Load Optimization

• SAP R3load parameter “OPT_COMPRESS” uses new CLI LOAD

attribute RESETDICTIONARYONLY

• RESETDICTIONARYONLY option is used to create a BLU compression

dictionary from sample data without loading any data.

• Advantages

Higher compression ratio with better BLU table dictionaries

No (large) temporary files on the database server are created any more.

Page 14: IBM DB2 on SAP V11.1 Update and Recent Developments · PDF fileSAP Convergent Invoicing on BLU Function push-down via SAP Core Data Services (CDS) Faster ABAP Selects SAP Rapid Replenishment

14

IBM DB2 on SAP – V11.1 Update and Recent Developments

Push Down BW Query Processing to DB2 BLU (1)Push down of cell restrictions in SAP BW queries

• Individual filter conditions for key figures and characteristics

• Often used in BW queries

• Complex Customer reports may contain 100s of cell restrictions

Available with SAP BW 7.50 SP4 on DB2 V11.1 and V10.5

Page 15: IBM DB2 on SAP V11.1 Update and Recent Developments · PDF fileSAP Convergent Invoicing on BLU Function push-down via SAP Core Data Services (CDS) Faster ABAP Selects SAP Rapid Replenishment

15

IBM DB2 on SAP – V11.1 Update and Recent Developments

Push Down BW Query Processing to DB2 BLU (2)Push down of cell restrictions in SAP BW queries

• Individual filter conditions for key figures and characteristics

• Often used in BW queries

• Complex Customer reports may contain 100s of cell restrictions

Available with SAP BW 7.50 SP4 on DB2 V11.1 and V10.5

Page 16: IBM DB2 on SAP V11.1 Update and Recent Developments · PDF fileSAP Convergent Invoicing on BLU Function push-down via SAP Core Data Services (CDS) Faster ABAP Selects SAP Rapid Replenishment

16

IBM DB2 on SAP – V11.1 Update and Recent Developments

Push Down BW Query Processing to DB2 BLU (3)Push down of cell restrictions in SAP BW queries

• Individual filter conditions for key figures and characteristics

• Often used in BW queries

• Complex Customer reports may contain 100s of cell restrictions

Available with SAP BW 7.50 SP4 on DB2 V11.1 and V10.5

Page 17: IBM DB2 on SAP V11.1 Update and Recent Developments · PDF fileSAP Convergent Invoicing on BLU Function push-down via SAP Core Data Services (CDS) Faster ABAP Selects SAP Rapid Replenishment

17

IBM DB2 on SAP – V11.1 Update and Recent Developments

Processing without push down of cell restrictions

• Large result set is transferred to SAP BW application server

• Final result is aggregated on SAP BW application server

Processing WITH push down of cell restrictions to DB2 BLU

• Restricted key figures are aggregated in DB2 BLU engine

• Small result set is transferred to SAP BW application server.

• No or significant less aggregation on SAP BW application server

Significant reduced data processing on the SAP BW application server

Up to large factor faster BW queries

Push Down BW Query Processing to DB2 BLU (4)

New!

Page 18: IBM DB2 on SAP V11.1 Update and Recent Developments · PDF fileSAP Convergent Invoicing on BLU Function push-down via SAP Core Data Services (CDS) Faster ABAP Selects SAP Rapid Replenishment

18

IBM DB2 on SAP – V11.1 Update and Recent Developments seconds

Mill

ion

Mill

ion

28 693 354307 160

2,6 2,29,9

1,0

Push Down BW Query Processing to DB2 BLU - Results

Internal Tests at IBM Germany Research & Development

Page 19: IBM DB2 on SAP V11.1 Update and Recent Developments · PDF fileSAP Convergent Invoicing on BLU Function push-down via SAP Core Data Services (CDS) Faster ABAP Selects SAP Rapid Replenishment

19

IBM DB2 on SAP – V11.1 Update and Recent Developments

BLU Acceleration: MPP (Massive Parallel Processing) Scale Out

Technology

– Pervasive SMP & MPP Query Parallelism

– Each table has its onw distribution key defined

– Each table uses a common data compresion dictionary

across all db partitions

– Data exchange during distributed joins and aggregation

processing occurs entirely within the BLU runtime in

native columnar format (avoids conversion to row format)

Value Proposition

– Improve Response Time

• All servers contribute to the processing of a query

– Massively Scale Data

• Significantly beyond current practical limits

– Streamline BLU Adoption

• Add BLU Acceleration to existing data warehouses

1/3 data

Hash partition(BLU

Acceleration)

Query #1processing

Query #1

Query #1processing

Query #1processing

1/3 data

Hash partition(BLU

Acceleration)

1/3 data

Hash partition(BLU

Acceleration)

DB2 10.5 BLU

Capacity

DB2 V11.1 BLU

Capacity

10s of TB 1000s of TB

100s of Cores 1000s of Cores

Page 20: IBM DB2 on SAP V11.1 Update and Recent Developments · PDF fileSAP Convergent Invoicing on BLU Function push-down via SAP Core Data Services (CDS) Faster ABAP Selects SAP Rapid Replenishment

20

IBM DB2 on SAP – V11.1 Update and Recent Developments

DB2 V11.1 – BLU MPP Support for SAP BW

BLU MPP for large SAP BW customers

• Allows Horizontal Scalability

• Consider BLU MPP usage for large BW databases

with > 70 TByte uncompressed data;

this equates to > 10 TByte BLU compressed data

• Database Partition size:

At a minimum, all CPUs and memory of one

socket

As a rule of thumb, 16 GByte memory per core

• Same table distribution as on row- store (DPF)

Master Data and Dimension tables on Part. 0

(Administration Partition)

Small PSA, DSO and Fact tables on Partition 0

(Administration Partition)

Large PSA, DSO and Fact tables are

distributed on Partition 1 ... N

Fast Communication

DB Part. 2 DB Part. 3DB Partition 0 DB Part. 1

Fact Tables

DataStore (DSO) Tables

PSA Tables

DB Server 1 DB Server 2

Dimension

Tables

Basis Tables

Master Data

SAP BW Appl.

Server 2

Small PSA,

DSO, Fact

Tables

SAP BW Appl.

Server 1

Page 21: IBM DB2 on SAP V11.1 Update and Recent Developments · PDF fileSAP Convergent Invoicing on BLU Function push-down via SAP Core Data Services (CDS) Faster ABAP Selects SAP Rapid Replenishment

21

IBM DB2 on SAP – V11.1 Update and Recent Developments

SAP BW Query Performance Tests with BLU MPP• Runtime comparison of BW InfoCube queries: Single Member versus MPP

• Single Member configuration: All tables are located on single member database

• MPP configuration: Fact tables are distributed on 2 database partitions

• Result: Average query run time on MPP system is factor 1.86x faster on MPP

Internal Tests at IBM Germany Research & Development

Page 22: IBM DB2 on SAP V11.1 Update and Recent Developments · PDF fileSAP Convergent Invoicing on BLU Function push-down via SAP Core Data Services (CDS) Faster ABAP Selects SAP Rapid Replenishment

22

IBM DB2 on SAP – V11.1 Update and Recent Developments

Agenda

• Overview

• DB2 BLU Extensions

• Database Performance Optimizations for SAP Business Suite

• DB2 Native Encryption

• SAP on DB2 Cloud Solutions (IaaS)

• High Availability and Disaster Recovery

• SAP Technical Monitoring Cockpit

• Summary

Page 23: IBM DB2 on SAP V11.1 Update and Recent Developments · PDF fileSAP Convergent Invoicing on BLU Function push-down via SAP Core Data Services (CDS) Faster ABAP Selects SAP Rapid Replenishment

23

IBM DB2 on SAP – V11.1 Update and Recent Developments

A Paradigm Change in SAP Application Programming

Data-To-Code:Intensive computations

in APPLICATIONlayer

Code-To-Data:Intensive

computations

in DATABASE layer

From Classic Approach

• Avoid costly computation on database level

• Transfer data to application server and compute there

To Data Centric Approach

•Get the algorithm to the data

•Only transfer computation results to the application server

Page 24: IBM DB2 on SAP V11.1 Update and Recent Developments · PDF fileSAP Convergent Invoicing on BLU Function push-down via SAP Core Data Services (CDS) Faster ABAP Selects SAP Rapid Replenishment

24

IBM DB2 on SAP – V11.1 Update and Recent Developments

SAP Core Data Services (CDS)Next generation data definition and access for database centric applications CDS presents the data layer in SAP’s modern business solution

Defines business objects as database views that contain SQL functions

Flexible and powerful data modelling with huge variety of options and functions

CDS Views are modelled with ABAP Eclipse Editor

Page 25: IBM DB2 on SAP V11.1 Update and Recent Developments · PDF fileSAP Convergent Invoicing on BLU Function push-down via SAP Core Data Services (CDS) Faster ABAP Selects SAP Rapid Replenishment

25

IBM DB2 on SAP – V11.1 Update and Recent Developments

Data Centric Approach with Open SQL Enhancements and Core Data Services (CDS) (1)

DB2

DB-independent

implementation

DB2 CLI

Business Suite

Applications

Core Data

Services

Open SQL

Page 26: IBM DB2 on SAP V11.1 Update and Recent Developments · PDF fileSAP Convergent Invoicing on BLU Function push-down via SAP Core Data Services (CDS) Faster ABAP Selects SAP Rapid Replenishment

26

IBM DB2 on SAP – V11.1 Update and Recent Developments

Data Centric Approach with Open SQL Enhancements and Core Data Services (CDS) (2)

DB2

DB-independent

implementation

DB2 CLI

Business Suite

Applications

Core Data

Services

Open SQL

ABAP Open SQL enhancements

Scope SAP NW 7.40

More complex SQL features, e.g. Aggregation, GROUP BY, HAVING, …

Scope SAP NW 7.5

New ABAP SQL Features, e.g. Select with Union, Insert from Select, …

Fast Data Access DB2 Memory Table Function

Temporary Tables DB2 Created Global Temporary Tables

Optimized currency and unit conversion DB2 Scalar Functions

Page 27: IBM DB2 on SAP V11.1 Update and Recent Developments · PDF fileSAP Convergent Invoicing on BLU Function push-down via SAP Core Data Services (CDS) Faster ABAP Selects SAP Rapid Replenishment

27

IBM DB2 on SAP – V11.1 Update and Recent Developments

Data Centric Approach with Open SQL Enhancements and Core Data Services (CDS) (3)

DB2

DB-independent

implementation

DB2 CLI

Business Suite

Applications

Core Data

Services

Open SQL ABAP CDS enhancements

Scope SAP NW 7.40 SP8

CDS Views DB2 SQL Views

CDS Views with parameters DB2 Inline Table Functions

CDS Scalar functions DB2 Scalar Functions

Scope SAP NW 7.5

Session variables DB2 SQL Variables in Modules

Date, Time, Timestamp functions DB2 Scalar Functions

ABAP Open SQL enhancements

Scope SAP NW 7.40

More complex SQL features, e.g. Aggregation, GROUP BY, HAVING, …

Scope SAP NW 7.5

New ABAP SQL Features, e.g. Select with Union, Insert from Select, …

Fast Data Access DB2 Memory Table Function

Temporary Tables DB2 Created Global Temporary Tables

Optimized currency and unit conversion DB2 Scalar Functions

Page 28: IBM DB2 on SAP V11.1 Update and Recent Developments · PDF fileSAP Convergent Invoicing on BLU Function push-down via SAP Core Data Services (CDS) Faster ABAP Selects SAP Rapid Replenishment

28

IBM DB2 on SAP – V11.1 Update and Recent Developments

SAP CDS – Performance Optimizations with db2sap Library Extensions

• Application logic running within database via DB2 scalar functions

(UDFs)

Heavily used within SAP Core Data Services (CDS)

Significant optimizations on DB2 for LUW

• Re-Implementation of DB2 PL/SQL functions in C language

Currency conversion

Unit conversion

Date/time conversion

• Deployment with SAP NetWeaver 7.50

New UDFs come with DB2 V11.1 and DB2 V10.5 FP7SAP installation

• Advantages

Push down data processing from application server to the database

Less data traffic: database application server

Significant faster run time of SQL functions in C

DB2

DB-independent

implementation

DB2 CLI

Business Suite

Applications

Core Data

Services

Open SQL

db2sap

library

Page 29: IBM DB2 on SAP V11.1 Update and Recent Developments · PDF fileSAP Convergent Invoicing on BLU Function push-down via SAP Core Data Services (CDS) Faster ABAP Selects SAP Rapid Replenishment

29

IBM DB2 on SAP – V11.1 Update and Recent Developments

Use of DB2 Symmetric Multi-processing (SMP) for SAP Applications

Open SQL

Business

Suite

DB2

Tables

CE1... CE2... CE3... CE4...

K81...

Agent

DB2

Parallel

Subagents

Coordinator

Agent

OLTP DefaultPre-SAP NW 7.5

OLTP with DB2 SMP processing Significantly faster reporting

Open SQL

Business

Suite

Tables

CE1... CE2... CE3... CE4...

K81...

Internal Tests at IBM Germany Research & Development

Significantly faster reporting queries and data extraction with the enablement of DB2 SMP parallelism in SAP OLTP systems on row-store

Enablement of DB2 parallel processing for SAP applications is described in SAP Note 2047006

– Easy activation

– No SAP application changes needed

– Default with NW 7.5

Accelerating SAP Profitability Analysis (CO-PA) with DB2 SMP

– Details in SAP note 2052896 and on IBM developerWorks (http://www.ibm.com/developerworks/data/library/techarticle/dm-1603-sapr-co-pa-db2r-luw-trs/index.html)

– Up to factor 8x faster with DB2 SMP

Page 30: IBM DB2 on SAP V11.1 Update and Recent Developments · PDF fileSAP Convergent Invoicing on BLU Function push-down via SAP Core Data Services (CDS) Faster ABAP Selects SAP Rapid Replenishment

30

IBM DB2 on SAP – V11.1 Update and Recent Developments

Agenda

• Overview

• DB2 BLU Extensions

• Database Performance Optimizations for SAP Business Suite

• DB2 Native Encryption

• SAP on DB2 Cloud Solutions (IaaS)

• High Availability and Disaster Recovery

• SAP Technical Monitoring Cockpit

• Summary

Page 31: IBM DB2 on SAP V11.1 Update and Recent Developments · PDF fileSAP Convergent Invoicing on BLU Function push-down via SAP Core Data Services (CDS) Faster ABAP Selects SAP Rapid Replenishment

31

IBM DB2 on SAP – V11.1 Update and Recent Developments

DB2 Native Encryption and Enterprise Key Management

DB2 Instance

DB2 Encrypted DB

DBM CFG

KEYSTORE_TYPEKEYSTORE_LOCATION

Database

Data

Encryption

Key (DEK)

DB CFG

ENCRLIBENCROPTS

EncryptedDatabase Backup Image

KeystoreFile

EncryptedMaster Key

Centralized Key Manager

EncryptedMaster Key

database

backup

Backup DEK

DB2 V10.5 FP5Simple Key Management• A local flat file used for

a specific DB2 instance

DB2 V11.1Enterprise Key Management• A centralized key manager

that can be used across many databases and other uses across an enterprise

• Goal: Protect data in cases of physical theft of disk devices, backup images, log files

and dump files

• DB2 Native Encryption

Symmetric encryption: same

key is used to encrypt and

decrypt database and backup

Two-Tier model

- Data Encryption Key (DEK)

- Master Key (MK)

No application or schema changes required

DB2 encrypts/decrypts data before it writes/reads data to/from disk

Works for standard DB2, DPF, pureScale, and HADR

• V11.1 adds support for Key Management Interoperability Protocol (KMIP) 1.1 complaint centralized key managers

Page 32: IBM DB2 on SAP V11.1 Update and Recent Developments · PDF fileSAP Convergent Invoicing on BLU Function push-down via SAP Core Data Services (CDS) Faster ABAP Selects SAP Rapid Replenishment

32

IBM DB2 on SAP – V11.1 Update and Recent Developments

DB2 Native Encryption – SAP Integration into SAP DBA CockpitDatabase Encryption Overview

Configuration Encryption:Displays data provided by the ADMIN_GET_ENCRYPTION_INFO table function

Page 33: IBM DB2 on SAP V11.1 Update and Recent Developments · PDF fileSAP Convergent Invoicing on BLU Function push-down via SAP Core Data Services (CDS) Faster ABAP Selects SAP Rapid Replenishment

33

IBM DB2 on SAP – V11.1 Update and Recent Developments

DB2 Native Encryption – SAP integration

Backup with Encryption

Jobs DBA Planning Calendar

Add Database Backup

to Device

Page 34: IBM DB2 on SAP V11.1 Update and Recent Developments · PDF fileSAP Convergent Invoicing on BLU Function push-down via SAP Core Data Services (CDS) Faster ABAP Selects SAP Rapid Replenishment

34

IBM DB2 on SAP – V11.1 Update and Recent Developments

Agenda

• Overview

• DB2 BLU Extensions

• Database Performance Optimizations for SAP Business Suite

• DB2 Native Encryption

• SAP on DB2 Cloud Solutions (IaaS)

• High Availability and Disaster Recovery

• SAP Technical Monitoring Cockpit

• Summary

Page 35: IBM DB2 on SAP V11.1 Update and Recent Developments · PDF fileSAP Convergent Invoicing on BLU Function push-down via SAP Core Data Services (CDS) Faster ABAP Selects SAP Rapid Replenishment

35

IBM DB2 on SAP – V11.1 Update and Recent Developments

SAP on DB2 Cloud Solutions (IaaS)

On-Premise

ERP Prod ERP Test

BW Prod BW Test

SAPRouter

ERP Dev BW Dev

Cloud SAP on DB2 systems can be moved to the Cloud

High Availability in the Cloud with DB2 HADR is possible

Preferred system types for deploying SAP NetWeaver based applications

Medium sized production systems

Development systems

Testing systems

Prototype systems

Learning / Demonstration systems

Existing SAP on DB2 cloud solutions (IaaS)

Amazon Web Services

Available since Q2/2011

SAP Note 1600156 - DB6: Support statement for DB2 on Amazon

Web Services

Microsoft Azure

Available since Q4 2015

Supported OS: Linux and Windows

SAP note 1928533 SAP Applications on Azure: Supported Products

and Sizing

SAP note 2233094 - DB6: SAP Applications on Azure Using IBM DB2

for Linux, UNIX, and Windows - Additional Information

VPN Connection

Page 36: IBM DB2 on SAP V11.1 Update and Recent Developments · PDF fileSAP Convergent Invoicing on BLU Function push-down via SAP Core Data Services (CDS) Faster ABAP Selects SAP Rapid Replenishment

36

IBM DB2 on SAP – V11.1 Update and Recent Developments

Remote Storage Option for Utilities

• Remote Storage Option for Utilities Remote storage is now accessible

- from INGEST, LOAD, BACKUP and RESTORE

- through the use of storage access aliases Supported remote cloud storage locations

- IBM® SoftLayer® Object Storage - Amazon Simple Storage Service (S3)

• SAP integraton into SAP DBA Cockpit

Remote cloud storage location can be

specified as DB2 backup directory

• Use case: Simple Disaster Recovery

solution using remote database backup

concept

SoftLayer Object Storage

Remote location https://mon01.objectstorage.service.networklayer.com/

/db2backup

DB2 Backup

Page 37: IBM DB2 on SAP V11.1 Update and Recent Developments · PDF fileSAP Convergent Invoicing on BLU Function push-down via SAP Core Data Services (CDS) Faster ABAP Selects SAP Rapid Replenishment

37

IBM DB2 on SAP – V11.1 Update and Recent Developments

Agenda

• Overview

• DB2 BLU Extensions

• Database Performance Optimizations for SAP Business Suite

• DB2 Native Encryption

• SAP on DB2 Cloud Solutions (IaaS)

• High Availability and Disaster Recovery

• SAP Technical Monitoring Cockpit

• Summary

Page 38: IBM DB2 on SAP V11.1 Update and Recent Developments · PDF fileSAP Convergent Invoicing on BLU Function push-down via SAP Core Data Services (CDS) Faster ABAP Selects SAP Rapid Replenishment

38

IBM DB2 on SAP – V11.1 Update and Recent Developments

DB2 V11.1 pureScale Enhancements

• Linux virtualization support (x86) – Adapter sharing

• Improved high availability for Geographically dispersed DB2 pureScale (GDPC) cluster to avoid Single Point of Failure (SPOF) on one site

Multiple adapter ports per member and CF

Dual switches on each site

Data Center 2

CFCF

Standby DR Cluster

CFCF

Primary Cluster

Data Center 1

SYNCNEARSYNC

ASYNCSUPER ASYNC

• HADR SYNC and NEARSYNC support

combines pureScale and HADR

to provide a near continuously

available system with robust

RPO=0 disaster recovery

Data Center 1 Data Center 2

Page 39: IBM DB2 on SAP V11.1 Update and Recent Developments · PDF fileSAP Convergent Invoicing on BLU Function push-down via SAP Core Data Services (CDS) Faster ABAP Selects SAP Rapid Replenishment

39

IBM DB2 on SAP – V11.1 Update and Recent Developments

Agenda

• Overview

• DB2 BLU Extensions

• Database Performance Optimizations for SAP Business Suite

• DB2 Native Encryption

• SAP on DB2 Cloud Solutions (IaaS)

• High Availability and Disaster Recovery

• Other DB2 V11.1 Features for SAP

• SAP Technical Monitoring Cockpit

• Summary

Page 40: IBM DB2 on SAP V11.1 Update and Recent Developments · PDF fileSAP Convergent Invoicing on BLU Function push-down via SAP Core Data Services (CDS) Faster ABAP Selects SAP Rapid Replenishment

40

IBM DB2 on SAP – V11.1 Update and Recent Developments

Other DB2 V11.1 Features for SAP (1)

• ADMIN_MOVE_TABLE improvements

- New REPORT option to monitor progress of table moves

- New TERM option to terminate a table move in progress

- Performance improvement of INIT phase

• New option “NO TABLESPACE” on the DB2 BACKUP command

- Allows you to take backups of the DB2 history file and other important DB2 meta information.

- Can be used to take regular backups of your history file independent of regular DB2 backups.

• New "-g" option for db2relocated

- For generating scripts that can be used as input for database relocation operations

- For cloning a database with different database name and paths

- Planned to use it for SAP system copy

Page 41: IBM DB2 on SAP V11.1 Update and Recent Developments · PDF fileSAP Convergent Invoicing on BLU Function push-down via SAP Core Data Services (CDS) Faster ABAP Selects SAP Rapid Replenishment

41

IBM DB2 on SAP – V11.1 Update and Recent Developments

Other DB2 V11.1 Features for SAP (2)

• Fast preallocation of log files as default under DB2_WORKLOAD=SAP

- SAP default setting: DB2_USE_FAST_LOG_PREALLOCATION=TRUE [DB2_WORKLOAD]

- Supported file systems: AIX and Linux on Veritas VxFS, JFS2, GPFS, Linux only on ext4 xFS

- Faster database activation and faster allocation of secondary log files

• AIX HW acceleration of Database Backup and Log File compression/decompression

• POWER 7+ and POWER 8 support with AIX 6 TL 9 SP3 or AIX 7 TL 3 SP 3

(Note for POWER8 usage: Performance issue identified with parallel NX842 processing;

code correction will come soon with new AIX service packs)

• Prerequisite: POWER Feature Active Memory Expansion and Hardware-Accelerated Active Memory

Expansion Capability (AME license) enabled on the POWER server

• Significant faster than database compression feature

Page 42: IBM DB2 on SAP V11.1 Update and Recent Developments · PDF fileSAP Convergent Invoicing on BLU Function push-down via SAP Core Data Services (CDS) Faster ABAP Selects SAP Rapid Replenishment

42

IBM DB2 on SAP – V11.1 Update and Recent Developments

Agenda

• Overview

• DB2 BLU Extensions

• Database Performance Optimizations for SAP Business Suite

• DB2 Native Encryption

• SAP on DB2 Cloud Solutions (IaaS)

• High Availability and Disaster Recovery

• Other DB2 V11.1 Features for SAP

• SAP Technical Monitoring Cockpit

• Summary

Page 43: IBM DB2 on SAP V11.1 Update and Recent Developments · PDF fileSAP Convergent Invoicing on BLU Function push-down via SAP Core Data Services (CDS) Faster ABAP Selects SAP Rapid Replenishment

43

IBM DB2 on SAP – V11.1 Update and Recent Developments

From existing SAP Monitoring to theTechnical Monitoring Cockpit (TMC)

Limitations Today Difficult to correlate data between database,

Operating System and Hardware

Different user interface between the separate transactions.

Cannot customize the user interface

Difficult to update the monitoring applications

(only via SAP notes and Support Packages)

SAP Business Suite Stack SAP Monitors - 2016

Page 44: IBM DB2 on SAP V11.1 Update and Recent Developments · PDF fileSAP Convergent Invoicing on BLU Function push-down via SAP Core Data Services (CDS) Faster ABAP Selects SAP Rapid Replenishment

44

IBM DB2 on SAP – V11.1 Update and Recent Developments

From existing SAP Monitoring to theTechnical Monitoring Cockpit (TMC)

Limitations Today Difficult to correlate data between database,

Operating System and Hardware

Different user interface between the separate transactions.

Cannot customize the user interface

Difficult to update the monitoring applications

(only via SAP notes and Support Packages)

Technical Monitoring Cockpit 2016+

Solution

Benefits Full Stack Monitoring with comprehensive

diagnostics

Powerful user interfaces SAP Fiori and SAP GUI support

Role based user interface

Simple customization and personalization

Content updates instead of SW upgrades (no SAP notes, no Support Packages)

SAP Business Suite Stack SAP Monitors - 2016

Page 45: IBM DB2 on SAP V11.1 Update and Recent Developments · PDF fileSAP Convergent Invoicing on BLU Function push-down via SAP Core Data Services (CDS) Faster ABAP Selects SAP Rapid Replenishment

45

IBM DB2 on SAP – V11.1 Update and Recent Developments

TMC User Interface

Page 46: IBM DB2 on SAP V11.1 Update and Recent Developments · PDF fileSAP Convergent Invoicing on BLU Function push-down via SAP Core Data Services (CDS) Faster ABAP Selects SAP Rapid Replenishment

46

IBM DB2 on SAP – V11.1 Update and Recent Developments

TMC Screen Example – Network Statistics

Page 47: IBM DB2 on SAP V11.1 Update and Recent Developments · PDF fileSAP Convergent Invoicing on BLU Function push-down via SAP Core Data Services (CDS) Faster ABAP Selects SAP Rapid Replenishment

47

IBM DB2 on SAP – V11.1 Update and Recent Developments

Agenda

• Overview

• DB2 BLU Extensions

• Database Performance Optimizations for SAP Business Suite

• DB2 Native Encryption

• SAP on DB2 Cloud Solutions (IaaS)

• High Availability and Disaster Recovery

• Other DB2 V11.1 Features for SAP

• SAP Technical Monitoring Cockpit

• Summary

Page 48: IBM DB2 on SAP V11.1 Update and Recent Developments · PDF fileSAP Convergent Invoicing on BLU Function push-down via SAP Core Data Services (CDS) Faster ABAP Selects SAP Rapid Replenishment

48

IBM DB2 on SAP – V11.1 Update and Recent Developments

Summary

What are the DB2 V11.1 benefits for SAP applications?

• Deep SAP integration with further performance improvements for

Existing SAP applications (SAP NW 7.0 and higher)

SAP’s new frameworks and new features (CDS, Open SQL)

SAP BW

• Scalability with BLU Acceleration

• DB2 Native Encryption with centralized key manager

• Extended SAP on DB2 Cloud solutions (IaaS)

• Extended High Availability / Disaster Recovery

• Improved DB2 database administration

Page 49: IBM DB2 on SAP V11.1 Update and Recent Developments · PDF fileSAP Convergent Invoicing on BLU Function push-down via SAP Core Data Services (CDS) Faster ABAP Selects SAP Rapid Replenishment

49

IBM DB2 on SAP – V11.1 Update and Recent Developments

Thank [email protected]