1 GSE DB2 Working Group meeting 27 March 2014 DB2 Connectivity at Euroclear.

18
1 GSE DB2 Working Group meeting 27 March 2014 DB2 Connectivity at Euroclear

Transcript of 1 GSE DB2 Working Group meeting 27 March 2014 DB2 Connectivity at Euroclear.

Page 1: 1 GSE DB2 Working Group meeting 27 March 2014 DB2 Connectivity at Euroclear.

1

GSE DB2 Working Group meeting 27 March 2014

DB2 Connectivity at Euroclear

Page 2: 1 GSE DB2 Working Group meeting 27 March 2014 DB2 Connectivity at Euroclear.

2

Contents

•About Euroclear•Infrastructure •Workload•As it was•As it is•The current challenges•The future challenges•Support Demanded•Tools

Page 3: 1 GSE DB2 Working Group meeting 27 March 2014 DB2 Connectivity at Euroclear.

About Euroclear

• Active in the financial transaction processing, Euroclear is the world’s largest provider of domestic and cross-border settlement & related services for bonds, equity and funds.

• Our clients are banks and financial institutions, brokers, dealers from over 80 countries.

3

Page 4: 1 GSE DB2 Working Group meeting 27 March 2014 DB2 Connectivity at Euroclear.

Euroclear facts & figures

4

• Number of employees: 3600 worldwide► 2,500 in Belgium, and approximately 900 in IT

• Nationalities: >80

• Average age: 37

• Number of offices worldwide: 12

• Countries in which we have clients: 80

• Headquarters: Belgium► Main office in Brussels, a 2nd office in Braine L’Alleud

Page 5: 1 GSE DB2 Working Group meeting 27 March 2014 DB2 Connectivity at Euroclear.

Our offices and hubs worldwide

5

Page 6: 1 GSE DB2 Working Group meeting 27 March 2014 DB2 Connectivity at Euroclear.

Who are we?

Page 7: 1 GSE DB2 Working Group meeting 27 March 2014 DB2 Connectivity at Euroclear.

The Data Center Policy

7

First company in Europe running a three data centre infrastructure, spread over two countries and designed to be fully redundant and synchronized for critical production applications.

We ensure integrity and consistency between mainframe and open systems in a 24/7 environment.

•2 Active Data Center:►Monthly SWAP►Fully synchronized–At disk level

►Active-Passive configuration (mainly)•1 Data Center for Regional disaster recover

Page 8: 1 GSE DB2 Working Group meeting 27 March 2014 DB2 Connectivity at Euroclear.

Infrastructure

8

Euroclear Infrastructures:

•3 Business environments

•36 DB2 subsystems running

•No data sharing

•Data Warehouse in EB

•Horizontal increase

•Vertical increase

• Joining of other DC

Page 9: 1 GSE DB2 Working Group meeting 27 March 2014 DB2 Connectivity at Euroclear.

Workload

9

It depends…

•Mainly static SQL on the core subsystems

•Mainly dynamic SQL on the data warehouse

Several tools generating the workload:

•Business Application

•Reporting tools

•Supported Tactical tools

•Unsupported Tactical tools

Focusing on the Data warehouse

•Static SQL : < 5 %

•Online queries

•ISPF : 60 % (decreasing)

•Distributed : 40 % (increasing)

Page 10: 1 GSE DB2 Working Group meeting 27 March 2014 DB2 Connectivity at Euroclear.

The need of the connectivity

10

There is a increasing need of sharing data across multiple platforms.

•Mutation from batch reporting to online reporting

•Improve user interaction with the data in “more appealing” environments

The challenges:

•Keeping the core business on DB2 and sharing the data on different Platform

•Manage the jungle of queries/tools connecting from everywhere

The demand of connectivity:

•The demand of connectivity is directed only toward the datawarehouse

•No users on the core back end

Page 11: 1 GSE DB2 Working Group meeting 27 March 2014 DB2 Connectivity at Euroclear.

As it was

11

You can connect from everywhere.

Advantages:

•Freedom

Drawbacks:

•Contention for mistakes of users

•Hard to trace

Page 12: 1 GSE DB2 Working Group meeting 27 March 2014 DB2 Connectivity at Euroclear.

As it is

12

Access through a gateway

Advantages:

•Traceable at gateway level

•Simpler interventions

•Possible to cut part of the workloadDrawbacks:

•Additional hardware / software to maintain

•Bigger impact of the intervention

Page 13: 1 GSE DB2 Working Group meeting 27 March 2014 DB2 Connectivity at Euroclear.

As it is

13

The rules to connect to DB2:

•All the users on Citrix connect through a gateway

•All the applications connect through a gateway installed locally

•SAS in passing through the SAS Spawner / SAS Access DB2

►Evaluating connectivity through ODBC as a Citrix User

–Direct ODBC connectivity increase the performance (testing)

•The gateways have dedicated network name and functional id

►Re-hosting of the old gateway network name on the new machine

•All the gateways are in cluster configuration

•Segregation of the connections:

►Split between Production and Test domain

►Link between Development and Production

Page 14: 1 GSE DB2 Working Group meeting 27 March 2014 DB2 Connectivity at Euroclear.

The current challenges

14

Capacity:

•Limit the consumption of the users

►SYSIBM.DSNRLST01

–By default 17 CPU sec/SQL

►Many exceptions

•Mitigate the “Killing SQL”

►Detect the poorly written SQL

–SQL Statement with 20 “with tables” Statements

►Reject SQL / Tool that are consuming too much

►Splitting the queries in procedures

►Monitor periodically the top queries from DISTSERV

Expansion:

•Several new installation of the DB2 Connect Gateway

►Opening the doors to Mainframe

►Mentality shift: DB2 is easy to query as any other DBMS

Page 15: 1 GSE DB2 Working Group meeting 27 March 2014 DB2 Connectivity at Euroclear.

The current challenges

15

Support:

•Welcome new requests

►Presentation about “DB2 & Mainframe : Opening the black box”

►Presentation about new features:

–Temporal Tables, XML, Sequences, etc…

►Support for user creation and rights granting

–Not easy for “distributed people” understand RACF

►Installation and setup of DB2 Connect Gateway

Page 16: 1 GSE DB2 Working Group meeting 27 March 2014 DB2 Connectivity at Euroclear.

The future challenges

16

Governance:

•Migrate from thousand of small tools to a global tool

►Centralize / Organize the demand of data on a single Product/BI tool

•Re-acquire the knowledge inside the SQL

►Very hard to understand what a 600 lines of select is doing and why

•Exploit even further the XML Generation capabilities

•Adopt one infrastructure for end 2 end replication

►CCD Table

►Applicative Replication

►Table Replication

Page 17: 1 GSE DB2 Working Group meeting 27 March 2014 DB2 Connectivity at Euroclear.

17

For internal use

Further questions?

• For questions► [email protected]

Page 18: 1 GSE DB2 Working Group meeting 27 March 2014 DB2 Connectivity at Euroclear.

18

For internal use