1

DEFENCE

Corporate Data Center Disaster Recovery

Pascal BRASSEURManager Corporate Data Center

23 Jun 2011

2

Agenda

• Foreword : ICT Structure within Defence• History• Building the Corporate Data Center

– Consolidation model– The different phases

• Building Disaster Recovery (Plans)– Scope– Study– Infrastructure & services– End state

• Closing remarks

3

Foreword : ICT (CIS) structure

• Operational CIS : Weapon systems to support the operational theaters (classified)

• Corporate CIS : Global support ICT infrastructure not direct linked to weapon systems (unclassified)– Corporate Defence Network (CDN) :

• decentralized on 80 sites (server farms)

• Offers common ICT services (mail, file, surf and print).

– Corporate Data center (CDC) :• Centralized systems (datacenter)

• Offers housing/hosting for all central applications of Defence.

4

History

• < 2001 :– 4 “forces” (Land-Air-Navy-Med) + 1 common Staff

service

• 2001 : Decision of the MOD to create one unique operational structure supported by common services :– Material resources (MR)

– Human resources (HR)

– Budget & finances (BF)

– Etc.

5

History

• Unique structure also for ICT.

• Decision to consolidate everything during 4 phases to build the Corporate Data Center

• Constraints/challenges :– 5 data centers

– Multi HW/OS/MW/DBMS

– Multi processes & automation systems

– People with heterogeneous cultures

6

Building CDC Consolidation model

7

Air22 Log W (EvN)

CDC – Phase 1Physical Consolidation – part 1

• Situation 2001 • Situation 2003

JointCVILV (QRE)

DefenceCDC

(Peutie)

LandCVILM (PEUTIE)

NavyNavCIS (StX)

MedCVIMed (NOH)

8

CDC – Phase 1Physical Consolidation – part 2

• 2004 : Setup HEDS (High End Data System) for RDBMS Oracle.

Power Systems IBM

AIX

9

CDC – Phase 1Physical Consolidation – part 3

• 2006 : Consolidation of the Wintel platforms

• >100 servers 13 servers

10

CDC – Phase 2Process & automation Consolidation

• Unique Deploy Process

4 standard environments :– Test

– Development

– Acceptance

– Production

• Unique tools for automation operations : TIVOLI TWS

• Etc.

DTA

PRD

11

CDC – Fhase 3Logical consolidation

• 2003 • 2010

System (OS)Unix (AIX), Intel (Windows),Intel (Linux), SUN (Solaris)*,

DBOracle, SqlServer, MySQL

Storage & Back-upEMC2 - CX4IBM - VTL

System (OS)Unix (AIX), Intel (Windows),Intel (Linux), SUN (Solaris),

Siemens Mainframe (BS2000),IBM Mainframe (OS390),

DBOracle, DB2, SqlServer, Sybase,

MySQLStorage & Back-up

ADIC, ABBA, V2X, Timberline,Timberwolf, IBM 9393,

IBM 7015SP, Sun Enterprise,Magstar MP 3575

12

CDC – Fase 4Disaster Recovery

CVILMPeutie

CVILVEvere-Zuid

22 Log WEvere-Noord

CVIMEDNOH

NavCISBrugge

Sint-Kruis

Corporate Data CenterPeutie

DisasterRecovery

Site

13

DRP – Scope

• Only (degraded mode allowed)

• RPO (Recovery Point Objective) = 24 hr

• RTO (Recovery Time Objective)= 48 hr

PRD

14

Recovery strategies

Situation< 2010

Share Group, Inc – The seven tiers model

Scope

15

DRP – Study• Full outsoucing (tapes offsite)

– Technical problems :• Incremental forever via TSM Manager : not possible

to restore data within 48 hours.

• Issues with tape transportation.

– Not possible to control outsourced costs in case of disaster because the acquisition procedures for new HW Mat takes time !

16

Costs DR Mode

0,00

1.000,00

2.000,00

3.000,00

4.000,00

5.000,00

6.000,00

7.000,00

8.000,00

9.000,00

1 3 5 7 9 11 13 15 17 19 21 23 25 27 29 31 33 35 37 39 41 43 45 47 49 51

Weeks

K€

Outsourced costs in case of disasterRenting of infrastructure

17

DRP – Study• In house DR

– Facilities exist– Own network (dark fibers) : « free of charge »– Capacity PRD – DTA is the same : splitting

infrastructure over 2 sites. In case of big disaster, only max 50% is damaged.

– But, following is needed :• Outsourced services (Defence has no internal

expertise)• Storage & replication

18

Retained solution – In house DR Project plan

– Setup Infrastructure & services.

– Develop Disaster Recovery plan

– First dry test

– Develop Crisis Management Plan

– 1 (integrated test / year)

+

– Full integration of the DRP plans in the change management process

19

Retain solution – In house DRSetting up infrastructure and services

– Setup of a new computer room in a bunker of Defence.

– Adaptation of the network topology :• Stretched IP network layer 2 over both sites

• Set up dark fibers for SAN over both sites to allow data replication.

– New contract services (consultancy) with leasing of storage & synchronous replication.Realization in 4 phases :

• Setup and testing the storage solution

• Data migration

• Writing documentation for DRP & TRP (Technical Restore Procedures)

• Moving Mat to disaster location

20

DRP architecture - End state

VTL

HEDS 1 PRD

WIntel 1PRD

F1 - PRD

SAN

STOPRD

DTA

PRD = Production

HEDS 2DTA

WIntel 2DTA

Bunker - DTA

SAN

STOPRD

DTA

DTA : Développement/test/acceptance

Synch replication

MAN

LAN LAN

VTL

21

Closing RemarksActual situation

– Setup Infrastructure & services.

– Develop Disaster Recovery plan

– First dry test

– Develop Crisis Management Plan

– 1 (integrated test / year)

+

– Full integration of the DRP plans in the change management process

Start 01/2010(not for building renovation !)

Done – 12 months

Test q3/2011

December 2011

Done

22

Contributions ?