Improving TCO & ROI in Data Centers - IMEX Research · 2007-08-11 · Improving TCO & ROI in Data...

©2003-2007 IMEX Research All rights Reserved

© 2007 IMEX ResearchAll Rights Reserved

Copying Prohibited

IMEXRESEARCH.COM

Next-Gen Data CenterImproving TCO & ROI in Data Centers thru

Virtualization and Blade Servers

Anil VasudevaChief Analyst & [email protected]


Copying ProhibitedPlease contact IMEX for written permission



Copying ProhibitedChaos in the Enterprise . . .

Server/OS

Network

Application

Storage

Test

Backup

Disaster Recovery

Database

Financials

TM

D/R plan (MF only)

STK Silos Tape

TM

TM

TM

IBM3090-600JMVS/ESAIMS / ADABAS

BU by FDRUpstream

HPUX 10, 11.0, 11.2 MPE Sybase 11.9, 12

Fujitsu DS90UXP/M

8mm BackupLegato to DLT

IBM ADSM3490

HPOmniBack

SunSolaris 3.2, 3.4, 3.5Oracle 7.5, 8.0

IBM RS6000AIX 4.1, 4.2, 4.3DB2/6000

Compaq ProLiant 2500,5500NT 3.5, 4.0 SQL

Cheyenne to 4mm

Batch

IBM AS/400OS/400

InventoryExchange

CAD/CAME-commerce

Lotus NotesOLTP

CICS

File transfers AIX to HP/UX via Platinum 9.9

FTP between Sun -NT

Database extracts MVS to SP2 via MQ Series 4.4

PeopleSoft

(1) Scales poorly (2) Difficult to manage (3) Reliability is questionable (4) Management costs out of control



Copying ProhibitedGenesis of NGDC

Revenue Growth

IT Costs (Actual)

IT Costs (Budgeted)Profit

CFO vs. CIO - Shocking Observations• IT Infrastructure Investments yet to

achieve TCO/ROI Financial Objectives • Expected Boost in Corporate

Productivity not Visible to CFO/CEOs• Post 2000 Dictum Do More with LessReason – IT Spiral• Web Growth New Apps Mushroom

Low Cost Windows (Tier-1) Servers Sprawl• Business Growth More Computing Power

Applications/DB (Tier-2,3) Servers Sprawl• More Servers Storage DC Facilities IT Support IT Staff • IT Costs == Business Growth



Copying ProhibitedDC Infrastructure Nightmares of CIOs

ServersServers/Admin

StorageTerabytes/DBA

MIS Alerts Urgent Alerts/Day

SystemAvailability

Servers Utilization

Win 5-10%, SMP 20-35%, MF 30-50%80+%

15-30300+

1TB100TB

20-403-5

HAL- 3 (99.9%)

HAL- 5 (99.999%)

Storage Utilization

30-45% Disk, 20-40% Tape75+%

Application Application/Server

115-20

Power & Cooling

kW/Rack Capability

TodayTargeted

2-5 kW/Rack15-25 kW/Rack



Copying ProhibitedEnd to End IT Infrastructure with HA & Securitywith HA & Security

Enterprise

Tier-3Data Bases

Tier-2Applications

Tier-1Edge Computing

ManagementDirectory Security Policy

Software OS Platform

Caching, Proxy, FW, SSL, IDS, DNS, LB, Web

Servers

IntrDet

IntrDet

Layer 3 Switches (Routers)

Layer 4-7 Switches

Layer 2 Switches

Stg Fibre Switches

Application,HA, File/Print, ERP, Security, SCM, CRM Servers

Database, Middleware, Data Mgmt

Servers

InternetISP

CoreOptical

NetworkingEdge

Access

ISPISP

ISP

IntrDet

Supplier/Partner

Remote Office

Home Networks

DSL

Cable Modem

MP3 VOD

WirelessCellular

xSP

App.Server

VPN

IntrDet

WebServices DBServers

ISP

ISP



Copying ProhibitedFollow SIVA© for a Scalable & Dynamic NGDC

IIntegrationntegrationIntegrates physical infrastructure sing Scalable Blades to Optimize CAPSIMS:Cost, Availability, Performance, Scalability, Inter-operability, manageability & Security

VVirtualizationirtualizationPools Resources, Optimally Provisions them for given Usage/Application to Deliver Business Service, Monitors Usage

AAutomationutomationAutomatically Maintains App Service Level Objectives using Policy Based ILM

SStandardizationtandardizationReduce CAPEX via using Industry Standard Infrastructure - HW, Interfaces, Open Source SW –OS, Middleware, and Shrink Wrap Applications > Reduced OPEX in Support, Training for Delivery of Business Services



Copying ProhibitedConsolidated Data Center

Tier-1Edge

Servers

InternetISP

CoreOptical

NetworkingEdge

Access

ISPISP

ISP

IntrDet

Supplier/Partner

Remote Office

Home Networks

DSL

Cable Modem

MP3 VOD

WirelessCellular

xSP

App.Server

VPN

IntrDet

WebServices DBServers

ISP

ISP

Enterprise

Tier-3Data Base

ServersTier-2 Apps

ManagementDirectory Security Policy

Software OS Platform

Switches: Layer 4-7,Layer 2, 10GbE, FC Stg

FC/ IPSAN

Caching, Proxy, FW, SSL, IDS, DNS,

LB, Web Servers

Application,HA, File/Print, ERP, SCM, CRM Servers

Database, Middleware, Data Mgmt Servers

Tier-1 EdgeApps



Copying Prohibited

SNMP,IETF/ CIM,

SMI-S,SMASH.

Quadrics,Myrinet,SCIInfiniBand,Ethernet / IP,Ethernet IP w/TOE,Ethernet IP w/TOE and RDMA.

SCSI,Fiber Channel,ISCSI.

Ethernet,Wi-Fi.Network Fabric

System FabricM

anag

emen

tFa

bric

Key to Integration: Interconnect Fabrics



Copying ProhibitedBlade Infrastructure:Local Area Grid (LAG©)

MidplaneW/Connectors

To Blades & BackModules

Storage: IP NAS or FC SAN Switch

Management Modules Remote Mgmt+KVM over IP

Cooling N+1Fans/Cooling ModulesPower: N+1Power Supplies

Networking: Gbit Ethernet Switches

BladeControlPanel

Processor Blades(6-24 typically)

MemoryDDR wECC

GbitEthernet

I/FSystemsMonitorModule

Micro-Processors

USB Ports, CD/Floppy I/F

© 2003-06 IMEX Research

~ GbE Switch supportsTrunking/Port AggregationFlow ControlQoS Packet PrioritizationSNMP/RMONIGMP/BOOTP/TFTP……



Copying ProhibitedBlades - TCO Savings & ROI

0%

20%

40%

60%

80%

100%

1 2

% C

ontr

ibut

ion

OPEX

CAPEX33%

67%

46%

25%

Blade Servers Rack Servers

3 Year TCO Savings Rack vs. Blade Servers

OPEXStaff/

Support25%Maintenance/

Downtime54%

Facilities/Power21%

CAPEX

Servers46%

SWInfrastructure

22%

Storage Infrastructure

13%

Networking19%

TCO Savings in..

Data: IMEX Research 2004



Copying ProhibitedDC Power/Cooling Spending to rise dramatically

OPEX to reach over 80% of New Server Spending $B

2003 2004 2005 2006 2007 2008 2009 2010

CAPEX OPEX

$63

$51 $5

6

Power & Cooling to reach 40 % of DC Server Infrastructure

Spending by 2010

0%10%20%30%40%50%60%70%80%90%

100%

2003 2004 2005 2006 2007 2008 2009 2010

Power & Cooling Spending to rise to 40% of DC Infrastructure Spending by 2010

Top Data Center Challenges

0 10 20 30 40 50 60 70

Operational Cost

Change Mgmt

Footprint / Space

Availability / Recovery

Server & Storage Growth

Cooling

Power Capacity



Copying ProhibitedData Center Cooling

Computer Simulation using widely available software (e.g. Fluent Airpack Ansys CFD …) to verify Cooling Designed is the most cost effective before commiting to final implementation.

Source: APC

IT Equipment50%

Where does the power go in Data Centers ?

Data: Liebert

Many techniques, methodologies and equipments from air cooling to liquid assisted cooling available form a variety of vendors and Consultants ….(Email [email protected] for more info and Assessment of competitive vendor products, consultants and data center power & cooling integrators) Source: IBM 2005



Copying Prohibited

*IOs per sesond for a required response time ( ms)

(RAID - 0, 3)

500100MB/sec101 505

1K

10 K

100

10

1

Market Segments by Applications

eCommerceeCommerceTransaction Transaction ProcessingProcessing

OLTPOLTPOLTP

Data Warehousing

Visual DB

DSS(RAID - 1, 5, 6)

IOPs

(L

aten

cy)

StreamingStreamingStreamingAudioAudio

VideoVideo

Scientific ComputingScientific Computing

ImagingImaging

NICNICNIC

TP

HPCHPC



Copying ProhibitedState of DB Applications

Scale In

Scale Out

Scal

e U

p

Large Databases by OS

OLTP DSS#

Larg

e D

Bs

UNIX

Win

z/OS

Linux

Storage Usage vs DB Capacity

0 20 40 60 80

>10 TB

5-10 TB

2-5 TB

1-2 TB

DB

Siz

e

TB

Stg (TB)DB (TB)

Large DB Size Growth by Market Segment

2005 2006 2007 2008 2009 2010

DB S

ize

(TB) OLTP

DSS

Yearly Storage Growth % 2005-06

0 % 2 0 % 4 0 % 6 0 % 8 0 % 10 0 % 12 0 % 14 0 %

Telecom

Software/Hi-Tech

Retail

Manufacturing

Transportation

Professional Services

Healthcare

Financial Services



Copying ProhibitedThe rapid rise of Clusters in HPC

Rise of Cluster Computing

0

50

100

150

200

250

300

350

1999

e

2000

2001

2002

2003

2004

e

# C

lust

ered

Com

pute

rs in

Top

500

.org



Copying Prohibited

Data rate & capacity

Throughput : : DSL/Cable

100+ Teraflops

Throughput = 100 GB/s

Rendering (Texture & Polygons)

Throughput = 1.2 GB/s

EntertainmentEntertainmentAudio/Video On DemandAudio/Video On Demand

High Performance High Performance ComputingComputing

Commercial Commercial VisualizationVisualization

BioInformaticsBioInformatics DecisionDecisionSupport SystSupport Syst

Dat

a: IM

EX R

esea

rch

& Pa

nasa

s



100+ Teraflops








Dat

a: IM

EX R

esea

rch

& Pa

nasa

s



100+ Teraflops






100+ Teraflops












Dat

a: IM

EX R

esea

rch

& Pa

nasa

s

High Performance Computing

Entertainment Audio/Video OnDemand

Decision-Support Systems

BioinformaticsCommercial Visualization

©2004--07 IMEX Research.com

HPC – From Academia to Wall St. to Hollywood



Copying ProhibitedImplementing Virtualization

Storage Arrays

Application & DB Servers

Client Workstations

SAN GbE or FCSwitches

LANEthernet Switches

At Various LevelsMicroprocessor – Intel VT, AMD-PacificaOS- zOS, pOS, UNIX, Windows, Linux- IBM, HP, Sun, VMWare, Xen, SWSoftFile System- DFSNetworking- MultiportStorage- Host, SAN, Controller- In-Band, Out-of-Band Management



Copying ProhibitedVirtualization ModelsIn

fo::

Dan

Old

s

Features• Guest OS - Each app contained by its own OS instance• VZ layer spoofs each OS into believing as if its the only OS on the system• Users can mix and match guest OS’s with various versions of Windows or Linux.Major Players VMWare, Microsoft, XenSource

Features• A single OS hosts multiple applications.• VZ layer handles resource allocation between apps• VZ layer also provides protection to the host OS so that a misbehaving application does not cause problems for the system as a wholeMajor PlayersSWSoft, Sun/Containers

App

licat

ion

App

licat

ion

App

licat

ion

App

licat

ion

Hardware

Operating System

Virtualizing Layer

OS Virtualization

OS 1

App

licat

ion

App

licat

ion

App

licat

ion

App

licat

ion

OS 2

OS 3

OS 4

Virtualizing Layer

Hardware

Hypervisor Model



Copying ProhibitedWorkloads Consolidation using VZ

Source: Dan Olds

• A single server 1.5x larger than standard 2-way server will handle consolidated load of 6 servers.• VZ manages the workloads + important apps get the compute resources they need automatically w/o operator intervention.• Physical consolidation of 15-20:1is easily possible• Reasonable goal for VZ x86 servers – 40-50% utilization on large systems (>4way), rising as dual/quad core processors becomes available• Savings result in Real Estate, Power & Cooling, High Availability, Hardware, Management



Copying ProhibitedHW Assisted Virtualization

X86 Instruction Set

Virtualization Extensions

Chipset

or

Man

agem

ent

PacificaVirtualizationTechnology

VTVirtualization

Technology

Direct ConnectArchitectureFSBus

Architecture

AMD64Extensions

Intel EM64 Extensions

VZ Extensions at Processor



Copying ProhibitedStorage Virtualization – Desired Features

Storage

Servers

Clients

SAN

LAN

Storage VZ - Must Have FeaturesScale Non-Disruptively in Capacity• Snapshot Point-In-Time across Stg.devices• Remote Replication across Heterogeneous Stg. Devices• Policy Based Non-Disruptive Data Migration betweenHeterogeneous Stg Systems & Between Stg Tiers

• Centralized Mgmt of all Stg.VZ under Single Image• Support Tiered Storage• Volume Management for Multivendor Stg. Systems• Common Set of Tools: Provisioning, Mgmt & Replication

Storage VZ - Vendors• Cloverleaf, Datacore, EMC• FalconStor, Fujitsu Computer Systems • Hitachi Data Systems• IBM, Network Appliance• StorageAge, Sun• Symantec/Veritas …

0100200300400500600700800900

1000

w /o Stg VZ w Stg VZ

Expe

nses

/Yea

r $K

HW

SANAdmin

SW

Total Svgs - 21%/yr.

- 24%

- 16%

- 19%

Savings achieved through Storage Virtualization



Copying ProhibitedFuture: Storage Management

Host Services Integration StorageProvisioning Layer

SAN Management Layer

DeviceService Layer

File system monitoring

SAN ManagementManagement

ConsoleManagement of

iSCSI HBAsMultiPath IO Supp

and FailoverSecurity

(iSNS, CHAP, SRP)

Virtualization Mirroring Snapshot Fail-Over

iSCSI Target ManagementLVM, Error Handling, SCSI Daemon, API Interoperability

HW Acceleration: TOE, iSCSI Offload, IPsec

Storage provisioning Win, LINUX, Solaris



Copying ProhibitedTCO Savings with Virtualization

w/o VZ w VZ

Provisioning

HardwareSAN

NetworkPower & Cooling

DC Real EstateDisaster Recovery

Downtime

Cos

t ove

r 3 y

ears

Servers ConsolidationPre-VZ = 995

After VZ=78

VZ SW Licences &

Support

For copy of TCO Analysis

Call (408) 268-0800 or

imex @ imexresearch.com

ROI Payback ~9.1 Mo



Copying Prohibited

•• WW 5.1 million data centers, Costs $100WW 5.1 million data centers, Costs $100--175M to build a large DC175M to build a large DC 20072007

–– ~$1005/Sqft, $40,000/Rack, $2,500/Server, 2.5U~$1005/Sqft, $40,000/Rack, $2,500/Server, 2.5U–– 82% of installed equipment (Server, Storage, Network) has only1082% of installed equipment (Server, Storage, Network) has only10% utilization% utilization–– For every $1 invested in new IT infrastructure, $7 spent to mainFor every $1 invested in new IT infrastructure, $7 spent to maintaintain–– For every $1 in new Server spending, 42c spent on Power & CoolinFor every $1 in new Server spending, 42c spent on Power & Cooling /2006g /2006–– Virtual Servers growth outstrip Physical servers by 50% > Rise iVirtual Servers growth outstrip Physical servers by 50% > Rise in managing VMn managing VM–– Blades increasing Power/Rack by 10x Need Power/Cooling, Weight, Blades increasing Power/Rack by 10x Need Power/Cooling, Weight, Solutions to pursueSolutions to pursue

•• ConsolidationConsolidation–– IT in Mega Data Centers, Data & Video Info Vaults at IT in Mega Data Centers, Data & Video Info Vaults at SPsSPs

•• New Technologies Adoption NecessaryNew Technologies Adoption Necessary –– as a Competitive Weaponas a Competitive Weapon–– Hi Density Blades, Hi Density Blades, MulticoreMulticore CPUs, Industry Std Computing Infrastructure, TB Disks,CPUs, Industry Std Computing Infrastructure, TB Disks,–– Fast Networks: 10GbE, MPLS; Global ReachFast Networks: 10GbE, MPLS; Global Reach–– Convergence (Voice Video, Data): Unified Communications, Convergence (Voice Video, Data): Unified Communications, VoIPVoIP–– Mobility & Wireless Mobility & Wireless

•• Focus OnFocus On–– Consolidation & VirtualizationConsolidation & Virtualization–– IT Services and not IT Resources or InfrastructureIT Services and not IT Resources or Infrastructure–– Rise of Cloud Computing and SaaS, SOA in its wakeRise of Cloud Computing and SaaS, SOA in its wake–– Control over Complex Systems Interdependencies to avoid creatinControl over Complex Systems Interdependencies to avoid creating system wide instabilitiesg system wide instabilities–– Automation of LowAutomation of Low--Level Risks to free up on Initiatives aligning IT (CIO) to BusinLevel Risks to free up on Initiatives aligning IT (CIO) to Business (CEO)ess (CEO)

Data Center Trends - Summary



Copying Prohibited

•• Follow SIVAFollow SIVA©© in executing your DC strategyin executing your DC strategy–– StandardizeStandardize (Windows/Linux, GbE, IP Storage/(Windows/Linux, GbE, IP Storage/iSCSI,SATAiSCSI,SATA..)..)–– IntegrateIntegrate (Blades, Management Tools..)(Blades, Management Tools..)–– VirtualizeVirtualize (Infrastructure(Infrastructure--uP,ServersuP,Servers, Storage, , Storage, Networks,ClientsNetworks,Clients

w P2V tools)w P2V tools)–– AutomateAutomate (Provide important Apps required resources (Provide important Apps required resources

automatically w/o intervention to automatically w/o intervention to OOPEX costs)PEX costs)

•• Server Virtualization (VZ) now a mainstream Server Virtualization (VZ) now a mainstream technologytechnology–– VZ turning DC core infrastructure upside down, DC Professionals VZ turning DC core infrastructure upside down, DC Professionals

very happy with its future usevery happy with its future use–– VZ means “Doing More for Less” (finally making CFOs get off VZ means “Doing More for Less” (finally making CFOs get off

your back)your back)

–– Combined with VZ & Consolidation Combined with VZ & Consolidation TCO Reduction of 60TCO Reduction of 60--70% 70% over 3 years, ROI >58%over 3 years, ROI >58%

Summary - Virtualization & Automation



Copying ProhibitedVirtualizing your IT InfrastructureSLA

UsageDept/Owner

AssetsLocation

• Host Name (Mfr/Model/SN,• Platform – OS/Processors/#/Speed/Type

• Pooled Infrastructure Resources by Application Metrics

• Pooled Capacity Provisioning: Processing, Bandwidth, Storage, Repository

• Usage Profiles• Users/Services/Workloads

• Applications (OLTP/BI/HPC/Data Streaming)• Execution: Rules Driven, Adaptive Provisioning

• Services Abstraction, Adaptive Provisioning

VirtualizationUtility - P2V

• Business Priorities• Cost of IT Ops/Charge Back Methods

• Response Time/Availability/Throughput,QoS• Transactions/Sessions/Events/Analysis/Reporting

• Business Services Managed & Charged

For copy of case study on how a major financial institution implemented virtualization email [email protected]



Copying Prohibited

IMEXRESEARCH.COM

Next-Gen Data CenterImproving TCO & ROI in Data Centers thru

Virtualization and Blade Servers

Anil VasudevaChief Analyst & [email protected]


Copying ProhibitedPlease contact IMEX for written permission

For TCO/ROI Financial Worksheets & DataCenter Analysis & NGDC Industry Report

Email: [email protected]:(408) 268-0800

Improving TCO & ROI in Data Centers - IMEX Research · 2007-08-11 · Improving TCO & ROI in Data...

Documents

Transcript of Improving TCO & ROI in Data Centers - IMEX Research · 2007-08-11 · Improving TCO & ROI in Data...