©2003-2007 IMEX Research All rights Reserved
© 2007 IMEX ResearchAll Rights Reserved
Copying Prohibited
IMEXRESEARCH.COM
Next-Gen Data CenterImproving TCO & ROI in Data Centers thru
Virtualization and Blade Servers
Anil VasudevaChief Analyst & [email protected]
© 2007 IMEX ResearchAll Rights Reserved
Copying ProhibitedPlease contact IMEX for written permission
©2003-2007 IMEX Research All rights Reserved
© 2007 IMEX ResearchAll Rights Reserved
Copying ProhibitedChaos in the Enterprise . . .
Server/OS
Network
Application
Storage
Test
Backup
Disaster Recovery
Database
Financials
TM
D/R plan (MF only)
STK Silos Tape
TM
TM
TM
IBM3090-600JMVS/ESAIMS / ADABAS
BU by FDRUpstream
HPUX 10, 11.0, 11.2 MPE Sybase 11.9, 12
Fujitsu DS90UXP/M
8mm BackupLegato to DLT
IBM ADSM3490
HPOmniBack
SunSolaris 3.2, 3.4, 3.5Oracle 7.5, 8.0
IBM RS6000AIX 4.1, 4.2, 4.3DB2/6000
Compaq ProLiant 2500,5500NT 3.5, 4.0 SQL
Cheyenne to 4mm
Batch
IBM AS/400OS/400
InventoryExchange
CAD/CAME-commerce
Lotus NotesOLTP
CICS
File transfers AIX to HP/UX via Platinum 9.9
FTP between Sun -NT
Database extracts MVS to SP2 via MQ Series 4.4
PeopleSoft
(1) Scales poorly (2) Difficult to manage (3) Reliability is questionable (4) Management costs out of control
©2003-2007 IMEX Research All rights Reserved
© 2007 IMEX ResearchAll Rights Reserved
Copying ProhibitedGenesis of NGDC
Revenue Growth
IT Costs (Actual)
IT Costs (Budgeted)Profit
CFO vs. CIO - Shocking Observations• IT Infrastructure Investments yet to
achieve TCO/ROI Financial Objectives • Expected Boost in Corporate
Productivity not Visible to CFO/CEOs• Post 2000 Dictum Do More with LessReason – IT Spiral• Web Growth New Apps Mushroom
Low Cost Windows (Tier-1) Servers Sprawl• Business Growth More Computing Power
Applications/DB (Tier-2,3) Servers Sprawl• More Servers Storage DC Facilities IT Support IT Staff • IT Costs == Business Growth
©2003-2007 IMEX Research All rights Reserved
© 2007 IMEX ResearchAll Rights Reserved
Copying ProhibitedDC Infrastructure Nightmares of CIOs
ServersServers/Admin
StorageTerabytes/DBA
MIS Alerts Urgent Alerts/Day
SystemAvailability
Servers Utilization
Win 5-10%, SMP 20-35%, MF 30-50%80+%
15-30300+
1TB100TB
20-403-5
HAL- 3 (99.9%)
HAL- 5 (99.999%)
Storage Utilization
30-45% Disk, 20-40% Tape75+%
Application Application/Server
115-20
Power & Cooling
kW/Rack Capability
TodayTargeted
2-5 kW/Rack15-25 kW/Rack
©2003-2007 IMEX Research All rights Reserved
© 2007 IMEX ResearchAll Rights Reserved
Copying ProhibitedEnd to End IT Infrastructure with HA & Securitywith HA & Security
Enterprise
Tier-3Data Bases
Tier-2Applications
Tier-1Edge Computing
ManagementDirectory Security Policy
Software OS Platform
Caching, Proxy, FW, SSL, IDS, DNS, LB, Web
Servers
IntrDet
IntrDet
Layer 3 Switches (Routers)
Layer 4-7 Switches
Layer 2 Switches
Stg Fibre Switches
Application,HA, File/Print, ERP, Security, SCM, CRM Servers
Database, Middleware, Data Mgmt
Servers
InternetISP
CoreOptical
NetworkingEdge
Access
ISPISP
ISP
IntrDet
Supplier/Partner
Remote Office
Home Networks
DSL
Cable Modem
MP3 VOD
WirelessCellular
xSP
App.Server
VPN
IntrDet
WebServices DBServers
ISP
ISP
©2003-2007 IMEX Research All rights Reserved
© 2007 IMEX ResearchAll Rights Reserved
Copying ProhibitedFollow SIVA© for a Scalable & Dynamic NGDC
IIntegrationntegrationIntegrates physical infrastructure sing Scalable Blades to Optimize CAPSIMS:Cost, Availability, Performance, Scalability, Inter-operability, manageability & Security
VVirtualizationirtualizationPools Resources, Optimally Provisions them for given Usage/Application to Deliver Business Service, Monitors Usage
AAutomationutomationAutomatically Maintains App Service Level Objectives using Policy Based ILM
SStandardizationtandardizationReduce CAPEX via using Industry Standard Infrastructure - HW, Interfaces, Open Source SW –OS, Middleware, and Shrink Wrap Applications > Reduced OPEX in Support, Training for Delivery of Business Services
©2003-2007 IMEX Research All rights Reserved
© 2007 IMEX ResearchAll Rights Reserved
Copying ProhibitedConsolidated Data Center
Tier-1Edge
Servers
InternetISP
CoreOptical
NetworkingEdge
Access
ISPISP
ISP
IntrDet
Supplier/Partner
Remote Office
Home Networks
DSL
Cable Modem
MP3 VOD
WirelessCellular
xSP
App.Server
VPN
IntrDet
WebServices DBServers
ISP
ISP
Enterprise
Tier-3Data Base
ServersTier-2 Apps
ManagementDirectory Security Policy
Software OS Platform
Switches: Layer 4-7,Layer 2, 10GbE, FC Stg
FC/ IPSAN
Caching, Proxy, FW, SSL, IDS, DNS,
LB, Web Servers
Application,HA, File/Print, ERP, SCM, CRM Servers
Database, Middleware, Data Mgmt Servers
Tier-1 EdgeApps
©2003-2007 IMEX Research All rights Reserved
© 2007 IMEX ResearchAll Rights Reserved
Copying Prohibited
SNMP,IETF/ CIM,
SMI-S,SMASH.
Quadrics,Myrinet,SCIInfiniBand,Ethernet / IP,Ethernet IP w/TOE,Ethernet IP w/TOE and RDMA.
SCSI,Fiber Channel,ISCSI.
Ethernet,Wi-Fi.Network Fabric
System FabricM
anag
emen
tFa
bric
Key to Integration: Interconnect Fabrics
©2003-2007 IMEX Research All rights Reserved
© 2007 IMEX ResearchAll Rights Reserved
Copying ProhibitedBlade Infrastructure:Local Area Grid (LAG©)
MidplaneW/Connectors
To Blades & BackModules
Storage: IP NAS or FC SAN Switch
Management Modules Remote Mgmt+KVM over IP
Cooling N+1Fans/Cooling ModulesPower: N+1Power Supplies
Networking: Gbit Ethernet Switches
BladeControlPanel
Processor Blades(6-24 typically)
MemoryDDR wECC
GbitEthernet
I/FSystemsMonitorModule
Micro-Processors
USB Ports, CD/Floppy I/F
© 2003-06 IMEX Research
~ GbE Switch supportsTrunking/Port AggregationFlow ControlQoS Packet PrioritizationSNMP/RMONIGMP/BOOTP/TFTP……
©2003-2007 IMEX Research All rights Reserved
© 2007 IMEX ResearchAll Rights Reserved
Copying ProhibitedBlades - TCO Savings & ROI
0%
20%
40%
60%
80%
100%
1 2
% C
ontr
ibut
ion
OPEX
CAPEX33%
67%
46%
25%
Blade Servers Rack Servers
3 Year TCO Savings Rack vs. Blade Servers
OPEXStaff/
Support25%Maintenance/
Downtime54%
Facilities/Power21%
CAPEX
Servers46%
SWInfrastructure
22%
Storage Infrastructure
13%
Networking19%
TCO Savings in..
Data: IMEX Research 2004
©2003-2007 IMEX Research All rights Reserved
© 2007 IMEX ResearchAll Rights Reserved
Copying ProhibitedDC Power/Cooling Spending to rise dramatically
OPEX to reach over 80% of New Server Spending $B
2003 2004 2005 2006 2007 2008 2009 2010
CAPEX OPEX
$63
$51 $5
6
Power & Cooling to reach 40 % of DC Server Infrastructure
Spending by 2010
0%10%20%30%40%50%60%70%80%90%
100%
2003 2004 2005 2006 2007 2008 2009 2010
Power & Cooling Spending to rise to 40% of DC Infrastructure Spending by 2010
Top Data Center Challenges
0 10 20 30 40 50 60 70
Operational Cost
Change Mgmt
Footprint / Space
Availability / Recovery
Server & Storage Growth
Cooling
Power Capacity
©2003-2007 IMEX Research All rights Reserved
© 2007 IMEX ResearchAll Rights Reserved
Copying ProhibitedData Center Cooling
Computer Simulation using widely available software (e.g. Fluent Airpack Ansys CFD …) to verify Cooling Designed is the most cost effective before commiting to final implementation.
Source: APC
IT Equipment50%
Where does the power go in Data Centers ?
Data: Liebert
Many techniques, methodologies and equipments from air cooling to liquid assisted cooling available form a variety of vendors and Consultants ….(Email [email protected] for more info and Assessment of competitive vendor products, consultants and data center power & cooling integrators) Source: IBM 2005
©2003-2007 IMEX Research All rights Reserved
© 2007 IMEX ResearchAll Rights Reserved
Copying Prohibited
*IOs per sesond for a required response time ( ms)
(RAID - 0, 3)
500100MB/sec101 505
1K
10 K
100
10
1
Market Segments by Applications
eCommerceeCommerceTransaction Transaction ProcessingProcessing
OLTPOLTPOLTP
Data Warehousing
Visual DB
DSS(RAID - 1, 5, 6)
IOPs
(L
aten
cy)
StreamingStreamingStreamingAudioAudio
VideoVideo
Scientific ComputingScientific Computing
ImagingImaging
NICNICNIC
TP
HPCHPC
©2003-2007 IMEX Research All rights Reserved
© 2007 IMEX ResearchAll Rights Reserved
Copying ProhibitedState of DB Applications
Scale In
Scale Out
Scal
e U
p
Large Databases by OS
OLTP DSS#
Larg
e D
Bs
UNIX
Win
z/OS
Linux
Storage Usage vs DB Capacity
0 20 40 60 80
>10 TB
5-10 TB
2-5 TB
1-2 TB
DB
Siz
e
TB
Stg (TB)DB (TB)
Large DB Size Growth by Market Segment
2005 2006 2007 2008 2009 2010
DB S
ize
(TB) OLTP
DSS
Yearly Storage Growth % 2005-06
0 % 2 0 % 4 0 % 6 0 % 8 0 % 10 0 % 12 0 % 14 0 %
Telecom
Software/Hi-Tech
Retail
Manufacturing
Transportation
Professional Services
Healthcare
Financial Services
©2003-2007 IMEX Research All rights Reserved
© 2007 IMEX ResearchAll Rights Reserved
Copying ProhibitedThe rapid rise of Clusters in HPC
Rise of Cluster Computing
0
50
100
150
200
250
300
350
1999
e
2000
2001
2002
2003
2004
e
# C
lust
ered
Com
pute
rs in
Top
500
.org
©2003-2007 IMEX Research All rights Reserved
© 2007 IMEX ResearchAll Rights Reserved
Copying Prohibited
Data rate & capacity
Throughput : : DSL/Cable
100+ Teraflops
Throughput = 100 GB/s
Rendering (Texture & Polygons)
Throughput = 1.2 GB/s
EntertainmentEntertainmentAudio/Video On DemandAudio/Video On Demand
High Performance High Performance ComputingComputing
Commercial Commercial VisualizationVisualization
BioInformaticsBioInformatics DecisionDecisionSupport SystSupport Syst
Dat
a: IM
EX R
esea
rch
& Pa
nasa
s
Data rate & capacity
Throughput : : DSL/Cable
100+ Teraflops
Throughput = 100 GB/s
Rendering (Texture & Polygons)
Throughput = 1.2 GB/s
EntertainmentEntertainmentAudio/Video On DemandAudio/Video On Demand
High Performance High Performance ComputingComputing
Commercial Commercial VisualizationVisualization
BioInformaticsBioInformatics DecisionDecisionSupport SystSupport Syst
Dat
a: IM
EX R
esea
rch
& Pa
nasa
s
Data rate & capacity
Throughput : : DSL/Cable
100+ Teraflops
Throughput = 100 GB/s
Rendering (Texture & Polygons)
Throughput = 1.2 GB/s
Data rate & capacity
Throughput : : DSL/Cable
100+ Teraflops
Throughput = 100 GB/s
Rendering (Texture & Polygons)
Throughput = 1.2 GB/s
EntertainmentEntertainmentAudio/Video On DemandAudio/Video On Demand
High Performance High Performance ComputingComputing
Commercial Commercial VisualizationVisualization
BioInformaticsBioInformatics DecisionDecisionSupport SystSupport Syst
EntertainmentEntertainmentAudio/Video On DemandAudio/Video On Demand
High Performance High Performance ComputingComputing
Commercial Commercial VisualizationVisualization
BioInformaticsBioInformatics DecisionDecisionSupport SystSupport Syst
Dat
a: IM
EX R
esea
rch
& Pa
nasa
s
High Performance Computing
Entertainment Audio/Video OnDemand
Decision-Support Systems
BioinformaticsCommercial Visualization
©2004--07 IMEX Research.com
HPC – From Academia to Wall St. to Hollywood
©2003-2007 IMEX Research All rights Reserved
© 2007 IMEX ResearchAll Rights Reserved
Copying ProhibitedImplementing Virtualization
Storage Arrays
Application & DB Servers
Client Workstations
SAN GbE or FCSwitches
LANEthernet Switches
At Various LevelsMicroprocessor – Intel VT, AMD-PacificaOS- zOS, pOS, UNIX, Windows, Linux- IBM, HP, Sun, VMWare, Xen, SWSoftFile System- DFSNetworking- MultiportStorage- Host, SAN, Controller- In-Band, Out-of-Band Management
©2003-2007 IMEX Research All rights Reserved
© 2007 IMEX ResearchAll Rights Reserved
Copying ProhibitedVirtualization ModelsIn
fo::
Dan
Old
s
Features• Guest OS - Each app contained by its own OS instance• VZ layer spoofs each OS into believing as if its the only OS on the system• Users can mix and match guest OS’s with various versions of Windows or Linux.Major Players VMWare, Microsoft, XenSource
Features• A single OS hosts multiple applications.• VZ layer handles resource allocation between apps• VZ layer also provides protection to the host OS so that a misbehaving application does not cause problems for the system as a wholeMajor PlayersSWSoft, Sun/Containers
App
licat
ion
App
licat
ion
App
licat
ion
App
licat
ion
Hardware
Operating System
Virtualizing Layer
OS Virtualization
OS 1
App
licat
ion
App
licat
ion
App
licat
ion
App
licat
ion
OS 2
OS 3
OS 4
Virtualizing Layer
Hardware
Hypervisor Model
©2003-2007 IMEX Research All rights Reserved
© 2007 IMEX ResearchAll Rights Reserved
Copying ProhibitedWorkloads Consolidation using VZ
Source: Dan Olds
• A single server 1.5x larger than standard 2-way server will handle consolidated load of 6 servers.• VZ manages the workloads + important apps get the compute resources they need automatically w/o operator intervention.• Physical consolidation of 15-20:1is easily possible• Reasonable goal for VZ x86 servers – 40-50% utilization on large systems (>4way), rising as dual/quad core processors becomes available• Savings result in Real Estate, Power & Cooling, High Availability, Hardware, Management
©2003-2007 IMEX Research All rights Reserved
© 2007 IMEX ResearchAll Rights Reserved
Copying ProhibitedHW Assisted Virtualization
X86 Instruction Set
Virtualization Extensions
Chipset
or
Man
agem
ent
PacificaVirtualizationTechnology
VTVirtualization
Technology
Direct ConnectArchitectureFSBus
Architecture
AMD64Extensions
Intel EM64 Extensions
VZ Extensions at Processor
©2003-2007 IMEX Research All rights Reserved
© 2007 IMEX ResearchAll Rights Reserved
Copying ProhibitedStorage Virtualization – Desired Features
Storage
Servers
Clients
SAN
LAN
Storage VZ - Must Have FeaturesScale Non-Disruptively in Capacity• Snapshot Point-In-Time across Stg.devices• Remote Replication across Heterogeneous Stg. Devices• Policy Based Non-Disruptive Data Migration betweenHeterogeneous Stg Systems & Between Stg Tiers
• Centralized Mgmt of all Stg.VZ under Single Image• Support Tiered Storage• Volume Management for Multivendor Stg. Systems• Common Set of Tools: Provisioning, Mgmt & Replication
Storage VZ - Vendors• Cloverleaf, Datacore, EMC• FalconStor, Fujitsu Computer Systems • Hitachi Data Systems• IBM, Network Appliance• StorageAge, Sun• Symantec/Veritas …
0100200300400500600700800900
1000
w /o Stg VZ w Stg VZ
Expe
nses
/Yea
r $K
HW
SANAdmin
SW
Total Svgs - 21%/yr.
- 24%
- 16%
- 19%
Savings achieved through Storage Virtualization
©2003-2007 IMEX Research All rights Reserved
© 2007 IMEX ResearchAll Rights Reserved
Copying ProhibitedFuture: Storage Management
Host Services Integration StorageProvisioning Layer
SAN Management Layer
DeviceService Layer
File system monitoring
SAN ManagementManagement
ConsoleManagement of
iSCSI HBAsMultiPath IO Supp
and FailoverSecurity
(iSNS, CHAP, SRP)
Virtualization Mirroring Snapshot Fail-Over
iSCSI Target ManagementLVM, Error Handling, SCSI Daemon, API Interoperability
HW Acceleration: TOE, iSCSI Offload, IPsec
Storage provisioning Win, LINUX, Solaris
©2003-2007 IMEX Research All rights Reserved
© 2007 IMEX ResearchAll Rights Reserved
Copying ProhibitedTCO Savings with Virtualization
w/o VZ w VZ
Provisioning
HardwareSAN
NetworkPower & Cooling
DC Real EstateDisaster Recovery
Downtime
Cos
t ove
r 3 y
ears
Servers ConsolidationPre-VZ = 995
After VZ=78
VZ SW Licences &
Support
For copy of TCO Analysis
Call (408) 268-0800 or
imex @ imexresearch.com
ROI Payback ~9.1 Mo
©2003-2007 IMEX Research All rights Reserved
© 2007 IMEX ResearchAll Rights Reserved
Copying Prohibited
•• WW 5.1 million data centers, Costs $100WW 5.1 million data centers, Costs $100--175M to build a large DC175M to build a large DC 20072007
–– ~$1005/Sqft, $40,000/Rack, $2,500/Server, 2.5U~$1005/Sqft, $40,000/Rack, $2,500/Server, 2.5U–– 82% of installed equipment (Server, Storage, Network) has only1082% of installed equipment (Server, Storage, Network) has only10% utilization% utilization–– For every $1 invested in new IT infrastructure, $7 spent to mainFor every $1 invested in new IT infrastructure, $7 spent to maintaintain–– For every $1 in new Server spending, 42c spent on Power & CoolinFor every $1 in new Server spending, 42c spent on Power & Cooling /2006g /2006–– Virtual Servers growth outstrip Physical servers by 50% > Rise iVirtual Servers growth outstrip Physical servers by 50% > Rise in managing VMn managing VM–– Blades increasing Power/Rack by 10x Need Power/Cooling, Weight, Blades increasing Power/Rack by 10x Need Power/Cooling, Weight, Solutions to pursueSolutions to pursue
•• ConsolidationConsolidation–– IT in Mega Data Centers, Data & Video Info Vaults at IT in Mega Data Centers, Data & Video Info Vaults at SPsSPs
•• New Technologies Adoption NecessaryNew Technologies Adoption Necessary –– as a Competitive Weaponas a Competitive Weapon–– Hi Density Blades, Hi Density Blades, MulticoreMulticore CPUs, Industry Std Computing Infrastructure, TB Disks,CPUs, Industry Std Computing Infrastructure, TB Disks,–– Fast Networks: 10GbE, MPLS; Global ReachFast Networks: 10GbE, MPLS; Global Reach–– Convergence (Voice Video, Data): Unified Communications, Convergence (Voice Video, Data): Unified Communications, VoIPVoIP–– Mobility & Wireless Mobility & Wireless
•• Focus OnFocus On–– Consolidation & VirtualizationConsolidation & Virtualization–– IT Services and not IT Resources or InfrastructureIT Services and not IT Resources or Infrastructure–– Rise of Cloud Computing and SaaS, SOA in its wakeRise of Cloud Computing and SaaS, SOA in its wake–– Control over Complex Systems Interdependencies to avoid creatinControl over Complex Systems Interdependencies to avoid creating system wide instabilitiesg system wide instabilities–– Automation of LowAutomation of Low--Level Risks to free up on Initiatives aligning IT (CIO) to BusinLevel Risks to free up on Initiatives aligning IT (CIO) to Business (CEO)ess (CEO)
Data Center Trends - Summary
©2003-2007 IMEX Research All rights Reserved
© 2007 IMEX ResearchAll Rights Reserved
Copying Prohibited
•• Follow SIVAFollow SIVA©© in executing your DC strategyin executing your DC strategy–– StandardizeStandardize (Windows/Linux, GbE, IP Storage/(Windows/Linux, GbE, IP Storage/iSCSI,SATAiSCSI,SATA..)..)–– IntegrateIntegrate (Blades, Management Tools..)(Blades, Management Tools..)–– VirtualizeVirtualize (Infrastructure(Infrastructure--uP,ServersuP,Servers, Storage, , Storage, Networks,ClientsNetworks,Clients
w P2V tools)w P2V tools)–– AutomateAutomate (Provide important Apps required resources (Provide important Apps required resources
automatically w/o intervention to automatically w/o intervention to OOPEX costs)PEX costs)
•• Server Virtualization (VZ) now a mainstream Server Virtualization (VZ) now a mainstream technologytechnology–– VZ turning DC core infrastructure upside down, DC Professionals VZ turning DC core infrastructure upside down, DC Professionals
very happy with its future usevery happy with its future use–– VZ means “Doing More for Less” (finally making CFOs get off VZ means “Doing More for Less” (finally making CFOs get off
your back)your back)
–– Combined with VZ & Consolidation Combined with VZ & Consolidation TCO Reduction of 60TCO Reduction of 60--70% 70% over 3 years, ROI >58%over 3 years, ROI >58%
Summary - Virtualization & Automation
©2003-2007 IMEX Research All rights Reserved
© 2007 IMEX ResearchAll Rights Reserved
Copying ProhibitedVirtualizing your IT InfrastructureSLA
UsageDept/Owner
AssetsLocation
• Host Name (Mfr/Model/SN,• Platform – OS/Processors/#/Speed/Type
• Pooled Infrastructure Resources by Application Metrics
• Pooled Capacity Provisioning: Processing, Bandwidth, Storage, Repository
• Usage Profiles• Users/Services/Workloads
• Applications (OLTP/BI/HPC/Data Streaming)• Execution: Rules Driven, Adaptive Provisioning
• Services Abstraction, Adaptive Provisioning
VirtualizationUtility - P2V
• Business Priorities• Cost of IT Ops/Charge Back Methods
• Response Time/Availability/Throughput,QoS• Transactions/Sessions/Events/Analysis/Reporting
• Business Services Managed & Charged
For copy of case study on how a major financial institution implemented virtualization email [email protected]
©2003-2007 IMEX Research All rights Reserved
© 2007 IMEX ResearchAll Rights Reserved
Copying Prohibited
IMEXRESEARCH.COM
Next-Gen Data CenterImproving TCO & ROI in Data Centers thru
Virtualization and Blade Servers
Anil VasudevaChief Analyst & [email protected]
© 2007 IMEX ResearchAll Rights Reserved
Copying ProhibitedPlease contact IMEX for written permission
For TCO/ROI Financial Worksheets & DataCenter Analysis & NGDC Industry Report
Email: [email protected]:(408) 268-0800
Top Related