8/6/2019 Blades and Storage Evolution
1/36
Emerging Infrastructureand Data CenterArchitecture Principlesand Practice
Richard FicheraDirector, BladeSystems StrategyBladeSystem & Infrastructure Software
8/6/2019 Blades and Storage Evolution
2/36
The problem complexity andphysics catch up with the datacenter
The building blocks servers,storage and fabrics
Evolution in Data Centerarchitectures
Infrastructure in motion VMs,automation and orchestration
Infrastructure and data centertransformation
Todays Agenda
8/6/2019 Blades and Storage Evolution
3/36
HP BladeSystem c-Class Server BladeEnclosure
Background
OverwhelmingComplexity and
Increasing Scale
8/6/2019 Blades and Storage Evolution
4/36
Shifting Costs Define FutureInvestments
Many Servers, Much Capacity, Low Utilization = $140B unutilized server assets
$0
$50
$100
$150
$200
$250
$300
1996
1997
1998
1999
2000
2001
2002
2003
2004
2005
2006
2007
2008
2009
2010
Installed Base(M Units)
Spending(US$B)
New Server Spending
Server Mgt and Admin Costs 4
Power and Cooling Costs 8
0
5
10
15
20
25
30
35
40
45
50
Many Servers, Much Capacity, Low Utilization = $140B unutilized server assets
$0
$50
$100
$150
$200
$250
$300
1996
1997
1998
1999
2000
2001
2002
2003
2004
2005
2006
2007
2008
2009
2010
Installed Base(M Units)
Spending(US$B)
New Server Spending
Server Mgt and Admin Costs 4
Power and Cooling Costs 8
0
5
10
15
20
25
30
35
40
45
50
$0
$50
$100
$150
$200
$250
$300
1996
1997
1998
1999
2000
2001
2002
2003
2004
2005
2006
2007
2008
2009
2010
Installed Base(M Units)
Spending(US$B)
New Server SpendingNew Server Spending
Server Mgt and Admin Costs 4
Power and Cooling Costs 8
0
5
10
15
20
25
30
35
40
45
50
0
5
10
15
20
25
30
35
40
45
50
0
5
10
15
20
25
30
35
40
45
50
Source: IDC, Virtualization and Multicore Innovations Disrupt the Worldwide Server Market, March 2007
8/6/2019 Blades and Storage Evolution
5/36
HP BladeSystem c-Class Server BladeEnclosure
Infrastructure Building
Blocks FundamentalPhysics and Trends
8/6/2019 Blades and Storage Evolution
6/36
Chefs Special - Sauted Data Center
0
20
40
60
80
100
120
140
Wolfe
Cooktop
x86 CPU
Watt / q are Inch
W/ q in
8/6/2019 Blades and Storage Evolution
7/36
Legacy Thermal Management Was anAfterthought
Overall PUE wasoften in theneighborhood of .
More energy used
to remove the heatthan was used todo productive work
For decades theonly real decisionswere water or airand how manyCRACs
%
6 %
%
AC conversioncooling
servers
Preliminary studies suggest
Cooli oads Domi ate t e DataCe ter
Source: C.G. Malone & Uptime Institute
erce tageof ower sed
8/6/2019 Blades and Storage Evolution
8/36
Power & Cooling Will Continue toDominate Data Center Architecture
7 9
Collapse complexityand take cost out
Relativedatacenterspendingper serverunit
Datacenter spending based on IDC Forecast and report: Datacenter of the Future II, January 9Spending is per server unit, normalized for CY =
8/6/2019 Blades and Storage Evolution
9/36
8/6/2019 Blades and Storage Evolution
10/36
Servers Market and Drivers
Market
The x server market represents approximately , ,servers per year, and will remain the center of innovation andinvestment.
The market is split / / in terms of the tower/rack/blade formfactors, with blades and extreme scale-out as the fastest-growingsegments.
Key Drivers
Acquisition cost will always be important
Energy consumption has become a priority, but focus will shift tolarger aggregates as marginal gains on servers get smaller
Total infrastructure cost, including management, becomes a focusat a system/DC level
This is the jumping off point for debates about unified fabrics, sharedand virtualized I/O, new virtualization management models, etc.
8/6/2019 Blades and Storage Evolution
11/36
Server Performance
Server performance willcontinue to increase
By , a socket serverwill have approximately -
times the performance ofthe same server in
Continued improvementsin architecture along withdensity
Niche architectures will havefreedom to embed othersystems elements on chip comm, crypto, etc.
0
5
10
15
20
25
2007 2009 2011
GOPs/Socket
8/6/2019 Blades and Storage Evolution
12/36
12 8 June, 2009
Processors trends
Silicon compaction continues ( nm, nm, 2nm) Higher levels of functional blocks integration Large gate count
Caches, Memory controller(s), I/O, TPM
All server processors going to NUMA using processor links (no more FSB)
More efficient coherency protocols (Intel: Home Snooping; AMD: HT Assist)
Higher number of and faster interfaces Large pin-count pkg
One or more processor links More flexible designs Intel QPI
AMD HT
Multiple memory links Flexible memory configurations
Integrated I/O links (PCIe , USB ) I/O closer to processor & memory
Core count increase continues ( , , 8, 10, 12, 16)
Core clock frequencies increase slow down (topping around GHz)
More physical memory address bits (Intel: 6; AMD: 8)
Wide range of power (TDP) bins (Intel: 7150W; AMD: 5140W)
Depends on core count, cache size, coherent link count
8/6/2019 Blades and Storage Evolution
13/36
13 8 June, 2009
Memory trends Increase DDR3 speeds with tradeoffs on # DIMMs per channel (DPC)
DRAM chip capacity increase
DIMM capacity increase
8GB DIMM will be linearly priced in 2010
Reduced DIMM power rail and consumption
DIMM interfaces (DDR, SMI/VMSE) changing to address DDR bus limitations
Non-volatile components will add memory/storage hierarchy
8/6/2019 Blades and Storage Evolution
14/36
Server Futures
Continued escalation of core count and memory
Expect differentiation in choice of on-board peripherals andaccelerators at both chip and board level
Continual pressure toward denser, higher layer count boards
Communications radius effects, SI and connector limits
Changing options for design
Link-based connections for more flexible design
More options for local and near storage
Design differentiation as requirements bi/trifurcate
GP, scale out, virtualization designs
Value increasingly in packaging, rack-scale and largerintegration
8/6/2019 Blades and Storage Evolution
15/36
Changing Focus for Server Design Server design is increasingly merging with DC
design for rack-level and larger aggregates
As designs become more aggregate, theoptimizations become more complex
Server design has beenfocused on the chip to chassisdomain
Increased demand for scale-out isshifting the focus to rack, moduleand entire DC scale designs
8/6/2019 Blades and Storage Evolution
16/36
Storage Density
Storage density will followa pattern similar to serverperformance
By 2010 -11, usable
densities will exceed 1PB/rack
Expect significant changesand differentiation in
Storage services
Packaging
Choices of connection fabric
0
200
400
600
800
1000
1200
2007 2009 2011
TB/rack
8/6/2019 Blades and Storage Evolution
17/36
17 8 June, 2009
Block storage device trends Cost competiveness drove HDD industry consolidation
HDD interfaces going fast serial links: SAS/SATA SAS growing to be the interface of choice in enterprise
FC HDD growth is flat or shrinking
Switched SAS also enables storage fabric for shared block storage
But, lots of things need to be developed for complete solutions
HDD capacity continue to increase, while rpm tops at 15K HDD areal density ~30-40% AGR [SFF 0.5TB in 10, TB in 11]
SFF dominates in enterprise
Enterprise SFF 10K adoption growing (largest segment) while LFF 15K vol.shrinking
Flash storage is disruptive
SSD /GB cross-over with SFF SAS 15K rpm in 11-12
256G/512G in 10, TB in 11
PCIe-based Flash storage significantly improves storage I/O
New storage hierarchies and models, including memory cache, disc cache, i/oaccelerators
17
8/6/2019 Blades and Storage Evolution
18/36
18 28 July 2011
Storage - Virtualized Data Path &Services
Data Path Modules
IBM Sun EMC HP
ReferenceStorage
Architecture
Storage VirtualizationManager Servers
Data PathControl Path
LUNs
Snapshot Clones Migration Thin provisioning/Dedup Mirroring
Physical Media
8/6/2019 Blades and Storage Evolution
19/36
Data CenterLogical Architecture ChangingResource Distribution Strategies
Rack-mountServerfarmsBlade
serverChassis
VirtualMachines
SLB
Firewall
Data CenterCore
WAN &Campus Core
Distribution/Aggregation
Access(ServerEdge)
28 July 201119
SAN
Changes in density andfabric are changing theapproach to modularity ofstorage and servers
Converged fabrics allowmore flexibility in location
and reduce interconnectcosts
Local mini-SANs suchas switched SAS allowrefactoring storage tobring it near consumers
and producers andaway from the SAN team
Increasingly flexiblestorage services models
SANstorage
Fabricstorage
8/6/2019 Blades and Storage Evolution
20/36
Physical Architecture Is There aPodular DC in Your Future? LowerTCO
Higher PUE and power/cooling efficiency vstraditional DC
Geographic flexibility
Can deploy closer to customers, and in localesnot suitable for brick & mortar
Controlled/hybrid co-lo environments Faster time to Revenue for customers
Brick & Mortar18+ months design/build vsContainer in
8/6/2019 Blades and Storage Evolution
21/36
HP BladeSystem c-Class Server BladeEnclosureVirtualization,
Orchestration,Automation and
Infrastructure Agility
8/6/2019 Blades and Storage Evolution
22/36
Virtualization A Blessing & a Curse
Virtualization of servers, storage, networks and I/Ohardware brings major benefits
Capital resource efficiency (the initial sell)
Standardization and ease of migration
A gateway to adaptive architectures
as well as significant burdens management,management, management
Are you substituting one vendor lock-in for another?
How many more tools do you want to add to your environment? How do you integrate the physical and virtual management layer?
Be prepared for major innovation and vendor conflict inthis arena for the next five years
You need to have a strategy, metrics and a roadmap
8/6/2019 Blades and Storage Evolution
23/36
Enterprise Customers continue to bechallenged managing infrastructure
Server admin and management costs grow with theinstalled base of servers1
Basic operations such as installing a server typically take weeksrequiring manual coordination across multiple customerorganizations
Power, cooling and facilities limitations continue to loomas limits - the 10 Million server
This will drive multiple deployment options such as cloud in anattempt to tap economies of scale
Virtualization helps some things, but potentiallycomplicates the management environment
Expect continued experimentation in virtualization managementmodels, expanded virtualization options
8/6/2019 Blades and Storage Evolution
24/36
Typical infrastructure deploymentBuilt one unit at a time
Line of businessselects application
Get purchaseapprovals Order server
Project planningmeetings
And moremeetings
Server delivery unpack inventory Move totest center
Build process
servernetwork storage facilities
Change controlapprovals
Move toproductionenvironment
Re-cable andmove into
production
Many people Many manual steps Many weeks Human error
8/6/2019 Blades and Storage Evolution
25/36
The Goal Automated ProvisioningProvisioned when needed
Line of businessselects application
Verify resource allocation Tool determines availableresources and when
Push goWorkflow startsautomatically
A full applicationinfrastructure up
and running!
Fewer people and steps
Guaranteed compliance
Integrated information Same interface for virtual and
physical resources
Choose infrastructureapplication template
(right size?, right app?)
8/6/2019 Blades and Storage Evolution
26/36
What You Need to Add
Comprehensive VM management CONVERGEDwith physical management Power-aware load placement and movement
Physical/logical discovery & visualization
Multi-tier provisioning of VMs, networks andapplications
Lifecycle management of VMs
Resilience, changing how we do HA
And the good news is that you have at least 100niche/startup vendors to choose from
As well as the feuding major vendors We ALL want to be your management console of
record
8/6/2019 Blades and Storage Evolution
27/36
HP BladeSystem c-Class Server BladeEnclosureInfrastructure
Transformation Howto Get There From
Here
8/6/2019 Blades and Storage Evolution
28/36
The Path to InfrastructureTransformation
Current State
Standardize
VMs
StorageNetworks
Virtualize
Autom
ate
Physicalrefresh?
Outsource?
T efuture iscloudy
What?
8/6/2019 Blades and Storage Evolution
29/36
Some Essential Principles
Draconian standardization
Its really amazing how simple you can make an enterpriseenvironment if you just dont let anyone complain (or at least stoplistening to them)
Vendor simplification Software is particularly important
You may want to maintain very coarse-grained hardwareheterogeneity for vendor management
Almost always, fewer is better
Locations, software titles, options
Once standardization has been in place for a full dev cycle,requests for variations become few and far between
8/6/2019 Blades and Storage Evolution
30/36
Data CenterTransformationWorkstream Approach
Enterprise ApplicationsBusiness Applications
Databases and Middleware
Back-office infrastructures
Directory Services
Messaging and collaboration
File and Print
IP and networking services
Thin Client Infrastructure / ClientServices
Infrastructure services
Management tools
Back-up software
Network
Facilities
IT Organization and processes
Define the optimal to-be architecture,migration approach,sourcing strategy andbusiness case by
workstream. Define dependencies
and order betweenworkstream items
Prioritize high ROIopportunities.
Holistic, totalimplementationprovides highest ROI.
8/6/2019 Blades and Storage Evolution
31/36
Timely response to new business initiatives (that old alignment
thing) Spend more time focusing on business value instead of
fighting fires and managing MAC addresses
GrowBusiness
Centralize & standardize IT and data center processes Establish compliance with industry best practices
Protect company revenue, brand & reputation from outage ordisaster
Mitigate
Risk
Overall lower total IT costs your mileage will vary
Up to 50% savings from IT consolidation, apps rationalization
Up to 60% energy savings from modern facilities
Up to 25% real estate, location savings
Reduce
Cost
Data Center & ITTransformationWhat Can You Achieve?
8/6/2019 Blades and Storage Evolution
32/36
Best Practices to Achieve the Vision
Simplify through standardization: Standard & consistent data centerarchitecture and design; standard hardware, tools, and infrastructure
Establish PMO for governance: Provides framework for how effort willbe structured, who will make decisions
Gomodular:Allows for fast build, flexibility, scalability, and
efficiencies; isolates and separates risk
Break plan into bite-size chunks: Divide into workstreams, engageproper expertise, identify clear goals & deliverables by quarter
Synchronizetiming is everything: Facilities must be ready toreceive servers; servers must be ready to receive applications
Define one set of processes:A properly documented single set ofprocesses aligned to ITIL V3 model ensures desired outcomes,allows for automation
Actively manage and communicate change: Change managementand well-executed communication strategy critical for success
8/6/2019 Blades and Storage Evolution
33/36
What Lies Beyond: Cloud Computing
A pool of abstracted, highly scalable, and managed compute infrastructure
capable of hosting end customer applications and billed by consumption.
If managing a massive data center isnt a core competency of your business, maybe you
should get out of this business and pass the responsibility to someone who has
Amazon CTO Werner Vogels, 2007 Next Generation Data Center Conference
Cloud computing's ecosystem in the future willinclude Google-like public clouds as a platformfor applications, and virtual private clouds, whichare third-party clouds, or segments of the public
cloud with additional features for security,compliance, etc.
The data centre of the future also will includeprivate (internal) clouds, which will be anextension of virtualization and used primarilybecause of their capital or operationalefficiencies. For some applications, data justwon't leave the enterprise.
8/6/2019 Blades and Storage Evolution
34/36
Clouds A Long Haul
Good concept, great marketing buzz.
Hey, where are the applications?
Welcome to the world of almost consistent data.
Where did you say my data is?
Did someone say standards?
Hi, Im Coke. Am I sharing my cloud with Pepsi?
Whats the difference between a well designedshared services platform and an internal cloud?
But it does have a future
8/6/2019 Blades and Storage Evolution
35/36
Thank You
Richard FicheraDirector, BladeSystems StrategyBladeSystem & Infrastructure [email protected]
8/6/2019 Blades and Storage Evolution
36/36
Expanding on the Themes at NGDC
Beyond Power and Cooling: Improving Data CenterProductivity Speaker, John Pflueger, Technology Strategist, Dell
How the Sustainable Data Center Will Reduce Costs andImprove IT, Doug Washburn, Forrester Research
Creating the Most Efficient, Resilient and SustainableData Centers, Patrick Leonard, Senior Manager, StrategicInitiatives , Equinix, Inc.
Working With our Utilities: Getting What You Need WhenYou Want It, Mark Bramfitt, Principal Program Manager, PG&ECorporation
From Monitoring to Management: GainingComprehensive Visibility into Data Center Operations,Traci Yarbrough, Product Marketing Manager, Aperture Technologies
Top Related