BRKDCT-2867

© 2006, Cisco Systems, Inc. All rights reserved.Presentation_ID.scr

1

© 2008 Cisco Systems, Inc. All rights reserved. Cisco Public 1Session_IDPresentation_ID

© 2008 Cisco Systems, Inc. All rights reserved. Cisco PublicSession_IDPresentation_ID 2

Data Center Facilities Consideration in Designing and Building Networks

BRKDCT-2867


2


Agenda

DC StandardDC ChallengesCooling Issues and SolutionsCabling Issues and SolutionsPower Issues and SolutionsDC Physical ConsiderationsModular Access (example)Consolidated I\O Architecture with VirtualizationSummaryQ&A


Data Center Standard


3


DC Standard

TIA/EIA568

Copper & Fiber Cabling

ANSI/TIA-942Telecommunications Infrastructure

Standard for Data Centers

TIA/EIA569

Pathways & Spaces

TIA/EIA606

Administration

TIA/EIA607

Grounding& Bonding

Uptime Institute

IEEE 1100ITE Grounding

ASHRAECooling/HVAC

TIA: Telecommunications Industry Association http://www.tiaonline.org/Uptime Institite: http://uptimeinstitute.org/Government work on server and DC Energy Efficiency:

http://www.energystar.gov/index.cfm?c=prod_development.server_efficiency


Zone Dist Area

Horizontal Cabling

Telecom Room(Office & Operations

Center LAN Switches)

Offices, Operations Center, Support

Rooms

Entrance Room(Carrier Equip &

Demarcation)

Access Providers

Access Providers

Horizontal Cabling

Equipment Dist Area

(Rack / Cabinet)

Equipment Dist Area

(Rack / Cabinet)

Equipment Dist Area

(Rack / Cabinet)

Equipment Dist Area

(Rack / Cabinet)

Horizontal CablingHorizontal Cabling Horizontal Cabling Horizontal Cabling

Horiz Dist Area(LAN/SAN/KVM

Switches)


Switches)


Switches)


Switches)

Backbone Cabling

Main Dist Area(Routers/Backbone LAN/SAN Switches, PBX, M13 Muxes)

Computer Room

Backbone Cabling

Backbone Cabling

TIA-942 Logical Layout


4


Example Data Center Layout

Main Distribution Area

Horizontal Distribution Area

Equipment Distribution Area


Zone Distribution Area (ZDA)

Horizontal Cabling(in hot aisles)

ZDA(Zone Outlet orConsolidation Point)

Patch Cord(to server)

EDA(server cabinet)

LEGEND:


5


Data Center TieringExcerpt from TIA-942 Standard

Tier IBasic

Tier IIRedundant

Components

Tier IIIConcurrently Maintainable

Tier IVFault Tolerant

Site Availability 99.671% 99.749% 99.982% 99.995%Downtown(Hours/Year) 28.8 22.0 1.6 0.4Operations Center Not Required Not Required Required RequiredRedundant Access Provider Services

Not Required Not Required Required Required

Redundant Backbone Pathways

No No Yes Yes

Redundant Horizontal Cabling

No No No Optional

UPS Redundancy N N+1 N+1 2NGaseous Suppression System

No No Clean AgentsFM200/Intergen

Clean AgentsFM200/Intergen


Data Center Challenges


6


Problem Statement

Blade servers 80-84 severs in cabinet

30kW of Power

1U systemsGreater port densities

Greater heat output

More weight

Storage devicesLarge footprints

1500, 2000, 2500+ lbs.

700, 900, 1100+ kgs.

Systems Entering Data Centers Have Changed; Most Legacy Server Environments Lack Sufficient Infrastructure to Gracefully Handle Them


Data Center Environmental Challenges

Cooling

Structured cabling

Power

Structural loading

The nature of Data Center infrastructure makes it challenging to find solutions that don’t spawn other problems

Typical Shortcomings


7


Data Center Inefficiencies

Uptime is the ultimate goal, as a result……Data Centers are over-planned

To provide 24X7 availabilityAllow for future growth90% of corporate Data Centers have more cooling capacity than required (Uptime Institute)

Inefficient equipment deploymentServer performance, one application per server72% of cooling bypasses the computing equipment entirely (Uptime Institute)

Inherent power inefficiencies


Cooling Issues and Solutions


8



Today’s products are hotter than yesterday’s

Tomorrow’s products will be hotter than today’s

Data Center Managers prefer to tightly install equipment to fully utilize cabinet space

2000 – 2010 Product Heat Density Trend Chart


Cooling Issues and SolutionsAmbient temperatures

50, 100, 150, 200 watts/sq. ft.

500, 1000, 1600, 2150 watts/ sq. m.

Hot spots

Short-cycling of air handlersArrhenius Rate Law

For every 18 °F (10 °C) increase in temperature there is a 50% decrease in reliability of electronics

Activation EnergyRate Constant

Frequency Factor or Pre-Exponential

Factor Mathematical Quantity, e

The Gas Constant

Kelvin TemperatureK = AeEA

RT-


9



Spread out heat sourcesIncrease aisle spaces

Don’t cluster high-density rows

Use deep plenum below floor and above ceiling

Orient air handlers perpendicular to rows

Design Solutions


Catalyst Switches in a Cabinet

Catalyst 6K Switches in a Cabinet

Utilize Ducting

Improve Air Flow Characteristics

CFD of 2 – Catalyst 6509 Switches with ducting

CFD of 2 – Catalyst 6509 Switches without ducting


10


AirflowCold Aisle / Hot Aisle

Air Circulation Components Cold Aisle/Hot Aisle Concept

Cable Placement Additional Cooling Capacity



Hot / cold aisles

Chimney design

Ducted air returnDesign Solutions


11


Cooling Issues and Solutions -Architectures

Central Air Handling Unit(CAHU)

Computer Room Air Handler(CRAH)

In-Row Air Handler(IRAH)


Cooling Issues and Solutions - A Hybrid Approach to Cooling

Most Data Centers will have a mix of heat densities and therefore cooling solutions

IT Refreshes happen every 2-4 years resulting in a mix of distributed IT assets

IT management of blades and storage deployments is often in clusters

Concentrated high density loads

Older server assets may be well served by room cooling units

Leverage existing cooling assets to maintain room conditions.

dRow-oriented Rack-

oriented

Room-oriented


12


Cooling Issues and Solutions –Alternative cooling architectures w/ power considerations

DensityApplicationMethod

Very high density specific racksMix of very high and low density

Very high densityTargeted zonesAssured redundancy

Medium densityGeneral use

Low densityVery flexible

1-5kW per rackTraditional room-oriented raised floor cooling

20-45kW per rackRack-coupled

10-25kW per rackIn-row with hot aisle containment

3-15kW per rackIn-row



Deploy redundant infrastructure

Supplemental cooling solutionsOverhead cooling units

Water-cooled cabinets

Auto-adjusting tile dampers

Cool Door Technology

In row cooling

Design Solutions


13



Distribute hottest systems

Limit clustering of like systems

Install air dams

Streamline cabling

Maintain static pressure

Employ temperature monitoring tools

Install air conservation system on floor

Operational Solutions


Cooling Issues and Solutions – In Row Cooling (iRAH)

Cooling

IT Racks

Front View

Elimination of mixing enables a predictable cooling pattern

Capture heat at the source and Neutralize

Capable of cooling high densities > 30 kW per rack

Close Coupled to Heat LoadThermal Containment Options

Dynamic fan control matches heat removal to heat generation

Redundancy – Reduce PowerVirtualization – Ramp-up and Down to meet thermal demand

Reduced deployment cycle and Cost through use of modular scaleable components

Build out in Zones.Cool only what you need to

Increased data center efficiency IRAH – In row air handler


14


Cooling Issues and Solutions - Hot Aisle Containment Systems (HACS)

InfraStruXure High Density

InfraStruXure InRow RCIn-Row Air Conditioner Cools hot chamber air

Chamber DoorsAccess to hot aisle, locks for security

Hot Aisle Ceiling Tiles/Cable TroughSeals in hot air, prevents mixing with room air

High Density Zones

Supports InRow products

Hot air scavenging systemDucted Return / Free Supply

Optimize InRow CoolingIncrease Efficiency

Improve Predictability

Use at any density


Data Center Cooling Solutions Summary1. Conduct a cooling checkup/survey.2. Route data cabling in the hot aisles

and power cable in the cold aisles.3. Control air path leaks and manage

cabling system pathways.4. Remove obstructions below raised

floor and seal cutouts.5. Separate blade server cabinets.6. Implement ASHRAE TC9.9 hot

aisle/cold aisle design.7. Place CRAC units at the ends of the

hot aisles.8. Manage floor vents.9. Install air flow assisting devices as

needed.10. In extreme cases, consider self-

contained cooling units.


15


Cabling Issues and Solutions



Insufficient portsUsers “borrow” other connections

Piecemeal fixes

Chaotic cablingRestricts air flow

Hinders troubleshooting

Creates unplanned dependencies

Prone to accidental downtime

Mess begets mess


16



Right-size port countsSet capacity to meet 95% of deployments

Prewire cabinet locations

Plan cable managementChoose graceful high-density solutions

Strategically deploy wire management

Employ a distributed physical design

Design Solutions



One main networking row

Cabling routed directly to server cabinet locations

Excellent for the logical elements of the network

Direct-Connect Design


17



Bad for the physical element of a network

Scales poorly

Prone to cable overlap




Network substations

Cabling to all server cabinets

Subset of cables to the main network row

Distributed Design


18



Distributed DesignGood for the physical element of a networkScales wellNo cable overlapCable runs are shorter and better organized

Easier to manageLess expensiveLess restrictive for air flow

Design Solutions


Cabling Issues and Solutions: Pathways

Cable Sizes GrowingCat 5e 0.157”Cat 6 0.25”Cat 6a 0.315”

Multiple Diverse RoutesUnder the Access FloorAbove the Racks \ CabinetsMixture of Under & Over the Access Floor


19


Cabling Issues and Solutions: Pathways and Spaces Under Floor

BenefitsPedestals create infrastructure pathwaysUtilization of real estateCabling is hidden

ConcernsCould restrict cold airflow

Creating segregated pathways

Accessibility to cables


Cabling Issues and Solutions: Pathways and Spaces Overhead

BenefitsAlleviates congestion beneath access floorCreation of segregated pathwaysMinimizes restrictions to cold air floor

ConcernsRequires adequate space above the racksInfrastructure provisions to support the pathways Cabling may be exposed


20


Before After



Cabling Issues and Solutions- Zone Cabling in the DC

Flexibility to Cable Full Rack Equipment Easily

Mainframes

SAN Equipment

Ability to make MACs Quickly and Easily

Reduced Network Downtime When Changes are Required


21


Cabling Issues and Solutions- Cabling a Cisco Modular Switch

Which way do you cable switch?



Neatly route cabling

Don’t use overly long patch cords

Use wire management as designed



22


Evolution of Ethernet Physical Media –Impact on Facilities

100Mb 1Gb 10Gb

UTP Cat 5 UTP Cat 5SFP Fiber

X2SFP+ Cu SFP+ FiberCat 6/7 ??

10Mb

UTP Cat 3

Mid 1980’s Mid 1990’s Early 2000’s Late 2000’s

CableTransceiver

Latency (link)Power

(each side)DistanceTechnology

Cat6Cat6a/7Cat6a/7

MM 62.5μmMM 50μm

MM OM2MM OM3

Twinax ~0.1μs~0.1W10mSFP+ CUCopper

2.5μs2.5μs1.5μs

~8W~8W~4W

55m100m30m

10GBASE-T

~01W82m300m

SFP+ SRshort reach

~01W10m100m

SFP+ USRultra short reach


Power Issues and Solutions


23


Growing demand for circuitsFrom: (2) 120V 20 amp circuits -Two poles

To: (2) 208V 30 amp circuits - Four poles

Growing demand for capacity

Today’s electrical loads exceed yesterday’s designsEliminates redundancy (N+1)

Exceeds total building capacity




Prewire all cabinet locationsSet capacity to meet 95% of deployments

Provide redundant powerFeed from multiple PDUs

Keep all component loads below 50%

Provide capacity to accommodate growth

Employ a distributed physical design

Design Solutions


24



Electrical conduits routed directly to all cabinet locations

Restrict airflow

Complicate troubleshooting

Create unintentional physical dependencies

Overlapping conduits

In large Data Centers conduit lengths can be excessive




Fewer overlapping conduits

Improved airflow

Reduced costs to modify shorter conduits

Reduced risk of multiple outages from a physical accident

Distributed Design


25



Remote Power PanelsInstalled back-to-back

Each fed from a different PDU

Network Patching Fields

Cabinets Floor Tiles Ports per Tile1 15 24 Fiber, 18 Copper 2 24-30 36 Fiber, 36 Copper5 50 48 Fiber, 48 Copper

Electrical/Network Substation



Use hosts with redundant power supplies

Limit systems with odd-numbered power cords

Consider amp-reading power strips



26


Data Center Power Considerations Summary

1. See Cooling top 10 Steps!2. Standardize on rack SOE3. Implement scalable UPS systems4. Increase Voltage5. Targeted higher UPS loading6. Investigate power efficiency7. Load balance8. Limit branch circuit proliferation9. Monitor power10. Manage and target power based

on monitoring benchmark


DC Physical Considerations


27


Data Center TopologyNetwork Equipment and Zones

Server Rack

Network Rack

Zone

DC

Pod

Storage Rack

Access Access LayerLayer

Aggregation Aggregation LayerLayer

Core Core LayerLayer

COLD AISLE

HOT AISLE

Pod

Pod


Pod ConceptNetwork Zones and Pods

COLD AISLE

HOT AISLE

Pod Pod

Sizing▪Zone: Typically mapped to agg pair size▪Pod: Typically mapped to access switch pair▪ Size: determined by distance and density▪ Cabling distance from server racks to network racks▪ 100m Copper▪ 200-500m Fiber

▪ Cabling density: # of servesr per rack and I/Os per server▪Rack▪ Server: 6-30 Servers per rack – limited by power▪ Network: Depends on access model: Modular, ToR or Blade▪ Storage: special Cabinets


28


Network Equipment DistributionEnd of Row

Patch panel Patch panel

Network Access Point

A - B

End of Row

server

server

server

server

Patch panelX-connect


C - D


Patch panel


A - B

server

server

server Patch panelX-connect


C - D


Patch panel

End of Row▪Traditionally used▪Copper from server to access switches▪Poses challenges on highly dense server farms

▫ Distance from farthest rack to access point▫ Row length may not lend itself well to switch port density

End of Row (half row)▪Use is starting to increase given EoRchallenges▪Copper from servers to access switches▪Fiber may be used to aggregate ToR▪It addresses aggregation requirements for ToR access environments

Common Characteristics▪Typically used for modular access▪Cabling is done at DC build-out▪Model evolving from EoR to MoR▪Lower cabling distances (lower cost)▪Allows denser access (better flexibility)

▪6-12 multi-RU servers per Rack▪4-6 kW per server rack, 10Kw-20Kw per network rack▪Subnets and VLANs: one or many per switch. Subnets tend to be medium and large

server

Fiber

Copper End of Row


Network Equipment DistributionTop of Rack

Top of Rack

To network core

server

server

Top of Rack

server

ToR▪Used in conjunction with dense access racks(1U servers)▪Typically one access switch per rack

▪Some customers are considering two + cluster

▪Typically:▪ ~10-15 server per rack (enterprises)▪ ~15-30 server per rack (SP)

▪ Use of either side of rack is gaining traction▪ Cabling:

▪Within rack: Copper for server to access switch▪Outside rack (uplink):

▪Copper (GE): needs a MoR model for fiber aggregation▪Fiber (GE or 10GE):is more flexible and also requires aggregation model (MoR)

▪Subnets and VLANS:▪ one or many subnets per access switch▪ Subnets tent to be small

Patch panel

Network Aggregation

PointA - B

server

server

server Patch panelX-connect

Network Aggregation

PointA - B


Patch panel

server

Top of Rack Top of Rack


A - B



C - D


Top of Rack

server

Top of Rack

Patch panel Patch panel


29


Network Equipment DistributionBlade Chassis

End of Row (Switch to Switch)▪Scales well for blade server racks (~3 blade chassis per rack)▪Most current uplinks are copper but the NG switches will offer fiber

End of Row (Pass-through)▪Scales well for pass-through blade racks▪Copper from servers to access switches

ToR▪Have not seen it used in conjunction with blade switches▪May be a viable option on pass-through environments is the access port count is right

Blade Chassissw1 sw2

Blade Chassis

sw1 sw2


Blade Chassis

Pass-through

Blade ChassisPass-through


Network Aggregation

PointA – B – C - D


Network Aggregation

PointA – B - C - D


Top of Rack

Blade Chassis

Pass-through






Network Aggregation

PointA – B – C - D


Network Aggregation

PointA – B - C - D


Patch panel

Patch panel

Patch panel

Patch panel


For Each Scenario in this example96in x 42in footprintTotal of 16.8KW of Power Total of 48 Servers

Air Flow delivered is the same

32in 45RU Cabinet AdvantagesReduced Static pressure due to proper cable

management with more than 4-5 2RU servers per cabinet

Vertical patch panels minimizes patch cord lengths, number of sizes, & increases usable RU spacingPower cables and Network cables have good

separationAdditional room for cabling thus reducing accidental

downtime

Footprint only increases with the number of servers in a 24” cabinet.

17 – 2RU Servers34 – 1RU Servers

Width of Cabinets24” vs 32” Cabinets?


30


Differences between Cabinets and Racks

• Aesthetics

• Security

• Additional Usable Cable Management Area & Flexibility

• Vertical Patch Panels

• Footprint

• Additional Cooling Options

• Cool Door

• Convert back and forth from Server to Switch cabinet


Risks to Consider in Capacity Planning

3,000 cfm200-300 cfmCooling Needs—chilled airflow

700-800 W/ft²30-40 W/ft²Power per Floor Space

> 20 kW per rack2-3 kW per rackPower per Server

High-Density ServerLegacy Server

Source: Gartner 2006

20,000 ft²

800kW

+33%

100-200 Racks*Peripheral DC costs considered

Legacy DC designed to accommodate 2-3kW per Rack

Introducing 1/3 high-density infrastructure into a legacy facility has cost, power, weight, and cooling implications


31


Modular Access / End Row Example


End of Row Example (Modular Access)The Challenge

~4000 ServersServer LAN A&B ConnectivityServers 1Gb ConnectivityUplinks 10Gb ConnectivityUtilize Catalyst 6509 SwitchesCore, Agg and Access DesignSAN CabinetsMainframe\Midrange Cabinets450 Watts per Server5.5 kW per Switch Cabinet4 kW per SAN\Midrange Cabinet“POD” Concept Design

Aggregation Layer

Access Layer

Data CenterCore

Aggregation Module

GE

48 Switches

10 GbE

22 2 2 2

2 2 2

4000 Servers


32


Data Center SizingEnterprise Modular Access: 6509

EnterpriseServers 1500 < x < 4000

Ports* 8000Switch Types 6509Core Switches

2: 6509

LCs: 6 4x10GE

Aggregation Switches

4: 6509s

LCs: 26 4x10GE

Outbound Capacity: 80GE

Oversubscription: 96:16

Access Switches

24: 6509

Oversubscription: 8.4:1

Core:6509: 16 10GE ÷ 4 ports per LC = 4 LCs

2 LCs for cross connectivity

Uplinks: based on DC outbound requirements

Aggregation: 6509: 96x10GE ÷ 4 ports per LC = 24 LCs

2 LCs for cross connectivity

26 LCs ÷ 8 Slots = 3.25 ~ 4 chassis

4 chassis x 4 uplinks = 16 10GE ports

Access: 8000 ÷ 336 = 23.8 ≈ 24 chassis4 10GE uplinks per chassis = 96 10GE

Oversubscription: 336:40 ~ 8.4:1Maximum CapacityAccess: 336 x 24 = 8064 ports ~ 4032 Servers

4 10GE uplinks per chassis = 8 10GE

Oversubscription: 336:40 ~ 8.4:1


End of Row Example (Modular Access) The Layout and Sample Solution

Agg1 Agg2 Agg3 Agg4

Acc11 Acc12

336 Servers

Acc1 Acc2

336 Servers

Acc13 Acc14

336 Servers

Acc23 Acc24

336 Servers

Core 1 Core 2

6 Pair Switches

6 Pair Switches

Servers: 40326509 Switches: 30Server\Switch Cabinets: 399Midrange\SAN Cabinets Allotted For: 124

12 Server “PODs”Consists of the following:

4 Switch Cabinets for LAN & SAN32 Server Cabinets12 Servers per Server Cabinet


33


End of Row Example (Modular Access)The Data Center Layout Total White Space:

14,400 sqFt


End of Row Example (Modular Access)The “POD” with EDA Breakout

Single “POD”

Equipment Distribution Area (EDA)

Acc1 Acc2

336 Servers


34


End of Row Example (Modular Access)EDA Application Photos


End of Row Example (Modular Access)The “POD” with HDA Breakout

Single “POD”

Horizontal Distribution Area (HDA)

Acc1 Acc2

336 Servers


35


End of Row Example (Modular Access)The “POD” with HDA Breakout

Single “POD”

Horizontal Distribution Area (HDA)

Acc1 Acc2

336 Servers


End of Row Example (Modular Access)HDA Application Photos


36


End of Row Example (Modular Access)Main Distribution Area (MDA)

Agg1 Agg2 Agg3 Agg4

Core 1 Core 2Additional Equipment:

Core Routing\Firewalls

LAN Appliances

SAN Directors


End of Row Example (Modular Access)Main Distribution Area (MDA)

Additional Equipment

Core Routing\Firewalls

LAN Appliances

SAN Directors

Core 1 Core 2


37


End of Row Example (Modular Access)CFD Analysis

Designed in a Hot –Cold Architecture

12 - 20 Ton CRAC Units Outside

12 - 30 To CRAC Units Inside

Utilizing Ceiling plenum for return air

All Perforated Tiles at 25% Open

Peak Temp was 114°


Consolidated I/O Architecture with Virtualization


38


Increased Efficiency, Simpler Operations

UnifiedFabric

Unified Fabric and I/O

Storage Network

Mgmt Network

Backup Network

Back-End Network

Front-End Network


Fibre Channel over Ethernet (FCoE)

10Gb Ethernet Pipe FC

A method for a direct mapping of FC frames over A method for a direct mapping of FC frames over Ethernet Ethernet

Seamlessly connects to FC networks Extends FC across the datacenter over the Ethernet

FCoE appears as FC to the host and the network

Preserves current FC infrastructure and management

FC frame is unchanged

Can operate over standard switches (with jumbo frames)

Priority Flow Control guarantees no-drops

Mimics FC credit-buffer system, avoids TCP

Does not require expensive off-loads


39


VM-Optimized Services

Enables convergence of multiple traffic types

Virtual Machines LAN Virtual Machines SANHypervisor Mgmt LANVirtual Infrastructure Services LAN

Scales VM LAN performance Increase I/O bandwidth Increase VM density

Accelerates Virtual Infrastructure Services

Live VM migrations via VMotion and DRS features

Enable additional services

VMotion

10 GbE

10 GbE DCE

Fibre Channel

SAN A

10 GbEFCoE/DCE

LAN SAN BLAN


Acc1 Acc2

40 Servers

Virtualized Server Environment – Unified FabricToR Deployment

Agg1 Agg2

10 CP

VMs per Server: 10Servers: 400Nexus 7000 Switches: 2Nexus 5000 Switches: 10MDS Switches: 2

40 Servers per Cabinet Pair2 Nexus 5020 per Cabinet Pair10 Cabinet Pairs

Acc1 Acc2

40 Servers


40


Virtualized Server Environment – Unified Fabric A Single “POD” Using Virtualized Model

24 Cabinets Total• 10 Server Cabinet Pairs (20 Total)

• 4 Switch Cabinets

Over Head Fiber Optic Cabling Only

400 Servers with 10 Virtualized Each (4000 Total Virtual Servers)


Virtualized Server Environment – Unified Fabric The Cabinet Pair Breakout

Cross Patching between Cabinets

20 Servers per Cabinet X 2 Cabinets (40 Total)

40 Connections per Switch

Each Switch Uplinks• 4 – LAN A \ 4 – LAN B• 4 – SAN A \ 4 – SAN B


41


Unified Fabric - Consolidated I/O Extends Benefits of ToR

2x Consolidated2x SAN

2x LAN

Unconsolidated I/O Consolidated I/O

Consolidate LAN I/O• Consolidate multiple LAN adapters into two CNAs

• Consolidate multiple cables into two paths

Consolidate SAN I/O• No need for SAN-specific adapters• Reduce SAN switches and cables • Unified I/O switches connect to existing SAN infrastructure

Consolidated I/O Benefits• CapEx Savings up to 30%• Cable reduction of 50% or

more for ToR and EoRdesigns

• Potential power savings


Virtualization Impact on Critical Facilities.

Power Needed per Server has increased

Could be up to 16KW for this cabinet

Need for Supplemental Cooling required

Weight of Equipment on Raised Floor

All Copper Cabling is Contained with the Two Cabinets

Cable reduction

Fiber Optic Cabling for the UplinksThe need for quality Fiber Cabling has increased


42


Summary



Cooling

Structured cabling

Power

Structural loading

The nature of Data Center infrastructure makes it challenging to find solutions that don’t spawn other problems

Typical Shortcomings


43



Physically DistributeEquipment

Power & Cooling

Right-size infrastructure (modularity)

Virtualize

Network Architecture and Facilities Dependencies

Use pools of servers and storage, controlled by the network, to provide Data Center resources.

Universal Solutions


Universal Solutions

More efficient use of computing resources

Shared computing among multiple machinesBuilt-in redundancy

Individual servers are expendable

Devices can be managed on a by-cabinet basis

Service Oriented Data Center (SODC)


44


Q and A


Recommended Reading

Site selection

Data Center sizing and layout

Physical design

Large-scale server moves

Remote monitoring

Change management

Available Onsite at the Cisco Company Store

Includes downloadabledesign template

Topics


45


Recommended Reading

Continue your Networkers at Cisco Live learning experience with further reading from Cisco PressCheck the Recommended Reading flyer for suggested books

Cisco PressData Center Fundamentals

Available Onsite at the Cisco Company Store


Additional Resources

URLs6500 Cabinet Information

http://wwwin.cisco.com/dss/isbu/6500/enviro/index.shtmlPanduit

http://www.panduit.com/default.aspTIA – Telecommunications Industry Association

http://www.tiaonline.org/ASHRAE – American Society of Heating, Refrigerating and Air-Conditioning Engineers

http://www.ashrae.org/Uptime Institute

http://uptimeinstitute.org/Government work on server and DC Energy Efficiency:

http://www.energystar.gov/index.cfm?c=prod_development.server_efficiency


46


Complete Your Online Session Evaluation

Win fabulous prizes; give us your feedback

Receive ten Passport Points for each session evaluation you complete

Go to the Internet stations located throughout the Convention Center to complete your session evaluation

Winners will be announced daily at the Internet stations


BRKDCT-2867

Documents

Transcript of BRKDCT-2867