Nexus 5K/2K/1K Update · !!Cabling and Physical Media Changes !!Rapid Growth in Storage Fabric...
Transcript of Nexus 5K/2K/1K Update · !!Cabling and Physical Media Changes !!Rapid Growth in Storage Fabric...
© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID
Aurelie Fonteny, Product Manager
Liz Stine, Technical Marketing Engineer
Nexus 5K/2K/1K Update
© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID 2 2
Agenda !!Nexus Portfolio
!!Nexus 5000 Overview
!!Nexus 2000 Overview
!!Nexus 1000 Overview
!!Technology: FCoE
© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID
Data Center Evolution Evolving Access Layer & Growing Demands
Increased Complexity and Scope of the Access Layer
!! The Data Center Access Layer is evolving !! High Density Servers with Virtual
Machines !! Migration from 1G to 10G !! Distribution of the Access Layer !! Embedded Blade Switches !! Embedded Virtual Switches
!! Challenges this brings !! Increase in the size of the access
topology (STP growth) !! Cabling and Physical Media
Changes !! Rapid Growth in Storage Fabric
connectivity !! Increase in the number of
management points !! Policy Boundaries !! Power & Cooling
LAN SAN B SAN A Gateway
Data Center SAN
High Performance Computing
Acc
ess
La
yer
HPC
Data Center LAN
© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID 4
Cisco Nexus Family: An Innovative Architecture to Simplify Data Center Transformation
Cost-Effective, 10 Gigabit Ethernet Connectivity Foundation
High Performance Switching
Performance
Data Center Ethernet
Scalability
Unified Fabric over 10GE - FCoE - iSCSI - HPC
Consolidation
VM-Optimized Services
Virtualization
Standards
Simplified operations
Operations
© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID 5
Evolution of Ethernet Physical Media Role of Transport in Enabling 10GE Technology
10GE Copper Solution •! Low cost •! Low power and latency •! Up to 5 meters (in-rack and adjacent rack cabling)
Cable Transceiver Latency
Power (each side) Distance Technology
Twinax ~0.25µµs ~0.1W 5m SFP+ CU Copper
MM OM1 MM OM3 ~0.1µµs 1W 33m
300m SFP+ SR short reach
MM OM2 MM OM3 ~0.1µµs 1W 26m
100m SFP+ USR
ultra short reach SR compatable
Cat6a/7 Cat6a/7
2.5µµs 1.5µµs
~8W ~4W
100m 30m 10GBASE-T
SFP+ Cu SFP+ to SFP+
© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID 6 6
Per
form
ance
520G
Nexus 5010
Nexus 7010
1Tb/s
Nexus 5020
Nexus 2000
Nexus 7018
VM
Nexus 1000V
NX-OS
Fabric Extender
Cisco Nexus Data Center Portfolio Today
Density
VN-Link
15Tb/s
7.5Tb/s
© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID
Nexus in the Data Center
N7000
N5000
N2000
1G and 10GE Rack Mount Servers
1G and 10GE Blade Servers
Pass-Thru
10GE Blade N4K - DCB Blade Switch
VM
VM
VM
VM VM VM
NEXUS 1000v
VM
VM
VM
VM VM VM
NEXUS 1000v
N1000
N4000
© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID
Nexus 5000 Overview
!! Purpose-built as a LAN switch, architected for Unified Fabric
!! Up to 1.04Tbps switching capacity, 773.8Mpps
!! Wire-rate, low latency, Layer2 switch
!! High density 10GE, some 1GE ports for migration
!! Unified lossless fabric
!! High Availability
!! Front-to-back cooling
!! NX-OS modular Operating System
* FC ports are SFP
© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID 9
Broad Customer Traction Nexus 5000/2000 Series is Proven
Nexus 5020 Nexus 5010 Nexus 2000
2008 2009
"!1000+ customers "!450,000+ 1GE ports shipped "!150,000+ 10GE ports shipped "!23% N5K have FCoE licences
attached
Vertical Customer Education Purdue University, University of
Arizona, Zuse Institute Berlin, University of Maryland, Technische Universitat Chemnitz
Healthcare Molina Healthcare
Manufacturing Coca-Cola, Schneider Electric
Research, HPC Lawrence Livermore National Lab Technology Cisco IT, BMC Software Service Provider The Planet, Terremark Law McDermott Will & Emery Government Stadt Pforzheim
© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID 10
Nexus 5000 Overview
Expansion Module Slots
Power Entry
Base 10GE 10/100/1000 Out of Band Mgmt
1/10GbE Capable Ports
Nex
us 5
020
Nex
us 5
010 Native 4GFC
FC Ports
10GE Ports
Expansion Modules
Native 8GFC FC Ports
© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID
Nexus 5000 Overview Physical Redundancy
!!1:1 Power Redundancy Hot Swappable Redundancy at 100-120V & 200-240V
!!N+1 Fan Redundancy Hot Swappable
Redundant FANs Redundant Power
© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID 12
Data Center Access Architecture vPC - Multichassis EtherChannel
!! vPC is a Port-channeling concept extending link aggregation to two separate physical switches
!! Allows the creation of resilient L2 topologies based on Link Aggregation.
!! Enables loop free Layer 2 topologies with physical network redundancy
!! Provides increased bandwidth
!! All links are actively forwarding
!! vPC maintains independent control planes
Virtual Port Channel
L2
Increased BW with vPC
Non-vPC vPC
Physical Topology Logical Topology
© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID 13
Acc
ess
La
yer
Ethernet FC Application Clusters
•! Data Center Compute •! Application Clusters •! Data Center Storage
LAN SAN B SAN A
Cluster
LAN
SAN B
SAN A
Unified Fabric Access Layer
Clusters
Nexus 5000
CNA CNA
•! Data Center Compute •! Application Clusters •! Data Center Storage
CNA Ethernet/DCE FC Application Clusters
Ethernet/DCE/FCoE
Servers
Access Layer Consolidation in the Data Center
© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID
Ethernet FC Application Clusters
•! Data Center Compute •! Application Clusters •! Data Center Storage
LAN SAN B SAN A
Cluster
LAN
SAN B
SAN A
Unified Fabric Access Layer
Clusters
CNA CNA
•! Data Center Compute •! Application Clusters •! Data Center Storage
CNA Ethernet/DCE FC Application Clusters
Ethernet/DCE/FCoE
Servers
SAN Connectivity
© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID
FCoE Advantages
FCoE is managed like FC at initiator, target, and switch level
!!Same Operational Model
!!Same Techniques of Traffic Management
!!Same Management and Security Models
!!Easy to Understand
!!Completely based on the FC model
!! Same host-to-switch and switch-to-switch behavior as FC
!! e.g. in order delivery, FSPF load balancing
!! WWNs, FC-IDs, hard/soft zoning, DNS, RSCN
FCoE is Fibre Channel
© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID 16
!!FCoE standard complete!!
!!Server platform vendors support FCoE IBM, HP and Dell are shipping FCoE switches and adapters today
!!All major ecosystem players support FCoE
!!Second generation Converged Network Adapters (CNAs) announced with broad platform support
Unified Fabric Adoption is Accelerating!!
© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID 17
CNA Technology Rapidly Evolving
First generation Mid-2008
Second generation Mid-2009 Near future
•!Multiple components •!Full height/lenght •!Single chip
•!Half height/length •!Less than half the
power
And other NIC vendors
Brings the economy of scale of Ethernet to SAN
© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID 18
PCIe
Ethernet 10G
bE
10GbE
Link
PCIe
Fibre Channel
HB
A
HB
A
Link
SCSI Drivers Ethernet Drivers
Operating System
Fibre Channel Drivers
Ethernet Drivers
Operating System
PCIe
Fibre Channel
Ethernet 10G
bEE
10GbEE
Link
CNA: Converged Network Adapter LAN CNA HBA
SCSI Drivers
•! CNA is a multi-function x8 PCIe device
•! Available as rack server add-in card or blade server mezzanine
•! Can also be called an FCoE capable NIC
© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID
Total Cost or Ownership for N5000
Consolidate I/O •! Eliminate adapter and
switch ports •! Eliminate cables •! Avoid air dams •! Reduce cable
maintenance •! Reduce power
Standardize I/O •! Standard server
configuration •! Enhance server
consolidation •! Enhance storage
consolidation
SAN Edge
LAN Access
Server
Management
Production Active Production Standby
Clustering
SAN A SAN B
Backup
© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID
Life-cycle Costs of Cabling
!! Cost of Installation Cabling within rack may be up to $200 per cable Cabling to patch panel may be up to $600 per cable depending on labor rates and state of cable infrastructure
!! Cost of bundling Thick cable bundles may impede airflow 10% to 15% additional airflow (100 racks at 4KW/hr per rack x 10% = $25K per year
!! Cost of abandoned cable Decommissioned cable often left in place Bulk adds over time causing airflow and service problems Fewer initial cables control problem
© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID
Unified Fabric is Accepted by Users
!! HealthCare Provider: 67% reduction in adapters and cabling, 41% power reduction, 7.2% increase in server capacity, >$1M capital costs savings
!! Defense: Reduced power, easier management, reduced total number of managed devices, quick provisioning of new servers
!! Web Hosting provider: Consolidating devices and simplifying data center infrastructure
!! Services Provider: 66% reduction in devices
!! Global Law Firm: Less hardware, less cable management, 100% connectivity of servers to SAN
!! Intel: 25% lower costs with equivalent throughput
!! LA County: reduced cable count
© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID 22
Deployment Requirements: !! Out of Power – Needed to reduce power consumption
!! Needed cost-effective solution
!! Overhead Cables too heavy – Needed to reduce weight of cabling
Why St. Joseph selected a Nexus ToR design:
!! ToR design eliminates overhead Cat6A bundles, reducing cabling costs by 95%
!! Nexus 2K/5K ToR allowed overall cost reduction of $2.05 million (66%) in cabling and hardware versus Traditional EoR Design
!! Maximizes cooling efficiency -- Reduced power requirements by 34%
!! Best Space Utilization
•! St. Joseph Health System is a not-for-profit Catholic health care system established in 1982.
•! SJHS is an industry leader in providing quality care. Ten of its hospitals and health entities received scores of 90 or better from the Joint Commission.
•! 2007 Net Revenue of $3.69 billion.
St. Joseph Health System Savings Through Nexus 2K+5K ToR Design
vPC vPC
© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID 23
St. Joseph Health System Savings Through Nexus ToR Design
* Projected savings
© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID 24
University of Arizona Nexus 5000 FCoE Deployment
Deployment Requirements: !! More Capacity to support higher traffic out of new Enterprise
databases
!! Higher bandwidth out of servers needed due to increased virtualization (VMware ESX with about 20 Virtual Machines per physical server)
Why University of Arizona selected Nexus 5000:
!! Capital cost savings: "The converged Ethernet and SAN networks reduced our upfront capital outlay by 50 percent, or $600,000, when compared to our previous architecture. Factors in the savings include switch port consolidation, using converged network adapters (CNAs) instead of separate network interface cards (NICs) and host bust adapters (HBAs), and reduced cabling.
!! Simplified Cable management: "Deploying the Cisco Nexus 5010 Switch top of rack reduced the homerun cable count from an average of 80 per rack to two, and intra-rack cable count from an average of four per server to two,". Not having to deal with that tangled web of cabling is dramatically reducing manpower requirements.“
!! Reduced power consumption and cooling efficiency: Consolidation has reduced power consumption per port by 30 percent, supporting the university's commitment to environmental sustainability. The reduction in cabling bulk has improved airflow, reducing server temperatures and the load on cooling systems. "In addition, front-to-back airflow in Cisco Nexus 5010 Switches enables proper hot aisle/cold aisle layout," Masseth says.
•! The University of Arizona was the first university in the state, founded in 1885
•! As of Fall 2007, total enrollment at the university was 36,733 students
Customer Feedback
“…the Nexus helped us drive the kind of server density and server connectivity
and throughput that we knew we would need when deploying these new systems
at a dramatically reduced cost and complexity.”
Derrick Masseth, University of Arizona Senior Director for Infrastructure Services
© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID 25
Cisco IT Nexus 5000 FCoE Deployment
Deployment Requirements: !! Additional server and storage capacity for crucial
corporate applications
!! Maximize utilization of space and minimize demand for power and cooling
Why Cisco IT selected Nexus 5000: !! Unified I/O frees up rack space, enabling a 30%
increase in server density ($1.8 million/year in savings at full deployment)
!! Unified Fabric significantly decreases required number of adapters, switches, and power. Cabling cost reduced 40% ($1.1 million in savings)
!! Led to 1/3 more power available to support servers without increasing overall power capacity
!! Ability to support increased computing capacity at a decreased power load extends data center life 12-18 months, saving $4-6 million in deferred investment
"This approach to reducing power demand could eventually provide as much as a 150 percent increase in the number of servers that can be operated in a facility. Further scale is possible with increasing virtual server deployments and improved storage utilization.“
-Mike Norman, Director, Cisco IT
Comparison of Power Distribution in a Data Center
© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID 26
Unified Fabric in the Real World New Cisco Data Center design with FCoE, implemented
in Mt. View CA Benefit to 1MW DC
Background Advantage
40% reduction in new cable infrastructure cost
Fewer cables deployed reduces total cable material and installation costs. Cables reduced 75%.
$1.1M savings
47% reduction in number of data center racks
Unified I/O cable count reduced 79%. Rack space freed up and air dams eliminated. Enables a 30% increase in server density. Rack space valued at $2500/rack/month
$1.8M/yr at full deployment
Data center life extended 12-18 months, deferring $100M investment
Replacement of older technology and lower power requirement of Unified Fabric enable 30% more server capacity in data center (720 to 1000 servers). 20-30% power reduction realized.
$4M to $6M
© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID 27
Nexus 2000 Fabric Extender Virtual Chassis
The Nexus 2000 Fabric Extender (FEX) acts as a remote linecard for the Nexus 5000, retaining all centralized management and configuration on the Nexus 5000, transforming it into a Virtualized Chassis
Nexus 5000 Virtualized chassis
+ Nexus 5000
Nexus 2000 Fabric Extender
=
© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID 28
Nexus 2000 Fabric Extender 1GE Connectivity
48 x 1 GE interfaces 4 x 10 GE interfaces
Beacon and status LEDs
Redundant, hot-swappable power supplies
Hot-swappable fan tray
© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID 29
Fabric Extender: Virtualized Access-Layer
!"#$%&' !"#$%('
)*+,-".*/01'2##033'4"50+'
60+70+3'
8*3,+*9-:;<'4"50+'
4('4&'
7=>'
!"#$%?'
?0@-3'&AAA''B"9+*#'
C@,0<10+'
!! Cisco Nexus 2148T Fabric Extender and Nexus 5000 provide a Flexible Access Solution
!! De-Coupling of the Layer 1 and Layer 2 Topologies !! Optimization of both Layer 1 (Cabling) and Layer 2
(Spanning Tree) Designs
•! Provides for simultaneous support of EoR, MoR and ToR
DC'!"#$'
60+70+3'
7=>' ?0@-3'EFGH'
IADC'!"#$'
60+70+3'
© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID 30
Nexus 2000 Fabric Extender Deployment Options
Nex
us 5
000
Nex
us 2
000
Fabr
ic E
xten
der
•! Deployment optimized for server connectivity •!Combines benefits of ToR and EoR •!First of a family •!No FCoE support •! Up to 12 FEX per N5K •! N5K-N2K Distance limitation: 300m (due to internal PFC)
Switch Fabric + Control Plane + Network level and Server level HA
Switch Fabric + Network level and Server level HA
© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID 31
Data Center Access Architecture Virtualized Access Switch High Availability Models
vPC Peer Link
Host MCEC
MCEC – Running between Single Supervisor Based Virtual Switches
Dual Supervisor Based Virtual Switches
Switch Fabric + Control Plane + Network level and Server level HA
Switch Fabric + Network level and Server level HA
vPC Peer Links
N2K MCEC
© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID 32
Server Virtualization Issues
1. vMotion moves VMs across physical ports—the network policy must follow
2. Impossible to view or apply network policy to locally switched traffic
3. Need collaboration between network and server admin
VLAN 101
vCenter
Cisco CLI (NX-OS)
© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID
!!Virtual machine aware network services
!!VN-Link refers to a literal link between a VM VNIC & a Cisco VN-Link Switch
!!Virtual Network Link (VN-Link) VM-level network granularity Mobility of network and security properties (follow the VM)
Policy-based configuration of VM interfaces (Port Profiles)
!!VN-Link with Nexus 1000V Replaces Hypervisor switch with Cisco modular switch (software)
Cisco Nexus 1000V Cisco Virtual Network Link – VN-Link
Hypervisor
NIV VN-Link Initiator
VNIC
VETH
© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID
Cisco Nexus 1000V
!! Industry’s first 3rd-party vNetwork Distributed Switch for VMware vSphere
!! Built on Cisco NX-OS !! Compatible with all switching platforms !! Maintain vCenter provisioning model
unmodified for server administration; allow network administration of virtual network via familiar Cisco NX-OS CLI
vSphere
© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID 35
Cisco Nexus 1000V
vSphere vSphere
© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID 36
Cisco Nexus 1000V Architecture
Nexus 1000V VSM
vSphere vSphere vSphere
Nexus 1000V VEM
© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID
Flexible Deployment Options
!!All servers on VMware Compatibility List
!!All switches, including all Cisco switches
!! 1G & 10G NICs
© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID 38
100s of Companies Use Nexus 1000V
University of Arizona
© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID 39
Nexus 5000/2000 Deployment Scenarios Uniform Access Platform for All DC Deployments
Virtual Machine Environments
VMotion
10 GbE 10 GbE DCE Fibre Channel
SAN A LAN SAN B LAN
FCoE
High Performance Compute 1/10GE L2 Datacenter and Enterprise
Unified Fabric over Ethernet
10 GbE 10 GbE DCE Fibre Channel 10 GbE FCoE/DCE
SAN B LAN SAN A LAN
MDS Nexus Catalyst
Nexus 5000
HPC
10 GbE 10 GbE DCE Fibre Channel FCoE
High Performance Cluster
High Performance Cluster Network
High Performance
Cluster
N2000 N2000 N5000
10GE Servers 1GE
Servers 1GE
Servers
N7000 or C6500
10GE
1GE
Nexus 5000
Nexus 5000
© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID
Nexus 5000
LAN
1GE
10GE
Virtu
aliz
atio
n Acc
ess
A
ggre
gatio
n
1GE N2000 FEX
10GE N2000 FEX
Blades
Ser
ver
Nexus 7000
10GE
FCoE
SAN
10GE FC
FCoE 10GE
Nexus 5K/2K/1K Deployment Scenarios Nexus – Virtualized Access
!! Virtualized Access
!! Fabric Extender !! Software and
Hardware Based VN-Link
!! 10G Unified I/O – FCoE
!! Low-latency, high performance
!! 1G connectivity
© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID 41
© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID
References
© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID 43
The Nexus Family Has Been Warmly Received…
“The Cisco Nexus 5000 brings a completely new technology to network consolidation…with a price that drubs
the competition, a small 2U form factor, great scalability, and unrivaled speed
and latency.” InfoWorld
“Cisco’s biggest switch, called the Nexus 7000, sits above them all,
unifying a computer center's crazy quilt of engineering standards into a
layer of control…” Forbes
Nexus 1000V
Nexus 7000
Nexus Family
Nexus 5000
© 2009 Cisco Systems, Inc. All rights reserved.
© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID 44
Deployment Requirements: !! Out of Power – Needed to reduce power consumption
!! Needed cost-effective solution
!! Overhead Cables too heavy – Needed to reduce weight of cabling
Why St. Joseph selected a Nexus ToR design:
!! ToR design eliminates overhead Cat6A bundles, reducing cabling costs by 95%
!! Nexus 2K/5K ToR allowed overall cost reduction of $2.05 million (66%) in cabling and hardware versus Traditional EoR Design
!! Maximizes cooling efficiency -- Reduced power requirements by 34%
!! Best Space Utilization
•! St. Joseph Health System is a not-for-profit Catholic health care system established in 1982.
•! SJHS is an industry leader in providing quality care. Ten of its hospitals and health entities received scores of 90 or better from the Joint Commission.
•! 2007 Net Revenue of $3.69 billion.
St. Joseph Health System Savings Through Nexus 2K+5K ToR Design
vPC vPC
© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID 45
St. Joseph Health System Savings Through Nexus ToR Design
* Projected savings
© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID 46
The Planet
!! 30% decrease in bandwidth cost per server
!! Increased capacity for shared storage service and new revenue
streams !! Foundation for new services without requiring major upgrades
!! Unified Fabric for cost-effective upgrade to10GB Ethernet !! Increased capacity
!! Testing completed in 2 weeks !! ‘Dropped’ into production without
affecting other systems or workloads
!! Increase bandwidth to support hosting services !! Deliver new bandwidth-intensive services
!!Minimize CapEx and OpEx !! Deploy solution rapidly and cost-effectively
Challenge
Benefits Solution: Cisco Nexus 5000
© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID
NetApp Nexus 2000/5000 Deployment
Deployment Requirements: !! Support for 10 Gigabit Ethernet connectivity
!! Minimize equipments costs, management overhead, and energy consumption through virtualization
!! FCoE support for future consolidation of data and storage networks
Why NetApp selected Nexus 5000: !! Nexus 5000 Unified Fabric and Virtualization features
!! Cost-effective scalability through additional Nexus 2148 fabric extenders for GE connectivity.
!! A single point of management for the 2148 Fabric Extenders through the Nexus 5010 switch
!! Excellent application performance with low latency 10GbE
•! NetApp is a global company with ~8000 employees and over $4 billion in revenues
•! NetApp creates innovative storage and data management solutions
•! NetApp ranks third in market capitalization in the Data Storage Devices industry
1GE Capable Servers
Nexus 2148s
Nexus 5Ks
Nexus 7Ks
Catalyst Core
© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID 48
Cisco IT Nexus 5000 FCoE Deployment
Deployment Requirements: !! Additional server and storage capacity for crucial
corporate applications
!! Maximize utilization of space and minimize demand for power and cooling
Why Cisco IT selected Nexus 5000: !! Unified I/O frees up rack space, enabling a 30%
increase in server density ($1.8 million/year in savings at full deployment)
!! Unified Fabric significantly decreases required number of adapters, switches, and power. Cabling cost reduced 40% ($1.1 million in savings)
!! Led to 1/3 more power available to support servers without increasing overall power capacity
!! Ability to support increased computing capacity at a decreased power load extends data center life 12-18 months, saving $4-6 million in deferred investment
"This approach to reducing power demand could eventually provide as much as a 150 percent increase in the number of servers that can be operated in a facility. Further scale is possible with increasing virtual server deployments and improved storage utilization.“
-Mike Norman, Director, Cisco IT
Comparison of Power Distribution in a Data Center
© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID 49
University of Arizona Nexus 5000 FCoE Deployment
Deployment Requirements: !! More Capacity to support higher traffic out of new
Enterprise databases
!! Higher bandwidth out of servers needed due to increased virtualization (VMware ESX with about 20 Virtual Machines per physical server)
Why University of Arizona selected Nexus 5000:
!! Cost analysis for converged LAN/SAN with FCoE between CNA’s and Nexus 5010s revealed a 50% cost savings vs. separated LAN/SAN infrastructure
!! Consolidation to 10GbE connections reduced need for cables, adaptors, switch ports, etc
!! Investment protection for existing native FC storage infrastructure while supporting end-to-end FCoE with future EMC FCoE-capable storage targets
•! The University of Arizona was the first university in the state, founded in 1885
•! As of Fall 2007, total enrollment at the university was 36,733 students
Customer Feedback
“…the Nexus helped us drive the kind of server density and server connectivity
and throughput that we knew we would need when deploying these new systems
at a dramatically reduced cost and complexity.”
Derrick Masseth, University of Arizona Senior Director for Infrastructure Services
© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID 50
Life Technologies Corporation Nexus 5000 Deployment
Deployment Requirements: !! High performance
!! Low latency
!! Ease of implementation and management
!! Low price
Why Life Technologies selected Nexus 5000:
!! Nexus 5K’s low latency allowed for an accelerated data refresh rate
!! Front-to-back airflow and rear-facing server ports allow for simplified cabling
!! Minimal training (only one day needed) due to NX-OS’s similarity to Cisco IOS Software
!! Rapid deployment was made possible through Advanced Services’ validated switch configurations
•! Life Technologies was created by the merger of Invitrogen and Applied Biosystems in November 2008
•! Life Technologies has historical sales of over $3 billion, employs 9,500 people, and owns over 3,600 patents
•! The global biotechnology tools company is dedicated to improving the human condition by helping its customers accelerate scientific exploration.
“The Cisco Nexus 5020 Switch accelerated daily analysis of our business information
from seven hours to two. This helps finance and marketing executives make decisions based on current information.”
Customer Feedback
© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID
Lawrence Livermore National Lab (LLNL) Nexus 2000/5000 Deployment
Deployment Requirements: !! Simplify Data Center Management
!! Support 10 Gigabit Ethernet for future growth
!! Reduce capital and operational costs through optimized virtualization
!! High Availability
Why LLNL selected Nexus 5000: !! High 10GE port density and low cost per port
!! Interoperability with Catalyst 6500 switches
!! Nexus 5000 Unified Fabric and Virtualization features
!! A single point of Management for the Nexus 5000 and all connected 2148 Fabric Extenders
•! LLNL is a national security lab dedicated to applying science and technology to the important issues of our time
•! LLNL is a leader in transforming scientific breakthroughs into solutions for real-world problems
•! Established in 1952 to meet urgent national security needs
“You get few opportunities to build a brand-new data center, and we wanted a design that would help us remain a world-class data center for the next 15 to 20 years.”
Customer Feedback
© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID 52
McDermott Will & Emery (MWE) Nexus 2000/5000 Deployment
Deployment Requirements: !! Bring down costs and complexity through consolidation
of data and storage networks
!! Utilize virtualization to increase utilization and decrease the number of servers needed
!! Provide SAN access to all servers
Why MWE selected Nexus 5000: !! Feature leadership today and tomorrow (FCoE, 10GE,
FEX, L2MP, VN-Link) for their new data center
!! Unified Fabric features to reduce the cost of adapters, cables, power, and cooling by up to 50%
!! Provided benefits of 100% SAN connectivity
!! Optimized Virtualization enabled reduction of physical servers from 300 to 100
•! McDermott Will & Emery is a premier international law firm that represents a wide range of commercial, industrial, and financial enterprises.
•! MWE currently advises more than 60% of the Fortune 100 and over 50% of the Fortune 500.
•! MWE is the world’s 19th largest law firm
Customer Feedback
“Fewer number of HBAs, NICs, switch ports, and lower power requirements
helped cut back on expenses, and when we examined our return on the
investment, what we would get with the Nexus just made sense to me, and my
director wholeheartedly agreed.” Edward Carroll, McDermott Will & Emery
Network Architect
© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID 53
Deployment Requirements: !! Separate management domains to control access to
equipment for increased security
!! Support new trends in Data Center technology
!! Engineer a better HA/DR plan
!! Build an operations center to showcase their equipment and technology.
Why Schneider Electric selected Nexus 5000:
!! As servers consolidate with VMWare, can integrate and manage switches from the Nexus 5000
!! Unified Fabric within data center reduced cabling costs and power consumption for each server
!! Reduced time to bring new servers on line
!! Simplified infrastructure
•! Schneider Electric is an international energy company with a focus on safe and efficient use of Energy in Commercial and private settings.
•! Schneider Electric provides services in the following areas: •! Automation and Control •! Electrical Distribution •! Building Automation and Security •! Data Center Power and Cooling Services
Nexus 5000 Nexus 5000
Nexus 7000s
Catalyst 4948 Catalyst 4948
Schneider Electric Nexus 5000 Deployment
© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID 54
One of Top 6 Energy Corporations Nexus 2000/5000 Deployment
Deployment Requirements: !! 1GE/10GE connectivity to provide architectural
flexibility and investment protection
!! Improve utilization and flexibility through a virtualized data center
!! Faster turnout on compute jobs
Why Customer selected Nexus 5000: !! Low Latency
!! Support for 1GE and 10GE connectivity, allowing easy transition to 10GE using Nexus 2000 and 5000 switches in the near-term
!! High 10 GE port density at a low cost per port – Customer envisions pure 10GE connectivity in the future
•! One of the world’s six “supermajor” oil companies.
•! Corporation had a revenue topping $200 billion in 2008
© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID 55
Purdue University Nexus 5000 Deployment
Deployment Requirements: !! Highly scalable 10GE design to support over 1200
servers
!! Low over-subscription design with non-blocking , wire-rate switches
!! Design that minimizes total cost of ownership
Why Purdue University selected Nexus 5000:
!! Nexus 5000 Pod and Top-of-Rack design minimizes long fibre runs. Utilizes Twin-AX cables to reduce cost
!! High 10GE port density with low cost-per-port
!! Greatly reduces power, cooling, and space requirements
!! Ethernet management reduces cables to two connections per server (one power, one 10GE)
•! Purdue University is a top 10 University in the U.S. for its undergraduate engineering program
•! Nexus products will be used in Purdue’s “Coates Cluster,” tapped as the world’s largest 10Gb Ethernet cluster
320 servers per pod. 32 servers per switch. Each switch uplinked to a pair of
5020 distribution switches.
© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID 56
Terremark Worldwide Inc. Nexus 5000 Deployment
Deployment Requirements: !! Address dynamic nature of customer moves/adds/
changes
!! Provide flexible BW: Fibre Channel, Ethernet without re-cabling or adding new equipment
!! Re-purpose the servers to meet growth
!! Allow customers to select service options and provision services quickly
Why Terremark selected Nexus 5000: !! Nexus 5000 with 10GE port density, unified fabric,
QoS capabilities
!! Nexus 5000 Virtualization features allow for increased flexibility and ease of management
!! Nexus-OS XML capabilities
•! Terremark is a carrier neutral global co-location provider
•! Terremark is a leader in virtualized, VMware based utility computing
•! Top customers: Lego, Akamai, H&R Block, BMW
32 Servers per Pair of Nexus 5000 ToR Switches
Nexus 5K
© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID 57
FamilySearch Nexus 2000/5000 Deployment
Deployment Requirements: !! Large 1Gbps deployment
!! Minimize equipment costs, management overhead, and energy consumption by building a single network
!! Unified Fabric capability for virtualization cluster and consolidation of data and storage networks
Why FamilySearch selected Nexus: !! Nexus 5000 Unified Fabric Capability
!! Reduced cabling costs using the Nexus 2148 ToR design
!! Consistent architecture for GE, 10GE, and Unified Fabric using the Nexus 2148/5000 for server access
!! Simplified management for the data center with the Nexus 2000 & Nexus 5000 combination
!! Cisco End-to-End solution
•! FamilySearch is the largest genealogy organization in the world. Millions of people use FamilySearch records, resources, and services to learn more about their family history
•! For over 100 years, Family Search has been actively gathering, preseving, and sharing genealogical records worldwide.
6000 Hosts, Dual Active Ethernet & 10Gbps UIO Virtualization Cluster
© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID 58
Zuse Institute Berlin (ZIB) Nexus 5000 FCoE Deployment
Deployment Requirements: !! Maximum throughput at the interface between the
Cisco SAN and the Ethernet infrastructure
!! Support for 10 Gigabit Ethernet connectivity
!! Unified Fabric capability for future growth and consolidation of data and storage networks
Why ZIB selected Nexus 5000: !! Unified Fabric allows for flexible development of the IP
and SAN infrastructure.
!! Consolidated data and storage networks will decrease costs for adapters, cabling, and power consumption
!! Cost-effective scalability of data transfer through the increased availability of adapter slots in a server
!! End-to-end redundancy for maximum failure protection
•! ZIB solves urgent problems in science, technology, environment, or society through mathematical analysis
•! The ZIB supercomputer is one of the top computers in Germany
•! As one of two operators of the HLRN supercomputer system, ZIB acts as a service provider for many other scientific institutions.
Customer Feedback
“The [Nexus 5020] switches have increased the throughput at this
bottleneck between the SAN and the 10-gigabit Ethernet network in a particularly
cost-effective way.”
Wolfgang Pyszkalski, Zuse Institute Berlin IT Services Department Manager
© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID 59
Coca-Cola Bottling Co. Consolidated (CCBCC) Nexus 5000 Deployment
Deployment Requirements: !! Reduce power consumption and cooling costs
!! Improve utilization and flexibility through a virtualized data center.
!! Improve Data Recovery Plan
Why CCBCC selected Nexus 5000: !! Nexus 5000 Unified Fabric and Virtualization features
with support for legacy equipment
!! Investment protection
!! Cost Savings on cabling due to consolidated data/storage networks
!! “Quite significant” power and cooling savings.
!! Reduction in switch ports
•! Coca-Cola Bottling Company Consolidated the second largest franchised bottler of Coca-Cola products in the United States.
•! Manages franchise territories with a consumer base of more than 18 million people.
Customer Feedback
“I want to say 30% to 60% cost savings… Any way I stacked it up, it was more cost efficient to go to the FCoE, go to the pod
design, using the Nexus.”