Nexus 5K/2K/1K Update · !!Cabling and Physical Media Changes !!Rapid Growth in Storage Fabric...

59
© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID Aurelie Fonteny, Product Manager Liz Stine, Technical Marketing Engineer Nexus 5K/2K/1K Update

Transcript of Nexus 5K/2K/1K Update · !!Cabling and Physical Media Changes !!Rapid Growth in Storage Fabric...

© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID

Aurelie Fonteny, Product Manager

Liz Stine, Technical Marketing Engineer

Nexus 5K/2K/1K Update

© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID 2 2

Agenda !!Nexus Portfolio

!!Nexus 5000 Overview

!!Nexus 2000 Overview

!!Nexus 1000 Overview

!!Technology: FCoE

© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID

Data Center Evolution Evolving Access Layer & Growing Demands

Increased Complexity and Scope of the Access Layer

!! The Data Center Access Layer is evolving !! High Density Servers with Virtual

Machines !! Migration from 1G to 10G !! Distribution of the Access Layer !! Embedded Blade Switches !! Embedded Virtual Switches

!! Challenges this brings !! Increase in the size of the access

topology (STP growth) !! Cabling and Physical Media

Changes !! Rapid Growth in Storage Fabric

connectivity !! Increase in the number of

management points !! Policy Boundaries !! Power & Cooling

LAN SAN B SAN A Gateway

Data Center SAN

High Performance Computing

Acc

ess

La

yer

HPC

Data Center LAN

© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID 4

Cisco Nexus Family: An Innovative Architecture to Simplify Data Center Transformation

Cost-Effective, 10 Gigabit Ethernet Connectivity Foundation

High Performance Switching

Performance

Data Center Ethernet

Scalability

Unified Fabric over 10GE - FCoE - iSCSI - HPC

Consolidation

VM-Optimized Services

Virtualization

Standards

Simplified operations

Operations

© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID 5

Evolution of Ethernet Physical Media Role of Transport in Enabling 10GE Technology

10GE Copper Solution •! Low cost •! Low power and latency •! Up to 5 meters (in-rack and adjacent rack cabling)

Cable Transceiver Latency

Power (each side) Distance Technology

Twinax ~0.25µµs ~0.1W 5m SFP+ CU Copper

MM OM1 MM OM3 ~0.1µµs 1W 33m

300m SFP+ SR short reach

MM OM2 MM OM3 ~0.1µµs 1W 26m

100m SFP+ USR

ultra short reach SR compatable

Cat6a/7 Cat6a/7

2.5µµs 1.5µµs

~8W ~4W

100m 30m 10GBASE-T

SFP+ Cu SFP+ to SFP+

© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID 6 6

Per

form

ance

520G

Nexus 5010

Nexus 7010

1Tb/s

Nexus 5020

Nexus 2000

Nexus 7018

VM

Nexus 1000V

NX-OS

Fabric Extender

Cisco Nexus Data Center Portfolio Today

Density

VN-Link

15Tb/s

7.5Tb/s

© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID

Nexus in the Data Center

N7000

N5000

N2000

1G and 10GE Rack Mount Servers

1G and 10GE Blade Servers

Pass-Thru

10GE Blade N4K - DCB Blade Switch

VM

VM

VM

VM VM VM

NEXUS 1000v

VM

VM

VM

VM VM VM

NEXUS 1000v

N1000

N4000

© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID

Nexus 5000 Overview

!! Purpose-built as a LAN switch, architected for Unified Fabric

!! Up to 1.04Tbps switching capacity, 773.8Mpps

!! Wire-rate, low latency, Layer2 switch

!! High density 10GE, some 1GE ports for migration

!! Unified lossless fabric

!! High Availability

!! Front-to-back cooling

!! NX-OS modular Operating System

* FC ports are SFP

© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID 9

Broad Customer Traction Nexus 5000/2000 Series is Proven

Nexus 5020 Nexus 5010 Nexus 2000

2008 2009

"!1000+ customers "!450,000+ 1GE ports shipped "!150,000+ 10GE ports shipped "!23% N5K have FCoE licences

attached

Vertical Customer Education Purdue University, University of

Arizona, Zuse Institute Berlin, University of Maryland, Technische Universitat Chemnitz

Healthcare Molina Healthcare

Manufacturing Coca-Cola, Schneider Electric

Research, HPC Lawrence Livermore National Lab Technology Cisco IT, BMC Software Service Provider The Planet, Terremark Law McDermott Will & Emery Government Stadt Pforzheim

© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID 10

Nexus 5000 Overview

Expansion Module Slots

Power Entry

Base 10GE 10/100/1000 Out of Band Mgmt

1/10GbE Capable Ports

Nex

us 5

020

Nex

us 5

010 Native 4GFC

FC Ports

10GE Ports

Expansion Modules

Native 8GFC FC Ports

© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID

Nexus 5000 Overview Physical Redundancy

!!1:1 Power Redundancy Hot Swappable Redundancy at 100-120V & 200-240V

!!N+1 Fan Redundancy Hot Swappable

Redundant FANs Redundant Power

© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID 12

Data Center Access Architecture vPC - Multichassis EtherChannel

!! vPC is a Port-channeling concept extending link aggregation to two separate physical switches

!! Allows the creation of resilient L2 topologies based on Link Aggregation.

!! Enables loop free Layer 2 topologies with physical network redundancy

!! Provides increased bandwidth

!! All links are actively forwarding

!! vPC maintains independent control planes

Virtual Port Channel

L2

Increased BW with vPC

Non-vPC vPC

Physical Topology Logical Topology

© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID 13

Acc

ess

La

yer

Ethernet FC Application Clusters

•! Data Center Compute •! Application Clusters •! Data Center Storage

LAN SAN B SAN A

Cluster

LAN

SAN B

SAN A

Unified Fabric Access Layer

Clusters

Nexus 5000

CNA CNA

•! Data Center Compute •! Application Clusters •! Data Center Storage

CNA Ethernet/DCE FC Application Clusters

Ethernet/DCE/FCoE

Servers

Access Layer Consolidation in the Data Center

© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID

Ethernet FC Application Clusters

•! Data Center Compute •! Application Clusters •! Data Center Storage

LAN SAN B SAN A

Cluster

LAN

SAN B

SAN A

Unified Fabric Access Layer

Clusters

CNA CNA

•! Data Center Compute •! Application Clusters •! Data Center Storage

CNA Ethernet/DCE FC Application Clusters

Ethernet/DCE/FCoE

Servers

SAN Connectivity

© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID

FCoE Advantages

FCoE is managed like FC at initiator, target, and switch level

!!Same Operational Model

!!Same Techniques of Traffic Management

!!Same Management and Security Models

!!Easy to Understand

!!Completely based on the FC model

!! Same host-to-switch and switch-to-switch behavior as FC

!! e.g. in order delivery, FSPF load balancing

!! WWNs, FC-IDs, hard/soft zoning, DNS, RSCN

FCoE is Fibre Channel

© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID 16

!!FCoE standard complete!!

!!Server platform vendors support FCoE IBM, HP and Dell are shipping FCoE switches and adapters today

!!All major ecosystem players support FCoE

!!Second generation Converged Network Adapters (CNAs) announced with broad platform support

Unified Fabric Adoption is Accelerating!!

© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID 17

CNA Technology Rapidly Evolving

First generation Mid-2008

Second generation Mid-2009 Near future

•!Multiple components •!Full height/lenght •!Single chip

•!Half height/length •!Less than half the

power

And other NIC vendors

Brings the economy of scale of Ethernet to SAN

© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID 18

PCIe

Ethernet 10G

bE

10GbE

Link

PCIe

Fibre Channel

HB

A

HB

A

Link

SCSI Drivers Ethernet Drivers

Operating System

Fibre Channel Drivers

Ethernet Drivers

Operating System

PCIe

Fibre Channel

Ethernet 10G

bEE

10GbEE

Link

CNA: Converged Network Adapter LAN CNA HBA

SCSI Drivers

•! CNA is a multi-function x8 PCIe device

•! Available as rack server add-in card or blade server mezzanine

•! Can also be called an FCoE capable NIC

© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID

Total Cost or Ownership for N5000

Consolidate I/O •! Eliminate adapter and

switch ports •! Eliminate cables •! Avoid air dams •! Reduce cable

maintenance •! Reduce power

Standardize I/O •! Standard server

configuration •! Enhance server

consolidation •! Enhance storage

consolidation

SAN Edge

LAN Access

Server

Management

Production Active Production Standby

Clustering

SAN A SAN B

Backup

© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID

Life-cycle Costs of Cabling

!! Cost of Installation Cabling within rack may be up to $200 per cable Cabling to patch panel may be up to $600 per cable depending on labor rates and state of cable infrastructure

!! Cost of bundling Thick cable bundles may impede airflow 10% to 15% additional airflow (100 racks at 4KW/hr per rack x 10% = $25K per year

!! Cost of abandoned cable Decommissioned cable often left in place Bulk adds over time causing airflow and service problems Fewer initial cables control problem

© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID

Unified Fabric is Accepted by Users

!! HealthCare Provider: 67% reduction in adapters and cabling, 41% power reduction, 7.2% increase in server capacity, >$1M capital costs savings

!! Defense: Reduced power, easier management, reduced total number of managed devices, quick provisioning of new servers

!! Web Hosting provider: Consolidating devices and simplifying data center infrastructure

!! Services Provider: 66% reduction in devices

!! Global Law Firm: Less hardware, less cable management, 100% connectivity of servers to SAN

!! Intel: 25% lower costs with equivalent throughput

!! LA County: reduced cable count

© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID 22

Deployment Requirements: !! Out of Power – Needed to reduce power consumption

!! Needed cost-effective solution

!! Overhead Cables too heavy – Needed to reduce weight of cabling

Why St. Joseph selected a Nexus ToR design:

!! ToR design eliminates overhead Cat6A bundles, reducing cabling costs by 95%

!! Nexus 2K/5K ToR allowed overall cost reduction of $2.05 million (66%) in cabling and hardware versus Traditional EoR Design

!! Maximizes cooling efficiency -- Reduced power requirements by 34%

!! Best Space Utilization

•! St. Joseph Health System is a not-for-profit Catholic health care system established in 1982.

•! SJHS is an industry leader in providing quality care. Ten of its hospitals and health entities received scores of 90 or better from the Joint Commission.

•! 2007 Net Revenue of $3.69 billion.

St. Joseph Health System Savings Through Nexus 2K+5K ToR Design

vPC vPC

© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID 23

St. Joseph Health System Savings Through Nexus ToR Design

* Projected savings

© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID 24

University of Arizona Nexus 5000 FCoE Deployment

Deployment Requirements: !! More Capacity to support higher traffic out of new Enterprise

databases

!! Higher bandwidth out of servers needed due to increased virtualization (VMware ESX with about 20 Virtual Machines per physical server)

Why University of Arizona selected Nexus 5000:

!! Capital cost savings: "The converged Ethernet and SAN networks reduced our upfront capital outlay by 50 percent, or $600,000, when compared to our previous architecture. Factors in the savings include switch port consolidation, using converged network adapters (CNAs) instead of separate network interface cards (NICs) and host bust adapters (HBAs), and reduced cabling.

!! Simplified Cable management: "Deploying the Cisco Nexus 5010 Switch top of rack reduced the homerun cable count from an average of 80 per rack to two, and intra-rack cable count from an average of four per server to two,". Not having to deal with that tangled web of cabling is dramatically reducing manpower requirements.“

!! Reduced power consumption and cooling efficiency: Consolidation has reduced power consumption per port by 30 percent, supporting the university's commitment to environmental sustainability. The reduction in cabling bulk has improved airflow, reducing server temperatures and the load on cooling systems. "In addition, front-to-back airflow in Cisco Nexus 5010 Switches enables proper hot aisle/cold aisle layout," Masseth says.

•! The University of Arizona was the first university in the state, founded in 1885

•! As of Fall 2007, total enrollment at the university was 36,733 students

Customer Feedback

“…the Nexus helped us drive the kind of server density and server connectivity

and throughput that we knew we would need when deploying these new systems

at a dramatically reduced cost and complexity.”

Derrick Masseth, University of Arizona Senior Director for Infrastructure Services

© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID 25

Cisco IT Nexus 5000 FCoE Deployment

Deployment Requirements: !! Additional server and storage capacity for crucial

corporate applications

!! Maximize utilization of space and minimize demand for power and cooling

Why Cisco IT selected Nexus 5000: !! Unified I/O frees up rack space, enabling a 30%

increase in server density ($1.8 million/year in savings at full deployment)

!! Unified Fabric significantly decreases required number of adapters, switches, and power. Cabling cost reduced 40% ($1.1 million in savings)

!! Led to 1/3 more power available to support servers without increasing overall power capacity

!! Ability to support increased computing capacity at a decreased power load extends data center life 12-18 months, saving $4-6 million in deferred investment

"This approach to reducing power demand could eventually provide as much as a 150 percent increase in the number of servers that can be operated in a facility. Further scale is possible with increasing virtual server deployments and improved storage utilization.“

-Mike Norman, Director, Cisco IT

Comparison of Power Distribution in a Data Center

© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID 26

Unified Fabric in the Real World New Cisco Data Center design with FCoE, implemented

in Mt. View CA Benefit to 1MW DC

Background Advantage

40% reduction in new cable infrastructure cost

Fewer cables deployed reduces total cable material and installation costs. Cables reduced 75%.

$1.1M savings

47% reduction in number of data center racks

Unified I/O cable count reduced 79%. Rack space freed up and air dams eliminated. Enables a 30% increase in server density. Rack space valued at $2500/rack/month

$1.8M/yr at full deployment

Data center life extended 12-18 months, deferring $100M investment

Replacement of older technology and lower power requirement of Unified Fabric enable 30% more server capacity in data center (720 to 1000 servers). 20-30% power reduction realized.

$4M to $6M

© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID 27

Nexus 2000 Fabric Extender Virtual Chassis

The Nexus 2000 Fabric Extender (FEX) acts as a remote linecard for the Nexus 5000, retaining all centralized management and configuration on the Nexus 5000, transforming it into a Virtualized Chassis

Nexus 5000 Virtualized chassis

+ Nexus 5000

Nexus 2000 Fabric Extender

=

© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID 28

Nexus 2000 Fabric Extender 1GE Connectivity

48 x 1 GE interfaces 4 x 10 GE interfaces

Beacon and status LEDs

Redundant, hot-swappable power supplies

Hot-swappable fan tray

© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID 29

Fabric Extender: Virtualized Access-Layer

!"#$%&' !"#$%('

)*+,-".*/01'2##033'4"50+'

60+70+3'

8*3,+*9-:;<'4"50+'

4('4&'

7=>'

!"#$%?'

?0@-3'&AAA''B"9+*#'

C@,0<10+'

!! Cisco Nexus 2148T Fabric Extender and Nexus 5000 provide a Flexible Access Solution

!! De-Coupling of the Layer 1 and Layer 2 Topologies !! Optimization of both Layer 1 (Cabling) and Layer 2

(Spanning Tree) Designs

•! Provides for simultaneous support of EoR, MoR and ToR

DC'!"#$'

60+70+3'

7=>' ?0@-3'EFGH'

IADC'!"#$'

60+70+3'

© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID 30

Nexus 2000 Fabric Extender Deployment Options

Nex

us 5

000

Nex

us 2

000

Fabr

ic E

xten

der

•! Deployment optimized for server connectivity •!Combines benefits of ToR and EoR •!First of a family •!No FCoE support •! Up to 12 FEX per N5K •! N5K-N2K Distance limitation: 300m (due to internal PFC)

Switch Fabric + Control Plane + Network level and Server level HA

Switch Fabric + Network level and Server level HA

© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID 31

Data Center Access Architecture Virtualized Access Switch High Availability Models

vPC Peer Link

Host MCEC

MCEC – Running between Single Supervisor Based Virtual Switches

Dual Supervisor Based Virtual Switches

Switch Fabric + Control Plane + Network level and Server level HA

Switch Fabric + Network level and Server level HA

vPC Peer Links

N2K MCEC

© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID 32

Server Virtualization Issues

1. vMotion moves VMs across physical ports—the network policy must follow

2. Impossible to view or apply network policy to locally switched traffic

3. Need collaboration between network and server admin

VLAN 101

vCenter

Cisco CLI (NX-OS)

© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID

!!Virtual machine aware network services

!!VN-Link refers to a literal link between a VM VNIC & a Cisco VN-Link Switch

!!Virtual Network Link (VN-Link) VM-level network granularity Mobility of network and security properties (follow the VM)

Policy-based configuration of VM interfaces (Port Profiles)

!!VN-Link with Nexus 1000V Replaces Hypervisor switch with Cisco modular switch (software)

Cisco Nexus 1000V Cisco Virtual Network Link – VN-Link

Hypervisor

NIV VN-Link Initiator

VNIC

VETH

© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID

Cisco Nexus 1000V

!! Industry’s first 3rd-party vNetwork Distributed Switch for VMware vSphere

!! Built on Cisco NX-OS !! Compatible with all switching platforms !! Maintain vCenter provisioning model

unmodified for server administration; allow network administration of virtual network via familiar Cisco NX-OS CLI

vSphere

© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID 35

Cisco Nexus 1000V

vSphere vSphere

© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID 36

Cisco Nexus 1000V Architecture

Nexus 1000V VSM

vSphere vSphere vSphere

Nexus 1000V VEM

© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID

Flexible Deployment Options

!!All servers on VMware Compatibility List

!!All switches, including all Cisco switches

!! 1G & 10G NICs

© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID 38

100s of Companies Use Nexus 1000V

University of Arizona

© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID 39

Nexus 5000/2000 Deployment Scenarios Uniform Access Platform for All DC Deployments

Virtual Machine Environments

VMotion

10 GbE 10 GbE DCE Fibre Channel

SAN A LAN SAN B LAN

FCoE

High Performance Compute 1/10GE L2 Datacenter and Enterprise

Unified Fabric over Ethernet

10 GbE 10 GbE DCE Fibre Channel 10 GbE FCoE/DCE

SAN B LAN SAN A LAN

MDS Nexus Catalyst

Nexus 5000

HPC

10 GbE 10 GbE DCE Fibre Channel FCoE

High Performance Cluster

High Performance Cluster Network

High Performance

Cluster

N2000 N2000 N5000

10GE Servers 1GE

Servers 1GE

Servers

N7000 or C6500

10GE

1GE

Nexus 5000

Nexus 5000

© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID

Nexus 5000

LAN

1GE

10GE

Virtu

aliz

atio

n Acc

ess

A

ggre

gatio

n

1GE N2000 FEX

10GE N2000 FEX

Blades

Ser

ver

Nexus 7000

10GE

FCoE

SAN

10GE FC

FCoE 10GE

Nexus 5K/2K/1K Deployment Scenarios Nexus – Virtualized Access

!! Virtualized Access

!! Fabric Extender !! Software and

Hardware Based VN-Link

!! 10G Unified I/O – FCoE

!! Low-latency, high performance

!! 1G connectivity

© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID 41

© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID

References

© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID 43

The Nexus Family Has Been Warmly Received…

“The Cisco Nexus 5000 brings a completely new technology to network consolidation…with a price that drubs

the competition, a small 2U form factor, great scalability, and unrivaled speed

and latency.” InfoWorld

“Cisco’s biggest switch, called the Nexus 7000, sits above them all,

unifying a computer center's crazy quilt of engineering standards into a

layer of control…” Forbes

Nexus 1000V

Nexus 7000

Nexus Family

Nexus 5000

© 2009 Cisco Systems, Inc. All rights reserved.

© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID 44

Deployment Requirements: !! Out of Power – Needed to reduce power consumption

!! Needed cost-effective solution

!! Overhead Cables too heavy – Needed to reduce weight of cabling

Why St. Joseph selected a Nexus ToR design:

!! ToR design eliminates overhead Cat6A bundles, reducing cabling costs by 95%

!! Nexus 2K/5K ToR allowed overall cost reduction of $2.05 million (66%) in cabling and hardware versus Traditional EoR Design

!! Maximizes cooling efficiency -- Reduced power requirements by 34%

!! Best Space Utilization

•! St. Joseph Health System is a not-for-profit Catholic health care system established in 1982.

•! SJHS is an industry leader in providing quality care. Ten of its hospitals and health entities received scores of 90 or better from the Joint Commission.

•! 2007 Net Revenue of $3.69 billion.

St. Joseph Health System Savings Through Nexus 2K+5K ToR Design

vPC vPC

© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID 45

St. Joseph Health System Savings Through Nexus ToR Design

* Projected savings

© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID 46

The Planet

!! 30% decrease in bandwidth cost per server

!! Increased capacity for shared storage service and new revenue

streams !! Foundation for new services without requiring major upgrades

!! Unified Fabric for cost-effective upgrade to10GB Ethernet !! Increased capacity

!! Testing completed in 2 weeks !! ‘Dropped’ into production without

affecting other systems or workloads

!! Increase bandwidth to support hosting services !! Deliver new bandwidth-intensive services

!!Minimize CapEx and OpEx !! Deploy solution rapidly and cost-effectively

Challenge

Benefits Solution: Cisco Nexus 5000

© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID

NetApp Nexus 2000/5000 Deployment

Deployment Requirements: !! Support for 10 Gigabit Ethernet connectivity

!! Minimize equipments costs, management overhead, and energy consumption through virtualization

!! FCoE support for future consolidation of data and storage networks

Why NetApp selected Nexus 5000: !! Nexus 5000 Unified Fabric and Virtualization features

!! Cost-effective scalability through additional Nexus 2148 fabric extenders for GE connectivity.

!! A single point of management for the 2148 Fabric Extenders through the Nexus 5010 switch

!! Excellent application performance with low latency 10GbE

•! NetApp is a global company with ~8000 employees and over $4 billion in revenues

•! NetApp creates innovative storage and data management solutions

•! NetApp ranks third in market capitalization in the Data Storage Devices industry

1GE Capable Servers

Nexus 2148s

Nexus 5Ks

Nexus 7Ks

Catalyst Core

© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID 48

Cisco IT Nexus 5000 FCoE Deployment

Deployment Requirements: !! Additional server and storage capacity for crucial

corporate applications

!! Maximize utilization of space and minimize demand for power and cooling

Why Cisco IT selected Nexus 5000: !! Unified I/O frees up rack space, enabling a 30%

increase in server density ($1.8 million/year in savings at full deployment)

!! Unified Fabric significantly decreases required number of adapters, switches, and power. Cabling cost reduced 40% ($1.1 million in savings)

!! Led to 1/3 more power available to support servers without increasing overall power capacity

!! Ability to support increased computing capacity at a decreased power load extends data center life 12-18 months, saving $4-6 million in deferred investment

"This approach to reducing power demand could eventually provide as much as a 150 percent increase in the number of servers that can be operated in a facility. Further scale is possible with increasing virtual server deployments and improved storage utilization.“

-Mike Norman, Director, Cisco IT

Comparison of Power Distribution in a Data Center

© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID 49

University of Arizona Nexus 5000 FCoE Deployment

Deployment Requirements: !! More Capacity to support higher traffic out of new

Enterprise databases

!! Higher bandwidth out of servers needed due to increased virtualization (VMware ESX with about 20 Virtual Machines per physical server)

Why University of Arizona selected Nexus 5000:

!! Cost analysis for converged LAN/SAN with FCoE between CNA’s and Nexus 5010s revealed a 50% cost savings vs. separated LAN/SAN infrastructure

!! Consolidation to 10GbE connections reduced need for cables, adaptors, switch ports, etc

!! Investment protection for existing native FC storage infrastructure while supporting end-to-end FCoE with future EMC FCoE-capable storage targets

•! The University of Arizona was the first university in the state, founded in 1885

•! As of Fall 2007, total enrollment at the university was 36,733 students

Customer Feedback

“…the Nexus helped us drive the kind of server density and server connectivity

and throughput that we knew we would need when deploying these new systems

at a dramatically reduced cost and complexity.”

Derrick Masseth, University of Arizona Senior Director for Infrastructure Services

© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID 50

Life Technologies Corporation Nexus 5000 Deployment

Deployment Requirements: !! High performance

!! Low latency

!! Ease of implementation and management

!! Low price

Why Life Technologies selected Nexus 5000:

!! Nexus 5K’s low latency allowed for an accelerated data refresh rate

!! Front-to-back airflow and rear-facing server ports allow for simplified cabling

!! Minimal training (only one day needed) due to NX-OS’s similarity to Cisco IOS Software

!! Rapid deployment was made possible through Advanced Services’ validated switch configurations

•! Life Technologies was created by the merger of Invitrogen and Applied Biosystems in November 2008

•! Life Technologies has historical sales of over $3 billion, employs 9,500 people, and owns over 3,600 patents

•! The global biotechnology tools company is dedicated to improving the human condition by helping its customers accelerate scientific exploration.

“The Cisco Nexus 5020 Switch accelerated daily analysis of our business information

from seven hours to two. This helps finance and marketing executives make decisions based on current information.”

Customer Feedback

© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID

Lawrence Livermore National Lab (LLNL) Nexus 2000/5000 Deployment

Deployment Requirements: !! Simplify Data Center Management

!! Support 10 Gigabit Ethernet for future growth

!! Reduce capital and operational costs through optimized virtualization

!! High Availability

Why LLNL selected Nexus 5000: !! High 10GE port density and low cost per port

!! Interoperability with Catalyst 6500 switches

!! Nexus 5000 Unified Fabric and Virtualization features

!! A single point of Management for the Nexus 5000 and all connected 2148 Fabric Extenders

•! LLNL is a national security lab dedicated to applying science and technology to the important issues of our time

•! LLNL is a leader in transforming scientific breakthroughs into solutions for real-world problems

•! Established in 1952 to meet urgent national security needs

“You get few opportunities to build a brand-new data center, and we wanted a design that would help us remain a world-class data center for the next 15 to 20 years.”

Customer Feedback

© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID 52

McDermott Will & Emery (MWE) Nexus 2000/5000 Deployment

Deployment Requirements: !! Bring down costs and complexity through consolidation

of data and storage networks

!! Utilize virtualization to increase utilization and decrease the number of servers needed

!! Provide SAN access to all servers

Why MWE selected Nexus 5000: !! Feature leadership today and tomorrow (FCoE, 10GE,

FEX, L2MP, VN-Link) for their new data center

!! Unified Fabric features to reduce the cost of adapters, cables, power, and cooling by up to 50%

!! Provided benefits of 100% SAN connectivity

!! Optimized Virtualization enabled reduction of physical servers from 300 to 100

•! McDermott Will & Emery is a premier international law firm that represents a wide range of commercial, industrial, and financial enterprises.

•! MWE currently advises more than 60% of the Fortune 100 and over 50% of the Fortune 500.

•! MWE is the world’s 19th largest law firm

Customer Feedback

“Fewer number of HBAs, NICs, switch ports, and lower power requirements

helped cut back on expenses, and when we examined our return on the

investment, what we would get with the Nexus just made sense to me, and my

director wholeheartedly agreed.” Edward Carroll, McDermott Will & Emery

Network Architect

© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID 53

Deployment Requirements: !! Separate management domains to control access to

equipment for increased security

!! Support new trends in Data Center technology

!! Engineer a better HA/DR plan

!! Build an operations center to showcase their equipment and technology.

Why Schneider Electric selected Nexus 5000:

!! As servers consolidate with VMWare, can integrate and manage switches from the Nexus 5000

!! Unified Fabric within data center reduced cabling costs and power consumption for each server

!! Reduced time to bring new servers on line

!! Simplified infrastructure

•! Schneider Electric is an international energy company with a focus on safe and efficient use of Energy in Commercial and private settings.

•! Schneider Electric provides services in the following areas: •! Automation and Control •! Electrical Distribution •! Building Automation and Security •! Data Center Power and Cooling Services

Nexus 5000 Nexus 5000

Nexus 7000s

Catalyst 4948 Catalyst 4948

Schneider Electric Nexus 5000 Deployment

© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID 54

One of Top 6 Energy Corporations Nexus 2000/5000 Deployment

Deployment Requirements: !! 1GE/10GE connectivity to provide architectural

flexibility and investment protection

!! Improve utilization and flexibility through a virtualized data center

!! Faster turnout on compute jobs

Why Customer selected Nexus 5000: !! Low Latency

!! Support for 1GE and 10GE connectivity, allowing easy transition to 10GE using Nexus 2000 and 5000 switches in the near-term

!! High 10 GE port density at a low cost per port – Customer envisions pure 10GE connectivity in the future

•! One of the world’s six “supermajor” oil companies.

•! Corporation had a revenue topping $200 billion in 2008

© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID 55

Purdue University Nexus 5000 Deployment

Deployment Requirements: !! Highly scalable 10GE design to support over 1200

servers

!! Low over-subscription design with non-blocking , wire-rate switches

!! Design that minimizes total cost of ownership

Why Purdue University selected Nexus 5000:

!! Nexus 5000 Pod and Top-of-Rack design minimizes long fibre runs. Utilizes Twin-AX cables to reduce cost

!! High 10GE port density with low cost-per-port

!! Greatly reduces power, cooling, and space requirements

!! Ethernet management reduces cables to two connections per server (one power, one 10GE)

•! Purdue University is a top 10 University in the U.S. for its undergraduate engineering program

•! Nexus products will be used in Purdue’s “Coates Cluster,” tapped as the world’s largest 10Gb Ethernet cluster

320 servers per pod. 32 servers per switch. Each switch uplinked to a pair of

5020 distribution switches.

© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID 56

Terremark Worldwide Inc. Nexus 5000 Deployment

Deployment Requirements: !! Address dynamic nature of customer moves/adds/

changes

!! Provide flexible BW: Fibre Channel, Ethernet without re-cabling or adding new equipment

!! Re-purpose the servers to meet growth

!! Allow customers to select service options and provision services quickly

Why Terremark selected Nexus 5000: !! Nexus 5000 with 10GE port density, unified fabric,

QoS capabilities

!! Nexus 5000 Virtualization features allow for increased flexibility and ease of management

!! Nexus-OS XML capabilities

•! Terremark is a carrier neutral global co-location provider

•! Terremark is a leader in virtualized, VMware based utility computing

•! Top customers: Lego, Akamai, H&R Block, BMW

32 Servers per Pair of Nexus 5000 ToR Switches

Nexus 5K

© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID 57

FamilySearch Nexus 2000/5000 Deployment

Deployment Requirements: !! Large 1Gbps deployment

!! Minimize equipment costs, management overhead, and energy consumption by building a single network

!! Unified Fabric capability for virtualization cluster and consolidation of data and storage networks

Why FamilySearch selected Nexus: !! Nexus 5000 Unified Fabric Capability

!! Reduced cabling costs using the Nexus 2148 ToR design

!! Consistent architecture for GE, 10GE, and Unified Fabric using the Nexus 2148/5000 for server access

!! Simplified management for the data center with the Nexus 2000 & Nexus 5000 combination

!! Cisco End-to-End solution

•! FamilySearch is the largest genealogy organization in the world. Millions of people use FamilySearch records, resources, and services to learn more about their family history

•! For over 100 years, Family Search has been actively gathering, preseving, and sharing genealogical records worldwide.

6000 Hosts, Dual Active Ethernet & 10Gbps UIO Virtualization Cluster

© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID 58

Zuse Institute Berlin (ZIB) Nexus 5000 FCoE Deployment

Deployment Requirements: !! Maximum throughput at the interface between the

Cisco SAN and the Ethernet infrastructure

!! Support for 10 Gigabit Ethernet connectivity

!! Unified Fabric capability for future growth and consolidation of data and storage networks

Why ZIB selected Nexus 5000: !! Unified Fabric allows for flexible development of the IP

and SAN infrastructure.

!! Consolidated data and storage networks will decrease costs for adapters, cabling, and power consumption

!! Cost-effective scalability of data transfer through the increased availability of adapter slots in a server

!! End-to-end redundancy for maximum failure protection

•! ZIB solves urgent problems in science, technology, environment, or society through mathematical analysis

•! The ZIB supercomputer is one of the top computers in Germany

•! As one of two operators of the HLRN supercomputer system, ZIB acts as a service provider for many other scientific institutions.

Customer Feedback

“The [Nexus 5020] switches have increased the throughput at this

bottleneck between the SAN and the 10-gigabit Ethernet network in a particularly

cost-effective way.”

Wolfgang Pyszkalski, Zuse Institute Berlin IT Services Department Manager

© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID 59

Coca-Cola Bottling Co. Consolidated (CCBCC) Nexus 5000 Deployment

Deployment Requirements: !! Reduce power consumption and cooling costs

!! Improve utilization and flexibility through a virtualized data center.

!! Improve Data Recovery Plan

Why CCBCC selected Nexus 5000: !! Nexus 5000 Unified Fabric and Virtualization features

with support for legacy equipment

!! Investment protection

!! Cost Savings on cabling due to consolidated data/storage networks

!! “Quite significant” power and cooling savings.

!! Reduction in switch ports

•! Coca-Cola Bottling Company Consolidated the second largest franchised bottler of Coca-Cola products in the United States.

•! Manages franchise territories with a consumer base of more than 18 million people.

Customer Feedback

“I want to say 30% to 60% cost savings… Any way I stacked it up, it was more cost efficient to go to the FCoE, go to the pod

design, using the Nexus.”