Network Storage: State of the Industry

91
IME ©2000-2003 IMEX Research Network Storage: State of the Industry Anil Vasudeva President & Chief Analyst IMEX Research.com (408) 268-0800 [email protected]

description

 

Transcript of Network Storage: State of the Industry

Page 1: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

Network Storage: State of the Industry

Anil VasudevaPresident & Chief Analyst

IMEX Research.com(408) 268-0800

[email protected]

Page 2: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

•• Markets Drivers / Industry DynamicsMarkets Drivers / Industry Dynamics

•• Market ForecastMarket Forecast

•• Emerging Technologies Roadmap Emerging Technologies Roadmap

•• Basis of CompetitionBasis of Competition

•• Supplier StrategiesSupplier Strategies

•• Futures OpportunitiesFutures Opportunities

Page 3: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

WW Storage Systems Market

WW Storage Systems Market EU Customer Rev $M

$-

$5,000

$10,000

$15,000

$20,000

$25,000

$30,000

2002 2003 2004 2005 2006

EU C

usto

mer

Rev

$M

DAS

NAS

SAN

Page 4: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

HA Secure End-to-End Internet

©1997-2002 IMEX Research. All Rights reserved.

InternetISP

CoreOptical

NetworkingEdge

Access ISP

ISPISP

ISP

ISP

Enterprise

IntrDet

IntrDet

IntrDet

IntrDet

xSP

DBServersApp.Servers

VPN

IntrDet

Supplier/Partner

IntrDet

Remote Office

Home Networks

56K DSLCable Modem

MP3 VOD

Wireless Cellular

WebServices

Page 5: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

End to End Internet

Web

Web

Web

Web

Web

Web

Web

Web

Data CenterApplicationsEdge

Directory Security Policy Management

Software OS Platform

AppApp

AppApp

AppApp

AppApp

DBDB

DBDB

DBDB

IP Storage Network

FC SAN IP SAN NAS NAS

InternetCoreOptical

Edge

HA, Secure Data Center

Page 6: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

• System Files• OLTP- Banking- Retail- Securities- Airlines ...

Scientific ComputingScientific Computing

ImagingImagingVideoVideo

*IOs per sesond for a required response time ( ms)

• Medical Imaging• PrePress• CAD/CAM• Geo InfoSystems• Geophysical mapping• Oil/Gas Exploration• Satellite Telemetry...

• OLAP• Data Warehousing• Data Mining

• Numeric IntensiveComputing

• StatisticalModeling

• Chemicals/Fluid DynamicSimulations • Scientific Visualization

• Film/Video• Video Editing• Animation• VOD

IOPs(latency)

IntranetIntranet

(RAID - 1, 5, 6)

Data Data WarehousingWarehousing

(RAID - 0, 3)

500100MB/sec101 505

1K

10 K

100

10

1

• ElectronicCommerce

• Data Bases

• Email • Hits/day

Internets

Visual DBVisual DB• Object RDBMS• Visual Data Marts

Transaction Transaction ProcessingProcessing

Market Segments by Applications

Page 7: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

The iSCSI SAN

To Other LANs,Servers or IP SANs

Ethernet Header CRCIP TCP DATA

Client requests data from App Server

Ethernet CRCHeader IP

TCP iSCSI SCSI DATA

iSCSI-equipped App Server (“initiator”) requests data from an iSCSI storage (“target”)

Storage Arrays(iSCSI Target)

Application & DB Servers

(iSCSI Initiator)

Client Workstations

SAN GigE

Switches

LANEthernet Switches

Page 8: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

Storage Sub Systems

Application & DB Servers

Clients

SAN

LAN Ntwk Mgmt WS

Storage Mgmt WS

Mgmt WS

Intelligent Uniform IP-based

Infrastructure

Present Data Center Infrastructue Future Infrastructue

Future Intelligent IP Infrastructure

Page 9: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

DAS SAN iSCSI NASComputer System

SCSI Device Driver

SCSI Bus Adapter

Computer System

iSCSI Layer

FC HBA

Computer System

iSCSI LayerFC HBANIC

Computer SystemApplication

NFS / CIFS

TCP/IP Stack

NIC

I/O Redirector

OS FS

Computer SystemApplication

NFS / CIFS

TCP/IP Stack

NIC

I/O Redirector

OS FS

Block I/O

SCSI HBA

FC HBA

SANSAN IP NetworkIP Network

iSCSI Appliance

iSCSI LayerI/O Bus Adapter

TCP/IP Stack

NIC

FILE I/O

IP NetworkIP Network

NAS Appliance

File System + LVM

Device Driver

TCP/IP Stack

NIC

SANSAN

Block I/O

File System + LVMDevice Driver

TCP/IP Stack

NIC

NAS Gateway

Transporting Application Data

Application

LVM Raw Partition

OS FS

DB Syst

Application

LVM Raw Partition

OS FS

DB Syst

Application

LVM Raw Partition

OS FS

DB Syst

Page 10: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

iSCSI SAN market to reach 1.7B by 2006

WW SAN Revenues by Technology

2001 2002 2003 2004 2005 2006

End

Use

r Cus

tom

er R

even

ues

$M

iSCSI

IB

Fibre Channel

Page 11: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

WW FC SAN Components -Market Shares

Emul e x4 %

Ga dz oox5 3 %

S t or a ge Te k9 %

Vi x e l3 4 %

McDATA91%

InRange9%

Br oc a de8 8 %

QLogi c7 %

Ga dz oox2 %

Vi x e l3 %

Cr ossr oa ds7 2 %

Ot he r s2 8 %

Market- Fibre Channel SAN Components 2000

Hubs$51M

Router$47M

Director$186M

HBA$545M

Switch$469M

JNI20%

Agilent10%

QLogic17%

Emulex35%

Others1%

Inter-phase

3%Compaq

7%Sun7%

Page 12: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

Storage Network Infrastructure

Storage Network Infrastructure

Hub1%

Director15%Switch

43%Router

3%

HBA38%

Page 13: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

IP Storage Protocol Stacks

Page 14: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

Entire stack needs attention

Challenge is to move data from application to the network and back with

minimum latency

Application

Memory

OS

Upper Layers

I/O interconnect

Data

Data

Network Interface(w or w/o TOE)

Chipset

CPU

TCP/IP (or Offload I/F)

TCP/IP Offloading

Page 15: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

Small Offic

e/

Home Office

Workgroup

Enter-

prise

FC SANsiSCSI HW SANs

iSCSI HW SANs

iSCSI SW SANMid NAS

Department

ASP - $1K to $25KPerf. – 1-5K+ tpm

ASP - $10K to $100KPerf. – 5-15K+ tpm

ASP - $1K to $25KPerf. - 15K-50K tpm

ASP - $1K to $25KPerf. - 50K+ tpm

StorageStorageServersServers

iSCSI SW SANEntry NASPATA, SATA

Environment

PerformanceScalability

FeaturesCost

SAN Market Segmentation

Page 16: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

iSCSI Server Options

iSCSI HBA• Enterprise Performance• Wire Speed IP Security• Management

NIC with TOE &iSCSI SW Driver• Increased Performance

NIC &iSCSI SW Driver• Entry Level• Low Cost

Market Size

Cost

&

Perfo

rman

ce

Page 17: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

iSCSI Market 2002-06

iSCSI Ports Units Forecast

0

5 0 0

1, 0 0 0

1, 5 0 0

2 , 0 0 0

2 , 5 0 0

3 , 0 0 0

2002 2003 2004 2005 2006

iSCSI Other Ports

iSCSI HBA Ports

iSCSI Ports ASP Forecast

0

250

500

750

1,000

1,250

1,500

1,750

2,000

2002 2003 2004 2005 2006

ASp

/Por

t $Other iSCSI Initiator

10 Gbit iSCSI HBA

1Gbit iSCSI HBA

Page 18: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

TCP + iSCSI Offload Engines

EthernetIP

TCPiSCSI

SCSI Device DriverVolume Manager

File System

Typical 1GbE NIC

EthernetIP

TCPiSCSI

SCSI Device Driver

Volume ManagerFile System

EthernetIP

TCPiSCSI

SCSI Device DriverVolume Manager

File System

Hos

tSW

Ada

pter

Host CPU

HBA Hardware

HBA Firmware

Page 19: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

TOE/iSCSI

Implementation Targeted Performance

SAN 180– 190 MBLAN >2 GHz

Mem

ory

Host Interface

PCI-Express

Mgmt Engine

Host Interface

x4 PCI-E

Mgmt RAMFIFO Mgmt

RAMFIFO

TOE

iSCSI

GbE MAC

PHYSerDes

GbE MAC

PHY SerDes

Page 20: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

IP SAN Management

Host Services Integration StorageProvisioning Layer

IP SAN Management Layer

Appliance Service Layer

File system monitoring

IP SAN ManagementManagement

ConsoleManagement of

iSCSI HBAsMultiPath IO Supp

and FailoverSecurity

(iSNS, CHAP, SRP)

Virtualization Mirroring Snapshot Fail-Over

iSCSI Target ManagementLVM, Error Handling, SCSI Daemon, API Interoperability

HW Acceleration: TOE, iSCSI Offload, IPsec

Storage provisioning Win, LINUX, Solaris

Page 21: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

Industry roadmap LAN/SAN ’02-’05LA

NSA

N

Offloaded• Initiator only• TCP/IP on NIC• iSCSI on NIC

Host• Uses CPU cycles• Stateless Offloads

Offloaded• Initiator & target• TCP/IP in Si• iSCSI in host • Single port and function• Fault Tolerance• Load Balancing

Offloaded• TCP/IP in Si• Single port and function• Windows & Linux

ConvergenceConvergence•• Dual functionDual function•• Initiator & targetInitiator & target•• Offloaded TCP/IPOffloaded TCP/IP•• Offloaded iSCSI Offloaded iSCSI •• Dual portDual port•• Fault toleranceFault tolerance•• Load balancingLoad balancing•• Motherboard optionMotherboard option•• External memory External memory

IntegrationIntegration•• Shares host memoryShares host memory•• Supports 1GbE & 10 GbESupports 1GbE & 10 GbE•• Offloaded TCP/IP & iSCSI Offloaded TCP/IP & iSCSI •• Initiator & targetInitiator & target•• LAN on Blades SolutionLAN on Blades Solution•• SAN on Blades SolutionSAN on Blades Solution

Page 22: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

10Gb Embedded TOE Evolution

TOE chipset2x1Gb TOE NIC 10 Gb TOE NIC Embedded

20042003 2005 2006 onwards

CPUCPUCPU CPUCPUCPU

MCMCMC

CPUCPUCPU CPUCPUCPU

PCI-X

TOE with 2GbE

PCI Exp PCI Exp

1GbE

1GbETOE

DMA

CPUCPUCPU

MCMC

CPUCPUCPU

PCI Exp

DMA

Uses Syst Mmry

TOE 10GbE

Ext.Mmry

PCI PCI-XExt Mmry

I/OBridge

I/OBridge

GbE

GbETOE

PCI-XPCI

I/OBridge

Uses Syst Mmry

PCI ExpPCI Exp

10 GbE1GbE1GbE

CPUCPUCPU CPUCPUCPU

MCMC

TOE

Page 23: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

Host interface PCI 64/66 PCI-Express x4

PCI-X 1.0

PCI-Express x8

PCI-X 2.0

PCI-Express x4

Packet memory External on NIC External on NIC Host memory,

External on NIC

Host memory

RDMA No HW support Microengine assists

Microengine + state machine

Microengine + State machine

iSCSI No HW support assists St. machine St. machine

DDP/MPA No HW support St. machine St. machine St. machine

MAC/PHY 1 MAC, PHY external

Dual MACs, PHY integrated

Single MAC + Serdes, external optics

Dual MACs, PHY integrated

Context memory External on NIC Internal cache Internal cache Internal cache, > than Cranbrook

Security (IPSEC) Prototype support for SSL

External ASIC External ASIC External ASIC

#of connections 1k 8k 8k 8k+Management PXE PXE, ASF2.0 PXE, ASF 2.0 PXE, ASF2.0

TOE solutions to be state machines

Page 24: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

HW

Software Architecture – Functions

IPUDP TCP

Channel Interface

Dual MACIPSec PHY 1 PHY 2

HW

iSCSI 1.0MPADDP

RDMA

uCode w HW Assist

HW Drivers

Base Hardware DriverBus Driver

Kernel-Mode Applications

UserKernel

Raw Packet DriveriSCSI 1.0 Offload

DriverRDMA Driver

IP TransportDriver

RDMA API

RDMA API

OS Cmpn

Offload Switch

SCSI Driver

File SystemsOS Network

Stack

OS Socket Driver

Sockets API

ApplicationsI/O Libraries

Page 25: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

Emerging IP Based Infrastructure

Networks

Storage

VirtualizationProvisioningAutomation

Servers

TelecomIP

Infrastructure

Page 26: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

TOE solution…

•• TCP/IP offload reduces overheads assoc. withTCP/IP offload reduces overheads assoc. with–– Protocol processingProtocol processing–– Data touching & manipulationData touching & manipulation–– Operating system relatedOperating system related

•• TOE based stack still requiresTOE based stack still requires–– Large highLarge high--speed NIC memory for TCP/IP buffersspeed NIC memory for TCP/IP buffers–– Mechanism to directly place data into app. buffersMechanism to directly place data into app. buffers–– OS support & efficient TOE I/F, OS support & efficient TOE I/F, ……

Page 27: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

TCP/IP Offload & Mgmt•• TCP/IP Offload using TOE:TCP/IP Offload using TOE:

– 8K TCP connections Supp– RDMA Supp – Full Data path offload:– Soft session setup/teardown– Memory pool for outstanding SCSI commands– Connection & Session-level error recovery

•• IPv4 & IPv6 support:IPv4 & IPv6 support:– Checksum and segmentation offload– Large send capability

•• Operating Systems:Operating Systems:– Drivers for Windows 2k, Linux

•• Management:Management:– Build on Ophir’s management– ASF 2.0 support– WfM support– IPMI support– VLAN Tagging

Page 28: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

NIC & iSCSI

•• Dual independent 1GbE ports:Dual independent 1GbE ports:–– PCIPCI--Ex Copper, Fiber, PCIEx Copper, Fiber, PCI--X Copper, FiberX Copper, Fiber–– PCIPCI--Express or PCIExpress or PCI--X InterfaceX Interface

•• Performance, sustained throughput:Performance, sustained throughput:–– SAN: 180 SAN: 180 –– 190 MB/sec190 MB/sec–– LAN: 1.9 Gbps Full Duplex LAN: 1.9 Gbps Full Duplex –– Simultaneous support of LAN and SAN trafficSimultaneous support of LAN and SAN traffic

•• Low CPU Utilization (<10% Low CPU Utilization (<10% on 2Ghz P4on 2Ghz P4))

•• iSCSIiSCSI offloaded solution offloaded solution usingTOEusingTOE–– Support for Windows, LinuxSupport for Windows, Linux–– iSCSIiSCSI Initiator and target modes SupportInitiator and target modes Support–– Full data path offload, Flexible TOE control pathFull data path offload, Flexible TOE control path–– Soft TCP session setup/teardown, Soft error handling and reportiSoft TCP session setup/teardown, Soft error handling and reportingng–– FullFull iSCSIiSCSI error detection and handlingerror detection and handling

•• Connection and session levels, SCSI errorsConnection and session levels, SCSI errors–– iSCSIiSCSI CRC supportCRC support–– RemoteRemote iSCSIiSCSI bootboot

Page 29: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

iSCSI Packet Flow: Initiator to Target

Page 30: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

FC SAN Market Shares

HP/CPQ2%

Other1%

Inrange2%

Vixel1%

Sun1%

Crossroads2%

Gadzoox2%

Antares1%

qLogic12%

Agilent5%Emulex

15%

McData17%

Brocade34%

JNI5%

Page 31: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

4-Tiered Computing in Data Center

Source : Sun Microsystems

Tier-1 Tier-2 Tier-3Users

InternetCoreOptical

Edge Edge

Tier-0

Page 32: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

End to End Internet

InternetCoreOptical

Edge

Web

Web

Web

Web

Web

Web

Web

Web

SANSAN SANSAN NASNAS NASNAS

Storage NetworkStorage Network

Data CenterApplicationsEdge

Directory Security Policy Management

Software OS Platform

AppApp

AppApp

AppApp

AppApp

DBDB

DBDB

DBDB

Page 33: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

Major Players in Infrastructure Convergence

StorageNetworks

Servers

Page 34: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

What is iSCSI

Page 35: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

TCP/IP Overhead saps CPU

0

100

200

300

400

500

600

700

83%71%68%60%

CPU Utilization %M

B/s

ec

MBS vs. CPU Utilization

TCP/IP Overhead saps CPU

Ethernet

IP

TCP

iSCSI

SCSI Device Driver

Volume Manager

File System

Typical 1GbE NIC

HBA Hardware

Processing by Host CPULegend

Page 36: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

TCP + iSCSI Offload Engines

EthernetIP

TCPiSCSI

SCSI Device DriverVolume Manager

File System

Typical 1GbE NIC

EthernetIP

TCPiSCSI

SCSI Device Driver

Volume ManagerFile System

EthernetIP

TCPiSCSI

SCSI Device DriverVolume Manager

File System

Hos

tSW

Ada

pter

Host CPU

HBA Hardware

HBA Firmware

Page 37: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

Page 38: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

Small Offic

e/

Home Office

Workgroup

Enter-

prise

FC SANsiSCSI HW SANs

iSCSI HW SANs

iSCSI SW SANMid NAS

Department

ASP - $1K to $25KPerf. – 1-5K+ tpm

ASP - $10K to $100KPerf. – 5-15K+ tpm

ASP - $1K to $25KPerf. - 15K-50K tpm

ASP - $1K to $25KPerf. - 50K+ tpm

StorageStorageServersServers

iSCSI SW SANEntry NASPATA, SATA

Environment

PerformanceScalability

FeaturesCost

SAN Market Segmentation

Page 39: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

iSCSI Market Development

2003 2004

Early Adoption• Gateways & Routers• Long Distance Backups

Pilots• Win Server 2003 Drivers• Exchange Consolidation• Native iSCSI Disk Arrays

& Tape Libraries

Distributed iSCSI• Gateways• SAN Consolidation• Long Distance Backup

Enterprise Adoption• 10Gbps Ethernet• Multi-headed Storage

SMB Adoption• Low Cost SANs• Windows & Linux

Page 40: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

•• DecadesDecades--old, tried and tested, everold, tried and tested, ever--evolving, widely deployedevolving, widely deployed

•• Many upperMany upper--layer protocol variations in uselayer protocol variations in use

•• Security, QoS, partitioning/subnetsSecurity, QoS, partitioning/subnets

•• LANLAN--centric manageabilitycentric manageability

•• Supports reliable Supports reliable ““streamsstreams””--based databased data

•• Work underway to fix required message framing, Work underway to fix required message framing,

and to add RDMAand to add RDMA

hardwaresoftware under development

Today’s NICPhysical

Data Link (MAC)

Network (IP)

Transport (TCP)

Session

Presentation

Application

Physical

Data Link (MAC)

Network (IP)

Transport (TCP)

Session

Presentation

Application

TCP/IP Offload Engine (TOE)

Physical

Data Link (MAC)

Network (IP)

Transport

Session

Presentation

Application

RDMA-Enabled TOE

verbs

HTT

PS

SL

SD

P

SC

SIiSCSI

iSER M

PI

Hyp

er T

ext T

rans

latio

n P

roto

col

Sec

ure

Soc

kets

Lay

er

Inte

rnet

SC

SI

iSC

SI o

ver R

DM

A

Sm

all C

ompu

ter S

yste

ms

Inte

rface

Sock

ets

Dire

ct P

roto

col

Mes

sage

Pas

sing

Inte

rface

... ...

TCPDDPMPA

RDMA P RDMA Protocol

Marker PDU Alignment

Direct Data Placement

IP Networks

Page 41: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

IP SAN Management

Host Services Integration StorageProvisioning

Value-add IP SAN Features

Appliance Service Layer

File system monitoring

IP SAN ManagementManagement

ConsoleManagement of

iSCSI HBAsMultiPath IO Supp

and FailoverSecurity

(iSNS, CHAP, SRP)

Virtualization Mirroring Snapshot Fail-Over

iSCSI Target ManagementLVM, Error Handling, SCSI Daemon, API SDK

HW Acceleration: TOE, iSCSI Offload, IPsecWeb

bas

ed G

UI

RA

ID

Storage provisioning Win, LINUX, Solaris

Page 42: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

Host Services IntegrationStorageProvisioning

Value-add IP SAN Features

Appliance Service Layer

File system monitoring

IP SAN ManagementManagement

ConsoleManagement of

iSCSI HBAsMultiPath IO Supp

and FailoverSecurity

(iSNS, CHAP, SRP)

Virtualization Mirroring Snapshot Fail-Over

iSCSI Target ManagementLVM, Error Handling, SCSI Daemon, API SDK

HW Acceleration: TOE, iSCSI Offload, IPsecWeb

bas

ed G

UI

RA

IDStorage provisioning Win, LINUX, Solaris

Page 43: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

LAN/SAN Integration

2005200420032002

SAN

Offload

•Initiator • TCP/IP on NIC• iSCSI on NIC

LAN

Host

•Uses CPU cycles• Stateless Offloads

Offload

• Initiator & Target• TCP/IP in Si• iSCSI in host • Single port & Fn• Fault Tolerance• Load Balancing

Offloads

•TCP/IP in Si• Single port & Fn• Win, Linux …

LAN/SAN LAN/SAN ConvergenceConvergence

• Dual function• Initiator & Target• Offloaded TCP/IP• Offloaded iSCSI • Dual port• Fault tolerance• Load balancing• MoBO option• Ext memory

LOM/SOMLOM/SOMIntegrationIntegration•Initiator & Target•• Offloaded TCP/IP• Offloaded iSCSI • Shares host memory• 1GbE & 10 GbE Supp• LOM/SOM

Page 44: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

10Gb Embedded TOE Evolution

TOE chipset2x1Gb TOE NIC 10 Gb TOE NIC Embedded

20042003 2005 2006 onwards

MCMC

CPUCPUCPU CPUCPUCPU

MCMC

CPUCPUCPU CPUCPUCPU

PCI-X

TOE with 2GbE

PCI Exp PCI Exp

1GbE

1GbETOE

DMA

CPUCPUCPU

MCMC

CPUCPUCPU

PCI Exp

DMA

Uses Syst Mmry

TOE 10GbE

Ext.Mmry

PCI PCI-XExt Mmry

I/OBridge

I/OBridge

GbE

GbETOE

PCI-XPCI

I/OBridge

Uses Syst Mmry

PCI ExpPCI Exp

10 GbE1GbE1GbE

CPUCPUCPU CPUCPUCPU

MCMC

TOE

Page 45: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

NIC & iSCSI• Dual independent 1GbE ports:

– PCI-Ex Copper, Fiber, PCI-X Copper, Fiber– PCI-Express or PCI-X Interface

• Performance, sustained throughput:– SAN: 180 – 190 MB/sec– LAN: 1.9 Gbps Full Duplex – Simultaneous support of LAN and SAN traffic

• Low CPU Utilization <10% (on 2Ghz CPU)

• iSCSI Initiator & Target Mode Support– Support for Windows, Linux

• Power < 8 Watts• iSCSI offloaded solution using TOE

– Full data path offload, flexible TOE control path– Soft TCP session setup/teardown– Soft error handling and reporting– Full iSCSI error detection and handling– iSCSI CRC support– Remote iSCSI boot– Initiator and target modes

Page 46: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

TCP/IP Offload & Mgmt• TCP/IP Offload using TOE:

–– 8K TCP connections Supp8K TCP connections Supp–– RDMA Supp RDMA Supp –– Full Data path offload:Full Data path offload:–– Soft session setup/teardownSoft session setup/teardown–– Memory pool for outstanding SCSI commandsMemory pool for outstanding SCSI commands–– Connection & SessionConnection & Session--level error recoverylevel error recovery

• IPv4 & IPv6 support:–– Checksum and segmentation offloadChecksum and segmentation offload–– Large send capabilityLarge send capability

• Operating Systems:–– Drivers for Windows 2k, LinuxDrivers for Windows 2k, Linux

• Management:–– ASF 2.0 supportASF 2.0 support–– WfMWfM supportsupport–– IPMI supportIPMI support–– VLAN TaggingVLAN Tagging

Page 47: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

Features 2002 2003 2004 2005

Host interface PCI 64/66 PCI-Express x4

PCI-X 1.0

PCI-Express x8

PCI-X 2.0

PCI-Express x4

Packet memory External on NIC External on NIC Host memory,

Ext on NIC

Host memory

RDMA No HW support uE assists uE + St.m/c uE + St.m/c

iSCSI No HW support uE assists uE + St.m/c machine

uE + St.m/c

DDP/MPA No HW support uE + St.m/c St.m/c St.m/c

MAC/PHY 1 MAC, PHY external

Dual MACs, PHY integrated

Single MAC + Serdes, external optics

Dual MACs, PHY integrated

Context memory External on NIC Internal cache Internal cache Internal cache

Security (IPSEC) Prototype support for SSL

External ASIC External ASIC External ASIC

#of connections 1k 8k 8k 8k+?

Management PXE PXE, ASF2.0 PXE, ASF 2.0 PXE, ASF2.0

Integration Standalone Standalone Standalone South bridge with legacy & PCI-X

Features : NICs to Integration

Page 48: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

Application

TCP/IP Offloading

The challenge The challenge is to move data is to move data from application from application to the network to the network and back with and back with

minimum minimum latencylatency

Memory

OS

Upper Layers

I/O interconnect

Data

Data

Network Interface(w or w/o TOE)

Chipset

CPU

TCP/IP (or Offload I/f)

It’s not just about TOE – entire stack needs attention

Page 49: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

SN Technologies Migration

1985 1990 2000 2003 2005 2010

IP

Fibre Channel

p-SCSI

Page 50: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

iSCSI SAN market to reach 1.7B by 2006

WW SAN Revenues

$-

$500

$1,000

$1,500

$2,000

$2,500

$3,000

$3,500

$4,000

$4,500

2001A 2002A 2003E 2004E 2005E 2006E

$M iSCSI

IB

Fibre Channel

Page 51: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

iSCSI SAN market to reach 1.7B by 2006

WW SAN Revenues by Technology

2001 2002 2003 2004 2005 2006

End

Use

r Cus

tom

er R

even

ues

$M

iSCSI

IB

Fibre Channel

Page 52: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

WW SAN Switch Port Shipments

WW SAN Switch Ports Shipments

-

2,000

4,000

6,000

8,000

10,000

12,000

14,000

2002 2003 2004 2005 2006 2007

Uni

ts in

000

s

iSCSI

FC

Page 53: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

Ethernet Technology Transitions

Page 54: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

20

40

60

80

100

Mb

(8xM

B)

Average & Peak Size Of Files

10

MS WordMS PPTMS XLSIntranet/Web Page

AvePeak

Number Of Times The Same Document Is Retransmitted Over LAN

20

40

60

80

100

10

MS WordMS PPTMS XLSIntranet/Web Page

1990 1995 2000 2005

Core Applications Consuming BW

Page 55: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

Client Workload Increasing Dramatically

1998 2001 2002-3

Background

Java* appletsJava* applets

Java* appletsJava* appletsPortalsPortals

Smart agentsSmart agentsBiz Automation Biz Automation SvcsSvcs..

Java* appletsJava* appletsPortalsPortals

CompressionCompressionVirus ScanVirus Scan

System ManagementSystem ManagementBackBack--upup

AuthentAuthent/Encrypt/EncryptSynchronizationSynchronization

CompressionCompressionVirus ScanVirus Scan

System ManagementSystem ManagementBackBack--upup

AuthentAuthent/Encrypt/EncryptSynchronizationSynchronization

CompressionCompressionVirus ScanVirus Scan

System ManagementSystem ManagementBackBack--upup

Directory ServicesDirectory ServicesPeerPeer--toto--Peer ServicesPeer Services

Foreground

Multitasking OSMultitasking OSOffice* appsOffice* apps

Passive BrowserPassive Browser

MM’’taskingtasking netnet--aware OSaware OSnetnet--aware Office*aware Office*Dynamic BrowserDynamic Browser

EmailEmailCollaborationCollaboration

Next Generation OSNext Generation OSnetnet--integrated Office*integrated Office*

Dynamic BrowserDynamic BrowserEmailEmail

CollaborationCollaborationCRM, SCM, ERP appsCRM, SCM, ERP apps

Speech InterfaceSpeech Interface

EmailEmail

Intel Workload Forecast, 2001

Page 56: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

Trends In GbE Adoption

20012001–– GbE is standard on all serversGbE is standard on all servers–– Price gap between 10/100 and 10/100/1000 switches with Price gap between 10/100 and 10/100/1000 switches with

uplinks is nearly closeduplinks is nearly closed

2002 2002 –– GbE Integrated on motherboardsGbE Integrated on motherboards

30% share of new desktops30% share of new desktops–– Wiring closet continues transition to GbE Wiring closet continues transition to GbE ——transition transition

complete in 2003complete in 2003

20042004–– GbE share similar to 100MbE todayGbE share similar to 100MbE today–– 100% share of new desktops100% share of new desktops

Page 57: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

GbE Fiber / Copper Deployment

GbE over Cu (Up to 100m)GbE over Cu (Up to 100m)

Between switchesBetween switches

To aggregate switches To aggregate switches

To serversTo servers

GbE over fiber between GbE over fiber between floorsfloors

10/100/1000 Ethernet over 10/100/1000 Ethernet over copper to the desktopcopper to the desktop

Gigabit Servers

10/100Desktops

10/100/1000Desktops

10/100/1000Workstations

Page 58: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

InternetVPN

PSTN Network

Quality of Service

IP Routing

Network Management

Network Access Control

Network Access Control

Intelligence In The Network

Page 59: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

Expansion of Ethernet

Page 60: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

WW Market - 10GbEPort Shipments

WW Shared Hub, Ethernet & LAN Switch Market (May02)

Page 61: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

Migration to 10GbE Applications

Page 62: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

10GbE Interoperability

Page 63: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

10GbE – Distance Support

Page 64: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

Connecting Customers - IP Everywhere

Page 65: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

Server Architectures: Competitive Technologies

Scalable Perf. vs. Availability

Scal

able

Per

form

ance

AvailabilityUniP

MPP

FTSMP

Clustering

N-way SMP

i

46

83216

Perf

orm

ance

-tp

c

Number of Processors

w/8 way

Multinode Clusters

w/4 way

2

Performance: SMP vs. Clustering

Clustering

SerialMF

SMP

MPP

Performance

Pric

e

Price/PerformanceSerial vs.Parallel Computing

Page 66: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

Server Product - Segmentation Trends

1995-1996 1997-1998 1999-2000 2001-2002

Pedestal

Rack (Front End)

Large SMPAppliancesBack-End

Telco GradeBlades

Pedestal

Rack (Front End)

Pedestal

Rack (Front End)

Pedestal

Large SMPAppliancesBack-End

Telco Grade

Large SMP

Ultra-Dense

Page 67: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

System Cost vs. High Availability

S/390MVSIBM Propl

S/390MVSIBM Propl

Acer HPBull IBMCompaq NCRDell NEC Fujitsu Siemens

Acer HPBull IBMCompaq NCRDell NEC Fujitsu Siemens

IBMIBM

Sun-SolarisHP-UXIBM-AIXNCR-SVR4

Sun-SolarisHP-UXIBM-AIXNCR-SVR4

Prop.

AS400

WinUNIX

ClusteredWin

DowntimeHrs./Syst/Yr

99.999% 99.9% 99.0%

$10K

System Availability99.99%

0.1 101 100

Avg.Syst

Price

$100 K

$1 M

$10 M

z/390

z/390Sysplex

ClusteredUNIX

ClusteredLinux

Page 68: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

*IOs per sesond for a required response time ( ms)500100MB/sec101 505

1K

10 K

100

10

1

Market Segments by Applications

TP

OLTP

DSS

Streaming

HPCHPC

Latency(IOPs)

NIC

Page 69: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

Scientific ComputingScientific Computing

ImagingImagingVideoVideo

*IOs per sesond for a required response time ( ms)

IntranetIntranet

Data Warehousing

(RAID - 0, 3)

500100MB/sec101 505

1K

10 K

100

10

1

Visual DB

Transaction Transaction ProcessingProcessing

Market Segments by ApplicationsOLTPOLTPOLTP

DSS

StreamingStreamingStreaming

(RAID - 1, 5, 6)

NICNICNIC

IOPs (Latency)

Page 70: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

Standard High-Volume ServersWW Market Forecast 2001-2006

2001 2002 2003 2004 2005 2006

Blades Rack-Wide Pedestals

Uni

ts in

000

s

9,000

3,000

0

6,000

Source: IMEX Research ©2003

Standard High-Volume Servers

Page 71: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

Blades Servers - Infrastructure

MidplaneW/Connectors

To Blades & BackModules

Storage: IP NAS or FC SAN Switch

Management Modules Remote Mgmt+KVM over IP

Cooling N+1Fans/Cooling ModulesPower: N+1Power Supplies

Networking: Gbit Ethernet Switches

BladeControlPanel

Processor Blades(6-24 typically)

MemoryDDR wECC

GbitEthernet

I/FSystemsMonitorModule

Micro-Processors

USB Ports, CD/Floppy I/F

© 2003 Source: IMEX Research

~ GbE Switch supportsTrunking/Port AggregationFlow ControlQoS Packet PrioritizationSNMP/RMONIGMP/BOOTP/TFTP……

Page 72: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

0%

100% 8+-way

4-way

2-way

1-way

2001 2002 2003 2004 2005

By 2005 2-way & 4-way processor based blades would become mainstream for high volume, low cost blade servers

Blade Servers Market - Sweet Spots

Page 73: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

Page 74: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

Ethernet for Server Blades

Page 75: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

WW Blades Market by Target Market Segments Rev $M

2001 2002 2003 2004 2005

Rev

$M

Blades - Telecom Blades - Enterpr. & SMBBlades - Hi Perf Comp. Blades - ISPs

Blades – Target Markets

WW Blades Market to reach $3.5 billion by 2005

Page 76: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

ItaniumProcessor

McKinley Madison(faster McKinley)

Montecito(Higher Performance,

SW=Madison/McKinley)

Deerfield(Dual Processor)

2001 2002 2003 2004

Intel SHV Roadmap

High-end(8-way and above)

PIII Xeon2ML2,900MHz

Profusion

XeonMP

Embedded Chipset

Mid Range(4-way)

PIII Xeon1M/2M L2,700 MHz

XeonMP

3rd Party Chipset

Entry(2-way)

PIII Xeon256K L2 1.0 Ghz

XeonE7500 &

3rd Party Chipsets

IA-32

IA-64

Page 77: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

High Performance Computing

Page 78: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

Business Processing

Collaborative

Syst Infrastructure

Web Infrastructure

Decision Support

Numeric Intensive Computing

SW/Applic Development

WindowsLinux

Other O/SUnix

$-

$1,000

$2,000

$3,000

$4,000

$5,000

$6,000

$7,000

$8,000W

W R

even

ues

$M

Servers Market by Application & OS - 2002

Server Market by Application 2002

WW Revenues $B

WW

Rev

enue

s $B

Page 79: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

Blade Server Management Software

VirtualizationVirtualization

ProvisioningProvisioning

AutomationAutomation

Allocates, Monitors, and Meters the Usage of Pooled Resources

Provisions the Resources Required to Deliver a Business Service

Automatically Maintains Application Service Level Objectives

Page 80: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

Management – Blade Servers

80%

2020%%

Ultra-dense HW• Density• Power Consumption• Cable Management

Management• Platforms integration:

Hardware Software Network Management

• Scalability• Security• Manageability• Lowest TCO

80 %

20 %

Page 81: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

VirtualApplication

SpecificClusters

PhysicalClustered

Blades

Cluster VirtualizationCluster Virtualization

Virtualization – Blade Servers

Page 82: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

0

5000

10000

15000

20000

25000

1:00

AM

3:00

AM

5:00

AM

7:00

AM

9:00

AM

11:0

0 AM

1:00

PM

3:00

PM

5:00

PM

7:00

PM

9:00

PM

Traf

fic

Company/Workload A . Company/Workload B .Company/Workload C . Company/Workload D

0

5000

10000

15000

20000

25000

1:00

AM

3:00

AM

5:00

AM

7:00

AM

9:00

AM

11:0

0 AM

1:00

PM

3:00

PM

5:00

PM

7:00

PM

9:00

PM

Traf

fic

Company/Workload A . Company/Workload B .Company/Workload C . Company/Workload D

Shared Loads - Single Computer

Individualized Loads - 4 Blades

Workload Mgmt – Internet Traffic Load

Page 83: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

Automated Data Centers/Web Services

Network Virtualization

Server Virtualization

Storage Virtualization

Internet Internet

Switching Pool

Load Balancer Pool

Server Pool

Switching Pool

Storage Pool

Util

ity C

ontr

olle

r

NAS Pool

Firewall Pool

• HP - Utility Data Center• Sun - N1/SunONE/Orion• Microsoft - .Net• IBM - OnDemand/Autonomics

Autonomics• Self Healing• Self Optimizing• Universal Identity• Single System Image• ….

Page 84: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

Resources: BladeServerCenter.com

Page 85: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

State of the Industry

IMEX Research.com(408) 268-0800

[email protected]

Page 86: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

Chaos in the Enterprise . . .

Server/OS

Network

Application

Storage

Test

Backup

Disaster Recovery

Database

Financials

TM

D/R plan (MF only)

STK Silos Tape

TM

TM

TM

IBM3090-600JMVS/ESAIMS / ADABAS

BU by FDR Upstream

HPUX 10, 11.0, 11.2 MPE Sybase 11.9, 12

Fujitsu DS90UX P/M

8mm BackupLegato to DLT

IBM ADSM3490

HP OmniBack

SunSolaris 3.2, 3.4, 3.5Oracle 7.5, 8.0

IBM RS6000AIX 4.1, 4.2, 4.3DB2/6000

Compaq ProLiant 2500,5500NT 3.5, 4.0 SQL

Cheyenn e to 4mm

Batch

IBM AS/400OS/400

InventoryExchange

CAD/CAME-commerce

Lotus NotesOLTP

CICS

File transfers AIX to HP/UX via Platinum 9.9

FTP between Sun - NT

Database extracts MVS to SP2 via MQ Series 4.4

PeopleSoft

(1) Scales poorly (2) Difficult to manage (3) Reliability is questionable (4) Management costs out of control

Page 87: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

Data Center Automation Targets

Servers Utilization

ServersServers/Admin

StorageTerabytes/DBA

NetworksNtwk Ports/Admin

SystemAvailability

20-25%80+%

15-30500+

1TB100TB

50-100500+

HAL- 3 (99.9%)

HAL- 5 (99.999%)

Page 88: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

Page 89: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

Page 90: Network Storage: State of the Industry

IME©2000-2003 IMEX Research

Page 91: Network Storage: State of the Industry

IME©2000-2003 IMEX Research