Network Storage: State of the Industry
-
Upload
imex-research -
Category
Technology
-
view
564 -
download
2
description
Transcript of Network Storage: State of the Industry
IME©2000-2003 IMEX Research
Network Storage: State of the Industry
Anil VasudevaPresident & Chief Analyst
IMEX Research.com(408) 268-0800
IME©2000-2003 IMEX Research
•• Markets Drivers / Industry DynamicsMarkets Drivers / Industry Dynamics
•• Market ForecastMarket Forecast
•• Emerging Technologies Roadmap Emerging Technologies Roadmap
•• Basis of CompetitionBasis of Competition
•• Supplier StrategiesSupplier Strategies
•• Futures OpportunitiesFutures Opportunities
IME©2000-2003 IMEX Research
WW Storage Systems Market
WW Storage Systems Market EU Customer Rev $M
$-
$5,000
$10,000
$15,000
$20,000
$25,000
$30,000
2002 2003 2004 2005 2006
EU C
usto
mer
Rev
$M
DAS
NAS
SAN
IME©2000-2003 IMEX Research
HA Secure End-to-End Internet
©1997-2002 IMEX Research. All Rights reserved.
InternetISP
CoreOptical
NetworkingEdge
Access ISP
ISPISP
ISP
ISP
Enterprise
IntrDet
IntrDet
IntrDet
IntrDet
xSP
DBServersApp.Servers
VPN
IntrDet
Supplier/Partner
IntrDet
Remote Office
Home Networks
56K DSLCable Modem
MP3 VOD
Wireless Cellular
WebServices
IME©2000-2003 IMEX Research
End to End Internet
Web
Web
Web
Web
Web
Web
Web
Web
Data CenterApplicationsEdge
Directory Security Policy Management
Software OS Platform
AppApp
AppApp
AppApp
AppApp
DBDB
DBDB
DBDB
IP Storage Network
FC SAN IP SAN NAS NAS
InternetCoreOptical
Edge
HA, Secure Data Center
IME©2000-2003 IMEX Research
• System Files• OLTP- Banking- Retail- Securities- Airlines ...
Scientific ComputingScientific Computing
ImagingImagingVideoVideo
*IOs per sesond for a required response time ( ms)
• Medical Imaging• PrePress• CAD/CAM• Geo InfoSystems• Geophysical mapping• Oil/Gas Exploration• Satellite Telemetry...
• OLAP• Data Warehousing• Data Mining
• Numeric IntensiveComputing
• StatisticalModeling
• Chemicals/Fluid DynamicSimulations • Scientific Visualization
• Film/Video• Video Editing• Animation• VOD
IOPs(latency)
IntranetIntranet
(RAID - 1, 5, 6)
Data Data WarehousingWarehousing
(RAID - 0, 3)
500100MB/sec101 505
1K
10 K
100
10
1
• ElectronicCommerce
• Data Bases
• Email • Hits/day
Internets
Visual DBVisual DB• Object RDBMS• Visual Data Marts
Transaction Transaction ProcessingProcessing
Market Segments by Applications
IME©2000-2003 IMEX Research
The iSCSI SAN
To Other LANs,Servers or IP SANs
Ethernet Header CRCIP TCP DATA
Client requests data from App Server
Ethernet CRCHeader IP
TCP iSCSI SCSI DATA
iSCSI-equipped App Server (“initiator”) requests data from an iSCSI storage (“target”)
Storage Arrays(iSCSI Target)
Application & DB Servers
(iSCSI Initiator)
Client Workstations
SAN GigE
Switches
LANEthernet Switches
IME©2000-2003 IMEX Research
Storage Sub Systems
Application & DB Servers
Clients
SAN
LAN Ntwk Mgmt WS
Storage Mgmt WS
Mgmt WS
Intelligent Uniform IP-based
Infrastructure
Present Data Center Infrastructue Future Infrastructue
Future Intelligent IP Infrastructure
IME©2000-2003 IMEX Research
DAS SAN iSCSI NASComputer System
SCSI Device Driver
SCSI Bus Adapter
Computer System
iSCSI Layer
FC HBA
Computer System
iSCSI LayerFC HBANIC
Computer SystemApplication
NFS / CIFS
TCP/IP Stack
NIC
I/O Redirector
OS FS
Computer SystemApplication
NFS / CIFS
TCP/IP Stack
NIC
I/O Redirector
OS FS
Block I/O
SCSI HBA
FC HBA
SANSAN IP NetworkIP Network
iSCSI Appliance
iSCSI LayerI/O Bus Adapter
TCP/IP Stack
NIC
FILE I/O
IP NetworkIP Network
NAS Appliance
File System + LVM
Device Driver
TCP/IP Stack
NIC
SANSAN
Block I/O
File System + LVMDevice Driver
TCP/IP Stack
NIC
NAS Gateway
Transporting Application Data
Application
LVM Raw Partition
OS FS
DB Syst
Application
LVM Raw Partition
OS FS
DB Syst
Application
LVM Raw Partition
OS FS
DB Syst
IME©2000-2003 IMEX Research
iSCSI SAN market to reach 1.7B by 2006
WW SAN Revenues by Technology
2001 2002 2003 2004 2005 2006
End
Use
r Cus
tom
er R
even
ues
$M
iSCSI
IB
Fibre Channel
IME©2000-2003 IMEX Research
WW FC SAN Components -Market Shares
Emul e x4 %
Ga dz oox5 3 %
S t or a ge Te k9 %
Vi x e l3 4 %
McDATA91%
InRange9%
Br oc a de8 8 %
QLogi c7 %
Ga dz oox2 %
Vi x e l3 %
Cr ossr oa ds7 2 %
Ot he r s2 8 %
Market- Fibre Channel SAN Components 2000
Hubs$51M
Router$47M
Director$186M
HBA$545M
Switch$469M
JNI20%
Agilent10%
QLogic17%
Emulex35%
Others1%
Inter-phase
3%Compaq
7%Sun7%
IME©2000-2003 IMEX Research
Storage Network Infrastructure
Storage Network Infrastructure
Hub1%
Director15%Switch
43%Router
3%
HBA38%
IME©2000-2003 IMEX Research
IP Storage Protocol Stacks
IME©2000-2003 IMEX Research
Entire stack needs attention
Challenge is to move data from application to the network and back with
minimum latency
Application
Memory
OS
Upper Layers
I/O interconnect
Data
Data
Network Interface(w or w/o TOE)
Chipset
CPU
TCP/IP (or Offload I/F)
TCP/IP Offloading
IME©2000-2003 IMEX Research
Small Offic
e/
Home Office
Workgroup
Enter-
prise
FC SANsiSCSI HW SANs
iSCSI HW SANs
iSCSI SW SANMid NAS
Department
ASP - $1K to $25KPerf. – 1-5K+ tpm
ASP - $10K to $100KPerf. – 5-15K+ tpm
ASP - $1K to $25KPerf. - 15K-50K tpm
ASP - $1K to $25KPerf. - 50K+ tpm
StorageStorageServersServers
iSCSI SW SANEntry NASPATA, SATA
Environment
PerformanceScalability
FeaturesCost
SAN Market Segmentation
IME©2000-2003 IMEX Research
iSCSI Server Options
iSCSI HBA• Enterprise Performance• Wire Speed IP Security• Management
NIC with TOE &iSCSI SW Driver• Increased Performance
NIC &iSCSI SW Driver• Entry Level• Low Cost
Market Size
Cost
&
Perfo
rman
ce
IME©2000-2003 IMEX Research
iSCSI Market 2002-06
iSCSI Ports Units Forecast
0
5 0 0
1, 0 0 0
1, 5 0 0
2 , 0 0 0
2 , 5 0 0
3 , 0 0 0
2002 2003 2004 2005 2006
iSCSI Other Ports
iSCSI HBA Ports
iSCSI Ports ASP Forecast
0
250
500
750
1,000
1,250
1,500
1,750
2,000
2002 2003 2004 2005 2006
ASp
/Por
t $Other iSCSI Initiator
10 Gbit iSCSI HBA
1Gbit iSCSI HBA
IME©2000-2003 IMEX Research
TCP + iSCSI Offload Engines
EthernetIP
TCPiSCSI
SCSI Device DriverVolume Manager
File System
Typical 1GbE NIC
EthernetIP
TCPiSCSI
SCSI Device Driver
Volume ManagerFile System
EthernetIP
TCPiSCSI
SCSI Device DriverVolume Manager
File System
Hos
tSW
Ada
pter
Host CPU
HBA Hardware
HBA Firmware
IME©2000-2003 IMEX Research
TOE/iSCSI
Implementation Targeted Performance
SAN 180– 190 MBLAN >2 GHz
Mem
ory
Host Interface
PCI-Express
Mgmt Engine
Host Interface
x4 PCI-E
Mgmt RAMFIFO Mgmt
RAMFIFO
TOE
iSCSI
GbE MAC
PHYSerDes
GbE MAC
PHY SerDes
IME©2000-2003 IMEX Research
IP SAN Management
Host Services Integration StorageProvisioning Layer
IP SAN Management Layer
Appliance Service Layer
File system monitoring
IP SAN ManagementManagement
ConsoleManagement of
iSCSI HBAsMultiPath IO Supp
and FailoverSecurity
(iSNS, CHAP, SRP)
Virtualization Mirroring Snapshot Fail-Over
iSCSI Target ManagementLVM, Error Handling, SCSI Daemon, API Interoperability
HW Acceleration: TOE, iSCSI Offload, IPsec
Storage provisioning Win, LINUX, Solaris
IME©2000-2003 IMEX Research
Industry roadmap LAN/SAN ’02-’05LA
NSA
N
Offloaded• Initiator only• TCP/IP on NIC• iSCSI on NIC
Host• Uses CPU cycles• Stateless Offloads
Offloaded• Initiator & target• TCP/IP in Si• iSCSI in host • Single port and function• Fault Tolerance• Load Balancing
Offloaded• TCP/IP in Si• Single port and function• Windows & Linux
ConvergenceConvergence•• Dual functionDual function•• Initiator & targetInitiator & target•• Offloaded TCP/IPOffloaded TCP/IP•• Offloaded iSCSI Offloaded iSCSI •• Dual portDual port•• Fault toleranceFault tolerance•• Load balancingLoad balancing•• Motherboard optionMotherboard option•• External memory External memory
IntegrationIntegration•• Shares host memoryShares host memory•• Supports 1GbE & 10 GbESupports 1GbE & 10 GbE•• Offloaded TCP/IP & iSCSI Offloaded TCP/IP & iSCSI •• Initiator & targetInitiator & target•• LAN on Blades SolutionLAN on Blades Solution•• SAN on Blades SolutionSAN on Blades Solution
IME©2000-2003 IMEX Research
10Gb Embedded TOE Evolution
TOE chipset2x1Gb TOE NIC 10 Gb TOE NIC Embedded
20042003 2005 2006 onwards
CPUCPUCPU CPUCPUCPU
MCMCMC
CPUCPUCPU CPUCPUCPU
PCI-X
TOE with 2GbE
PCI Exp PCI Exp
1GbE
1GbETOE
DMA
CPUCPUCPU
MCMC
CPUCPUCPU
PCI Exp
DMA
Uses Syst Mmry
TOE 10GbE
Ext.Mmry
PCI PCI-XExt Mmry
I/OBridge
I/OBridge
GbE
GbETOE
PCI-XPCI
I/OBridge
Uses Syst Mmry
PCI ExpPCI Exp
10 GbE1GbE1GbE
CPUCPUCPU CPUCPUCPU
MCMC
TOE
IME©2000-2003 IMEX Research
Host interface PCI 64/66 PCI-Express x4
PCI-X 1.0
PCI-Express x8
PCI-X 2.0
PCI-Express x4
Packet memory External on NIC External on NIC Host memory,
External on NIC
Host memory
RDMA No HW support Microengine assists
Microengine + state machine
Microengine + State machine
iSCSI No HW support assists St. machine St. machine
DDP/MPA No HW support St. machine St. machine St. machine
MAC/PHY 1 MAC, PHY external
Dual MACs, PHY integrated
Single MAC + Serdes, external optics
Dual MACs, PHY integrated
Context memory External on NIC Internal cache Internal cache Internal cache, > than Cranbrook
Security (IPSEC) Prototype support for SSL
External ASIC External ASIC External ASIC
#of connections 1k 8k 8k 8k+Management PXE PXE, ASF2.0 PXE, ASF 2.0 PXE, ASF2.0
TOE solutions to be state machines
IME©2000-2003 IMEX Research
HW
Software Architecture – Functions
IPUDP TCP
Channel Interface
Dual MACIPSec PHY 1 PHY 2
HW
iSCSI 1.0MPADDP
RDMA
uCode w HW Assist
HW Drivers
Base Hardware DriverBus Driver
Kernel-Mode Applications
UserKernel
Raw Packet DriveriSCSI 1.0 Offload
DriverRDMA Driver
IP TransportDriver
RDMA API
RDMA API
OS Cmpn
Offload Switch
SCSI Driver
File SystemsOS Network
Stack
OS Socket Driver
Sockets API
ApplicationsI/O Libraries
IME©2000-2003 IMEX Research
Emerging IP Based Infrastructure
Networks
Storage
VirtualizationProvisioningAutomation
Servers
TelecomIP
Infrastructure
IME©2000-2003 IMEX Research
TOE solution…
•• TCP/IP offload reduces overheads assoc. withTCP/IP offload reduces overheads assoc. with–– Protocol processingProtocol processing–– Data touching & manipulationData touching & manipulation–– Operating system relatedOperating system related
•• TOE based stack still requiresTOE based stack still requires–– Large highLarge high--speed NIC memory for TCP/IP buffersspeed NIC memory for TCP/IP buffers–– Mechanism to directly place data into app. buffersMechanism to directly place data into app. buffers–– OS support & efficient TOE I/F, OS support & efficient TOE I/F, ……
IME©2000-2003 IMEX Research
TCP/IP Offload & Mgmt•• TCP/IP Offload using TOE:TCP/IP Offload using TOE:
– 8K TCP connections Supp– RDMA Supp – Full Data path offload:– Soft session setup/teardown– Memory pool for outstanding SCSI commands– Connection & Session-level error recovery
•• IPv4 & IPv6 support:IPv4 & IPv6 support:– Checksum and segmentation offload– Large send capability
•• Operating Systems:Operating Systems:– Drivers for Windows 2k, Linux
•• Management:Management:– Build on Ophir’s management– ASF 2.0 support– WfM support– IPMI support– VLAN Tagging
IME©2000-2003 IMEX Research
NIC & iSCSI
•• Dual independent 1GbE ports:Dual independent 1GbE ports:–– PCIPCI--Ex Copper, Fiber, PCIEx Copper, Fiber, PCI--X Copper, FiberX Copper, Fiber–– PCIPCI--Express or PCIExpress or PCI--X InterfaceX Interface
•• Performance, sustained throughput:Performance, sustained throughput:–– SAN: 180 SAN: 180 –– 190 MB/sec190 MB/sec–– LAN: 1.9 Gbps Full Duplex LAN: 1.9 Gbps Full Duplex –– Simultaneous support of LAN and SAN trafficSimultaneous support of LAN and SAN traffic
•• Low CPU Utilization (<10% Low CPU Utilization (<10% on 2Ghz P4on 2Ghz P4))
•• iSCSIiSCSI offloaded solution offloaded solution usingTOEusingTOE–– Support for Windows, LinuxSupport for Windows, Linux–– iSCSIiSCSI Initiator and target modes SupportInitiator and target modes Support–– Full data path offload, Flexible TOE control pathFull data path offload, Flexible TOE control path–– Soft TCP session setup/teardown, Soft error handling and reportiSoft TCP session setup/teardown, Soft error handling and reportingng–– FullFull iSCSIiSCSI error detection and handlingerror detection and handling
•• Connection and session levels, SCSI errorsConnection and session levels, SCSI errors–– iSCSIiSCSI CRC supportCRC support–– RemoteRemote iSCSIiSCSI bootboot
IME©2000-2003 IMEX Research
iSCSI Packet Flow: Initiator to Target
IME©2000-2003 IMEX Research
FC SAN Market Shares
HP/CPQ2%
Other1%
Inrange2%
Vixel1%
Sun1%
Crossroads2%
Gadzoox2%
Antares1%
qLogic12%
Agilent5%Emulex
15%
McData17%
Brocade34%
JNI5%
IME©2000-2003 IMEX Research
4-Tiered Computing in Data Center
Source : Sun Microsystems
Tier-1 Tier-2 Tier-3Users
InternetCoreOptical
Edge Edge
Tier-0
IME©2000-2003 IMEX Research
End to End Internet
InternetCoreOptical
Edge
Web
Web
Web
Web
Web
Web
Web
Web
SANSAN SANSAN NASNAS NASNAS
Storage NetworkStorage Network
Data CenterApplicationsEdge
Directory Security Policy Management
Software OS Platform
AppApp
AppApp
AppApp
AppApp
DBDB
DBDB
DBDB
IME©2000-2003 IMEX Research
Major Players in Infrastructure Convergence
StorageNetworks
Servers
IME©2000-2003 IMEX Research
What is iSCSI
IME©2000-2003 IMEX Research
TCP/IP Overhead saps CPU
0
100
200
300
400
500
600
700
83%71%68%60%
CPU Utilization %M
B/s
ec
MBS vs. CPU Utilization
TCP/IP Overhead saps CPU
Ethernet
IP
TCP
iSCSI
SCSI Device Driver
Volume Manager
File System
Typical 1GbE NIC
HBA Hardware
Processing by Host CPULegend
IME©2000-2003 IMEX Research
TCP + iSCSI Offload Engines
EthernetIP
TCPiSCSI
SCSI Device DriverVolume Manager
File System
Typical 1GbE NIC
EthernetIP
TCPiSCSI
SCSI Device Driver
Volume ManagerFile System
EthernetIP
TCPiSCSI
SCSI Device DriverVolume Manager
File System
Hos
tSW
Ada
pter
Host CPU
HBA Hardware
HBA Firmware
IME©2000-2003 IMEX Research
IME©2000-2003 IMEX Research
Small Offic
e/
Home Office
Workgroup
Enter-
prise
FC SANsiSCSI HW SANs
iSCSI HW SANs
iSCSI SW SANMid NAS
Department
ASP - $1K to $25KPerf. – 1-5K+ tpm
ASP - $10K to $100KPerf. – 5-15K+ tpm
ASP - $1K to $25KPerf. - 15K-50K tpm
ASP - $1K to $25KPerf. - 50K+ tpm
StorageStorageServersServers
iSCSI SW SANEntry NASPATA, SATA
Environment
PerformanceScalability
FeaturesCost
SAN Market Segmentation
IME©2000-2003 IMEX Research
iSCSI Market Development
2003 2004
Early Adoption• Gateways & Routers• Long Distance Backups
Pilots• Win Server 2003 Drivers• Exchange Consolidation• Native iSCSI Disk Arrays
& Tape Libraries
Distributed iSCSI• Gateways• SAN Consolidation• Long Distance Backup
Enterprise Adoption• 10Gbps Ethernet• Multi-headed Storage
SMB Adoption• Low Cost SANs• Windows & Linux
IME©2000-2003 IMEX Research
•• DecadesDecades--old, tried and tested, everold, tried and tested, ever--evolving, widely deployedevolving, widely deployed
•• Many upperMany upper--layer protocol variations in uselayer protocol variations in use
•• Security, QoS, partitioning/subnetsSecurity, QoS, partitioning/subnets
•• LANLAN--centric manageabilitycentric manageability
•• Supports reliable Supports reliable ““streamsstreams””--based databased data
•• Work underway to fix required message framing, Work underway to fix required message framing,
and to add RDMAand to add RDMA
hardwaresoftware under development
Today’s NICPhysical
Data Link (MAC)
Network (IP)
Transport (TCP)
Session
Presentation
Application
Physical
Data Link (MAC)
Network (IP)
Transport (TCP)
Session
Presentation
Application
TCP/IP Offload Engine (TOE)
Physical
Data Link (MAC)
Network (IP)
Transport
Session
Presentation
Application
RDMA-Enabled TOE
verbs
HTT
PS
SL
SD
P
SC
SIiSCSI
iSER M
PI
Hyp
er T
ext T
rans
latio
n P
roto
col
Sec
ure
Soc
kets
Lay
er
Inte
rnet
SC
SI
iSC
SI o
ver R
DM
A
Sm
all C
ompu
ter S
yste
ms
Inte
rface
Sock
ets
Dire
ct P
roto
col
Mes
sage
Pas
sing
Inte
rface
... ...
TCPDDPMPA
RDMA P RDMA Protocol
Marker PDU Alignment
Direct Data Placement
IP Networks
IME©2000-2003 IMEX Research
IP SAN Management
Host Services Integration StorageProvisioning
Value-add IP SAN Features
Appliance Service Layer
File system monitoring
IP SAN ManagementManagement
ConsoleManagement of
iSCSI HBAsMultiPath IO Supp
and FailoverSecurity
(iSNS, CHAP, SRP)
Virtualization Mirroring Snapshot Fail-Over
iSCSI Target ManagementLVM, Error Handling, SCSI Daemon, API SDK
HW Acceleration: TOE, iSCSI Offload, IPsecWeb
bas
ed G
UI
RA
ID
Storage provisioning Win, LINUX, Solaris
IME©2000-2003 IMEX Research
Host Services IntegrationStorageProvisioning
Value-add IP SAN Features
Appliance Service Layer
File system monitoring
IP SAN ManagementManagement
ConsoleManagement of
iSCSI HBAsMultiPath IO Supp
and FailoverSecurity
(iSNS, CHAP, SRP)
Virtualization Mirroring Snapshot Fail-Over
iSCSI Target ManagementLVM, Error Handling, SCSI Daemon, API SDK
HW Acceleration: TOE, iSCSI Offload, IPsecWeb
bas
ed G
UI
RA
IDStorage provisioning Win, LINUX, Solaris
IME©2000-2003 IMEX Research
LAN/SAN Integration
2005200420032002
SAN
Offload
•Initiator • TCP/IP on NIC• iSCSI on NIC
LAN
Host
•Uses CPU cycles• Stateless Offloads
Offload
• Initiator & Target• TCP/IP in Si• iSCSI in host • Single port & Fn• Fault Tolerance• Load Balancing
Offloads
•TCP/IP in Si• Single port & Fn• Win, Linux …
LAN/SAN LAN/SAN ConvergenceConvergence
• Dual function• Initiator & Target• Offloaded TCP/IP• Offloaded iSCSI • Dual port• Fault tolerance• Load balancing• MoBO option• Ext memory
LOM/SOMLOM/SOMIntegrationIntegration•Initiator & Target•• Offloaded TCP/IP• Offloaded iSCSI • Shares host memory• 1GbE & 10 GbE Supp• LOM/SOM
IME©2000-2003 IMEX Research
10Gb Embedded TOE Evolution
TOE chipset2x1Gb TOE NIC 10 Gb TOE NIC Embedded
20042003 2005 2006 onwards
MCMC
CPUCPUCPU CPUCPUCPU
MCMC
CPUCPUCPU CPUCPUCPU
PCI-X
TOE with 2GbE
PCI Exp PCI Exp
1GbE
1GbETOE
DMA
CPUCPUCPU
MCMC
CPUCPUCPU
PCI Exp
DMA
Uses Syst Mmry
TOE 10GbE
Ext.Mmry
PCI PCI-XExt Mmry
I/OBridge
I/OBridge
GbE
GbETOE
PCI-XPCI
I/OBridge
Uses Syst Mmry
PCI ExpPCI Exp
10 GbE1GbE1GbE
CPUCPUCPU CPUCPUCPU
MCMC
TOE
IME©2000-2003 IMEX Research
NIC & iSCSI• Dual independent 1GbE ports:
– PCI-Ex Copper, Fiber, PCI-X Copper, Fiber– PCI-Express or PCI-X Interface
• Performance, sustained throughput:– SAN: 180 – 190 MB/sec– LAN: 1.9 Gbps Full Duplex – Simultaneous support of LAN and SAN traffic
• Low CPU Utilization <10% (on 2Ghz CPU)
• iSCSI Initiator & Target Mode Support– Support for Windows, Linux
• Power < 8 Watts• iSCSI offloaded solution using TOE
– Full data path offload, flexible TOE control path– Soft TCP session setup/teardown– Soft error handling and reporting– Full iSCSI error detection and handling– iSCSI CRC support– Remote iSCSI boot– Initiator and target modes
IME©2000-2003 IMEX Research
TCP/IP Offload & Mgmt• TCP/IP Offload using TOE:
–– 8K TCP connections Supp8K TCP connections Supp–– RDMA Supp RDMA Supp –– Full Data path offload:Full Data path offload:–– Soft session setup/teardownSoft session setup/teardown–– Memory pool for outstanding SCSI commandsMemory pool for outstanding SCSI commands–– Connection & SessionConnection & Session--level error recoverylevel error recovery
• IPv4 & IPv6 support:–– Checksum and segmentation offloadChecksum and segmentation offload–– Large send capabilityLarge send capability
• Operating Systems:–– Drivers for Windows 2k, LinuxDrivers for Windows 2k, Linux
• Management:–– ASF 2.0 supportASF 2.0 support–– WfMWfM supportsupport–– IPMI supportIPMI support–– VLAN TaggingVLAN Tagging
IME©2000-2003 IMEX Research
Features 2002 2003 2004 2005
Host interface PCI 64/66 PCI-Express x4
PCI-X 1.0
PCI-Express x8
PCI-X 2.0
PCI-Express x4
Packet memory External on NIC External on NIC Host memory,
Ext on NIC
Host memory
RDMA No HW support uE assists uE + St.m/c uE + St.m/c
iSCSI No HW support uE assists uE + St.m/c machine
uE + St.m/c
DDP/MPA No HW support uE + St.m/c St.m/c St.m/c
MAC/PHY 1 MAC, PHY external
Dual MACs, PHY integrated
Single MAC + Serdes, external optics
Dual MACs, PHY integrated
Context memory External on NIC Internal cache Internal cache Internal cache
Security (IPSEC) Prototype support for SSL
External ASIC External ASIC External ASIC
#of connections 1k 8k 8k 8k+?
Management PXE PXE, ASF2.0 PXE, ASF 2.0 PXE, ASF2.0
Integration Standalone Standalone Standalone South bridge with legacy & PCI-X
Features : NICs to Integration
IME©2000-2003 IMEX Research
Application
TCP/IP Offloading
The challenge The challenge is to move data is to move data from application from application to the network to the network and back with and back with
minimum minimum latencylatency
Memory
OS
Upper Layers
I/O interconnect
Data
Data
Network Interface(w or w/o TOE)
Chipset
CPU
TCP/IP (or Offload I/f)
It’s not just about TOE – entire stack needs attention
IME©2000-2003 IMEX Research
SN Technologies Migration
1985 1990 2000 2003 2005 2010
IP
Fibre Channel
p-SCSI
IME©2000-2003 IMEX Research
iSCSI SAN market to reach 1.7B by 2006
WW SAN Revenues
$-
$500
$1,000
$1,500
$2,000
$2,500
$3,000
$3,500
$4,000
$4,500
2001A 2002A 2003E 2004E 2005E 2006E
$M iSCSI
IB
Fibre Channel
IME©2000-2003 IMEX Research
iSCSI SAN market to reach 1.7B by 2006
WW SAN Revenues by Technology
2001 2002 2003 2004 2005 2006
End
Use
r Cus
tom
er R
even
ues
$M
iSCSI
IB
Fibre Channel
IME©2000-2003 IMEX Research
WW SAN Switch Port Shipments
WW SAN Switch Ports Shipments
-
2,000
4,000
6,000
8,000
10,000
12,000
14,000
2002 2003 2004 2005 2006 2007
Uni
ts in
000
s
iSCSI
FC
IME©2000-2003 IMEX Research
Ethernet Technology Transitions
IME©2000-2003 IMEX Research
20
40
60
80
100
Mb
(8xM
B)
Average & Peak Size Of Files
10
MS WordMS PPTMS XLSIntranet/Web Page
AvePeak
Number Of Times The Same Document Is Retransmitted Over LAN
20
40
60
80
100
10
MS WordMS PPTMS XLSIntranet/Web Page
1990 1995 2000 2005
Core Applications Consuming BW
IME©2000-2003 IMEX Research
Client Workload Increasing Dramatically
1998 2001 2002-3
Background
Java* appletsJava* applets
Java* appletsJava* appletsPortalsPortals
Smart agentsSmart agentsBiz Automation Biz Automation SvcsSvcs..
Java* appletsJava* appletsPortalsPortals
CompressionCompressionVirus ScanVirus Scan
System ManagementSystem ManagementBackBack--upup
AuthentAuthent/Encrypt/EncryptSynchronizationSynchronization
CompressionCompressionVirus ScanVirus Scan
System ManagementSystem ManagementBackBack--upup
AuthentAuthent/Encrypt/EncryptSynchronizationSynchronization
CompressionCompressionVirus ScanVirus Scan
System ManagementSystem ManagementBackBack--upup
Directory ServicesDirectory ServicesPeerPeer--toto--Peer ServicesPeer Services
Foreground
Multitasking OSMultitasking OSOffice* appsOffice* apps
Passive BrowserPassive Browser
MM’’taskingtasking netnet--aware OSaware OSnetnet--aware Office*aware Office*Dynamic BrowserDynamic Browser
EmailEmailCollaborationCollaboration
Next Generation OSNext Generation OSnetnet--integrated Office*integrated Office*
Dynamic BrowserDynamic BrowserEmailEmail
CollaborationCollaborationCRM, SCM, ERP appsCRM, SCM, ERP apps
Speech InterfaceSpeech Interface
EmailEmail
Intel Workload Forecast, 2001
IME©2000-2003 IMEX Research
Trends In GbE Adoption
20012001–– GbE is standard on all serversGbE is standard on all servers–– Price gap between 10/100 and 10/100/1000 switches with Price gap between 10/100 and 10/100/1000 switches with
uplinks is nearly closeduplinks is nearly closed
2002 2002 –– GbE Integrated on motherboardsGbE Integrated on motherboards
30% share of new desktops30% share of new desktops–– Wiring closet continues transition to GbE Wiring closet continues transition to GbE ——transition transition
complete in 2003complete in 2003
20042004–– GbE share similar to 100MbE todayGbE share similar to 100MbE today–– 100% share of new desktops100% share of new desktops
IME©2000-2003 IMEX Research
GbE Fiber / Copper Deployment
GbE over Cu (Up to 100m)GbE over Cu (Up to 100m)
Between switchesBetween switches
To aggregate switches To aggregate switches
To serversTo servers
GbE over fiber between GbE over fiber between floorsfloors
10/100/1000 Ethernet over 10/100/1000 Ethernet over copper to the desktopcopper to the desktop
Gigabit Servers
10/100Desktops
10/100/1000Desktops
10/100/1000Workstations
IME©2000-2003 IMEX Research
InternetVPN
PSTN Network
Quality of Service
IP Routing
Network Management
Network Access Control
Network Access Control
Intelligence In The Network
IME©2000-2003 IMEX Research
Expansion of Ethernet
IME©2000-2003 IMEX Research
WW Market - 10GbEPort Shipments
WW Shared Hub, Ethernet & LAN Switch Market (May02)
IME©2000-2003 IMEX Research
Migration to 10GbE Applications
IME©2000-2003 IMEX Research
10GbE Interoperability
IME©2000-2003 IMEX Research
10GbE – Distance Support
IME©2000-2003 IMEX Research
Connecting Customers - IP Everywhere
IME©2000-2003 IMEX Research
Server Architectures: Competitive Technologies
Scalable Perf. vs. Availability
Scal
able
Per
form
ance
AvailabilityUniP
MPP
FTSMP
Clustering
N-way SMP
i
46
83216
Perf
orm
ance
-tp
c
Number of Processors
w/8 way
Multinode Clusters
w/4 way
2
Performance: SMP vs. Clustering
Clustering
SerialMF
SMP
MPP
Performance
Pric
e
Price/PerformanceSerial vs.Parallel Computing
IME©2000-2003 IMEX Research
Server Product - Segmentation Trends
1995-1996 1997-1998 1999-2000 2001-2002
Pedestal
Rack (Front End)
Large SMPAppliancesBack-End
Telco GradeBlades
Pedestal
Rack (Front End)
Pedestal
Rack (Front End)
Pedestal
Large SMPAppliancesBack-End
Telco Grade
Large SMP
Ultra-Dense
IME©2000-2003 IMEX Research
System Cost vs. High Availability
S/390MVSIBM Propl
S/390MVSIBM Propl
Acer HPBull IBMCompaq NCRDell NEC Fujitsu Siemens
Acer HPBull IBMCompaq NCRDell NEC Fujitsu Siemens
IBMIBM
Sun-SolarisHP-UXIBM-AIXNCR-SVR4
Sun-SolarisHP-UXIBM-AIXNCR-SVR4
Prop.
AS400
WinUNIX
ClusteredWin
DowntimeHrs./Syst/Yr
99.999% 99.9% 99.0%
$10K
System Availability99.99%
0.1 101 100
Avg.Syst
Price
$100 K
$1 M
$10 M
z/390
z/390Sysplex
ClusteredUNIX
ClusteredLinux
IME©2000-2003 IMEX Research
*IOs per sesond for a required response time ( ms)500100MB/sec101 505
1K
10 K
100
10
1
Market Segments by Applications
TP
OLTP
DSS
Streaming
HPCHPC
Latency(IOPs)
NIC
IME©2000-2003 IMEX Research
Scientific ComputingScientific Computing
ImagingImagingVideoVideo
*IOs per sesond for a required response time ( ms)
IntranetIntranet
Data Warehousing
(RAID - 0, 3)
500100MB/sec101 505
1K
10 K
100
10
1
Visual DB
Transaction Transaction ProcessingProcessing
Market Segments by ApplicationsOLTPOLTPOLTP
DSS
StreamingStreamingStreaming
(RAID - 1, 5, 6)
NICNICNIC
IOPs (Latency)
IME©2000-2003 IMEX Research
Standard High-Volume ServersWW Market Forecast 2001-2006
2001 2002 2003 2004 2005 2006
Blades Rack-Wide Pedestals
Uni
ts in
000
s
9,000
3,000
0
6,000
Source: IMEX Research ©2003
Standard High-Volume Servers
IME©2000-2003 IMEX Research
Blades Servers - Infrastructure
MidplaneW/Connectors
To Blades & BackModules
Storage: IP NAS or FC SAN Switch
Management Modules Remote Mgmt+KVM over IP
Cooling N+1Fans/Cooling ModulesPower: N+1Power Supplies
Networking: Gbit Ethernet Switches
BladeControlPanel
Processor Blades(6-24 typically)
MemoryDDR wECC
GbitEthernet
I/FSystemsMonitorModule
Micro-Processors
USB Ports, CD/Floppy I/F
© 2003 Source: IMEX Research
~ GbE Switch supportsTrunking/Port AggregationFlow ControlQoS Packet PrioritizationSNMP/RMONIGMP/BOOTP/TFTP……
IME©2000-2003 IMEX Research
0%
100% 8+-way
4-way
2-way
1-way
2001 2002 2003 2004 2005
By 2005 2-way & 4-way processor based blades would become mainstream for high volume, low cost blade servers
Blade Servers Market - Sweet Spots
IME©2000-2003 IMEX Research
IME©2000-2003 IMEX Research
Ethernet for Server Blades
IME©2000-2003 IMEX Research
WW Blades Market by Target Market Segments Rev $M
2001 2002 2003 2004 2005
Rev
$M
Blades - Telecom Blades - Enterpr. & SMBBlades - Hi Perf Comp. Blades - ISPs
Blades – Target Markets
WW Blades Market to reach $3.5 billion by 2005
IME©2000-2003 IMEX Research
ItaniumProcessor
McKinley Madison(faster McKinley)
Montecito(Higher Performance,
SW=Madison/McKinley)
Deerfield(Dual Processor)
2001 2002 2003 2004
Intel SHV Roadmap
High-end(8-way and above)
PIII Xeon2ML2,900MHz
Profusion
XeonMP
Embedded Chipset
Mid Range(4-way)
PIII Xeon1M/2M L2,700 MHz
XeonMP
3rd Party Chipset
Entry(2-way)
PIII Xeon256K L2 1.0 Ghz
XeonE7500 &
3rd Party Chipsets
IA-32
IA-64
IME©2000-2003 IMEX Research
High Performance Computing
IME©2000-2003 IMEX Research
Business Processing
Collaborative
Syst Infrastructure
Web Infrastructure
Decision Support
Numeric Intensive Computing
SW/Applic Development
WindowsLinux
Other O/SUnix
$-
$1,000
$2,000
$3,000
$4,000
$5,000
$6,000
$7,000
$8,000W
W R
even
ues
$M
Servers Market by Application & OS - 2002
Server Market by Application 2002
WW Revenues $B
WW
Rev
enue
s $B
IME©2000-2003 IMEX Research
Blade Server Management Software
VirtualizationVirtualization
ProvisioningProvisioning
AutomationAutomation
Allocates, Monitors, and Meters the Usage of Pooled Resources
Provisions the Resources Required to Deliver a Business Service
Automatically Maintains Application Service Level Objectives
IME©2000-2003 IMEX Research
Management – Blade Servers
80%
2020%%
Ultra-dense HW• Density• Power Consumption• Cable Management
Management• Platforms integration:
Hardware Software Network Management
• Scalability• Security• Manageability• Lowest TCO
80 %
20 %
IME©2000-2003 IMEX Research
VirtualApplication
SpecificClusters
PhysicalClustered
Blades
Cluster VirtualizationCluster Virtualization
Virtualization – Blade Servers
IME©2000-2003 IMEX Research
0
5000
10000
15000
20000
25000
1:00
AM
3:00
AM
5:00
AM
7:00
AM
9:00
AM
11:0
0 AM
1:00
PM
3:00
PM
5:00
PM
7:00
PM
9:00
PM
Traf
fic
Company/Workload A . Company/Workload B .Company/Workload C . Company/Workload D
0
5000
10000
15000
20000
25000
1:00
AM
3:00
AM
5:00
AM
7:00
AM
9:00
AM
11:0
0 AM
1:00
PM
3:00
PM
5:00
PM
7:00
PM
9:00
PM
Traf
fic
Company/Workload A . Company/Workload B .Company/Workload C . Company/Workload D
Shared Loads - Single Computer
Individualized Loads - 4 Blades
Workload Mgmt – Internet Traffic Load
IME©2000-2003 IMEX Research
Automated Data Centers/Web Services
Network Virtualization
Server Virtualization
Storage Virtualization
Internet Internet
Switching Pool
Load Balancer Pool
Server Pool
Switching Pool
Storage Pool
Util
ity C
ontr
olle
r
NAS Pool
Firewall Pool
• HP - Utility Data Center• Sun - N1/SunONE/Orion• Microsoft - .Net• IBM - OnDemand/Autonomics
Autonomics• Self Healing• Self Optimizing• Universal Identity• Single System Image• ….
IME©2000-2003 IMEX Research
Resources: BladeServerCenter.com
IME©2000-2003 IMEX Research
State of the Industry
IMEX Research.com(408) 268-0800
IME©2000-2003 IMEX Research
Chaos in the Enterprise . . .
Server/OS
Network
Application
Storage
Test
Backup
Disaster Recovery
Database
Financials
TM
D/R plan (MF only)
STK Silos Tape
TM
TM
TM
IBM3090-600JMVS/ESAIMS / ADABAS
BU by FDR Upstream
HPUX 10, 11.0, 11.2 MPE Sybase 11.9, 12
Fujitsu DS90UX P/M
8mm BackupLegato to DLT
IBM ADSM3490
HP OmniBack
SunSolaris 3.2, 3.4, 3.5Oracle 7.5, 8.0
IBM RS6000AIX 4.1, 4.2, 4.3DB2/6000
Compaq ProLiant 2500,5500NT 3.5, 4.0 SQL
Cheyenn e to 4mm
Batch
IBM AS/400OS/400
InventoryExchange
CAD/CAME-commerce
Lotus NotesOLTP
CICS
File transfers AIX to HP/UX via Platinum 9.9
FTP between Sun - NT
Database extracts MVS to SP2 via MQ Series 4.4
PeopleSoft
(1) Scales poorly (2) Difficult to manage (3) Reliability is questionable (4) Management costs out of control
IME©2000-2003 IMEX Research
Data Center Automation Targets
Servers Utilization
ServersServers/Admin
StorageTerabytes/DBA
NetworksNtwk Ports/Admin
SystemAvailability
20-25%80+%
15-30500+
1TB100TB
50-100500+
HAL- 3 (99.9%)
HAL- 5 (99.999%)
IME©2000-2003 IMEX Research
IME©2000-2003 IMEX Research
IME©2000-2003 IMEX Research
IME©2000-2003 IMEX Research