LISA ’12: The Evolution of Ethernet - USENIXLISA ’12: The Evolution of Ethernet John...
Transcript of LISA ’12: The Evolution of Ethernet - USENIXLISA ’12: The Evolution of Ethernet John...
![Page 1: LISA ’12: The Evolution of Ethernet - USENIXLISA ’12: The Evolution of Ethernet John D’Ambrosia Chairman, Ethernet Alliance (Dell) jdambrosia@ieee.org Chauncey Schwartz Marketing](https://reader033.fdocuments.us/reader033/viewer/2022042021/5e77d2806a9130543e49c78c/html5/thumbnails/1.jpg)
© 2012 Ethernet Alliance 1
LISA ’12: The Evolution of Ethernet
John D’AmbrosiaChairman, Ethernet Alliance
(Dell)[email protected]
Chauncey SchwartzMarketing Chair, Ethernet Alliance
(QLogic)[email protected]
![Page 2: LISA ’12: The Evolution of Ethernet - USENIXLISA ’12: The Evolution of Ethernet John D’Ambrosia Chairman, Ethernet Alliance (Dell) jdambrosia@ieee.org Chauncey Schwartz Marketing](https://reader033.fdocuments.us/reader033/viewer/2022042021/5e77d2806a9130543e49c78c/html5/thumbnails/2.jpg)
2© 2012 Ethernet Alliance
Regarding the Views Expressed The views expressed on IEEE standards and related
products should NOT be considered the position, explanation, or interpretation of the Ethernet Alliance.
Per IEEE-SA Standards Board Operations Manual, January 2005:“At lectures, symposia, seminars, or educational courses, an individual presenting information on IEEE standards shall make it clear that his or her views should be considered the personal views of that individual rather than the formal position, explanation, or interpretation of the IEEE.”
![Page 3: LISA ’12: The Evolution of Ethernet - USENIXLISA ’12: The Evolution of Ethernet John D’Ambrosia Chairman, Ethernet Alliance (Dell) jdambrosia@ieee.org Chauncey Schwartz Marketing](https://reader033.fdocuments.us/reader033/viewer/2022042021/5e77d2806a9130543e49c78c/html5/thumbnails/3.jpg)
3© 2012 Ethernet Alliance
Introduction Building Your Network The Growth of Ethernet Ethernet and the Data Center The Road to Success Wrap-up Q&A
AGENDA
![Page 4: LISA ’12: The Evolution of Ethernet - USENIXLISA ’12: The Evolution of Ethernet John D’Ambrosia Chairman, Ethernet Alliance (Dell) jdambrosia@ieee.org Chauncey Schwartz Marketing](https://reader033.fdocuments.us/reader033/viewer/2022042021/5e77d2806a9130543e49c78c/html5/thumbnails/4.jpg)
4© 2012 Ethernet Alliance
How do we tell the story??
Speed ? Media ? Deployment ? Function ? Application ? What’s Next ?
![Page 5: LISA ’12: The Evolution of Ethernet - USENIXLISA ’12: The Evolution of Ethernet John D’Ambrosia Chairman, Ethernet Alliance (Dell) jdambrosia@ieee.org Chauncey Schwartz Marketing](https://reader033.fdocuments.us/reader033/viewer/2022042021/5e77d2806a9130543e49c78c/html5/thumbnails/5.jpg)
5© 2012 Ethernet Alliance
What do I want from “the Cloud”The data I want
The applications I wantWhenever I want itWherever I want itHowever I want it
Thinking “Cloud” ?
![Page 6: LISA ’12: The Evolution of Ethernet - USENIXLISA ’12: The Evolution of Ethernet John D’Ambrosia Chairman, Ethernet Alliance (Dell) jdambrosia@ieee.org Chauncey Schwartz Marketing](https://reader033.fdocuments.us/reader033/viewer/2022042021/5e77d2806a9130543e49c78c/html5/thumbnails/6.jpg)
6© 2012 Ethernet Alliance
2015 Global Users and Network Connections
North America
288 Million Users2.2 Billion Networked Devices
Western Europe
314 Million Users2.3 Billion Networked Devices
Central/Eastern Europe201 Million Users
902 Million Networked Devices
Latin America260 Million Users
1.3 Billion Networked Devices
Middle East & Africa
495 Million Users 1.3 Billion Networked Devices
Asia Pacific1330 Million Users
5.8 Billion Networked Devices
Japan116 Million Users
727 Million Networked Devices
Source: nowell_01_0911.pdf citing Cisco Visual Networking Index (VNI) Global IP Traffic Forecast, 2010–2015, http://www.ieee802.org/3/ad_hoc/bwa/public/sep11/nowell_01_0911.pdf
![Page 7: LISA ’12: The Evolution of Ethernet - USENIXLISA ’12: The Evolution of Ethernet John D’Ambrosia Chairman, Ethernet Alliance (Dell) jdambrosia@ieee.org Chauncey Schwartz Marketing](https://reader033.fdocuments.us/reader033/viewer/2022042021/5e77d2806a9130543e49c78c/html5/thumbnails/7.jpg)
7© 2012 Ethernet Alliance
Example: Financial Sector
Usage growth
Bandwidth Growth
Source: http://www.ieee802.org/3/ad_hoc/bwa/public/jun11/bach_01a_0611.pdf
2000 2005 2010
Mes
sage
s per
seco
nd
5 M
0
Order Traffic Equities QuotesEquities Trades Options Data
2006 2008 2011
Source DataIndustry Distribution
0
1T
2T
3T
![Page 8: LISA ’12: The Evolution of Ethernet - USENIXLISA ’12: The Evolution of Ethernet John D’Ambrosia Chairman, Ethernet Alliance (Dell) jdambrosia@ieee.org Chauncey Schwartz Marketing](https://reader033.fdocuments.us/reader033/viewer/2022042021/5e77d2806a9130543e49c78c/html5/thumbnails/8.jpg)
8© 2012 Ethernet Alliance
Growth is throughout the Eco-system
Source: http://www.ieee802.org/3/ad_hoc/bwa/public/jun11/bach_01a_0611.pdf
Networking equipment, compute (servers) equipment and storage equipment all required to scale to match application requirements
![Page 9: LISA ’12: The Evolution of Ethernet - USENIXLISA ’12: The Evolution of Ethernet John D’Ambrosia Chairman, Ethernet Alliance (Dell) jdambrosia@ieee.org Chauncey Schwartz Marketing](https://reader033.fdocuments.us/reader033/viewer/2022042021/5e77d2806a9130543e49c78c/html5/thumbnails/9.jpg)
9© 2012 Ethernet Alliance
The Equation Remains the Same
Faster Broadband SpeedsIncreased # of
Users
Increased Access
Rates and Methods
Increased Services++ = Bandwidth
ExplosionEverywhere
Source: nowell_01_0911.pdf citing Cisco Visual Networking Index (VNI) Global IP Traffic Forecast, 2010–2015, http://www.ieee802.org/3/ad_hoc/bwa/public/sep11/nowell_01_0911.pdf
More Devices
More Internet Users
More Rich Media Content
Speed IncreasingKey Growth Factors
YOU
![Page 10: LISA ’12: The Evolution of Ethernet - USENIXLISA ’12: The Evolution of Ethernet John D’Ambrosia Chairman, Ethernet Alliance (Dell) jdambrosia@ieee.org Chauncey Schwartz Marketing](https://reader033.fdocuments.us/reader033/viewer/2022042021/5e77d2806a9130543e49c78c/html5/thumbnails/10.jpg)
10© 2012 Ethernet Alliance
Metcalfe’s LawThe value of a telecommunications network is proportional to the square of the number of connected users of the system
ChallengesDeveloping itDeploying itManaging it
BenefitsAny whereAny timeAny way
Ethernet
![Page 11: LISA ’12: The Evolution of Ethernet - USENIXLISA ’12: The Evolution of Ethernet John D’Ambrosia Chairman, Ethernet Alliance (Dell) jdambrosia@ieee.org Chauncey Schwartz Marketing](https://reader033.fdocuments.us/reader033/viewer/2022042021/5e77d2806a9130543e49c78c/html5/thumbnails/11.jpg)
11© 2012 Ethernet Alliance
The World is Your Network And
EthernetConnects It
![Page 12: LISA ’12: The Evolution of Ethernet - USENIXLISA ’12: The Evolution of Ethernet John D’Ambrosia Chairman, Ethernet Alliance (Dell) jdambrosia@ieee.org Chauncey Schwartz Marketing](https://reader033.fdocuments.us/reader033/viewer/2022042021/5e77d2806a9130543e49c78c/html5/thumbnails/12.jpg)
12© 2012 Ethernet Alliance
BUILDING YOUR NETWORK
Ethernet’s Building Blocks
![Page 13: LISA ’12: The Evolution of Ethernet - USENIXLISA ’12: The Evolution of Ethernet John D’Ambrosia Chairman, Ethernet Alliance (Dell) jdambrosia@ieee.org Chauncey Schwartz Marketing](https://reader033.fdocuments.us/reader033/viewer/2022042021/5e77d2806a9130543e49c78c/html5/thumbnails/13.jpg)
13© 2012 Ethernet Alliance
Network Concerns? Enterprise? Data Center? Metro? Carrier? Wireless? Wi-Fi? Automotive?
Ethernet is everywhere!
What’s Your Network Concern?
![Page 14: LISA ’12: The Evolution of Ethernet - USENIXLISA ’12: The Evolution of Ethernet John D’Ambrosia Chairman, Ethernet Alliance (Dell) jdambrosia@ieee.org Chauncey Schwartz Marketing](https://reader033.fdocuments.us/reader033/viewer/2022042021/5e77d2806a9130543e49c78c/html5/thumbnails/14.jpg)
14© 2012 Ethernet Alliance
One Size Doesn’t Fit All Anymore Industry challenges Market Need Increasing Bandwidth Technical Feasibility Lowering Cost per bit!
Think “Big” Scaling Economics of applications
will dictate solutions! Connecting everyone,
everywhere, all the time!
1995 2000 2005 2010 2015 2020100
1,000
10,000
100,000
1,000,000
Rate
Mb/
s
Date
Core Networking Doubling ≈18 mos
Gigabit Ethernet
10 Gigabit Ethernet
40 Gigabit Ethernet
100 Gigabit Ethernet
Server I/O Doubling ≈24 mos
Why was 40GbE and 100GbE
developed?
![Page 15: LISA ’12: The Evolution of Ethernet - USENIXLISA ’12: The Evolution of Ethernet John D’Ambrosia Chairman, Ethernet Alliance (Dell) jdambrosia@ieee.org Chauncey Schwartz Marketing](https://reader033.fdocuments.us/reader033/viewer/2022042021/5e77d2806a9130543e49c78c/html5/thumbnails/15.jpg)
15© 2012 Ethernet Alliance
IEEE 40Gb/s and 100Gb/s:Currently Defined Physical Layer Specifications
Media PHY name Description 40G 100G
Backplane 40GBASE-KR4 At least 1m backplane 4x10GParallel
Cu Cable40GBASE-CR4100GBASE-CR10
At least 7m cu (twin-ax) cable
4x10G Parallel
10x10G Parallel
MultimodeFiber
40GBASE-SR4100GBASE-SR10
At least 100m OM3 MMF(150m OM4 MMF)
4x10G Parallel
10x10G Parallel
SingleModeFiber
40GBASE-FR At least 2km SMF 40G Serial
40GBASE-LR4100GBASE-LR4
At least 10km SMF 4x10G WDM
4x25G WDM
100GBASE-ER4 At least 40km SMF 4x25G WDM
![Page 16: LISA ’12: The Evolution of Ethernet - USENIXLISA ’12: The Evolution of Ethernet John D’Ambrosia Chairman, Ethernet Alliance (Dell) jdambrosia@ieee.org Chauncey Schwartz Marketing](https://reader033.fdocuments.us/reader033/viewer/2022042021/5e77d2806a9130543e49c78c/html5/thumbnails/16.jpg)
16© 2012 Ethernet Alliance
Growing the 100GbE FamilyMedia PHY name Description 40G 100G
PCB Traces CAUI Chip-to-chip and chip-to-module interfaces
4x25GParallel
Backplane100GBASE-KR4100GBASE-KP4
NRZ-based PHYPAM-4 based PHY
4x25G Parallel
Cu Cable 100GBASE-CR4 At least 5m cu (twin-ax) cable (NRZ)
4x25G Parallel
Twisted Pair To be determined To be determined √
MMF 100GBASE-nRxAt least 20m MMFAt least 100m MMF
4x25G Parallel
SMF40GBASE-nRx At least 40km SMF 4x10G
WDM
100GBASE-nRx At least 500m SMF ?
![Page 17: LISA ’12: The Evolution of Ethernet - USENIXLISA ’12: The Evolution of Ethernet John D’Ambrosia Chairman, Ethernet Alliance (Dell) jdambrosia@ieee.org Chauncey Schwartz Marketing](https://reader033.fdocuments.us/reader033/viewer/2022042021/5e77d2806a9130543e49c78c/html5/thumbnails/17.jpg)
17© 2012 Ethernet Alliance
Forecast: 2015: Terabit! 2020:10 Terabit!
0.01
0.1
1
10
100
2004 2006 2008 2010 2012 2014 2016 2018 2020
Traf
fic re
lativ
e to
201
0 va
lue
Financial sectorfit to Figure 15 CAGR = 95%
Peeringfit to Figure 39 CAGR = 64%
IP trafficFigure 2
CAGR = 32%
Sciencefit to Figure 13
ESnet 2004 to 2011CAGR = 70%
CableFigure 20 CAGR = 50%
Figure 15 NYSE historical data
Figure 39 Euro‐IXhistorical data
HSSG tutorialSlide 22 coreCAGR = 58%
HSSG tutorialSlide 22 server I/O
CAGR = 36%
Source: IEEE 802.3 Ethernet Bandwidth Assessment, http://www.ieee802.org/3/ad_hoc/bwa/BWA_Report.pdf.
![Page 18: LISA ’12: The Evolution of Ethernet - USENIXLISA ’12: The Evolution of Ethernet John D’Ambrosia Chairman, Ethernet Alliance (Dell) jdambrosia@ieee.org Chauncey Schwartz Marketing](https://reader033.fdocuments.us/reader033/viewer/2022042021/5e77d2806a9130543e49c78c/html5/thumbnails/18.jpg)
18© 2012 Ethernet Alliance
The Future is Here
Source: https://labs.ripe.net/Members/fergalc/internet-traffic-during-olympics-2012
2012 Summer Olympics
After First Round of Euro 2012 Matches
Source: https://labs.ripe.net/Members/fergalc/internet-traffic-after-first-round-of-euro-2012-matches/AMSIXNL.png
Thanks to Bijal Sanghani, Euro-IX.
![Page 19: LISA ’12: The Evolution of Ethernet - USENIXLISA ’12: The Evolution of Ethernet John D’Ambrosia Chairman, Ethernet Alliance (Dell) jdambrosia@ieee.org Chauncey Schwartz Marketing](https://reader033.fdocuments.us/reader033/viewer/2022042021/5e77d2806a9130543e49c78c/html5/thumbnails/19.jpg)
19© 2012 Ethernet Alliance
Based on slide used by permission from David Law
19
Key:
Twisted pair
Co-axial
Point to Multipoint Fibre
Single-mode Fibre
Backplane
Twin-axial
Multimode Fibre
Voice grade copper
Chip-to chip/module
Distance (m)
10M
100M
1G
10G
100G
10 102 103 104 1051
Rate (b/s)
0.1
1M
40G
1T
Open Circle indicates development effort
Distance channel model dependentDC
Power Over Ethernet
Future CFI?
Co-axial Network
Reduced Twisted pair
![Page 20: LISA ’12: The Evolution of Ethernet - USENIXLISA ’12: The Evolution of Ethernet John D’Ambrosia Chairman, Ethernet Alliance (Dell) jdambrosia@ieee.org Chauncey Schwartz Marketing](https://reader033.fdocuments.us/reader033/viewer/2022042021/5e77d2806a9130543e49c78c/html5/thumbnails/20.jpg)
20© 2012 Ethernet Alliance
Ethernet’s Expanding Eco-system
Formation of IEEE P802.3bp RTPGE Task
Force
GbE for Automotive!
By 2019 – nominal estimate: 300 M ports per
year
What new services will be introduced?
What will this mean to you?
![Page 21: LISA ’12: The Evolution of Ethernet - USENIXLISA ’12: The Evolution of Ethernet John D’Ambrosia Chairman, Ethernet Alliance (Dell) jdambrosia@ieee.org Chauncey Schwartz Marketing](https://reader033.fdocuments.us/reader033/viewer/2022042021/5e77d2806a9130543e49c78c/html5/thumbnails/21.jpg)
21© 2012 Ethernet Alliance
The Growth of Ethernet
![Page 22: LISA ’12: The Evolution of Ethernet - USENIXLISA ’12: The Evolution of Ethernet John D’Ambrosia Chairman, Ethernet Alliance (Dell) jdambrosia@ieee.org Chauncey Schwartz Marketing](https://reader033.fdocuments.us/reader033/viewer/2022042021/5e77d2806a9130543e49c78c/html5/thumbnails/22.jpg)
22© 2012 Ethernet Alliance
Ethernet Port ShipmentsOver 400 Million Ports
shipped in 2012 for the first time!
Source: Dell’Oro Ethernet Switch Forecast Report, July 2012
![Page 23: LISA ’12: The Evolution of Ethernet - USENIXLISA ’12: The Evolution of Ethernet John D’Ambrosia Chairman, Ethernet Alliance (Dell) jdambrosia@ieee.org Chauncey Schwartz Marketing](https://reader033.fdocuments.us/reader033/viewer/2022042021/5e77d2806a9130543e49c78c/html5/thumbnails/23.jpg)
23© 2012 Ethernet Alliance
The 10GbE Server Market Looks Bright!
0.0
1.0
2.0
CREHAN RESEARCH Inc.
Ports in M
illions
10GbE Server-class Adapter/LOM Shipments
All data used with permission Seamus Crehan, Crehan Research.
![Page 24: LISA ’12: The Evolution of Ethernet - USENIXLISA ’12: The Evolution of Ethernet John D’Ambrosia Chairman, Ethernet Alliance (Dell) jdambrosia@ieee.org Chauncey Schwartz Marketing](https://reader033.fdocuments.us/reader033/viewer/2022042021/5e77d2806a9130543e49c78c/html5/thumbnails/24.jpg)
24© 2012 Ethernet Alliance
External Storage Shipments
1301227
7910
2005 2010 2015
Stor
age
(Exa
byte
s)
Total Digital Data
Source: http://www.ieee802.org/3/ad_hoc/bwa/public/sep11/kipp_01a_0911.pdf
Growth over Next Decade
# of Servers x10
Storage x50
# of Files x75
Considerthe
implications!
Entered the ZettabyteEra
![Page 25: LISA ’12: The Evolution of Ethernet - USENIXLISA ’12: The Evolution of Ethernet John D’Ambrosia Chairman, Ethernet Alliance (Dell) jdambrosia@ieee.org Chauncey Schwartz Marketing](https://reader033.fdocuments.us/reader033/viewer/2022042021/5e77d2806a9130543e49c78c/html5/thumbnails/25.jpg)
25© 2012 Ethernet Alliance
Global IP Traffic by Local Access Technology
Source: nowell_01_0911.pdf citing Cisco Visual Networking Index (VNI) Global IP Traffic Forecast, 2010–2015, http://www.ieee802.org/3/ad_hoc/bwa/public/sep11/nowell_01_0911.pdf
![Page 26: LISA ’12: The Evolution of Ethernet - USENIXLISA ’12: The Evolution of Ethernet John D’Ambrosia Chairman, Ethernet Alliance (Dell) jdambrosia@ieee.org Chauncey Schwartz Marketing](https://reader033.fdocuments.us/reader033/viewer/2022042021/5e77d2806a9130543e49c78c/html5/thumbnails/26.jpg)
26© 2012 Ethernet Alliance
Data Center Growth
Compute
Networking
StorageEntered the zettabyte (1 billion terabytes) era in 2010Individual disk drives over 1 terabyte1000 disk drive storage subsystem equals 1 Petabyte
First petaflop supercomputers in 2011Individual servers delivering 10s of Gb/s of I/OPCIe 3.0 supports 2 x 40GbE NICs now
Entered the 100GbE era in 2010Individual switches have Tb/s of bandwidth
ETHERNET: The Progression of Plug-n-Play
![Page 27: LISA ’12: The Evolution of Ethernet - USENIXLISA ’12: The Evolution of Ethernet John D’Ambrosia Chairman, Ethernet Alliance (Dell) jdambrosia@ieee.org Chauncey Schwartz Marketing](https://reader033.fdocuments.us/reader033/viewer/2022042021/5e77d2806a9130543e49c78c/html5/thumbnails/27.jpg)
27© 2012 Ethernet Alliance
ETHERNET AND THE DATA CENTER
![Page 28: LISA ’12: The Evolution of Ethernet - USENIXLISA ’12: The Evolution of Ethernet John D’Ambrosia Chairman, Ethernet Alliance (Dell) jdambrosia@ieee.org Chauncey Schwartz Marketing](https://reader033.fdocuments.us/reader033/viewer/2022042021/5e77d2806a9130543e49c78c/html5/thumbnails/28.jpg)
28© 2012 Ethernet Alliance
Top IT Initiatives
Source: 2010 ESG Research
![Page 29: LISA ’12: The Evolution of Ethernet - USENIXLISA ’12: The Evolution of Ethernet John D’Ambrosia Chairman, Ethernet Alliance (Dell) jdambrosia@ieee.org Chauncey Schwartz Marketing](https://reader033.fdocuments.us/reader033/viewer/2022042021/5e77d2806a9130543e49c78c/html5/thumbnails/29.jpg)
29© 2012 Ethernet Alliance
Server Virtualization – Driving the data center evolution
86% of servers workloads
will be virtualized
by 2018
Source: ESG Research
Source: Gartner
65% in 2010
85% in 2018
![Page 30: LISA ’12: The Evolution of Ethernet - USENIXLISA ’12: The Evolution of Ethernet John D’Ambrosia Chairman, Ethernet Alliance (Dell) jdambrosia@ieee.org Chauncey Schwartz Marketing](https://reader033.fdocuments.us/reader033/viewer/2022042021/5e77d2806a9130543e49c78c/html5/thumbnails/30.jpg)
30© 2012 Ethernet Alliance
VM density drives I/O demand which drives Network Innovation
10GbE
40GbE
Source: ESG Research
Virtual Machine density: Number of VMs deployed per physical server
![Page 31: LISA ’12: The Evolution of Ethernet - USENIXLISA ’12: The Evolution of Ethernet John D’Ambrosia Chairman, Ethernet Alliance (Dell) jdambrosia@ieee.org Chauncey Schwartz Marketing](https://reader033.fdocuments.us/reader033/viewer/2022042021/5e77d2806a9130543e49c78c/html5/thumbnails/31.jpg)
31© 2012 Ethernet Alliance
10Gb Ethernet Solutions in the Data Center
ConsolidationOptimizing data center resources
VirtualizationIncreasing resource utilization, availability and agility
Cloud Completing the journey
ConvergenceUnified data center fabric
Data Center Evolution
![Page 32: LISA ’12: The Evolution of Ethernet - USENIXLISA ’12: The Evolution of Ethernet John D’Ambrosia Chairman, Ethernet Alliance (Dell) jdambrosia@ieee.org Chauncey Schwartz Marketing](https://reader033.fdocuments.us/reader033/viewer/2022042021/5e77d2806a9130543e49c78c/html5/thumbnails/32.jpg)
32© 2012 Ethernet Alliance
All Roads Lead to Ethernet for Data Center I/ONetworking
LAN
EthernetEthernet
NAS
FileStorage
EthernetEthernet
SAN
iSCSIHBA
EthernetEthernet
SAN
Fibre ChannelHBA
EthernetEthernet
Low Latency
Ethernet[iWarp]
Ethernet[iWarp]
InfinBandHCA
InfiniBandInfiniBand
Used with Permission from Pat Thaler, Broadcom.
![Page 33: LISA ’12: The Evolution of Ethernet - USENIXLISA ’12: The Evolution of Ethernet John D’Ambrosia Chairman, Ethernet Alliance (Dell) jdambrosia@ieee.org Chauncey Schwartz Marketing](https://reader033.fdocuments.us/reader033/viewer/2022042021/5e77d2806a9130543e49c78c/html5/thumbnails/33.jpg)
33© 2012 Ethernet Alliance
Today’s Environment Separate networks for
each traffic type LAN, SAN, IPC
Unique infrastructure Server adapters Fabric switches Cables
Separate management schemes
Inherently costly and complicated
LAN
SAN
IPC
![Page 34: LISA ’12: The Evolution of Ethernet - USENIXLISA ’12: The Evolution of Ethernet John D’Ambrosia Chairman, Ethernet Alliance (Dell) jdambrosia@ieee.org Chauncey Schwartz Marketing](https://reader033.fdocuments.us/reader033/viewer/2022042021/5e77d2806a9130543e49c78c/html5/thumbnails/34.jpg)
34© 2012 Ethernet Alliance
What is Data Center Bridging? Terminology Enhanced Ethernet Datacenter Ethernet Converged Enhanced Ethernet
Lossless vs. lossy Ethernet = Lossy (expected to “drop” packets when busy) Fibre Channel = Lossless (expected to not lose information) SCSI does not recover quickly from lost packets
Enhanced Ethernet is lossless New features have been added to prevent dropped
packets Better suited for transporting SCSI traffic
![Page 35: LISA ’12: The Evolution of Ethernet - USENIXLISA ’12: The Evolution of Ethernet John D’Ambrosia Chairman, Ethernet Alliance (Dell) jdambrosia@ieee.org Chauncey Schwartz Marketing](https://reader033.fdocuments.us/reader033/viewer/2022042021/5e77d2806a9130543e49c78c/html5/thumbnails/35.jpg)
35© 2012 Ethernet Alliance
Data Center Bridging (DCB) enables converged networks
IP
FCoE10GbEiSCSI
Standards Done!
IEEE 802.1Qaz: Enhanced Transmission Selection (ETS)
IEEE 802.1Qbb: Priority-based Flow Control (PFC)
IEEE 802.1Qau: Congestion Notification
Simultaneous NAS, iSCSI,FC/FCoE
![Page 36: LISA ’12: The Evolution of Ethernet - USENIXLISA ’12: The Evolution of Ethernet John D’Ambrosia Chairman, Ethernet Alliance (Dell) jdambrosia@ieee.org Chauncey Schwartz Marketing](https://reader033.fdocuments.us/reader033/viewer/2022042021/5e77d2806a9130543e49c78c/html5/thumbnails/36.jpg)
36© 2012 Ethernet Alliance
Data Center Bridging Standards Pause IEEE 802.3X – defines link level flow control and specifies
protocols, procedures and managed objects that enable flow control full‐duplex Ethernet links to prevent lost packets
Priority Flow Control (PFC) IEEE 802.1Qbb – enhances pause mechanism to achieve flow control of 8 traffic classes by adding priority information in the flow control packets (http://www.ieee802.org/1/files/public/docs2008/bb-pelissier-pfc-proposal-0508.pdf)
Enhanced Transmission Selection (ETS) IEEE 802.1Qaz – assigns traffic classes into priority groups and manages bandwidth allocation and sharing across priority groups (http://www.ieee802.org/1/files/public/docs2008/az-wadekar-
ets-proposal-0608-v1.01.pdf)
Data Center Bridging Exchange Protocol (DCBX) IEEE 802.1Qaz –“Advertisement/configuration” to allow devices to automatically exchange DCB link capabilities (http://www.ieee802.org/1/files/public/docs2008/az-wadekar-dcbx-capability-exchange-discoveryprotocol-1108-v1.01.pdf)
Congestion Notification (CN) IEEE 802.1Qau – allows bridges to send congestion signals to end-systems to regulate the amount of network traffic
![Page 37: LISA ’12: The Evolution of Ethernet - USENIXLISA ’12: The Evolution of Ethernet John D’Ambrosia Chairman, Ethernet Alliance (Dell) jdambrosia@ieee.org Chauncey Schwartz Marketing](https://reader033.fdocuments.us/reader033/viewer/2022042021/5e77d2806a9130543e49c78c/html5/thumbnails/37.jpg)
37© 2012 Ethernet Alliance
Quick reminder on Data Center Bridging
Unifying I/Os and networks over Ethernet
Enhanced switches to support lossless Ethernet
Essentially, improved Ethernet that is suitable for data center applications
Use cases support multiple storage protocols and LAN, and high performance computing
![Page 38: LISA ’12: The Evolution of Ethernet - USENIXLISA ’12: The Evolution of Ethernet John D’Ambrosia Chairman, Ethernet Alliance (Dell) jdambrosia@ieee.org Chauncey Schwartz Marketing](https://reader033.fdocuments.us/reader033/viewer/2022042021/5e77d2806a9130543e49c78c/html5/thumbnails/38.jpg)
38© 2012 Ethernet Alliance
Deployment Process Today: Not Converged Separate NIC & HBA
Step 1: Converged edge DCB adapters DCB “top of rack” switch
Step 2: Converged core Expanded converged
network Native attach storage
Goal: Converged network Multiple storage
technologies over Ethernet Process Benefit: Provides the building blocks to
upgrade a portion of or all data center network assets into a converged infrastructure
![Page 39: LISA ’12: The Evolution of Ethernet - USENIXLISA ’12: The Evolution of Ethernet John D’Ambrosia Chairman, Ethernet Alliance (Dell) jdambrosia@ieee.org Chauncey Schwartz Marketing](https://reader033.fdocuments.us/reader033/viewer/2022042021/5e77d2806a9130543e49c78c/html5/thumbnails/39.jpg)
39© 2012 Ethernet Alliance
Enhanced Transmission Selection (ETS)
Standards
IEEE 802.1Qaz Approved as IEEE
standards in June 2011
Industry
Many switch, adapter and chipset vendors Switch vendor support
Interoperability Not applicable
See DCBX interoperability
Local forwarding decision
Works well end-to-end across different vendors
![Page 40: LISA ’12: The Evolution of Ethernet - USENIXLISA ’12: The Evolution of Ethernet John D’Ambrosia Chairman, Ethernet Alliance (Dell) jdambrosia@ieee.org Chauncey Schwartz Marketing](https://reader033.fdocuments.us/reader033/viewer/2022042021/5e77d2806a9130543e49c78c/html5/thumbnails/40.jpg)
40© 2012 Ethernet Alliance
Data Center Bridging eXchange (DCBX)
Standards
Pre-standard Convergence
Enhanced Ethernet (CEE)
IEEE P802.1Qaz Approved as IEEE
standards in June 2011
Industry
Many switch, adapter and chipset vendors
Interoperability Most venders support
CEE 1.01 Highly interoperable
Few venders support IEEE 802.1Qaz today Most have roadmap to
support this in near future
![Page 41: LISA ’12: The Evolution of Ethernet - USENIXLISA ’12: The Evolution of Ethernet John D’Ambrosia Chairman, Ethernet Alliance (Dell) jdambrosia@ieee.org Chauncey Schwartz Marketing](https://reader033.fdocuments.us/reader033/viewer/2022042021/5e77d2806a9130543e49c78c/html5/thumbnails/41.jpg)
41© 2012 Ethernet Alliance
Congestion Notification
Standards
IEEE 802.1Qau Approved as IEEE
standards in 2010
Industry
Very few support Few have roadmap in
the near future Interoperability Limited early
interoperability testing fall 2010
More testing planned
![Page 42: LISA ’12: The Evolution of Ethernet - USENIXLISA ’12: The Evolution of Ethernet John D’Ambrosia Chairman, Ethernet Alliance (Dell) jdambrosia@ieee.org Chauncey Schwartz Marketing](https://reader033.fdocuments.us/reader033/viewer/2022042021/5e77d2806a9130543e49c78c/html5/thumbnails/42.jpg)
42© 2012 Ethernet Alliance
ROAD TO SUCCESS
Testing, testing, and more testing
![Page 43: LISA ’12: The Evolution of Ethernet - USENIXLISA ’12: The Evolution of Ethernet John D’Ambrosia Chairman, Ethernet Alliance (Dell) jdambrosia@ieee.org Chauncey Schwartz Marketing](https://reader033.fdocuments.us/reader033/viewer/2022042021/5e77d2806a9130543e49c78c/html5/thumbnails/43.jpg)
43© 2012 Ethernet Alliance
A lot to test in the Converged Data Center
DCB protocols, FCoE/iSCSI/RoCE /iWARP applications, converged switches, DCB adapters, Bridging protocols, Routing protocols, 40/100GbE uplinks, virtualization performance
![Page 44: LISA ’12: The Evolution of Ethernet - USENIXLISA ’12: The Evolution of Ethernet John D’Ambrosia Chairman, Ethernet Alliance (Dell) jdambrosia@ieee.org Chauncey Schwartz Marketing](https://reader033.fdocuments.us/reader033/viewer/2022042021/5e77d2806a9130543e49c78c/html5/thumbnails/44.jpg)
44© 2012 Ethernet Alliance
Ethernet Alliance Testing end-to-end
Network testing
TCP/IP performanceSwitch performance
Ethernet
Storage testing
I/O performanceServer performance
Fibre Channel
EA Plugfest converged network testing
FCoE/iSCSI/iWARP/RoCEData Center Bridging
Storage + TCP/IPCNA
Virtualization
Ethernet Alliance facilitates multi-vendor PlugFests at
University of New Hampshire Interoperability lab
to validate end-to-end converged network functionality.
![Page 45: LISA ’12: The Evolution of Ethernet - USENIXLISA ’12: The Evolution of Ethernet John D’Ambrosia Chairman, Ethernet Alliance (Dell) jdambrosia@ieee.org Chauncey Schwartz Marketing](https://reader033.fdocuments.us/reader033/viewer/2022042021/5e77d2806a9130543e49c78c/html5/thumbnails/45.jpg)
45© 2012 Ethernet Alliance
OFC 2012: From the Cloud to the Data Center
• Optical Technologies Featuredo 100 GbE over OTNo 100 GbE (100GBASE-LR4)o 40 GbEo 40 GbE to 4 x 10 GbE Breakout o 10 GbE
http://www.ethernetalliance.org/wp-content/uploads/2012/02/EA_OFC12_press-release.pdf
Interop Las Vegas 2012 • Ethernet’s data center support
o Cloud computing o Convergenceo Virtualization
• Featuredo 40 GbE o 10 GbE
http://www.ethernetalliance.org/wp-content/uploads/2012/05/EA_PressRelease_Interop_FINAL-050112-2.pdf
© 2012 Ethernet Alliance
Interoperability Demonstrations
![Page 46: LISA ’12: The Evolution of Ethernet - USENIXLISA ’12: The Evolution of Ethernet John D’Ambrosia Chairman, Ethernet Alliance (Dell) jdambrosia@ieee.org Chauncey Schwartz Marketing](https://reader033.fdocuments.us/reader033/viewer/2022042021/5e77d2806a9130543e49c78c/html5/thumbnails/46.jpg)
46© 2012 Ethernet Alliance© 2012 Ethernet Alliance
When: Oct 22 – 26, 2012 Where: Univ. of New
Hampshire, Interoperability Laboratory
18 companies participated Testing Included
• Data Center Bridgingo 10GBASE–To 10G/40G Ethernet DCB networko Terabit capable fabric with 18
vendors interoperating
http://www.ethernetalliance.org/wp-content/uploads/2012/10/EA_Terafabric_media-alert_FINAL_101712.pdf
TeraFabric Plugfest 2012
![Page 47: LISA ’12: The Evolution of Ethernet - USENIXLISA ’12: The Evolution of Ethernet John D’Ambrosia Chairman, Ethernet Alliance (Dell) jdambrosia@ieee.org Chauncey Schwartz Marketing](https://reader033.fdocuments.us/reader033/viewer/2022042021/5e77d2806a9130543e49c78c/html5/thumbnails/47.jpg)
47© 2012 Ethernet Alliance
THE ETHERNET ALLIANCE A global community of end users, system vendors,
component suppliers and academia Mission
• Promote existing and emerging IEEE 802 Ethernet standards• Accelerate industry adoption • Demonstrate multi-vendor interoperability
2012 Strategic Priorities• Demonstrating Interoperability• Industry Consensus Building• Global Expansion• Marketing & Education
The Voice of Ethernet
![Page 48: LISA ’12: The Evolution of Ethernet - USENIXLISA ’12: The Evolution of Ethernet John D’Ambrosia Chairman, Ethernet Alliance (Dell) jdambrosia@ieee.org Chauncey Schwartz Marketing](https://reader033.fdocuments.us/reader033/viewer/2022042021/5e77d2806a9130543e49c78c/html5/thumbnails/48.jpg)
48© 2012 Ethernet Alliance
Reaching Consensus
End users Equipment Vendors Chip Vendors Optics Vendors Cable Suppliers
Connector Vendors Test Equipment Vendors PCB Materials Vendors PCB Mfg. and Assembly Vendors Consultants
• Any standards development effort might include these (and others):
• In the IEEE technical decisions require > 75% consensus
• What is the industry consensus?
• Myth: The IEEE makes the decisions• Reality: The IEEE is a forum for the industry to make the
decisions
![Page 49: LISA ’12: The Evolution of Ethernet - USENIXLISA ’12: The Evolution of Ethernet John D’Ambrosia Chairman, Ethernet Alliance (Dell) jdambrosia@ieee.org Chauncey Schwartz Marketing](https://reader033.fdocuments.us/reader033/viewer/2022042021/5e77d2806a9130543e49c78c/html5/thumbnails/49.jpg)
49© 2012 Ethernet Alliance
The Ethernet AllianceThe Voice of Ethernet
For more information visit: www.ethernetalliance.org; Follow @EthernetAllianc on TwitterJoin the Ethernet Alliance LinkedIn groupVisit the Ethernet Alliance Facebook page
Questions? Contact: Morgan Fricke – Director of Operations
− [email protected] John D’Ambrosia – Chairman of the Board
![Page 50: LISA ’12: The Evolution of Ethernet - USENIXLISA ’12: The Evolution of Ethernet John D’Ambrosia Chairman, Ethernet Alliance (Dell) jdambrosia@ieee.org Chauncey Schwartz Marketing](https://reader033.fdocuments.us/reader033/viewer/2022042021/5e77d2806a9130543e49c78c/html5/thumbnails/50.jpg)
50© 2012 Ethernet Alliance
Discussion and Q&A