Post on 25-Dec-2015
Module 12MXL DCB <Place supporting graphic here>
Module Objectives:
• Describe DCB• Describe each of the four DCB protocols• Enable Tagging on the array using one of three methods• Configure the MXL for DCB• Use The Broadcom utility to configure Network Partitioning for
Microsoft Servers
DCB
What is DCB?
• Data Center Bridging (DCB) –Is a set IEEE Ethernet enhancements that provide data centers with the ability to converged network traffic into multiple traffic types, like (LAN), server, and storage traffic.
• Instead of deploying an Ethernet network for LAN traffic, and additional network for storage only one DCB-enabled network is required in a data center.
• The MXL switch supports a unified fabric and the ability to consolidate multiple network infrastructures .
• The server in this network uses a single input/output (I/O) device called a converged network adapter (CNA) to support DCB.
• A CNA is a computer input/output device that combines the functionality of a host bus adapter (HBA) with a network interface controller (NIC). Multiple adapters on different devices for several traffic types are no longer required.
DCB Protocols
To ensure lossless delivery and latency-sensitive scheduling of storage and service traffic and I/Oconvergence of LAN, storage, and server traffic over a unified fabric, IEEE data center bridging adds thefollowing extensions to a classical Ethernet network:
• 802.1Qbb - Priority-based Flow Control (PFC)• 802.1Qaz - Enhanced Transmission Selection (ETS)• 802.1Qau - Congestion Notification• Data Center Bridging Exchange (DCBX) protocol
dot1p priority queues as virtual transmit queues
Receive buffers
802.1Qbb (Priority-based Flow Control)
10GELink
HALT an individual stream, but NOT all of them!
Priority Based Flow Control (802.1Qbb)
Each Class needs to be created and priority assigned
76543210
• PFC pauses transmission of priority4 traffic
802.1Qaz (Enhanced Transmission Selection)
t1
5G
4G
1G
3G
4G
3G
10GELink
t2
Allocated bandwidth is based on the class of the traffic. Which will provide a
guarantee of bandwidth
Enhanced Transmission Selection (802.1Qaz)
Actual usage. If not all bandwidth is used it can be shared with other pipes.
Data Center Bridging compatibility eXchange (DCBX-802.1Qaz)
Built upon LLDP (802.1AB) Neighbors can configure parameters
based on TLV exchange Switch will configure the arrays and
servers the servers via iSCSI TLV using LLDP
End-to-End Communication between end-points. Tells the end-
point to BACK OFF!
Congestion Notification (802.1Qau)
Conformance
• Dell has published list of companies which integrate iSCSI over DCB into their Switch products
• http://en.community.dell.com/techcenter/storage/w/wiki/2632.storage-infrastructure-and-solutions-team-publications.aspx
• Components must support the iSCSI TLV. Many companies do not currently support iSCSI TLV with their DCB implementations.
DCB implementation
• Use of VLAN tags– In order to identify priorities, each frame is tagged with a
802.1Q tag– VLAN ID is part of the tag hence VLAN ID is required for
DCB– One VLAN ID for the group and is used for all SAN 10GE
interfaces (i.e., not including management network)• Switch support
– CEE/DCB-trunking/converged switchport mode required (differs by vendor)
– Using DCBX, switch communicates configuration to end-stations
Installation and Setup
Welcome to Group Manager
Copyright 2001-2011 Dell, Inc.
It appears that the storage array has not been configured.Would you like to configure the array now ? (y/n) [n]
Please run setup before executing management commandsIt appears that the storage array has not been configured. Please run setup before executing management commands.CLI> setup def_dcb_vlan_id 2 <<TAB IS YOUR FRIEND>>
Group Manager Setup Utility
The setup utility establishes the initial network and storage configuration for a storage array and then configures the array as a member of a new or existing group of arrays.
NOTE: There is currently no support for setting DCB VLAN
ID with the Remote Setup Wizard.
Create vlan via CLI and GUI
• grpparams dcb default-vlan-id or
Verifying DCB Operation (GUI)
Disable 802.3x flow control
Disable 802.3x flow control on SFP+ ports FTOS#configure FTOS(conf)#interface range tengigabitethernet 0/1 – 32 FTOS(conf-if-range-te-0/1-32,te-0/41-56)#no flowcontrol rx on tx off FTOS(conf-if-range-te-0/1-32,te-0/41-56)#exit
Disable 802.3 x flow control on QSFP ports FTOS(conf)#interface range fortyGigE 0/33 , fortyGigE 0/37 FTOS(conf-if-range-fo-0/33,fo-0/37)#no flowcontrol rx on tx off FTOS(conf-if-range-fo-0/33,fo-0/37)#exit
Enable DCB and reload
Enable DCB and reload If DCB was previously disabled, it must be manually re-enabled. To verify and enable DCB, enter the following commands: Note: This example shows DCB currently disabled and the steps to enable DCB. FTOS#show dcb FTOS#configure FTOS(conf)#dcb enable FTOS(conf)#dcb stack-unit all pfc-buffering pfc-ports 56 pfc-queues 2 FTOS(conf)#exit FTOS#copy running-config startup-config FTOS#reload Note: The switch will reboot.
Create tagged VLAN for all ports and port-channels
Create tagged VLAN for all ports and port-channels FTOS(conf)#interface vlan VLAN-id Note: You must supply a VLAN id. The valid range is 2-4093. FTOS (conf-if-vl-100)#tagged tengigabitethernet 0/1-32 FTOS (conf-if-vl-100)#tagged tengigabitethernet 0/41-56 FTOS (conf-if-vl-100)#tagged port-channel 1 FTOS (conf-if-vl-100)#exit
Configure priority groups and policies
Configure priority groups and policies
FTOS(conf)#dcb-input pfc FTOS(conf-dcb-in)#pfc priority 4 FTOS(conf-dcb-in)#exit
FTOS(conf)#priority-group iSCSI FTOS(conf-pg)#priority-list 4 FTOS(conf-pg)#set-pgid 1 FTOS(conf-pg)#exit FTOS(conf)#priority-group OTHER FTOS(conf-pg)#priority-list 0-3,5-7 FTOS(conf-pg)#set-pgid 2 FTOS(conf-pg)#exit
FTOS(conf)#dcb-output etsFTOS(conf-dcb-out)#priority-group iSCSI qos-policy iSCSI FTOS(conf-dcb-out)#priority-group OTHER qos-policy OTHER FTOS(conf-dcb-out)#exit
FTOS (conf)#service-class dynamic dot1p
Configure ETS values
Configure ETS values FTOS#configure FTOS(conf)#qos-policy-output iSCSI ets FTOS(conf-qos-policy-out)#bandwidth-percentage 50 FTOS(conf-qos-policy-out)#exit
FTOS(conf)#qos-policy-output OTHER ets FTOS(conf-qos-policy-out)#bandwidth-percentage 50 FTOS(conf-qos-policy-out)#exit Note: the total of all percentages must add up to 100 percent
Apply priorities to switch ports
Apply priorities to switch ports
FTOS(conf)#interface range tengigabitethernet 0/1 – 32 FTOS(conf-if-range-te-0/1-32,te-0/41-56)#dcb-policy input pfc FTOS(conf-if-range-te-0/1-32,te-0/41-56)#dcb-policy output ets FTOS(conf-if-range-te-0/1-32,te-0/41-56)#protocol lldp FTOS(conf-if-range-te-0/1-32,te-0/41-56-lldp)#exit FTOS(conf-if-range-te-0/1-32,te-0/41-56)#exit
FTOS(conf)#interface range fortyGigE 0/33 , fortyGigE 0/37 FTOS(conf-if-range-fo-0/33,fo-0/37)#dcb-policy input pfc FTOS(conf-if-range-fo-0/33,fo-0/37)#dcb-policy output ets FTOS(conf-if-range-fo-0/33,fo-0/37)#exit FTOS(conf)#exit
Broadcom Active Control Suite
Broadcom Active Control Suite
Broadcom 57810S iSCSI VLAN configuration
• Here is the VLAN configuration for iSCSI traffic on the adapter port.
Initiator VLAN ID configuration
DCBX operation state and configuration verification• The DCB parameters shown are the values advertised by the
switch peer and accepted by the NIC port. It also indicates the DCB operational state for each feature.
Module Summary
• Now that you have completed this module you should be able to:• Describe DCB• Describe each of the four DCB protocols• Enable Tagging on the array using one of the three methods• Configure the MXL for DCB• Use The Broadcom utility to configure Network Partitioning for
Microsoft Servers
LabLab 12 – Converged Infrastructure Solution
• Configure the array for DCB and VLAN tagging
• Configure the MXL switch for DCB
• Use the Broadcom Utility to configure Network Partitioning
Questions?