NIC Management Storage Migration Cluster NIC.

62

Transcript of NIC Management Storage Migration Cluster NIC.

Page 1: NIC Management Storage Migration Cluster NIC.
Page 2: NIC Management Storage Migration Cluster NIC.

Converged Networking for Windows Server 2012 R2 Hyper-VTaylor Brown – Program ManagerDon Stanwyck – Program Manager

DCIM-B378

Page 3: NIC Management Storage Migration Cluster NIC.

Virtualized WorkloadsHosting InfrastructureOther Topics

Agenda

Page 4: NIC Management Storage Migration Cluster NIC.

Historical Topology7 or more physical interfaces

Management

Storage times two…

Migration

Cluster

Virtual machine access times two

NIC

NIC

NIC

NIC

NIC

Management

Storage

Migration

Cluster

Team

NIC NIC

Virtual Switch

Page 5: NIC Management Storage Migration Cluster NIC.

Converged Topology2 or more physical interfacesThey don’t have to be 10GB…

Network teaming

Virtual switch

Network QoS

Network isolation

vNIC

vNIC

vNIC

vNIC

vNIC

Management

Storage

Migration

Cluster

Team

NIC NIC

Virtual Switch

Page 6: NIC Management Storage Migration Cluster NIC.

Converged Topology with RDMAFast, low latency, low overhead SMB

Leverages converged networking

Improved storage and migration perf

Can failover to converged

vNIC

vNIC

rNIC

rNIC

vNIC

Management

Storage

Migration

Cluster

Team

NIC NIC

Virtual Switch

Page 7: NIC Management Storage Migration Cluster NIC.

Topology: converged plus RDMA, SR-IOVFast, low latency, low overhead guest networking

Leverages converged networking

Can target specific VMs

Can failover to converged

vNIC

vNIC

rNIC

rNIC

vNIC

Management

Storage

Migration

Cluster

Team

NIC NIC

Virtual Switch

Virtual Switch

NICSR-IOV

Enabled

Page 8: NIC Management Storage Migration Cluster NIC.

virtualized workloadsdemands on networking

Page 9: NIC Management Storage Migration Cluster NIC.

Low demandLucky you…

High demandThroughput?Latency?Inbound, Outbound, Both?North <-> South, East <-> West?Availability?

Demands On Network

Page 10: NIC Management Storage Migration Cluster NIC.

What is it?The grouping of 1 or more NICs to form a larger bandwidth virtual NIC that doesn’t fail unless every member of the team failsThe way to expose VLANs in native hosts (NOT in Hyper-V!!)

Why use it?Better utilization of bandwidthLoss of a NIC or NIC cable doesn’t cut off communication

How does it get along with othersDoesn’t get along with SR-IOV or RDMA (the bypass technologies)Works with all other Windows Networking Features

Recommended mode: Switch independent teaming with Dynamic Load Distribution

NIC Teaming (in the host OS)

Page 11: NIC Management Storage Migration Cluster NIC.

NetLbfo Powershell Cmdlets [Add|Get|Remove|Set]- NetLbfoTeamMember [Add|Get|Remove|Set]- NetLbfoTeamNic [Get|New|Remove|Rename|Set]- NetLbfoTeam

*-NetAdapter cmdlets also work (where applicable)Invoke the UI: LbfoAdmin.exe

Or use the link on Server Manager

NIC Teaming

Page 12: NIC Management Storage Migration Cluster NIC.

Host NIC Teaming in VMM$1 = New-SCLogicalNetwork -Name "Team"

$2 = New-SCLogicalNetworkDefinition -Name "Team_0" -LogicalNetwork $1 -VMHostGroup (Get-

SCVMHostGroup -Name "All Hosts")

-SubnetVLan (New-SCSubnetVLan -VLanID 0)

Page 13: NIC Management Storage Migration Cluster NIC.

Host NIC Teaming in VMM$1 = New-SCLogicalNetwork -Name "Team"

$2 = New-SCLogicalNetworkDefinition -Name "Team_0" -LogicalNetwork $1 -VMHostGroup (Get-

SCVMHostGroup -Name "All Hosts")

-SubnetVLan (New-SCSubnetVLan -VLanID 0)

$3 = New-SCNativeUplinkPortProfile -Name "Team" -

LogicalNetworkDefinition $2 -

LBFOLoadBalancingAlgorithm "HostDefault" -LBFOTeamMode

"SwitchIndependent"

Page 14: NIC Management Storage Migration Cluster NIC.

Host NIC Teaming in VMM$1 = New-SCLogicalNetwork -Name "Team"

$2 = New-SCLogicalNetworkDefinition -Name "Team_0" -LogicalNetwork $1 -VMHostGroup (Get-

SCVMHostGroup -Name "All Hosts")

-SubnetVLan (New-SCSubnetVLan -VLanID 0)

$3 = New-SCNativeUplinkPortProfile -Name "Team" -

LogicalNetworkDefinition $2 -

LBFOLoadBalancingAlgorithm "HostDefault" -LBFOTeamMode

"SwitchIndependent"

$4 = New-SCLogicalSwitch -Name "Team" -

SwitchUplinkMode "Team"

New-SCUplinkPortProfileSet -Name "Team" -LogicalSwitch $4 -NativeUplinkPortProfile $3

Page 15: NIC Management Storage Migration Cluster NIC.

What is it?The grouping of 1 or 2 virtual NICs to form a larger bandwidth virtual NIC that doesn’t fail unless every member of the team fails (i.e., every underlying switch loses connectivity)

Why use it?Better utilization of bandwidthLoss of a NIC or NIC cable doesn’t cut off communication to the guestProvides failure protection in a guest with SR-IOV VFs

How does it get along with othersWorks with all other Windows Networking Features in the guest

Recommended mode: Switch independent teaming with Dynamic Load Distribution

NIC Teaming (in the guest OS)

Page 16: NIC Management Storage Migration Cluster NIC.

Guest NIC Teaming in Hyper-VSet-VMNetworkAdapter

-AllowTeaming

Page 17: NIC Management Storage Migration Cluster NIC.

Guest NIC Teaming in VMMNew/Set-SCVirtualNetworkAdapterNativePortProfile

-AllowTeaming<Boolean>

Page 18: NIC Management Storage Migration Cluster NIC.

What is itA way to spread traffic processing across multiple processors

RSS for host NICs (vNICs) and SR-IOV VFsVMQ for guest NICs (vmNICs)

Why use itBecause multiple processors are better than one processorvRSS provides near line rate to a VM on existing hardware

How does it get along with othersRSS and VMQ each work with all other features except . . .RSS and VMQ can’t be used at the same time on the same NIC

VMQ, RSS, and vRSS

Page 19: NIC Management Storage Migration Cluster NIC.

Host VMq Information and ConfigurationPS C:\> Get-NetAdapterVmq

Name InterfaceDescription Enabled BaseVmqProcessor MaxProcessors NumberOfReceive Queues---- -------------------- ------- ---------------- ------------- ---------------Fabric Uplink Logical Switch Microsoft Network Adapter Mult... True 0:0 126SLOT 7 Port 2 Intel(R) Ethernet Server Adapt... True 0:0 16 63SLOT 7 Port 1 Intel(R) Ethernet Server Ada...#2 True 0:0 16 63

Page 20: NIC Management Storage Migration Cluster NIC.

Host VMq Information and ConfigurationPS C:\> Get-NetAdapterVmq

Name InterfaceDescription Enabled BaseVmqProcessor MaxProcessors NumberOfReceive Queues---- -------------------- ------- ---------------- ------------- ---------------Fabric Uplink Logical Switch Microsoft Network Adapter Mult... True 0:0 126SLOT 7 Port 2 Intel(R) Ethernet Server Adapt... True 0:0 16 63SLOT 7 Port 1 Intel(R) Ethernet Server Ada...#2 True 0:0 16 63

63 + 63 = 126

Page 21: NIC Management Storage Migration Cluster NIC.

Host VMq Information and ConfigurationPS C:\> Get-NetAdapterVmq

Name InterfaceDescription Enabled BaseVmqProcessor MaxProcessors NumberOfReceive Queues---- -------------------- ------- ---------------- ------------- ---------------Fabric Uplink Logical Switch Microsoft Network Adapter Mult... True 0:0 126SLOT 7 Port 2 Intel(R) Ethernet Server Adapt... True 0:0 16 63SLOT 7 Port 1 Intel(R) Ethernet Server Ada...#2 True 0:0 16 63

PS C:\> Disable-NetAdapterVmq

PS C:\> Enable-NetAdapterVmq

Page 22: NIC Management Storage Migration Cluster NIC.

Guest VMq Configuration in Hyper-VSet-VMNetworkAdapter

-VmqWeight <0 -100>

*Weight of 0 == disabled*Weight of 1-100 == enabled

*Default is 100

Page 23: NIC Management Storage Migration Cluster NIC.

Guest VMq Configuration in VMMNew/Set-SCVirtualNetworkAdapterNativePortProfile

-EnableVmq

*Default is enabled

Page 24: NIC Management Storage Migration Cluster NIC.

Guest View of Virtual RSS Get-NetAdapterRssEnable-NetAdapterRssDisable-NetAdapterRss

Page 25: NIC Management Storage Migration Cluster NIC.

What is itA way to get the NIC to segment a packet for youThe sender sends a large packet to the NIC, the NIC sends multiple packets that fit within the MTU (packets are not marked as segments)

Why use itReduces stack processing

How does it get along with othersLSO gets along with all other Windows Networking Features

Large Send Offload (LSO)

Page 26: NIC Management Storage Migration Cluster NIC.

Host Large Send Offload InformationPS C:\> Get-NetAdapterLso

Name Version V1IPv4Enabled IPv4Enabled IPv6Enabled---- ------- ------------- ----------- -----------vEthernet (Storage4) LSO Version 2 False True TruevEthernet (Storage3) LSO Version 2 False True TruevEthernet (Storage2) LSO Version 2 False True TruevEthernet (Storage1) LSO Version 2 False True TruevEthernet (Migration) LSO Version 2 False True TruevEthernet (Cluster) LSO Version 2 False True TruevEthernet (Fabric Managment... LSO Version 2 False True TrueFabric Managment Logical Sw... LSO Version 2 False True TrueFabric Uplink Logical Switch LSO Version 2 False True True10GBCopper-1 LSO Version 2 False True True10GBFibre-2 LSO Version 2 True True True10GBFibre-1 LSO Version 2 True True True1GBLOM-4 LSO Version 2 False True True1GBLOM-3 LSO Version 2 False True TrueRDMA-2 LSO Version 2 True True TrueRDMA-1 LSO Version 2 True True True1GBLOM-1 LSO Version 2 False True True1GBLOM-2 LSO Version 2 False True True10GBCopper-2 LSO Version 2 False True True

Page 27: NIC Management Storage Migration Cluster NIC.

What is itA way to send large data units unbrokenUsually used for storage but can be used for anything

Why use itReduces packet processing at every hop (savings estimated in the 10-25% range)

How does it get along with othersHas a slightly lower error detection probabilityRequires knowledge of path-MTUOtherwise gets along with all other Windows Networking Features

Jumbo Frames

Verifying Path MTU…C:\> ping -l 9014 <host>

Page 28: NIC Management Storage Migration Cluster NIC.

Guest View of Jumbo FramesSet-NetAdapterAdvancedProperty

-RegistryKeyword

"*JumboPacket" -RegistryValue

9014

Page 29: NIC Management Storage Migration Cluster NIC.

Topology with SR-IOV

vNIC

vNIC

vNIC

vNIC

vNIC

Management

Storage

Migration

Cluster

Team

NIC NIC

Virtual Switch

Virtual Switch

NIC

SR-IOV Enabled

Page 30: NIC Management Storage Migration Cluster NIC.

What is itSR-IOV is a way to bypass the host OS and process the networking traffic directly in the VMRSS is the way the SR-IOV bypass traffic can get distributed to different processors in the VM enabling higher throughput

Why use itBecause with SR-IOV and RSS we’ve seen over 39 Gbps of traffic handled in a VM (coming from a single 40 Gbps NIC Port)

How does it get along with othersSR-IOV doesn’t play well with NIC Teaming (host) or other switch features

Plays well with Guest NIC TeamingACLs, VM-QoS, etc., will prevent SR-IOV from being usedShould only be used in trusted VMsCan’t have more VMs than NIC VFs/vPorts*

SR-IOV and RSS

Page 31: NIC Management Storage Migration Cluster NIC.

Parent Partition

SR-IOVVirtual machine

Network stack

VM NIC

Virtual function (VF)

Hyper-V Extensible Switch

ExtensionsRouting Filtering

ACLs

SR-IOV network adapter VF

Virtual machine

Network stack

VM NIC

VM BUS

Page 32: NIC Management Storage Migration Cluster NIC.

Parent Partition

SR-IOV + RSSVirtual machine

Network stack

VM NIC

Virtual function (VF)

Hyper-V Extensible Switch

ExtensionsRouting Filtering

ACLs

SR-IOV network adapter VF

Virtual machine

Network stack

VM NIC

VM BUS

Page 33: NIC Management Storage Migration Cluster NIC.

SR-IOV Switch Configuration in Hyper-VNew-VMSwitch –EnableIov

Get-VMSwitch | filter-tableName, IovSupport,

IovSupportReasons

Page 34: NIC Management Storage Migration Cluster NIC.

SR-IOV Virtual NIC Configuration in Hyper-VSet-VMNetworkAdapter

-IovWeight <0-100>

Set-VMNetworkAdapter-IovInterruptModeration

Default, Adaptive, Off, Low,

Medium, and High

-IovQueuePairsRequested <1 – Max Uint>

Page 35: NIC Management Storage Migration Cluster NIC.

SR-IOV Switch Configuration in VMMNew-SCLogicalSwitch

-EnableSriov

Page 36: NIC Management Storage Migration Cluster NIC.

SR-IOV Port Profile Configuration in VMMNew/Set-SCVirtualNetworkAdapterNativePortProfile

-EnableSriov

Page 37: NIC Management Storage Migration Cluster NIC.

SR-IOV Guest Configuration in VMMGet-SCPortClassification |

where {$_.Name -eq “SR-IOV"}

Set-SCVirtualNetworkAdapter-PortClassification

Page 38: NIC Management Storage Migration Cluster NIC.

Low demandLucky you…

High demandThroughput?

Use NIC Teaming, SR-IOV, vRSS/Guest RSS, VMQ, LSO, Jumbo framesLatency?

Use SR-IOV, VMQ, vRSS/Guest RSSInbound, Outbound, Both?

Inbound: SR-IOV, VMQOutbound: NIC Teaming, SR-IOV, LSO, Jumbo frames

North <-> South, East <-> West?North-South demands are generally lower than East-West. Optimize East-West.

Availability?NIC Teaming

Demands On Network - revisited

Page 39: NIC Management Storage Migration Cluster NIC.

hosting infrastructuredemands on networking

Page 40: NIC Management Storage Migration Cluster NIC.

Services of the networkBandwidth management (QoS)Virtual machine mobility

Live migrationStorage migration

SMB configuration

Demands On Network

Time Session Code

Title

Wednesday

3:15 – 4:30 DCIM-B337 File Server Networking for a Private Cloud Storage Infrastructure in Windows Server 2012 R2

Page 41: NIC Management Storage Migration Cluster NIC.

What is itTwo forms: Software QoS (vmQoS) and Hardware QoS (DCB)Software QoS provides per-VM (per vSwitch port) bandwidth management for better sharingHardware QoS provides per-traffic class reservationsSoftware QoS and Hardware QoS cannot be used at the same time on the same NIC

Why use itSoftware: To manage bandwidth allocations per VM or vNICHardware: To ensure storage and data traffic play well together

How does it get along with othersQoS can’t be used when SR-IOV is used

Quality of Service

Page 42: NIC Management Storage Migration Cluster NIC.

Watch out for . . . Software QoS and Hardware QoS cannot be used at the same time on the same NICIn Software QoS (vmQoS)

If weights are used, the weights should be such that the lowest weight is not extremely different from the highest weightIf absolute bandwidth is used, the bandwidth should be such that the lowest bandwidth is not orders of magnitude less than the highest bandwidth

Once a switch is created in a mode (weight, absolute bandwidth) it can’t be changed.

Weights are better than absoluteCan’t migrate between systems where one is weights-based and the other is absoluteMigration will be blocked if absolute values can’t be honored

DCBFor best results make sure PFC/ETS is on throughout your datacenter network

Quality of Service - Caution

Page 43: NIC Management Storage Migration Cluster NIC.

Software QoS in Hyper-VNew-VMSwitch

-MinimumBandwidthMode<Absolute, Default,

None, Weight>

Set-VMSwitch-

DefaultFlowMinimumBandwidthAbsolute-

DefaultFlowMinimumBandwidthWeight

Set-VMNetworkAdapter-MaximumBandwidth-MinimumBandwidthAbsolute-MinimumBandwidthWeight

Page 44: NIC Management Storage Migration Cluster NIC.

Software QoS in VMMNew/Set-SCVirtualNetworkAdapterNativePortProfile

-MaximumBandwidth-MinimumBandwidthAbsolute-MinimumBandwidthWeight

ALSO

Add/Set-SCVMHost-NetworkPercentageReserve

Page 45: NIC Management Storage Migration Cluster NIC.

Enabling Hardware QoS in Hyper-VSet-VMNetworkAdatper

-IeeePriorityTag <On, Off>

Page 46: NIC Management Storage Migration Cluster NIC.

Enabling Hardware QoS in VMMNew/Set-SCVirtualNetworkAdapterNativePortProfile

-AllowIeeePriorityTagging<Boolean>

Page 47: NIC Management Storage Migration Cluster NIC.

What is itEnables migration of VM’s across Hyper-V serversThree different transport options: TCP, Compression, SMB

Why use itTCP – reduced CPU utilizationCompression – faster migrationsSMB – multiple interfaces (SMB Mulitchannel), reduced CPU with SMB DirectSimultaneous migrations – reduces bandwidth demand

How does it get along with othersPerfectly… except it can be a bandwidth hog

Live migration

Page 48: NIC Management Storage Migration Cluster NIC.

Live Migration Settings in Hyper-V

Set-VMHost -MaximumVirtualMachineMigrations -

VirtualMachineMigrationPerformanceOptionTCPIP, Compression, SMB

Page 49: NIC Management Storage Migration Cluster NIC.

Live Migration Settings in VMMAdd/Set-SCVMHost

-EnableLiveMigration-LiveMigrationMaximum-

LiveStorageMigrationMaximum-MigrationAuthProtocol-

MigrationPerformanceOption-MigrationSubnet

Page 50: NIC Management Storage Migration Cluster NIC.

What is itEnables live migration of virtual machine storageTraffic flows through the Hyper-V serverMaximum concurrent migrations configurable

Why use itReduces bandwidth demands

How does it get along with othersPerfectly… Just keep in mind it needs bandwidth

Storage migration

Page 51: NIC Management Storage Migration Cluster NIC.

Storage Migration Settings in Hyper-VSet-VMHost

-MaximumStorageMigrations

Page 52: NIC Management Storage Migration Cluster NIC.

Storage Migration Settings in VMMAdd/Set-SCVMHost

-LiveMigrationMaximum

Page 53: NIC Management Storage Migration Cluster NIC.

What is itQuality of Service for SMB

Why use itEnables bandwidth management of SMB connections

Live migrationProvisioningVirtual machines

How does it get along with othersWorks with SMB MultichannelWorks with SMB DirectWorks with RDMA

SMB Bandwidth Limits

Page 54: NIC Management Storage Migration Cluster NIC.

SMB Bandwidth LimitAdd-WindowsFeature FS-SMBBW

Set-SmbBandwidthLimit -Category LiveMigration-BytesPerSecond 1000MB

Set-SmbBandwidthLimit -Category VirtualMachine

-BytesPerSecond 5GB

Page 55: NIC Management Storage Migration Cluster NIC.

Key message: manage your bandwidth

hosting infrastructuredemands on networking

Page 56: NIC Management Storage Migration Cluster NIC.

Network Recommendations for a Hyper-V Cluster in Windows Server 2012

http://technet.microsoft.com/en-us/library/dn550728.aspx

Windows Server 2012 R2 NIC Teaming (LBFO) Deployment and Management

http://www.microsoft.com/en-us/download/details.aspx?id=40319

Windows Server 2012 NIC Teaming (LBFO) Deployment and Management

http://www.microsoft.com/en-us/download/details.aspx?id=30160

What’s New in Windows Server 2012 R2 Networkinghttp://channel9.msdn.com/Events/TechEd/NorthAmerica/2013/MDC-B216

Additional Content and Documentation

Page 57: NIC Management Storage Migration Cluster NIC.

Related contentTime Session Title

Monday

1:15PM – 2:30PM DCIM-B314 Extend Datacenter Networking with Partner Solutions

Tuesday

8:30AM - 9:45AM DCIM-B379 Using VMware? The Advantages of Microsoft Cloud Fundamentals with Virtualization 

8:30AM - 9:45AM DCIM-B315 Cloud Optimized Networking in Windows Server 2012 R2

10:15AM -11:30AM

DCIM-IL300 Configuring Networking with Microsoft System Center 2012 R2 Virtual Machine Manager (repeats on Wednesday at 1:30pm)

3:15 PM - 4:30 PM

DCIM-B365 Understanding Hyper-V Network Virtualization: Demo Extravaganza

5:00 PM - 6:15 PM

DCIM-B344 Network Tuning for Specific Workloads

Wednesday

3:15PM – 4:30PM DCIM-B337 File Server Networking for a Private Cloud Storage Infrastructure in Windows Server 2012 R2

5:00PM - 6:15PM  DCIM-B380 What’s New in Windows Server 2012 R2 Hyper-V 

Thursday

2:45PM - 4:00PM  DCIM-B219 Secure Design and Best Practices for Your Private Cloud

Page 58: NIC Management Storage Migration Cluster NIC.

Come Visit Us in the Microsoft Solutions Experience!

Look for Datacenter and Infrastructure ManagementTechExpo Level 1 Hall CD

For More InformationWindows Server 2012 R2http://technet.microsoft.com/en-US/evalcenter/dn205286

Windows Server

Microsoft Azure

Microsoft Azurehttp://azure.microsoft.com/en-us/

System Center

System Center 2012 R2http://technet.microsoft.com/en-US/evalcenter/dn205295

Azure PackAzure Packhttp://www.microsoft.com/en-us/server-cloud/products/windows-azure-pack

Page 59: NIC Management Storage Migration Cluster NIC.

Resources

Learning

Microsoft Certification & Training Resources

www.microsoft.com/learning

msdn

Resources for Developers

http://microsoft.com/msdn

TechNet

Resources for IT Professionals

http://microsoft.com/technet

Sessions on Demand

http://channel9.msdn.com/Events/TechEd

Page 60: NIC Management Storage Migration Cluster NIC.

Complete an evaluation and enter to win!

Page 61: NIC Management Storage Migration Cluster NIC.

Evaluate this session

Scan this QR code to evaluate this session.

Page 62: NIC Management Storage Migration Cluster NIC.

© 2014 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.