Hyper-V Storage Performance and Scaling · Hyper-V Multi-Channel With Flexible Settings 23 Advanced...
Transcript of Hyper-V Storage Performance and Scaling · Hyper-V Multi-Channel With Flexible Settings 23 Advanced...
2012 Storage Developer Conference. © Microsoft Corporation. All Rights Reserved.
Hyper-V Storage Performance and Scaling
Joe Dai, Liang Yang Microsoft
2012 Storage Developer Conference. © Microsoft Corporation. All Rights Reserved.
Survey: Top Impediment To Increased Virtualization?
Storage 45 % Memory 35 % Network 27 % CPU 0 %
*Microsoft Internal Marketing Study
2
2012 Storage Developer Conference. © Microsoft Corporation. All Rights Reserved.
Hyper-V Enables Multiple Storage Options At Flexible Price-Performance Points That Offer Continuously Availability & High Scalability
3
Agenda
2012 Storage Developer Conference. © Microsoft Corporation. All Rights Reserved.
New Hyper-V Storage Options
4
2012 Storage Developer Conference. © Microsoft Corporation. All Rights Reserved.
New Storage Options
5
External Storage Arrays
Remote File Servers
Storage Spaces
New in Windows Server 2012
2012 Storage Developer Conference. © Microsoft Corporation. All Rights Reserved.
External Storage Arrays
Virtual Fibre Channel Extends Fibre Channel Into VM’s High Performance Workloads Guest Clustering Exposes SAN Functionality
Utilizes NPIV Functionality Support
Host: Windows Server 2012 Updated NPIV HBA Driver
Guest: Windows Server 2008 or Newer
Live Migration Just Works
6
SAN
Hyper-V Host
VM VM
WWN
vHBA
WWN
vHBA
NPIV HBA
2012 Storage Developer Conference. © Microsoft Corporation. All Rights Reserved.
Remote File Servers
Supports All Existing Scenarios
Enables New Scenarios Shared Nothing Live
Migration Cross-Cluster Live
Migration
Requires SMB 3.0
7
File Server
Hyper-V Host
VM VM
SMB Share
VHD VHDX
2012 Storage Developer Conference. © Microsoft Corporation. All Rights Reserved.
Storage Spaces
Device Pooling Thin Provisioning Resiliency
Simple Space Mirror Space Parity Space
8
JBOD
Hyper-V Host
VM VM
Pool Space
VHDX
Space
VHD
2012 Storage Developer Conference. © Microsoft Corporation. All Rights Reserved.
Clustered PCI RAID
Host Hardware RAID In A Cluster
Resiliency To Node Failure LUN Fails Over
Resiliency To Disk Failure RAID
9
Shared JBOD SAS
Clustered
Hyper-V Host
Hyper-V Host
Cluster Shared Volume
PCI RAID
PCI RAID
SAS
2012 Storage Developer Conference. © Microsoft Corporation. All Rights Reserved.
Hyper-V Storage Stack Improvements
10
2012 Storage Developer Conference. © Microsoft Corporation. All Rights Reserved.
VHDX Offloaded Data Transfer Unmap IO Scaling
11
Storage Stack Improvements
2012 Storage Developer Conference. © Microsoft Corporation. All Rights Reserved.
New Virtual Hard Disk Format Latest Spec 1.0: Bing: VHDX Format Specification
12
VHDX
2012 Storage Developer Conference. © Microsoft Corporation. All Rights Reserved.
13
VHDX
Large Sector
Support
Enhanced Perf
Larger Block Sizes
Embed Custom
Metadata
User Defined
Metadata
Larger Virtual Disks
Enhanced Resiliency
2012 Storage Developer Conference. © Microsoft Corporation. All Rights Reserved.
32KB Random Writes
14
IOPS
2012 Storage Developer Conference. © Microsoft Corporation. All Rights Reserved.
1MB Sequential Writes
15
25% 25%
2012 Storage Developer Conference. © Microsoft Corporation. All Rights Reserved.
Offloaded Data Transfer (ODX)
VMs Can Fully Leverage ODX Enabled Hardware
Reduce Maintenance Time Merge, Mirror, VHD/VHDX
Creation
16
SAN
Hyper-V Host
VM
LUN LUN
VHD Stack
Token Toke
n
2012 Storage Developer Conference. © Microsoft Corporation. All Rights Reserved.
Unmap
Unmaps are passed from VM to Physical Layer
Increased Storage Efficiency in the Entire Storage Stack
Supported on: VHDX and PassThru Disks Virtual SCSI, FC, and IDE
17
SAN
Hyper-V Host
VM
Pool Space VHDX
2012 Storage Developer Conference. © Microsoft Corporation. All Rights Reserved.
IO Scaling
Liang Yang
18
2012 Storage Developer Conference. © Microsoft Corporation. All Rights Reserved.
Hyper-V Bottlenecks in Windows Server 2008 R2
19
2012 Storage Developer Conference. © Microsoft Corporation. All Rights Reserved.
Hyper-V I/O Scaling in Windows Server 2012
20
Virtual Storage Stack
VM Device
Device
2012 Storage Developer Conference. © Microsoft Corporation. All Rights Reserved.
Hyper-V Multi-Channel Boosts VM Performance
21
VM performance scales nicely with increased number of VM VPs VM remains perfectly responsive even under most intensive workloads.
2012 Storage Developer Conference. © Microsoft Corporation. All Rights Reserved.
Experimental Performance Data
22
Both synthetic and TPC-E results show significant improvement.
2012 Storage Developer Conference. © Microsoft Corporation. All Rights Reserved.
Hyper-V Multi-Channel With Flexible Settings
23
Advanced users can fine tune up multi-channel settings in VM for optimal performance
Maximum number of channels per VM is tied up to the number of VPs to minimize the memory overhead(of small VMs) on host and other VMs.
VP count 1 2 4 8 16 32 48 64 Default channels
1 1 1 1 1 2 3 4
Maximum channels
1 1 1 2 4 8 12 16
Maximum memory per device
10MB 10MB 10MB 20MB 40MB 80MB 120MB 160MB
2012 Storage Developer Conference. © Microsoft Corporation. All Rights Reserved.
One Million IOPS Virtual Machine Demo
Host Configurations(total cost excluding server: ~$10,000) Server(1x): Dell R910 Intel Xeon E7-4850(Quad Westmere-EX 10 core with HT) 80 CPUs 256G RAM SSDs(40x): Intel 520 SATA 180GB 2.5” SATA III MLC HBAs(5x): LSI PCIe Gen. 2 Mustang 9205-8e Storage Enclosures(8x): StarTech 4 Bay 2.5” 6Gbps SAS/SATA Mobile Rack Backplane
VM Configurations: 64 vCPUs, 32G vRAM, Virtual SCSI Controller(1x), Passthru(40x)
24
2012 Storage Developer Conference. © Microsoft Corporation. All Rights Reserved.
Thank You.
25