Post on 26-Dec-2015
Hyper-V Storage
Senthil RajaramSenior PMMicrosoft Corporation
agenda
• Deep Dive - Existing and New Options
• Virtual Storage Stack Improvements
• Example Configurations
Survey:
Top Impediment To Increased Virtualization?
MemoryNetwork Storage
CPU
35 %27 %45 %0 %
Hyper-V Enables Multiple Storage Options At Flexible Price-
Performance Points That Offer Continuously Availability & High
Scalability
Hyper-V & Shared StorageMore Options For Hyper-V Storage Deployments
New for Windows Server 2012
External Storage Arrays
Remote File Servers
Storage Spaces
Clustered PCI RAID
Hyper-V StorageLight Up External Storage Arrays
External Storage Array
LUN
Hyper-V Server
VM
Virtual Fibre ChannelExtends Fibre Channel Into VM’s
High Performance WorkloadsGuest ClusteringExposes SAN Functionality
Utilizes NPIV Functionality
SupportHost: Windows Server 2012
Updated NPIV HBA driver
Guest: >= Windows Server 2008
Live Migration Just Works
vHBA
WWN
NPIV HBA
VM
vHBA
WWN
Virtual Fibre Channel and Live Migration
Live Migrate
Shared Storage
WWPN A: C0:03:FF:78:22:A0:00:14
WWPN B: C0:03:FF:78:22:A0:00:15
WWPN A: C0:03:FF:78:22:A0:00:14
WWPN B: C0:03:FF:78:22:A0:00:15
1. Create A Temporary VM On Destination Hyper-V Server2. Connect Temporary VM’s HBAs To FC Fabric Using WWPN B 3. Verify Temporary VM Has Connectivity To Shared Storage
4. Complete Normal VM Live Migration (copy memory etc..) Limit IO Queue Depth To 1
5. Pause Source VM6. Change Temporary VM To Permanent VM and Start IO7. Logout of FC Fabric and Delete Source VM
Hyper-V Storage
Virtual Fibre Channel
Senthil RajaramSenior PMMicrosoft Corporation
Hyper-V Host
VHD Stack
Increased Storage Efficiency – UnmapUnmap
Storage Informed Of Unused Space
Efficiencies At Virtual LayerAllows Reuse Of Unused Blocks
Efficiencies At Physical LayerVMs Unmap Passed To Hardware
Supported OnVHDX & PassThru DisksVirtual SCSI or Virtual Fibre Channel
VHDX
External Storage Array
VM
Hyper-V Storage
Unmap Integration
Senthil RajaramSenior PMMicrosoft Corporation
Hyper-V Host
VHD Stack
Offloaded Data Transfer (ODX)Traditional Data Copy Model
Server Issues Read Request To SANData Is Read Into MemoryData Is Written From Memory To SAN
ProblemsIncreased CPU & Memory UtilizationIncreased Storage TrafficInefficient For SAN
External Storage Array
LUN1 LUN2
Hyper-V Host
VHD Stack
Offloaded Data Transfer (ODX)
Offload Enabled Data Copy ModelServer Issues Offload Read Request To SANSAN Returns Token Representing RequestServer Issues Write Request To SAN Using TokenSAN Completes Data Copy InternallySAN Confirms Data Was Copied
Reduce Maintenance TimeMerge, Mirror, VHD/VHDX Creation
Increased Workload PerformanceVM’s Are Fully ODX Aware and Enabled
External Storage Array
LUN2LUN1
Toke
n
Toke
n
Hyper-V Storage
ODX Integration
Senthil RajaramSenior PMMicrosoft Corporation
Hyper-V Storage
New Storage Options
SMB File Storage
File Server
Hyper-V Host
Share1
VHDVHD
X
Supports All Existing Scenarios
Enables New ScenariosShared Nothing LMCross-Cluster LM
Requires SMB 3.0
VM VM
VIR304-Building Flexible Hyper-V Env…
VIR306-Hyper-V over SMB
Handling Intermittent Network Failure
Resiliency: Transparently Re-establishes Network Connection
Temporary DisconnectX
Normal Operation1
Connections & Handles Re-establishedApplication Does Not Receive IO Error
3
1X3
Hyper-V Host
File Server
\\FS\Share
Hyper-V Host
File Server
13 1
Handling Permanent Network Failure
Multichannel: Transparently Uses Alternate Network Path
Permanent Disconnect
X
Normal Operation1
Connections & Handles Failover, Application Does Not Receive IO Error
3
X
\\FS\Share
Clustered
File Server
Node B
File Server
Node A
Handling File Server Node Failure
Continuous AvailabilityTransparently Fails Over Share To Different File Server
Failure of File Server,Share Failed Over To New Node
X
Normal Operation1
Connections Re-established,Application Does Not Receive IO Error
3
1
\\FS\Share\\FS\
Share
3
X
Hyper-V Host
ClusteredHyper-V Host A
File Server
Handling Hyper-V Node Failure
Cluster Client Failover (CCF)
VMs communicate identityEnables Quick Recovery
Hyper-V Host Failure, VM Starts On Different Hyper-V Node
X
Normal Operation1
Stale Handles Shot Down, New Handles Opened Without Delay
3
1
\\FS\Share
3
Hyper-V Host B
X
Host based Backup And Restore
Virtual Shadow Service For SMB
No Change in Flow For Backup
File Server
Hyper-V Host
\\FS\S1
VSS Service
Backup
Agent
Remote VSS
Agent
Remote VSS
Provider
VSS Service/ Provider
\\FS\S1~ Snap
Performance
SMB Direct (SMB over RDMA)Minimal CPU utilization for I/O processingHigh Throughput With Low Latency
SMB MultiChannelActive – Active Configuration
Setup & Administration
Management - Hyper-V & SMB PowerShell
Full Permissions On SMB Share & NTFS FoldersHyper-V Host Machine-Accounts VM Administrators
Hyper-V Host
Pool
Storage Spaces
Inbox Solution ProvidesPoolingThin provisioningResiliency
Simple SpaceMirror SpaceParity Space
Space
JBOD
WSV327-Vast Storage Capabilities for Everyone
Space
Hyper-V Host
Clustered
Storage Spaces & Clusters
Cluster Supports SpacesNot For Parity Spaces
Simple Direct IO from all Nodes
Mirrored SpaceCSV Redirection From Non-Owning NodesUse Low Latency Network (10G or RDMA) For Cluster Network
Hyper-V Host
CSVM-
SpaceM-
Space
Shared JBOD SAS
S-Spac
e
S-Space
Clustered PCI RAID
Host Hardware RAID In A Cluster
Resiliency To Node Failure LUN Fails Over
Resiliency To Disk FailureRAID
Hyper-V Host
Hyper-V Host
CSV
Clustered
Shared JBOD SAS
LUN
PCI RAID PCI RAID
WSV310-Cluster-in-a-Box, RDMA, and More
SAS
Hyper-V StorageVirtual Storage Stack Improvements
The New Default Format for Virtual Hard Disks
VHDX
Up To 64 TB
Larger Virtual Disks
MB Alignmen
t
Large Sector
Support
Enhanced Perf
Larger Block Sizes
Internal Log
Enhanced Resiliency
Embed Custom
Metadata
User Defined
Metadata
VHDX Performance - 32KB Random Writes
PassThru Fixed Dynamic Differencing125000
130000
135000
140000
145000
150000
155000
160000Disk VHD VHDX
10%
10%
Queue Depth 16
IOPS
VHDX Performance - 1MB Sequential Writes
PassThru Fixed Dynamic Differencing0
200
400
600
800
1000
1200
1400
1600
1800Disk VHD VHDX
Queue Depth 16
MB/S
25% 25%
Large Sector Support
Advanced Format/Large Sector Disk Types:Physical Media 4K
512eEmulated 512-byte Logical InterfaceRead-Modify-Write ( RMW )
4K Native: Exposes 4K Interface Directly
512B
Hardware
4K
Hardware
4K
4K
Hyper-V Host
Large Sector Support – 512e DisksSub-Optimal Performance For Existing VHDs ~30%
512b structures - Sector Bitmap, Header, Footer Parent LocatorsHardware Read-Modify-Write
Windows Server 2012 New VHDs 4K Aligned - PaddingBetter Performance, Reduced Need For RMW
No Auto Align For Existing VHDs
512e Disk
Hardware
RMW
LegacyVHD
4K AlignedOffset
Unaligned F(Off)+512b
VM
VHD
Aligned F(Off)+4 KB
VHD Performance on 512e
64KB Seq Writes0
1000
2000
3000
4000
5000
6000
7000 Unalinged AlingedRaw
IOPS
6000%
8KB Random Writes0
10
20
30
40
50
60
70
80
90
100 Unalinged AlingedRaw
IOPS
6000%
40%
Hyper-V Host
Large Sector Support – Native 4K Disks
Windows Server 2012 Supports Native 4K Disks
Software Read-Modify- Write
512b Logical Sector Virtual Disk
Performance Penalty For RMW
4K Logical Sector VHDX No Performance Penalty
VHD VHDX
512
4K
SoftwareRMW
VHDX
512
4K4K 4K
Native 4K Disk
VM
Reduce Downtime - Online MetaOperations
Reclaim Deleted Snapshot SpaceOnline Virtual Disk Merge
VM Storage MobilityOnline Virtual Disk Mirror
Quick DeploymentOnline SetParent
Hyper-V Storage Reclaim Deleted Snapshot SpaceQuick VM DeploymentSenthil RajaramSenior PMMicrosoft Corporation
Hyper-V Host
Parent Partitio
n
IO SCALING
VirtualStorage Stack
VM
VMDev
IO Throughput Was Limited By
1 Channel Per VMFixed VP For IO Interrupt Handling256 Queue Depth/SCSI, Shared For All Attached Devices
Windows Server 20121 Channel/16 VPs , Per SCSI256 Queue Depth/Device, Per SCSIIO Interrupt Handling Distributed Amongst VPs
Dev
Hyper-V Storage
Scaling IO
Senthil RajaramSenior PMMicrosoft Corporation
Related Technologies
CSV Read CacheBlock Cache Very Effective For VDI Boot Storm
Inbox De-Duplication EngineBlock Level De-DuplicationVery Effective For VHD Library Server
Not supported For Live VM Virtual Hard Disks
Hyper-V Storage
Example Configurations
SAN Configuration
Hyper-V Server Cluster
Cluster Shared Volume
Shared Virtual Fibre Channel LUN
Hyper-V Server ClusterSAN
Cluster Shared VolumeBlock Storage
Virtual FC
Fibre Channel or iSCSI
Fibre Channel or iSCSI
Block Storage
Virtual FC
Storage Space
Storage Space
Cluster Shared Volume
Cluster Shared Volume
File Share
File Share Configuration With Storage Spaces
Hyper-V Server ClusterHyper-V Server Cluster File Share
Shared SAS JBOD Array(s)
Windows Continuously Available File Servers
Mulit-ChannelSMB
Mulit-ChannelSMB
Hyper-V Server Cluster
Two Server High Availability
Storage Space
Cluster Shared Volume
Shared SAS JBOD Array(s)
Hyper-V Server
Hyper-V Server
Storage Space
Cluster Shared Volume
PCI RAID
Cluster Shared Volume
Shared SAS JBOD Array(s)
Hyper-V Server
Hyper-V Server
PCI RAID
Cluster Shared Volume
Related Content
Breakout Sessions
Session Code
Title
VIR306 Hyper-V over SMB2: Remote File Storage Support in Windows Server 2012 Hyper-V
VIR401 Hyper-V High-Availability & Mobility: Designing Infrastructure for Your Private Cloud
WSV334
Windows Server 2012 File and Storage Services Management
WSV327
Windows Server 2012 Storage Solutions: Vast Storage Capabilities for Everyone
VIR302 Enabling Disaster Recovery for Hyper-V Workloads Using Hyper-V Replica
VIR304 Building Flexible Hyper-V Environments: Hyper-V Live Migration and Live Storage Migration
WSV410
Continuously Available File Server: Under the Hood
Related Content
Hands-on Labs (session codes and titles)
Session Code
Title
VIR13-HOL Configuring Windows Server 2012 Hyper-V to Use Highly Available Storage
VIR21-HOL Configuring Windows Server 2012 Hyper-V Replica
VIR12-HOL Flexible Infrastructure with Windows Server 2012 Hyper-V
WSV-31-HOL Introduction to Storage Spaces in Windows Server 2012
Related Content
Product Demo Stations (demo station title and location)
Find Me Later At…
Location Title
VIR02-TLC Windows Server 2012 Hyper-V
WSV08-TLC Windows Server 2012 Storage
Location Title
VIR02-TLC Windows Server 2012 Hyper-V
SIA, WSV, and VIR Track Resources
Talk to our Experts at the TLC#TEVIR301
DOWNLOAD Windows Server 2012 Release Candidate
microsoft.com/windowsserverHands-On Labs
DOWNLOAD Windows Azure
Windowsazure.com/teched
Resources
Connect. Share. Discuss.
http://europe.msteched.com
Learning
Microsoft Certification & Training Resources
www.microsoft.com/learning
TechNet
Resources for IT Professionals
http://microsoft.com/technet
Resources for Developers
http://microsoft.com/msdn
Evaluations
http://europe.msteched.com/sessions
Submit your evals online
© 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to
be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS
PRESENTATION.