Post on 13-Apr-2020
Swaroop DuttaEric Knauft
STO2986BU
#VMworld #STO2986BU
vSAN TechnicalDeep Dive
VMworld 2017 Content: Not fo
r publication or distri
bution
• This presentation may contain product features that are currently under development.
• This overview of new technology represents no commitment from VMware to deliver these features in any generally available product.
• Features are subject to change, and must not be included in contracts, purchase orders, or sales agreements of any kind.
• Technical feasibility and market demand will affect final delivery.
• Pricing and packaging for any new technologies or features discussed or presented have not been determined.
Disclaimer
2
VMworld 2017 Content: Not fo
r publication or distri
bution
VMware vSAN Delivers a Native vSphere Architecture
Runs on any standard x86 server
Pools HDD/SSD into a shared datastore
Delivers enterprise-grade scale and performance
Managed through per-VM storage policies
Deeply integrated with the VMware stack
vSphere vSAN
vSAN DatastoreVMworld 2017 Content: N
ot for publicatio
n or distribution
March 2015
All Flash
64 Node Cluster
2x Hybrid Speed
Sep 2015
Stretched Cluster
Replication: 5min
RPO
2-node ROBO
March 2016
Deduplication
Compression
RAID5/6
Quality of Service
vSAN 6.0 vSAN 6.1 vSAN 6.5
Accelerating Innovation
VSAN 5.5 vSAN 6.2
Nov 2016
iSCSI Support
2-Node Direct
Connect
Large Capacity
Drives
VMworld 2017 Content: Not fo
r publication or distri
bution
Rapid Pace of Innovation: vSAN 6.6 Biggest Release Ever!20+ New Major vSAN Features
3/2014
v5.5
• Distributed RAID• Per-VM SPBM• Set and change FTT via
policy• In-kernel hyper-
convergence engine• RVC and Observer
3/2015
v6.0
• All-flash architecture• Perf improvements (4x
IOPS)• 64-node support• High density storage
blades• Fault domain awareness• Scalable snapshots and
clones• Disk enclosure
management
8/2015
v6.1
• Windows Failover Clustering
• Oracle RAC support• HW checksum and
encryption• 2-node ROBO mode• UltraDIMM and NVMe
support• Stretch clusters• 5 min RPO (vSphere Rep) • SMP-FT support• Health Check, vROps,
LogInsight
2/2016
v6.2
• IPv6 support• Software checksum• Nearline dedup and
compression on all-flash
• Erasure coding on all-flash
• Qos: IOPS limits• Performance
monitoring service
10/2016
v6.5
• iSCSI• 2-Node direct connect• PowerCLI• Public APIs and SDK• 512e support• All-Flash to all editions
• Native encryption for data-at-rest• Compliance certifications• Resilient management independent of vCenter• Degraded Disk Handling v2.0 (DDHv2)• Smart repairs and enhanced rebalancing• Intelligent rebuilds using partial repairs• Certified file service & data protection solutions• Stretched clusters with local failure protection• Site affinity for stretched clusters• 1-click witness change for Stretched Cluster• vSAN Management Pack for vRealize• Enhanced vSAN SDK and PowerCLI• Simple networking with Unicast • vSAN Cloud Analytics with real-time support
notification and recommendations• vSAN Config Assist with 1-click hardware
lifecycle management• Extended vSAN Health Services• vSAN Easy Install with 1-click fixes• Up to 50% greater IOPS for all-flash with
optimized checksum and dedupe• Support for new next-gen workloads• vSAN for Photon in Photon Platform 1.1• Day 0 support for latest flash technologies• Expanded caching tier choice• Docker Volume Driver 1.1
4/2017
v6.6
© 2017 VMware Inc. All rights reserved. Confidential – Not for Distribution(vSphere 6.5 EP02 Patch)
VMworld 2017 Content: Not fo
r publication or distri
bution
vSAN 6.6.1
6
Enhanced Operations
✓Partial Rebuilds
✓Smart Repairs
✓Point Fix
✓What-Ifs
✓Resync Throttling
s
All-Flash
Optimizations
✓Support for Intel Xeon
Scalable
✓All-Flash performance
improvements
✓New Platform Support
Management
✓Firmware/driver auto
updates
✓Performance Analytics
✓Analytics-based KB
awareness
Security &
Availability
✓Encryption
✓Local Failure Protection
for Stretched Clusters
VMworld 2017 Content: Not fo
r publication or distri
bution
Secure Data with vSAN Data-at-Rest Encryption
• Datastore level, data-at-rest encryption for all objects on vSAN Datastore
• Enabled at cluster level, supporting hybrid, all-flash, and stretched clusters
• No need for self encrypting drives (SEDs), reducing cost and complexity
• Works with all vSAN features, including deduplication and compression
• Integrates with KMIP compliant key management technologies, including SafeNet, Hytrust, Thales, Vormetric, etc.
vSphere vSAN
vSAN Datastore
VMworld 2017 Content: Not fo
r publication or distri
bution
Encryption – Details
8
• Encryption key in memory used to encrypt data and then place in cache tier and destaged to capacity tier
• Data remains deduped and compressed with encryption
• Provisioning of KMS is same for VMcryptand vSAN Encryption
• Workflows factored for host reboots, adding new hosts or changing keys VMworld 2017 Content: N
ot for publicatio
n or distribution
Low Cost Local and Remote Protection for Stretched Clusters
vSphere vSAN
ClusterCluster
5ms RTT, 10GbE
• Redundancy locally andacross sites
• With site failure, vSAN maintains availability with local redundancy in surviving site
• No change in stretched cluster configuration steps
• Optimized site locality logic to minimize I/O traffic across sites
RAID-6
3rd site for
witness
RAID-6
RAID-1
VMworld 2017 Content: Not fo
r publication or distri
bution
Increase Flexibilitywith Site Affinity for Stretched Clusters
vSphere vSAN
ClusterCluster
• User can specify single site location of VM’s components if site level protection is unnecessary
• Policy driven using SPBM
• Reduces network and storage requirements by running workloads closer to the clients
3rd site for
witness
RAID-6
VMworld 2017 Content: Not fo
r publication or distri
bution
Stretched Cluster Optimizations
11
vSphere vSAN
ClusterCluster
5ms RTT, 10GbE
RAID-6
3rd site for
witness
RAID-6
RAID-1
Proxy
• Data needs to be sent to multiple replicas on the remote site
• Will consume network bandwidth if not optimized
• vSAN sends copies once to a proxy on the remote site
• Proxy will replicate the copies as many times required locally
• Network bandwidth is conservedVMworld 2017 Content: N
ot for publicatio
n or distribution
Intelligent Rebuilds Using Enhanced Rebalancing
vSphere vSAN
vSAN Datastore
• Allows rebalance even when disks are mostly full by splitting large components to fit in free space
• Improved visibility in rebalancing status in Health Services
• New customizable “throttling” of resync activity using slider bar
VMworld 2017 Content: Not fo
r publication or distri
bution
Component Splitting and Reporting for Enhanced Rebalancing
R1
C2C1
R1
R0C1
C4C3
• C2 is split into smaller C3 and C4 components
• C3 and C4 can now fit into available space – avoids further resyncs, rebalance
• Health services now shows resyncing components, amount left to resync and components that are resyncingVMworld 2017 Content: N
ot for publicatio
n or distribution
Intelligent Rebuilds Using Partial Repairs
• More resilient repair process
• Repairs as many components as possible even if not enough resources to ensure fullcompliance
• Remaining components will be repaired as soon as enough resources are available
• Works in non-stretched and stretched clusters
Replica
Status: Two host failures
Configured policy: FTT2
Effective compliance: FTT0
Replica Replica WW
VMworld 2017 Content: Not fo
r publication or distri
bution
Intelligent Rebuilds Using Partial Repairs
• More resilient repair process
• Repairs as many components as possible even if not enough resources to ensure fullcompliance
• Remaining components will be repaired as soon as enough resources are available
• Works in non-stretched and stretched clusters
Status: Partial repair completed
Configured policy: FTT2
Effective compliance: FTT1
Replica Replica Replica ReplicaReplicaW
VMworld 2017 Content: Not fo
r publication or distri
bution
Intelligent Rebuilds Using Smart, Efficient Repairs
• Two methods for repairs of offline components reappearing after 60 minutes.
• Calculates cost of methods of repair at time host comes back online
• Will choose most efficient method, and cancel other action
• Significant improvement in speed and efficiency of component repairs
R1
C2C1C1
ReplacementComponent(Partially Repaired)
Absent CompComes Back
Which is Faster?
VMworld 2017 Content: Not fo
r publication or distri
bution
Health Monitoring —Decommissioning Host Improvements
• Conducts a precheck for free space prior to maintenance mode decommissioning
• Dialog and report shown prior to entering maintenance mode
• Decommission check occurs for disk and disk group removals
• Tries smaller components to fit in remaining free space
• Reduced amount of temporary space during decommissioning effort
vSphere vSAN
vSAN Datastore
VMworld 2017 Content: Not fo
r publication or distri
bution
Health Monitoring —vSAN Degraded Device Handling Enhancements
• Smarter intelligence in detecting impending drive failures
• If replica exists, components on suspect device marked as “absent” with standard repair process
• If last replica, proactive evacuation of components occurs on suspect device
• Any evacuation failures will be shown in UI
vSphere vSAN
vSAN Datastore
VMworld 2017 Content: Not fo
r publication or distri
bution
New vSAN Cloud AnalyticsDelivers Proactive Guidance
Performance diagnostics to verify expected performance and report anomalies if encountered
• Cloud-based health checks for easy, online known issue detection tied to relevant support notices (KBs)
• New analytics framework results in:
– Identified and relevant issues showing up immediately as health check notifications
– Continuous updates with cloud model—no need to wait for subsequent vSAN releases
• Reduce troubleshooting with prescriptive, environment specific analytics
• All information sent to VMware anonymized
checks/
KBs
VMware Customer Experience Improvement Program
vSAN Cloud Analytics
VMworld 2017 Content: Not fo
r publication or distri
bution
Cloud-connected Performance Diagnostics
• Provides diagnostics for benchmarking & PoCs
• Specify one of three predefined areas of focus for benchmarks:
– Max IOPS
– Max Throughput
– Min Latency
• Integration into HCIBench
• Output automatically sent to cloud for analysis
• Provides results of analysis in UI
• Detects issues and suggests remediation steps by tying to specific KB articles
NEWvSAN 6.6.1
vSphere vSAN
HCIBench
Analysis
Detect issues
Visible to GSS
Feedback
Site results
Links to KBs
vSAN Cloud Analytics
VMware Customer Experience Improvement Program
VMworld 2017 Content: Not fo
r publication or distri
bution
vSAN integration with vRealize Operations
• Prebuilt vSAN dashboards with multi-site visibility and analytics
• Fully integrated natively into vRealize Operations 6.6
• Prebuilt dashboards
• Easily customize to expose data you want to see
• Display vSAN and non vSAN metrics together
Aggregate cluster statistics
Cluster specific statistics
VMworld 2017 Content: Not fo
r publication or distri
bution
VMware Update Manager (VUM) Integration
• Simplifies upgrades and patching by verifying hardware compatibility
• Creates HCL aware baseline recommendations, scanning for critical patches or required drivers
• Will only upgrade to the highest level of HCL compatibility
• Automates VUM baseline creation, scanning and delivery of update packages and ISOs.
NEWvSAN 6.6.1
Custom Baseline
Update to 6.6.1 Update drivers
Update to 6.6.1
Custom Baseline
Update drivers
Remain at 6.2
VUM
HCL Database
Release Catalog
vmware.com
Custom Baseline
VMworld 2017 Content: Not fo
r publication or distri
bution
.
Intelligent, AutomatedOperations with vSAN Config Assist
• Simplify HCI Management with prescriptive one-click controller firmware and driver upgrades
• HCL aware. Pulls correct OEM firmware and drivers for selected controllers from participating vendors including Dell, Lenovo, Fujitsu, and SuperMicro
• Validate and remediate software configuration settings for vSAN
• Configuration wizards validate vSAN settings and ensure best practice compliance
vSphere vSAN
vSAN DatastoreVMworld 2017 Content: Not fo
r publication or distri
bution
vSAN Performance Enhancements
.
• Reduced overhead of checksum
• Improved deduplication and
compression
• Destaging optimizations
• Object Management improvements
• iSCSI for vSAN performance
improvements
• More accurate cache sizing
guidelines
• New vSAN ReadyNode Sizer!
vSphere vSAN
vSAN Datastore
VMworld 2017 Content: Not fo
r publication or distri
bution
Expand competitive advantage with Day 1 support of latest flash innovations
Simplify new technology adoption without a major forklift upgrade to infrastructure
Lower costs with higher consolidation ratios
© 2017 VMware Inc. All rights reserved. Confidential – Not for Distribution
Scale to Tomorrow with Latest Hardware Innovations
Next-Gen
Servers
Next-Gen Flash
(Intel 3D XPoint
NVMe)
* Source: VMware Internal Analysis based on stated pricing.
• Day 1 support of latest hardware
through industry’s best ecosystem
• Intel Purely Platform
• HPE Apollo and Synergy support
• Support larger caching drive options,
including 1.6TB flash drives
• Lower read latencies with vSAN and
new 3D XPoint NVMe drives from Intel
NEWvSAN 6.6.1
VMworld 2017 Content: Not fo
r publication or distri
bution
New Apps and Hardware
.
VMware HCI
vSAN Datastore
• New reference architectures available for broader set of use cases
– Intersystems Caché
– Hadoop and Big Data
– XenDesktop/XenApp
– Kubernetes
– MongoDB
• Flexibility and choice with the latest hardware
VMworld 2017 Content: Not fo
r publication or distri
bution
VMworld 2017 Content: Not fo
r publication or distri
bution
VMworld 2017 Content: Not fo
r publication or distri
bution