1
Windows Server 2008 - File and Storage Solutions
2
Agenda
Remote File ServicesServer Message Block version 2 (SMB2)Distributed File System Namespace (DFS-N)Distributed File System Replication (DFS-R)Microsoft Services for Network File System (MSNFS)Folder Redirection and Offline Files (CSC)
Storage ManagementStorage ExplorerShare and Storage ManagementVirtual Disk Services (VDS)Volume ShadowCopy Services (VSS)File Server Resource Manager (FSRM)
Not covered here:NTFS, TxFCHKDSK, DefragMPIOiSCSI InitiatoriSCSI Target
3
Roles, Role Services and Features
Before we begin, I wanted to quickly review these new Windows Server 2008 tools…Server Manager
RolesRole ServicesFeatures
ServerManagerCmd.exe
4
Server Manager - Roles
5
Server Manager - Role Services
6
Server Manager - Features
7
ServerManagerCmd.exe
8
Server Message Block version 2 (SMB2)
9
The Need For SMB2
SMB1 LimitationsConsidered “chatty”Poor WAN performance due to limited request pipelining / compoundingArbitrary limits on number of users, open files, sharesProtocol evolved through many releases over many years
Difficult to extend, maintain and secure due to large number /variety of commands
Motivations for SMB2Data access over WAN has become much more commonLAN performance also much increased (1Gb is here, 10Gb coming)Build a solid foundation for continued innovation
10
SMB2 BenefitsScalability for file sharing greatly increasedPerformance massively improved
Request compounding reduces “chattiness”Larger reads/writes can fill the pipe even with significant link latency
Secure and robustDurable handlesMessage signing settings improved (HMAC SHA-256 replaces MD5)Small command set reduces attack surface and complexity
Symbolic link supportEvaluation of symlinks involving remote paths is limited by defaultCan only be created by administrators (via Group Policy)
Limits SMB1 SMB2Number of users Max 2^16 Max 2^64
Number of open files Max 2^16 Max 2^64
Number of shares Max 2^16 Max 2^32
Total SMB1 SMB2Opcodes >100 19
11
SMB2 CopyFile Performance
Improved WAN utilizationBenefits due to combination of:
TCP stack improvementsSMB2 request pipeliningSMB2 large request supportCopyFileEx() improvements
Large buffersAsync, non-cached, IO
Write Request
Write Response
Pre-Vista Vista
12
SMB2 CopyFile Performance
XCOPY, remote->Local, 1Gb / 100ms RTT
8 Mb file 700 Mb file38
483249
4991
814
10490
XP-SMB1 Vista-SMB1 Vista-SMB2
Thro
ughp
ut in
kb/
s
13
SMB2 Compounding SampleA common application generated request sequence is shown belowLeft side shows resulting client-server requests without compoundingRight side shows resulting client-server requests with compoundingBenefit of round trip savings is greater the higher the link latency
Open Dir
Query Dir
Query Volume
Response
Response
Response
Open Dir
Query Dir
Query VolumeResponse
Close Dir
Close Dir
ResponseQuery Dir
Query Volume
Satisfied from SMB2 client cache
14
SMB2 Explorer PerformanceDramatic benefits in explorer directory enumeration, due to a combination of:
compounding/speculative requestsdirectory and attribute caching
For this scenario, a directory containing about 50 Excel 2007 files was opened using Windows ExplorerNetwork – 1Gb/s, 100ms RTT
Se-ries
1
0 0.5 1 1.5 2 2.5 3 3.5 4 4.5
Vista SP1 SMB2 Vista SMB1
Response Time in Seconds
15
SMB2 VersionsFirst shipped in Windows Vista RTM
Not all protocol features utilized by Windows Vista RTM implementationDialect revved for Windows Server 2008 / Windows Vista SP1
Windows Server 2008 / Windows Vista SP1 enhancementsUses request compoundingCached: directory enumerations and file attributesCached: common share and file system property queries
Client/ Server OS Older Windows Windows Vista RTM Windows Vista SP1 Windows Server 2008
Older Windows SMB 1 SMB 1 SMB 1
Windows Vista RTM SMB1 SMB2 (v2.001) SMB 1
Windows Vista SP1Windows Server 2008 SMB1 SMB 1 SMB2 (v2.002)
16
Server Message Block Version 2 (SMB2)
Compound Packets
Durable File Handles
Increased Buffer Sizes
Symbolic Links
Greater Scalability
More Secure
17
Distributed File SystemNamespace (DFS-N)
18
DFS Overview
\\Contoso\Public
DFS Namespace (DFS-N)
Namespace Server
Namespace Root
Software
Tools
Training Guides
Folder
Folders with Targets
DFS Folder Targets
\\NYC-SVR-01\Tools
Tools
\\SEA-SVR-01\Tools
Tools
\\SEA-SVR-02\Training
Training Guides
DFS Replication(DFS-R)
19
DFS Namespace
Windows 2008 Mode Domain Namespaces:
Eliminates 5000 link limit for domain namespaces
Our Vista/WS2008 build release namespace comprised
60,000 links, with ~1000 added and removed every day
Requires: Windows 2008 Namespace ServersWindows 2008 Domain Functional Level
Access Based Enumeration (ABE) support
For both standalone and 2008 mode domain namespaces
Improved diagnosticsIn-box – DFSUTIL.EXE, DFSDIAG.EXESystem Center Operations Manager (SCOM) 2007 pack coming soon
20
Distributed File SystemReplication (DFS-R)
21
DFS ReplicationPerformance
Un-buffered disk I/O Asynchronous – performance Low priority – reduced system impact
RPC asynchronous pipesUp to 16 concurrent file downloads (up from 4)Better hub server scale-out over slow links
22
Windows Server 2003 R2
DFS-R Performance
Initialize Data Transfer
Retrieve Data
Retrieve Data
Initialize Data Transfer
READ WRITE
Retrieve Data
Windows Server 2008
23
DFS ReplicationPerformance
Un-buffered disk I/O Asynchronous – performance Low priority – reduced system impact
RPC asynchronous pipesUp to 16 concurrent file downloads (up from 4)Better hub server scale-out over slow links
ReliabilityDirty Shutdown Recovery improvedStaging area moved out of replicated file tree
24
Improved Dirty Shutdown Recovery
DFSR USN Consumer updates Checkpoint USNUpdates every three seconds and on DB changes
Improper shutdown of DFSR serviceSystem reboot/crashPower failure
File system
Database
Hub Server
Branch Office USN Journal
Last USN created by NTFS
Checkpoint USNLast USN consumed
by DFSR
25
DFS ReplicationPerformance
Un-buffered disk I/O Asynchronous – performance Low priority – reduced system impact
RPC asynchronous pipesUp to 16 concurrent file downloads (up from 4)Better hub server scale-out over slow links
ReliabilityDirty Shutdown Recovery improvedStaging area moved out of replicated file tree
SYSVOL replication now supported using DFS-RTools for migration of SYSVOL from FRS to DFS-RSafe, multi step process with rollback from all pointsRead Only Domain Controller (RODC) SupportNTFRS will be deprecated in a future release
26
SYSVOL Migration to DFSR
REDIRECTEDSTART PREPARED ELIMINATED
FRS FRS DFSR DFSR
PREPARINGINITIAL SYNC
REDIRECTING
ELIMINATING
DFSR FRS
27
End-To-End Administrator Experience
Raise domain functional level to Windows Server 2008
Check health of AD replication – RepAdmin /ReplSum
Migrate to ‘PREPARED’ state – dfsrmig /setGlobalState 1
Ensure all DCs are ‘PREPARED’ – dfsrmig /getMigrationState
Migrate to ‘REDIRECTED’ state – dfsrmig /setGlobalState 2
Ensure all DCs are ‘REDIRECTED’– dfsrmig /getMigrationState
Migrate to ‘ELIMINATED’ state - dfsrmig /setGlobalState 3
28
DFS-R in R2DFS-R Read only replication
Publication data that should never be changed at branch locationsOpen or create requesting WRITE access will be failed by a new filter driverEven if the filter is not running, other Win7 Replication Group members will refuse updates from a read-only replication partnerRead-only member: Windows Server 2008 R2Other members: Windows Server 2003 R2 or later
DFS-R cluster support (high-availability) Replicated file folders on a clustered file serverAny Highly Available File Server can become a DFSR member server, and the DFS-R service will fail over transparently between nodesAll cluster nodes: Windows Server 2008 R2Other members: Windows Server 2003 R2 or later
Windows Server 2008 R2
29
Services for NFS (MSNFS)
30
MSNFS In Windows Vista/WS2008Support for NFS v2/3 now included in Windows
NFS Client “in-box” for the first time in the Windows Vista releaseNFS Server “in-box” for the first time in Windows Server 2008 release
Enhancements in Windows Server 2008IPv6 supportEnhanced RFC2307: Leverage AD for Windows and Unix user mappingImproved audit loggingFine grained component installation: Greater control and scriptable MSNFS deploymentsFile Share management UI provides consistent experience: Share a folder via SMB and NFS from one locationAutomated firewall configuration simplifies deployment
Username mapping server deprecated, can still use it running on a down-level box
31
MSNFS in R2Unmapped Unix User Access
Enables zero configuration NFS deploymentsNo up-front mapping required between Unix and Windows usersAssociates a Unix UID/GID directly to a Windows SID
WMI provider for NFSConsistent remote management of NFS servicesSimplification from Windows Server 2008 Required multiple tools for remote management
Support for NetgroupsRFC 2307 and NIS based NetgroupsNFS file share access control via Netgroup mappings
Enhanced Security with RPCSEC_GSS supportAuthentication and integrity support Kerb5 used for authentication supportKerb5i used for integrity checkingExtensible framework to allow for future security algorithms
Windows Server 2008 R2
32
NFS Deployment Requirements
Windows Server 2008 R2
Feature Server Client
Unmapped Unix User Access Windows Server 2008 R2 NFS v2 or NFS v3 Clients
on any OS
WMI Remote Manageability Windows Server 2008 R2 NFS v2 or NFS v3 Clients on any OS
Netgroups Windows Server 2008 R2 NFS v2 or NFS v3 Clients on any OS
Enhanced Security for NFS Windows Server 2008 R2 in AD deployment
NFS v2 or NFS v3 Clients on any OS
33
Folder Redirection and Offline Files
34
Offline Files
Folder Redirection And Offline Files
File Server
Folder Redirection
35
Offline Files In Windows Vista
Seamless transitionsFaster synchronizationSupport for large files like Outlook PST’sPer-user encryptionImproved “Slow-link Mode”Ghosting – consistent client/server namespace Better interoperability with DFSScriptable API support
36
R2 ImprovementsBackground Synchronization
Offline files are automatically synchronized in the backgroundSlow-link mode is ON by default (when round-trip latency ≥ 80ms)Fully integrated with Sync Center, showing last update timeConfigurable settings for IT administrators
Improved App File Open & CloseSMB optimizations reduce the exchanges required to open and save application files
Transparent CachingAutomatically cache the network file to the local client diskThe cached copy is only used if the local/server versions are the sameAll files modifications are made on the server Administrators can control by Group Policy (not enabled by default on fast networks)
BranchCache™Remote files accessed from a branch office are stored in the client machine disk cacheClients can retrieve files from other clients in the same branchThe file version and user access rights are always validated with the serverExisting Windows security access controls are enforced
Windows Server 2008 R2
37
BranchCache™
Windows Server 2008 R2
Slow WAN Link
Client 1 Client 2
Windows 7 Clients
Windows Server2008
Slow WAN Link
Client 1 Client 2
Windows Vista SP1 Clients
Windows Server 2008 R2
38
Deployment Requirements
Windows Server 2008 R2
Feature Client Server Configuration
Background sync Windows 7Windows Server 2008 or
Windows Server 2008 R2CSC deployment
Improved file open & close Windows 7 Windows Server 2008 R2 File Server role
Transparent caching Windows 7Windows Server 2008 or
Windows Server 2008 R2Group policy
Offline Files exclusion list Windows 7Windows Server 2008 or
Windows Server 2008 R2Group policy
BranchCache™ Windows 7 Windows Server 2008 R2 Group policy
39
Storage Explorer
40
Storage Explorer
Design:uses industry standard APIs to gather information about storage devices in FC and iSCSI SANslooks and behaves like applications that Windows administrators are familiar withimplemented as an MMC snap-in
Storage Explorer GUI:provides a tree-structured view of all the components within the SAN (Fabrics, Platforms, Storage Devices, LUNs)
Storage Explorer and SMfS (Storage Manager for SANs)Combined, these two applications provide full-featured SAN configuration management functionality that is built into the Windows OS
41
Storage Explorer
Scalable, standards-based platform for storage fabric device discoveryHierarchical view of FC and iSCSI SAN topologyNo agents or hardware providers required
42
Share and Storage Management
43
Share and Storage Management
New MMC snap-inUnified overview of storage and sharesUnified share provisioning (SMB and NFS)Unifying share and storage provisioning
Tabbed overview of shares and volumes with key propertiesVolume actions
Extend, format, delete and propertiesShare actions
Stop sharing and properties
44
Share and Storage Management
Manage shares & volumes in the same snap-inView shares on the ‘Shares’ tab
45
Share and Storage Management
Manage shares & volumes in the same snap-inView volumes on the ‘Volumes’ tab
46
Provision a File Share
47
Provision a Volume
48
Volume ShadowcopyServices (VSS)
49
VSS in Windows Server 2008Diskshadow – inbox VSS requester
Enables creation and management of hardware and software snapshotsSupports a script mode and an interactive shellReference requester for developing writers and hardware providersHandy tool for IT administrators
Hardware snapshot reliability enhancementsResilient to timing issues during snapshot importSupport fast recovery of GPT disksMultiple imports of shadow copy LUNsAuto recovery of transportable snapshots
Snapshot protection modeConcurrent backups with single restore
50
VSS in R2
LUN re-syncFast recovery of production LUNDuplication of production LUN
Express writerDevelop a VSS backup extension in two weeks
Concurrent restoresWriter error tunneling
Requesters trap and respond to application specific errors during backups and restores
Snapshot volumes on VHDs
Windows Server 2008 R2
51
Virtual Disk Services (VDS)
52
VDS in Windows Server 2008LUN Shrink
Enables shrinking LUNs and recovering space on a hardware arrayUsed in conjunction with Volume and File System shrink
SAN Policy (disk online/offline)New SAN disks declared to be online or offline by defaultThe default for high end server editions is offlineThis protects SAN disks from aggressive Windows behaviorBetter cluster integration – clustering now uses VDS to manage disksNew read only attribute for disks
Partition AlignmentThe default alignment of new partitions is 1Mbyte
Dynamic Partition AllocationNew algorithm scans through all free space and allocates from the best fitReduced free space fragmentation
53
VDS in R2
Storage Pools (collection of storage in an array)Based on array vendor input and SMI-SPhase I: Enumerate Pools; Create LUN in Pool; Get Properties
Updates to hardware array support Explicit RAID types (ex: 3, 4, 5, 6, 10, 50, 60) New Subsystem types (SAS, hybrid) Query array’s internal number for a LUN New flags on subsystems, controllers, drives and LUNs
Native VHD supportCreate, surface, remove VHDsExpand, compact, merge, shrink, convertNew VDS provider type: extensible to other virtual disk types
Windows Server 2008 R2
54
File Server Resource Manager (FSRM)
55
FSRM
Storage usage, planning and monitoringQuota ManagementPolicy Management
Help IT administratorUnderstand how existing storage is utilizedTroubleshoot storage capacity issuesDefine and implement storage policies
Storage reports and alertsCurrent storage usage and usage trendsQuota thresholdPolicy related alerts
56
FSRM Quota Management
57
FSRM File Screening
58
FSRM Report Management
59
FSRM Reports
60
Summary
Remote File ServicesServer Message Block version 2 (SMB2)Distributed File System Namespace (DFS-N)Distributed File System Replication (DFS-R)Microsoft Services for Network File System (MSNFS)Folder Redirection and Offline Files (CSC)
Storage ManagementStorage ExplorerShare and Storage ManagementVirtual Disk Services (VDS)Volume ShadowCopy Services (VSS)File Server Resource Manager (FSRM)
61
© 2008 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED
OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
Top Related