The Future of File Protocols

SMB 2.2 in the Datacenter

Thomas Pfenning

General Manager, Windows File Server

9/20/2011 SNIA SDC 2011 1

Do file protocols have a future?

9/20/2011 2 SNIA SDC 2011

Where’s the Data Now?

Disk capacity continues to grow rapidly

Unstructured data (file-based) storage is growing faster than structured data

More stored data is generated by server applications than stored on all file servers

-

-

-

-

-

-

-

2008 2009 2010 2011

Databases File Servers

Sources: IDC, Microsoft marketing

9/20/2011 SNIA SDC 2011 3

Customers Prefer Files

Customer IT manager reasons for wanting choice of file access: o Reduced fabric costs &

converged networks o Reduced storage admin &

LUN management o Increased deployment

flexibility

Encouraged by vendor support: o Oracle over NFS o VMware over NFS

Worldwide File-Based vs. Block-Based Storage Capacity Shipments, 2009–2014

Source: IDC

9/20/2011 SNIA SDC 2011 4

Key Requirements for Datacenter Storage

•Rule #1: Don’t lose data

Reliability

•Data must be remain reachable, despite potential failures:

•Disk failure

•Network/fabric failure

•System/server failure

Availability

•Meet needs of server applications:

•Latency

•Bandwidth

• IOPs

•CPU utilization

Performance

•Able to make application-consistent backup of data on network server

Backup

9/20/2011 SNIA SDC 2011 5

Hyper-V over SMB2.2 File Server Configurations

9/20/2011 SNIA SDC 2011 6

DIFFERENT FILE SERVER CONFIGURATION OPTIONS (SINGLE, DUAL, AND MULTI-NODE)

Single-node File Server • Lowest cost for shared storage

• Shares not continuously available

Dual-node File Server • Low cost for continuously available

shared storage • Scalability to a few hundred disks

Multi-node File Server • Highest scalability

(up to thousands of disks) • Higher cost, but still lower than

connecting all Hyper-V hosts with FC

Hyper-V Parent 1

Child 1

Config

VHD Disk

Hyper-V Parent N

Child N

Config

VHD Disk

File Server

Share1 Share2

Cache

Disk Disk

D1

Hyper-V Parent 1

Child 1

Config

VHD Disk

Hyper-V Parent N

Child N

Config

VHD Disk

File Server 1

Share1 Share2

Cache

File Server 2

Share1 Share2

Cache

Shared SAS Storage

Disk Disk Disk Disk

D2

Hyper-V Parent 1

Child 1

Config

VHD Disk

Hyper-V Parent N

Child N

Config

VHD Disk

Fibre Channel Storage Array

Disk Disk Disk Disk Disk Disk Disk

FS 1

Share1

Cache

FS 2

Share2

Cache

FS 3

Share3

Cache

FS 4

Share4

Cache

D3

DEMO SMB 2.2 multichannel

9/20/2011 SNIA SDC 2011 7

SMB 2.2 Client Interface Scaling — Throughput

Preliminary data shows linear bandwidth scaling for up to 4 interfaces

1 – 1150 MB/sec 2 – 2330 MB/sec 3 – 3320 MB/sec 4 – 4300 MB/sec

Receive Side Scaling support in the NIC is critical

BW at small I/Os is bottlenecked on CPU

9/20/2011 SNIA SDC 2011 8

Performance whitepaper provides full details: http://go.microsoft.com/fwlink/p/?LinkId=227841

0

500

1000

1500

2000

2500

3000

3500

4000

4500

MB

/sec

I/O Size

1 x 10GbE 2 x 10GbE 3 x 10GbE 4 x 10GbE

SMB 2.2

Jim Pinkerton

Architect, Windows File Server

9/20/2011 SNIA SDC 2011 9

To Date: Information Worker Has Driven SMB 2

9/20/2011 SNIA SDC 2011 10

• Office documents

• Browsing a file server and copying files

• Compiling source code

• New standard benchmark for Information Worker workloads – FSCT

Target Workload

• Unique Opcodes went from >100 to 19

• General purpose compounding

• Scaling number of users, open files, shares

• Large MTU support

• Improved resiliency to intermittent network failures with Durable Handles

Simplified Protocol for the 21st Century

• New Oplock model – Leases

• Heavy pipelining for high latency x bandwidth product pipes

• BranchCache

• Dynamic resizing of SMB2 packets

WAN

• Client metadata caching

• Improved copyfile implementation for high speed links and WAN connections

Windows Implementation Improvements

Server Application Workloads Drove SMB2.2

9/20/2011 SNIA SDC 2011 11

•Dedicated access (virtual disks), long-lived files

•Relatively little metadata

•Often tons of small I/Os

•Virtual desktops workload similar to Information Worker workload, plus boot storm

Virtualization

•Mostly dedicated access, long-lived files

•OLTP with small read/write I/O

•Data mining with mostly sequential large read I/O

Database

•General purpose web serving (many, many small files, short-lived opens)

•Media streaming (long lived files, sequential, medium sized I/O)

Web Servers

•High bandwidth and low latency, widest variety of workloads

HPC

Reliable Storage

File Server

File Server

App Server

SMB2.2 Must-Have Features for Server Application Workloads

9/20/2011 12

SMB2.2 Transparent Failover – file I/O, metadata I/O, directory operations o Implies all operations are write-through

SMB2.2 Multichannel – network fault tolerance and scale

SMB2.2 Cluster Client Failover – service fault tolerance

Remote VSS – Application server consistent backups

App Server

Backup Server

SNIA SDC 2011

Other Desired SMB 2.2 Features for Server Application Workloads

• Active-Active clustered file shares

• Witness Protocol – failover is not timeout driven

• SMBDirect – RDMA support to enable low CPU, low latency, higher performance

Performance & Scale

• Directory Leases – further reduce chattiness

• BranchCache v2 – support for variable size chunks

Information Worker Improvements

• Copy Offload (T10), Trim (T10)

• Discovery of 4K Native support

• DFS-N update for site awareness

Miscellaneous Features

9/20/2011 SNIA SDC 2011 13

SMB 2.2 – Built for Server Storage

• Write-through to storage in Continuous Availability mode

Reliability

• SMB multichannel

• Transparent client failover

• SMB witness protocol

Availability

• SMB multichannel

• SMBDirect (RDMA)

• Directory Oplocks

• BranchCache v2

Performance

• Remote VSS snapshots

Backup

9/20/2011 SNIA SDC 2011 14

SMB 2.2 and related protocols will be fully documented o Full docs will be available by beta of “Windows Server 8”

Announcing: Early previews available today at http://msdn.microsoft.com/en-us/library/ee941641.aspx

Early engagement with key storage vendors

Commitment to Interoperability

MS-SMB2 Server Message Block (SMB) Version 2 Protocol. Includes complete preview of SMB2.2 functionality.

MS-FSRVP File Server Remote VSS Protocol, an RPC-based protocol that is used for creating shadow copies of file shares on a remote computer.

MS-SMBD SMB2 Remote Direct Memory Access (RDMA) Transport Protocol. A new transport protocol for SMB2.2 that supports RDMA.

9/20/2011 SNIA SDC 2011 15

Dennis Chapman Senior Technical Director NetApp, Inc.

9/20/2011 SNIA SDC 2011 16

John Hayden CTO, Unified Storage Division EMC Corporation

9/20/2011 SNIA SDC 2011 17

SMB 2.2 at SDC

9 Microsoft talks on SMB 2.2 during this conference:

9/20/2011 SNIA SDC 2011 18

Tuesday Afternoon Wednesday Afternoon Thursday Morning

• SMB 2.2: Bigger. Faster. Scalier – Part 1

• SMB 2.2: Bigger. Faster. Scalier – Part 2

• SMB2.2 - Advancements in Backup to Support Application Storage on a File Server

• SMB2.2 – SMB 2.2 Over RDMA

• SMB2.2 - Advancements for WAN

• Moving an Enterprise Database Platform to run on CIFS/SMB/SMB2 File Access Protocols

• “Windows Server 8” and SMB 2.2 - Advancements in Management

• SMB2.2 - Advancements in Server Application Performance

• Advancements in Hyper-V Storage

Black = protocol session Blue = workload session

2011 SNIA CIFS/SMB/SMB2 Plugfest

27 companies and organizations (so far)

50+ platforms and products

>110 test engineers and developers attending

Representation from 5 continents

9/20/2011 SNIA SDC 2011 19

Tomorrow: Plugfest with Server Applications

We encourage server application vendors to attend to interoperate with CIFS/SMB/SMB2 implementations

As a first step, Microsoft applications are participating in this year’s plugfest: oMicrosoft Hyper-V oMicrosoft SQL Server oMicrosoft Web Server (IIS)

9/20/2011 SNIA SDC 2011 20

Thank you.

9/20/2011 SNIA SDC 2011 21