Dell EMC Unity: Migration from VNX Deepak Venkat · PDF fileDell EMC Unity: Migration from VNX...

Dell EMC Unity: Migration from VNX

Deepak Venkat Product Technologist Midrange & Entry Solutions

Dell - Internal Use - Confidential

2

Optimized for All-Flash Performance & Simplicity

What’s New with Dell EMC Unity

New 80 drive 3U disk shelf 500TBe per rack U density 256TBu File System with Inline

Compression AppSync integration, snapshot & thin

clones for iCDM Simpler Mapped RAID protection

40% more cores; 2X the memory

650F

550F 450F

350F

Dell EMC Unity: Migration from VNX

Dell EMC Midrange and Entry Solutions


4

Agenda • Migration Challenges

• Block Migration • File Migration • Existing Tools

• Dell EMC Unity Native Migration Tool • Block Migration • NFS Migration • SMB Migration

• Q&A


5

Migration Challenges

“Appliance Based?!”

“Cutover Challenge?!”

Block Migration - The Storage Admin Perspective

“Host Based?!”

“License Cost?!”

Data Data

Data Data Data Data

Full Copy

Incremental Copy


6

Existing Tools – Block Migration

• EMC VPLEX

• EMC RecoverPoint

• EMC SAN Copy (Push)

• EMC PowerPath Migration Enabler

• Basic Copy/Paste

• VMware Storage vMotion

• Host-Based Logical Volume Manager Migration (Linux)


7

Migration Challenges

“Windows, Unix?!”

“Cutover Challenge?!”

File Migration - The Storage Admin Perspective

“Data, ACL, Time Stamp?!”

“Shares, Exports, Users, Groups?!”

Data Data

Data Data Data Data

Full Copy

Incremental Copy


8

Existing Tools – File Migration

• Basic Copy/Paste

• EMCopy / Sharedup / LGDup

• Robocopy / Richcopy / Securecopy

• Rsync

• Datadobi Dobiminer


9

What if you could…

Save $$$$? Single Migration

Tool?

Migrate not just Data? Spend less

time learning tool?


10

INTRODUCING DELL EMC UNITY NATIVE MIGRATION TOOL…

Simple, Intuitive interface with GUI support

Supports Block Data, File Data including NFS & SMB*

Shorter Cutover Window

Free and included in base license

* SMB support coming Q2/2017


11

Available on all Dell EMC Unity Models

Dell EMC UNITY MIGRATION TOOL

UNITY 400

UNITY 500

UNITY 600

HYBRID

UNITY 300

UNITY 500F

UNITY 300F

UNITY 600F

UNITY 400F

ALL-FLASH

JUST

ONE TOOL

Dell EMC Unity Native Block Import

PROCESS

OVERVIEW


14

Overview

• Leverages EMC SAN Copy to import block resources from VNX – Pre-loaded onto VNX systems (older systems require NDU) – Free to use – Mature program – (Existing documentation, videos, etc.)

• In UnityOE 4.1, this feature takes ease-of-use a step further by integrating SAN Copy configuration & execution into Dell EMC Unity


15

Overview

• Unisphere / UEMCLI / REST API to perform block import from VNX systems – Auto discovery of all import eligible block resources – Auto creation of target devices

• Dell EMC Unity supports SAN Copy push – Hosts can be online during Full & Incremental migration – The SAN Copy engine still runs on the VNX

PROCESS

OVERVIEW


17

Process

• Pre-configure SAN Copy on VNX1/VNX2 system

• Connect Dell EMC Unity to VNX1/VNX2 system

• Create the import session from Dell EMC Unity

• When import is complete, cutover host access to the Dell EMC Unity system


18

• Ensure SAN Copy is enabled

• Configure FC port zoning between VNX and Dell EMC Unity (for FC)

• Configure iSCSI Interfaces on VNX and Dell EMC Unity, and establish an iSCSI IP Connection (for iSCSI)

• Configure a Reserved LUN Pool (RLP)

Process PRE-CONFIGURATION ON VNX


19

Simple - Three Step Process


20

• Create a pair of Mobility Interfaces

Step 1 - Interfaces CONNECT DELL EMC UNITY TO VNX


21

• Configure an Import Connection to the source VNX system › All FC and iSCSI VNX Initiators will be logged in and associated › The same connection can be used for Dell EMC Unity File Import

Step 2 - Connections CONNECT DELL EMC UNITY TO VNX


22

• Auto discovery of all import eligible block resources: › Pool LUNs, Meta LUNs, Classic LUNs, Consistency Groups › No more Manual LUN mapping (Old School Excel mapping)

Discovery


23

• Create an import session – Select LUN(s) and CG(s) to import

Step 3 - Import Sessions CREATE AN IMPORT SESSION


24

• Create an import session – Select the target Pool – Input data transfer throttle setting



25

• Import session will copy data to the Dell EMC Unity system – Target LUNs/CGs are automatically created and balanced

between SPs – Incremental copy, with differential copies to update the target – Can pause/resume, modify settings, and cancel



26

• When the session is “Ready to Cutover” – Ensure hosts have access to the Dell EMC Unity system

Step 3 - Import Sessions CUTOVER AN IMPORT SESSION


27

• When the session is “Ready to Cutover” – Choose a period for planned disruption

• At this point, the cutover can be performed: – Host access from the source VNX is disabled – A final incremental sync is performed – The SAN Copy session(s) is deleted – Host access to the target Dell EMC Unity system is enabled

Step 3 - Import Sessions CUTOVER AN IMPORT SESSION


28

Import Session: Cutover and Completion


29

• Simple Three Step Process

• Leverages SAN Copy

• Auto Discovery of Source

• Auto creation of Target LUNs/CGs

Summary: Native Block Import

Dell EMC Unity File Import (NFS)

Process

OVERVIEW


32

Overview

• Customers running VNX1/VNX2 systems have options for file migration to Dell EMC Unity: – rsync – Copy & Paste – Datadobi Dobiminer

• Native Data Migration option available in Dell EMC Unity OE 4.1 version – NFS option available now – SMB option available Q2


33

Overview • Native Data Migration first introduced in Dell EMC Unity OE 4.1

– Supports NFS File Systems mounted on a VDM – VDM migration to NAS Server – NFSv3 support – Transparent to host IO – Support for rollback

• Some preparatory work is required on the VNX system, but creation, monitoring, and cutover are all managed in Dell EMC Unity – Unisphere, UEMCLI, REST API


34

• Leverages the Inband Migration Tool (IMT) that was developed to handle communication and data transfer between VNX and Dell EMC Unity

Overview HOW DOES IT WORK?


35

• When started, the import session will create the destination file system and perform a baseline copy

• After the baseline copy is complete, host access can be cutover to the Dell EMCUnity system

• The full copy will complete in the background. During this time IMT will sync data between VNX and Dell EMC Unity


VDM

NFS FS

NAS Server

NFS FS

IMT

Host Access Host Access

Host Read (Unity) Host Read (VNX) Host Write

• Host Read (Dell EMC Unity): Pulled from Unity

• Host Read (VNX): Pulled from VNX and copied to Dell EMC Unity

• Host Write: Write mirrored


36

• The baseline copy consists of: – NAS Server and File System attributes – “Cold” data – data not updated in the last hour

• From this point, cutover can be performed – Delta copies of remaining and modified data will continue

until the commit – After cutover, data is written to both the source VNX and

Dell EMC Unity system until the session is committed



37

Overview WHAT IS TRANSFERRED?

Process

OVERVIEW


39

• Configure a Mobility Network Interface

• Establish an Import Connection

• Configure Import Session

Process


40



41




42

• Configure an Import Connection to the source VNX system



43

• Create an Import Session – Select a VNX VDM and File systems

Step 3 – Import Sessions CREATE IMPORT SESSION


44

• Create an Import Session – Select destination Pool(s) & Network Interfaces



45

• Monitor the progress of the import session in Unisphere, UEMCLI, and/or REST API – Status will read, “Ready to Cutover”

• After the baseline copy has completed, cutover to the Dell EMC Unity system can be performed – Hosts begin accessing file systems from the Dell EMC Unity

system

Step 3 – Import Sessions CUTOVER THE IMPORT SESSION


46

• Until the session is ready to “Commit”, Only ”Cutover” option would be highlighted

Step 3 – Import Sessions CUTOVER THE IMPORT SESSION


47

• When the import has completed, its status will change to “Ready to Commit”

• At this point, the user can commit the import session – This will stop and remove any data transfer procedures – The Unity system becomes the primary node for client access for

all imported NAS Servers and file systems

Step 3 – Import Sessions COMMIT THE IMPORT SESSION


48

• Properties of the import session can be modified – Name – File System to Pool mapping – Interface to Port mapping

• An import session can be paused and resumed

• An import session can be canceled

• If configured in Unisphere, the import session will automatically start after creation

• With UEMCLI, the import session is manually started

Process DURING THE IMPORT SESSION


49

• Some operations are discouraged on the source VNX: – Changes to Quota settings – NIS/LDAP configuration changes – DNS/Gateway/Routing changes – Creating/deleting file systems

• Dell EMC Unity cannot prevent these actions on the source VNX, but it can result in: – The changes not being carried to the Dell EMC Unity system – Breaking the import session

Process DURING THE IMPORT SESSION


50

• Native support for NFS File Import added in Dell EMC UnityOE 4.1

• VDMs and NFS File Systems from VNX and VNX2 systems are supported

• Rollback

• Summary Reports

Summary: NFS File Import


51

Dell EMC Unity File Import (SMB)


52

PROCESS

OVERVIEW


53

• Customers running VNX1/VNX2 systems have host based options for file migration to Dell EMC Unity: – EMCopy, Robocopy, RichCopy, SecureCopy, LGDup, ShareDup – Datadobi Dobiminer

• Q2/2017 Dell EMC Unity OE release adds support for CIFS File Systems – Migrates VNX VDM and CIFS Server to NAS Server

Overview FEATURE


54

• Native file migration expanded to include CIFS – VNX VDM and CIFS Server to NAS Server – Support for disruptive rollback

• Some preparatory work required

• Creation, monitoring, and cutover managed through Dell EMC Unity – Very similar to NFS Import workflow

Overview FEATURE


55

Overview IMPORT SESSION LIFECYCLE

Initial Sync

Started

Ready to Cutover

Syncing

Ready to Commit

Committing

Completed

Baseline Copy

Incremental Copy

Final Sync

HOST ACCESS STATE PROCESS USER ACTION

Create Import Session

Cutover

Commit


56

Overview WHAT IS MIGRATED?

MIGRATED

SMB server attributes

SMB shares

SMB local groups

SMB local users

SMB user privileges

DFS

Home directory


57

PROCESS

OVERVIEW


58

• Update parameters essential for CIFS import

• acl.mappingErrorAction – Defines rules for unknown mapping between SID/UID/GID on ACL

settings

• acl.extacl – This parameter is a bit list which enables special capabilities around

ACL management. – Allows migrating of UNIX ownership necessary for preserving Quota

Process PREPARE VNX


59

• Ensure local groups are enabled, then two options: – Set local Administrator’s password using Computer Management – Create a local admin user using Computer Management

› Must be added to Administrators group

• Ensure time is synchronized with destination – Within 5 seconds – Recommend using NTP

Process PREPARE VNX


60

• Configure a Mobility Network Interface

• Establish an Import Connection

• Configure Import Session

Process


61



62




63

• Configure an Import Connection to the source VNX system



64

• Create an Import Session – Select a VNX VDM and File systems



65

• Create an Import Session – Select destination Pool(s) & Network Interfaces



66

• Cutover is a disruptive procedure – Offline window projected for less than 90 seconds

• AD credentials required to rename source SMB server • Network access switched from VNX to Dell EMC Unity • Source (VNX) production interface are disabled

– Offline window begins

• Remaining SMB configuration is transferred – Local groups & users – Shares – SMB server AD account

Step 3 – Import Sessions CUTOVER


67

• Source VNX share security is updated – Deny any access – Access only possible through C$ for admins

• Source CIFS server renamed – Appends “_” to CIFS server name – Current 16 character limit

• Target (Unity) production interface enabled – Offline window ends



68



69

• SMB clients access the destination only

• Any modifications are done on the source first – This ensures capability for rollback

• Data continues to be migrated from VNX to Dell EMC Unity

• “Ready to Commit” state once completed

Step 3 – Import Sessions INCREMENTAL COPY


70

Step 3 – Import Sessions INCREMENTAL COPY


71

• Both source and destination are in sync

• Commit can be performed at any time once “Ready to Commit”

• Once committed: – Synchronization stops on the source – Can no longer rollback – Destination is now the production server

Step 3 – Import Sessions COMMIT


72

• Until the session is ready to “Commit”, Only ”Cutover” option would be highlighted

Step 3 – Import Sessions COMMIT - CUTOVER THE IMPORT SESSION


73

• Native Support for SMB migration available Q2/2017

• Auto discovery of all import eligible File resources

• Migrates Data, Shares, ACL and more…

• Auto creation of Target File Systems

Summary: SMB File Import


74

Documentation & Additional info:


75

• Dell EMC Unity Native Import is SIMPLE – Simple Unisphere interface for import makes it very easy to use

• Dell EMC Unity Native Import is INTUITIVE – Intuitive steps easily orchestrate the import of those resources

• Dell EMC Unity Native Import is MODERN – Modern design supports Block & NFS with Dell EMC Unity OE 4.1, SMB in

Q2/2017

• Dell EMC Unity Native Import is AFFORDABLE • Affordable as part of Base License while eliminating time and other costs

Conclusion…


76

• Proven, standardized platform and vendor-agnostic methodology

• Standardized blueprints tailor engagements to specific use cases and desired outcomes

• Leading technology and the industry’s most extensive interoperability testing and validation engine

• Focus on continuous availability of apps and data

Services Booth #347

TAILOR

ED

AUTOMATED AVA

ILA

BIL

ITY

FO

CU

SED

REPEATABLE

IDM Factory & Blueprint

Intelligent Data Mobility (IDM) A Better, Faster, Easier Way to Migrate Data

Breakout sessions: • Tue 8:30 AM - 9:30 AM, Palazzo L • Wed 3:00 PM - 4:00 PM, Palazzo J


77

Dell EMC Services Driving the rapid adoption and optimization of your digital technologies

CONSULTING

Harness the power of business urgency with help from our consultants

DEPLOYMENT

Accelerate technology adoption with expert deployment designed for you

MANAGED SERVICES

Gain efficiencies with our hosted cloud, managed applications, storage, archiving, and back-up

TRAINING

Develop and retain valuable IT talent through continuous learning

IT PROVEN

Learn how to invest from extreme users such as Dell IT

SUPPORT

Maximize productivity with expert support backed by proactive, predictive tools

Booth #347


78

Thank You for Attending

PLEASE TAKE A MOMENT TO • Visit the Storage & Data Protection Booth • Tweet: @DellEMCStorage

A STAR IS BORN • Shoot an in-room 10 second reference video

(where applicable)

Talk with us in the booth about the:

Modern Infrastructure Assessment &

Storage Efficiency Guarantee

SITES TO BE SEEN • Efficiency Guarantee: dellemc.com/4to1guarantee • CloudIQ: dellemc.com/cloudiq • All-Flash Storage: dellemc.com/all-flash

http://www.dellemc.com/4to1guarantee

http://www.dellemc.com/cloudiq

http://www.dellemc.com/all-flash


79

Related Sessions for SC and Dell EMC Unity Series Session Title Day/Time Dell EMC Unity & SC Series: Midrange Storage Portfolio Overview Mon @ 12:00 PM + Wed @ 01:30 PM CloudIQ: Cloud-Based Storage Analytics for Dell EMC Unity and SC Series Mon @ 04:30 PM + Wed @ 08:30 AM Dell EMC Unity All-Flash: What’s New Tue @ 03:00 PM + Wed @ 01:30 PM Dell EMC Unity: Architectural Overview Mon @ 01:30 PM + Thu @ 08:30 AM Dell EMC Unity: Best Practices For Best Performance Wed @ 08:30 AM + Thu @ 10:00 AM Dell EMC Unity: Performance Analysis Deep Dive Wed @ 03:00 PM + Thu @ 01:00 PM Dell EMC Unity: Next Generation NAS & File Capabilities Mon @ 03:00 PM + Thu @ 11:30 AM Dell EMC Unity: Data Protection & Copy Management Options Mon @ 08:30 AM + Wed @ 12:00 PM Dell EMC Unity: Virtualization & Cloud Integration Mon @ 12:00 PM Dell EMC Unity: Migration From VNX Tue @ 08:30 AM Dell EMC Unity: Using Dell EMC UnityVSA In Converged Environments Mon @ 08:30 AM Dell EMC Unity All Flash: Flash Technology Deep Dive Mon @ 08:30 AM + Thu @ 01:00 PM SC Series: What's New Mon @ 04:30 PM + Tue @ 03:00 PM SC Series: Architectural Overview Mon @ 01:30 PM + Tue @ 03:00 PM SC Series: Performance Best Practices Mon @ 04:30 PM + Thu. @ 01:00 PM SC Series: Affordable Data Mobility & Business Continuity With Multi-Array Federation Mon @ 08:30 AM + Thu @ 01:00 PM SC Series: Virtualization & Ecosystem Integrations Wed @ 03:00 PM + Thu @ 08:30 AM


80

Hands on Labs for SC and Dell EMC Unity Series Self-Paced Day/Time

Dell EMC Unity CloudIQ – Event Correlation & Analytics

Monday: 8:30AM – 9:00PM

Tuesday: 7:00AM – 5:30PM

Wednesday: 7:00AM – 5:00PM

Thursday: 7:00AM – 2:00PM

Dell EMC Unity – Simplified Storage Management & Administration

Dell EMC Unity – VMware vSphere Integration

Dell EMC Unity – Configuring Snapshots & Replication

SC Series: Introduction to SC Series and Dell Storage Manager

Guided Day/Time

Dell EMC Unity CloudIQ – Event Correlation & Analytics (Registration required and limited availability)

Tuesday: 1:30PM – 2:30PM

Thursday: 8:30AM – 9:30AM


81


82

WANT TO WIN A LEVITATING DEATH STAR SPEAKER?

• Follow @DellEMCStorage while at Dell EMC World

• 2 Winners will be chosen daily from

Monday May 8 through Thursday May 11 • All winners will be notified through

Twitter Direct Message

NO PURCHASE NECESSARY. Ends 05/11/2017. To enter and for Official Rules, visit http://thecoreblog.emc.com/dell-emc-world-follow-win-sweepstakes-2017/

Dell EMC Unity: Migration from VNX Deepak Venkat · PDF fileDell EMC Unity: Migration from VNX...

Documents

Transcript of Dell EMC Unity: Migration from VNX Deepak Venkat · PDF fileDell EMC Unity: Migration from VNX...