Universal Hybrid Cloud Connector · 2019-12-21 · 2017 Storage Developer Conference. © Veritas...

24
Universal Hybrid Cloud Connector Pankaj Mansukhani Nalini Kumari Nallamalli Meghraj Bendre Veritas Technologies LLC

Transcript of Universal Hybrid Cloud Connector · 2019-12-21 · 2017 Storage Developer Conference. © Veritas...

Page 1: Universal Hybrid Cloud Connector · 2019-12-21 · 2017 Storage Developer Conference. © Veritas Technologies LLC. All Rights Reserved. 1 Universal Hybrid Cloud Connector Pankaj Mansukhani

2017 Storage Developer Conference. © Veritas Technologies LLC. All Rights Reserved. 1

Universal Hybrid Cloud Connector

Pankaj MansukhaniNalini Kumari Nallamalli

Meghraj Bendre

Veritas Technologies LLC

Page 2: Universal Hybrid Cloud Connector · 2019-12-21 · 2017 Storage Developer Conference. © Veritas Technologies LLC. All Rights Reserved. 1 Universal Hybrid Cloud Connector Pankaj Mansukhani

2017 Storage Developer Conference. © Veritas Technologies LLC. All Rights Reserved. 2

Agenda

Hybrid Cloud Multi Volume File system SmartTier Architecture of Cloud Connector Demo Use-cases

Page 3: Universal Hybrid Cloud Connector · 2019-12-21 · 2017 Storage Developer Conference. © Veritas Technologies LLC. All Rights Reserved. 1 Universal Hybrid Cloud Connector Pankaj Mansukhani

2017 Storage Developer Conference. © Veritas Technologies LLC. All Rights Reserved. 3

What is Hybrid cloud?

Hybrid cloud is a cloud computing environment which uses a mix of on-premises, private cloud and third-party, public cloud services with orchestration between the two platforms.“Reference: http://searchcloudcomputing.techtarget.com/definition/hybrid-cloud”

Gartner predicts that by 2020 around 90% of organizations will adopt hybrid infrastructure“Gartner Says a Massive Shift to Hybrid Infrastructure Services Is Underway” April 2017

Hybrid cloud adoption grew 3X last year from 19% to 57% of organizations surveyed“Forbes 2017 State Of Cloud Adoption And Security” – April 2017

Page 4: Universal Hybrid Cloud Connector · 2019-12-21 · 2017 Storage Developer Conference. © Veritas Technologies LLC. All Rights Reserved. 1 Universal Hybrid Cloud Connector Pankaj Mansukhani

2017 Storage Developer Conference. © Veritas Technologies LLC. All Rights Reserved. 4

Bridge GAP Between New and Old

Databases,Warehouses

Enterprise Applications

Legacy Systems

Traditional Enterprise

Page 5: Universal Hybrid Cloud Connector · 2019-12-21 · 2017 Storage Developer Conference. © Veritas Technologies LLC. All Rights Reserved. 1 Universal Hybrid Cloud Connector Pankaj Mansukhani

2017 Storage Developer Conference. © Veritas Technologies LLC. All Rights Reserved. 5

Benefits of Hybrid cloud

Flexibility Security Stability Cost effectiveness

Page 6: Universal Hybrid Cloud Connector · 2019-12-21 · 2017 Storage Developer Conference. © Veritas Technologies LLC. All Rights Reserved. 1 Universal Hybrid Cloud Connector Pankaj Mansukhani

2017 Storage Developer Conference. © Veritas Technologies LLC. All Rights Reserved. 6

Challenges in Migration

Downtime Integration complexity Security Risks Change and Scale complications

Page 7: Universal Hybrid Cloud Connector · 2019-12-21 · 2017 Storage Developer Conference. © Veritas Technologies LLC. All Rights Reserved. 1 Universal Hybrid Cloud Connector Pankaj Mansukhani

2017 Storage Developer Conference. © Veritas Technologies LLC. All Rights Reserved. 7

Volume Manager

Page 8: Universal Hybrid Cloud Connector · 2019-12-21 · 2017 Storage Developer Conference. © Veritas Technologies LLC. All Rights Reserved. 1 Universal Hybrid Cloud Connector Pankaj Mansukhani

2017 Storage Developer Conference. © Veritas Technologies LLC. All Rights Reserved. 8

VxFS

Page 9: Universal Hybrid Cloud Connector · 2019-12-21 · 2017 Storage Developer Conference. © Veritas Technologies LLC. All Rights Reserved. 1 Universal Hybrid Cloud Connector Pankaj Mansukhani

2017 Storage Developer Conference. © Veritas Technologies LLC. All Rights Reserved. 9

Multi-Volume File System

High-EndStorage

VxFS

Mid-RangeStorage

VxFS

Low-EndStorage

VxFS

Volume set

Application1 Application2 Application3

Multi-Volume File System

Application

vol1 vol2 vol3

Page 10: Universal Hybrid Cloud Connector · 2019-12-21 · 2017 Storage Developer Conference. © Veritas Technologies LLC. All Rights Reserved. 1 Universal Hybrid Cloud Connector Pankaj Mansukhani

2017 Storage Developer Conference. © Veritas Technologies LLC. All Rights Reserved. 10

SmartTier

AKA Dynamic Storage Tiering Creates file storage space from

multiple tiers Transparent relocation of files Tiers and Policies: Rich

framework to define where to create files; when, why, & where to relocate files

Page 11: Universal Hybrid Cloud Connector · 2019-12-21 · 2017 Storage Developer Conference. © Veritas Technologies LLC. All Rights Reserved. 1 Universal Hybrid Cloud Connector Pankaj Mansukhani

2017 Storage Developer Conference. © Veritas Technologies LLC. All Rights Reserved. 11

SmartTier (Policy Framework)

Create various placement policies Directory (Logical location) Filename (Name) User or group (Owner) mtime or atime (Aging) I/O or Access Temperature (Activity) Space allocated to the file (Size) Current Tier (Physical location)

Page 12: Universal Hybrid Cloud Connector · 2019-12-21 · 2017 Storage Developer Conference. © Veritas Technologies LLC. All Rights Reserved. 1 Universal Hybrid Cloud Connector Pankaj Mansukhani

2017 Storage Developer Conference. © Veritas Technologies LLC. All Rights Reserved. 12

Benefits of SmartTier/MVFS

Control over data Improve I/O performance Reduced storage costs

Page 13: Universal Hybrid Cloud Connector · 2019-12-21 · 2017 Storage Developer Conference. © Veritas Technologies LLC. All Rights Reserved. 1 Universal Hybrid Cloud Connector Pankaj Mansukhani

2017 Storage Developer Conference. © Veritas Technologies LLC. All Rights Reserved. 13

Hybrid cloud connector

VxFS Multi Volume File System

Cloud

Application

I/O

Policy

S3 REST APIs

Rules to move databetween on-premise and cloud

Veritas™ enables policy driven seamless data movement between block storage and cloud, completely transparent to applications

Metadata + Hot data Warm Data Cold Data

Tier1 Tier2 Tier3

Page 14: Universal Hybrid Cloud Connector · 2019-12-21 · 2017 Storage Developer Conference. © Veritas Technologies LLC. All Rights Reserved. 1 Universal Hybrid Cloud Connector Pankaj Mansukhani

2017 Storage Developer Conference. © Veritas Technologies LLC. All Rights Reserved. 14

Cloud Object Storage

Objects are fundamental entities Eventual consistent No Partial Object update

Page 15: Universal Hybrid Cloud Connector · 2019-12-21 · 2017 Storage Developer Conference. © Veritas Technologies LLC. All Rights Reserved. 1 Universal Hybrid Cloud Connector Pankaj Mansukhani

2017 Storage Developer Conference. © Veritas Technologies LLC. All Rights Reserved. 15

Design cloud Connector

Volume to object mapping Flexible object size Read/Write maps to GET/PUT Reclaim maps to DELETE Read-Modify-Write

Page 16: Universal Hybrid Cloud Connector · 2019-12-21 · 2017 Storage Developer Conference. © Veritas Technologies LLC. All Rights Reserved. 1 Universal Hybrid Cloud Connector Pankaj Mansukhani

2017 Storage Developer Conference. © Veritas Technologies LLC. All Rights Reserved. 16

Challenges

Locking at object level Cluster Volume manager Eventual Consistency

Page 17: Universal Hybrid Cloud Connector · 2019-12-21 · 2017 Storage Developer Conference. © Veritas Technologies LLC. All Rights Reserved. 1 Universal Hybrid Cloud Connector Pankaj Mansukhani

2017 Storage Developer Conference. © Veritas Technologies LLC. All Rights Reserved. 17

Migration to Hybrid Cloud

localvol

/data

datadg

datavset

cloudvol

/data Policy.xml

TIER:LOCAL TIER:CLOUD

Files not accessed in last 30days, move to CLOUD tier

Define PolicyAssignEnforce

Private/Public Cloud

Page 18: Universal Hybrid Cloud Connector · 2019-12-21 · 2017 Storage Developer Conference. © Veritas Technologies LLC. All Rights Reserved. 1 Universal Hybrid Cloud Connector Pankaj Mansukhani

2017 Storage Developer Conference. © Veritas Technologies LLC. All Rights Reserved. 18

Page 19: Universal Hybrid Cloud Connector · 2019-12-21 · 2017 Storage Developer Conference. © Veritas Technologies LLC. All Rights Reserved. 1 Universal Hybrid Cloud Connector Pankaj Mansukhani

2017 Storage Developer Conference. © Veritas Technologies LLC. All Rights Reserved. 19

Use Cases

Migration of complete data to cloudPrimary copyMirrorSnapshot

Policy based migration of data to cloudTiering solution

Page 20: Universal Hybrid Cloud Connector · 2019-12-21 · 2017 Storage Developer Conference. © Veritas Technologies LLC. All Rights Reserved. 1 Universal Hybrid Cloud Connector Pankaj Mansukhani

2017 Storage Developer Conference. © Veritas Technologies LLC. All Rights Reserved. 20

Comparison

Array SolutionsCostlyArray SpecificAdded management complexity

Cloud SolutionsCloud Specific (Ex: AWS Storage Gateway)

Page 21: Universal Hybrid Cloud Connector · 2019-12-21 · 2017 Storage Developer Conference. © Veritas Technologies LLC. All Rights Reserved. 1 Universal Hybrid Cloud Connector Pankaj Mansukhani

2017 Storage Developer Conference. © Veritas Technologies LLC. All Rights Reserved. 21

Benefits of our solution

Hybrid ConnectorSoftware basedGeneric

Works with any cloud Works with any array

No Management complexity

Page 22: Universal Hybrid Cloud Connector · 2019-12-21 · 2017 Storage Developer Conference. © Veritas Technologies LLC. All Rights Reserved. 1 Universal Hybrid Cloud Connector Pankaj Mansukhani

2017 Storage Developer Conference. © Veritas Technologies LLC. All Rights Reserved. 22

Summary

Hybrid cloud seems to be the future in storage world Veritas InfoScale provides solution to adopt hybrid cloud

seamlessly The solution is based on MVFS/SmartTier Implemented using cloud as an tier Platform and Cloud service provider agnostic Solution

Page 23: Universal Hybrid Cloud Connector · 2019-12-21 · 2017 Storage Developer Conference. © Veritas Technologies LLC. All Rights Reserved. 1 Universal Hybrid Cloud Connector Pankaj Mansukhani

2017 Storage Developer Conference. © Veritas Technologies LLC. All Rights Reserved. 23

Q & A

Page 24: Universal Hybrid Cloud Connector · 2019-12-21 · 2017 Storage Developer Conference. © Veritas Technologies LLC. All Rights Reserved. 1 Universal Hybrid Cloud Connector Pankaj Mansukhani

2017 Storage Developer Conference. © Veritas Technologies LLC. All Rights Reserved. 24

THANK YOU