Panzura & Scality - Cloud Storage made seamless - Cloud Expo New York City 2012

18
Slide 1 Cloud Storage Made Seamless Marc Villemade Technology Evangelist Scality Ranajit Nevatia VP, Marketing Panzura

description

This is the full presentation I did with Ranajit Nevatia from Panzura (@ranajitN) at Cloud Computing Expo NY in June 2012.It introduces and explains the concepts of Structured and Unstructured data and why Object Storage will prevail when it comes to the latter.

Transcript of Panzura & Scality - Cloud Storage made seamless - Cloud Expo New York City 2012

Page 1: Panzura & Scality - Cloud Storage made seamless - Cloud Expo New York City 2012

Slide 1

Cloud Storage Made Seamless Marc Villemade Technology Evangelist Scality

Ranajit Nevatia VP, Marketing Panzura

Page 2: Panzura & Scality - Cloud Storage made seamless - Cloud Expo New York City 2012

There are two types of data (roughly)

! Structured ! We (sort of) know how to manage this

! Unstructured ! This is the new beast we have issues with

Slide 2

Page 3: Panzura & Scality - Cloud Storage made seamless - Cloud Expo New York City 2012

How to define Structured Data? !  Structured data is a set of organized pieces of data !  Relational databases are a perfect example !  Atomic pieces are, on their own, meaningless

Slide 3

Page 4: Panzura & Scality - Cloud Storage made seamless - Cloud Expo New York City 2012

What about Unstructured Data? ! Unstructured data is self-contained pieces of data !  Self-descriptive !  Meaningful in and of itself !  Typically has metadata attached to it

! Email, Videos, Presentations, Spreadsheets, satellite images…

! An easy way to think about it is anything that can be stored in one file is unstructured data

Slide 4

Page 5: Panzura & Scality - Cloud Storage made seamless - Cloud Expo New York City 2012

Some numbers… !  In 2012, Humanity will generate 2.7 ZB of data 1

!  It is estimated that we permanently store ~ 1 ZB of it 2 (~40%)

!  80% of it is unstructured 1

!  500 Quadrillion files (500,000 million million files)

!  Next year and so on, it will grow by 50% y-o-y 1

!  It will double every 2 years in the next 10 years

Kind of unfathomable, ain’t it?

Slide 5

(1) IDC numbers – (2) University of Southern California (2007)

Page 6: Panzura & Scality - Cloud Storage made seamless - Cloud Expo New York City 2012

Humans like organized things Well, some of them at least…

!  Structured storage systems have been used for Unstructured Data !  Organized in file systems, hierarchies, directories !  Easier for us

!  And then new data creation patterns emerged early 2000s !  The model doesn’t fit anymore !  And here’s why

Slide 6

Page 7: Panzura & Scality - Cloud Storage made seamless - Cloud Expo New York City 2012

Typical SAN / NAS issues at Scale

!  Technology refresh and migration necessary to benefit from larger disks

!  Scheduled maintenance window nuisance !  Limitations on # of files !  Volume management is complex !  Serial architecture compromises performance !  RAID is less efficient for large drives !  FC networks are expensive & point-to-point !  Cost is prohibitive for large capacity

Slide 7

Page 8: Panzura & Scality - Cloud Storage made seamless - Cloud Expo New York City 2012

Humans like organized things Well, some of them at least…

!  Structured data storage systems are used for Unstructured. !  Organized in file systems, hierarchies, directories !  Easier for us

!  And then new data creation patterns emerged early 2000s !  The model doesn’t fit anymore !  SANs and NASes were not made to handle this

Slide 8

Page 9: Panzura & Scality - Cloud Storage made seamless - Cloud Expo New York City 2012

So what’s the solution?

! We believe it’s Object Storage ! Yahoo!, Amazon, Google.. were the pioneers

! Main Characteristics ! Flat Namespace !  Infinite Scalability ! Elasticity ! Cost-efficiency ! Data availability and durability

Slide 9

Page 10: Panzura & Scality - Cloud Storage made seamless - Cloud Expo New York City 2012

Scality’s Storage Vision

Slide 10

Their DC Their App. YOUR Data

Their DC YOUR App. YOUR Data

YOUR DC YOUR App. YOUR Data

Page 11: Panzura & Scality - Cloud Storage made seamless - Cloud Expo New York City 2012

Scality has developed a distributed (scale–out) object-based storage software to turn x86 servers into Petabyte scale storage for unstructured data (files). (Scality is NOT designed for VM, VDI, Relational Database)

Slide 11

What is the Secret Sauce?

•  Distributed System •  Distributed metadata •  No Single point of failure •  Self healing •  Organic upgrades

Page 12: Panzura & Scality - Cloud Storage made seamless - Cloud Expo New York City 2012

Slide 12

What’s unique about Scality RING

•  Performance •  ESG Lab report: we’re 10x faster than any other object store

•  Hardware-agnostic •  Software Vendor •  Mixed hardware (disks, nodes)

•  Erasure-Coding with No penalty on read •  With only 60% overhead

•  Tiering •  Policy driven •  Automatic, Transparent

Page 13: Panzura & Scality - Cloud Storage made seamless - Cloud Expo New York City 2012

© 2011 Panzura, Inc. Confidential. All rights reserved.

Tiers&of&Storage&and&Evolu3on&

Primary (FC) Secondary (Tape)

$$$$ + Very Fast $ + Slow speed Storage 90’s

Higher capacity Higher performance

Structured and Unstructured Data Backup and Archive Data

$$$$ + Very Fast $$$ + Medium $$ + Medium $$ + Medium $ + Slow speed

Storage 2000

Primary(SAN) Secondary Primary (NAS) Secondary (NAS)

Unstructured Files, Active Archives Snapshots, D2D BU and DR Tape BU Structured Data

Cloud NAS Cloud Backup/DR Cloud Archive Structured Data

$$$$ + Very Fast $$ + fast $ + Medium $ + Medium

Storage tomorrow

Enterprise Object Storage Primary(SSD)

Page 14: Panzura & Scality - Cloud Storage made seamless - Cloud Expo New York City 2012

CONFIDENTIAL - Copyright ©2011 Panzura, Inc. All rights reserved.

Enterprise&Today&

London New York Tokyo

Replicated DR Storage

Page 15: Panzura & Scality - Cloud Storage made seamless - Cloud Expo New York City 2012

© 2011 Panzura, Inc. Confidential. All rights reserved.

Centralized&Storage&using&Scality&

Panzura Global File System (App Intelligence)

R/W Perf ACL AD G. CIFS/NFS G. Locking G.NS

Panzura Cloud Storage Controller (Unlimited Capacity)

Virt/Phy 10Gbps SSD Cache IOPS Replication Encryption RAID-DP Snapshots

G. Mgmt G. Dedup

Performance Protection

Global Local Efficient

London New York Tokyo

Page 16: Panzura & Scality - Cloud Storage made seamless - Cloud Expo New York City 2012

CONFIDENTIAL - Copyright ©2011 Panzura, Inc. All rights reserved.

Fully&Seamless,&Scalable&Storage&

Performance Needs

Increase

Capacity Needs

Increase

Application Servers

Panzura File System Controller

Cloud Storage Infrastructure

Business Continuity

& DR

or

Public Private Cloud

Cloud Capacity Increased

File System Controllers

Added

Page 17: Panzura & Scality - Cloud Storage made seamless - Cloud Expo New York City 2012

© 2011 Panzura, Inc. Confidential. All rights reserved.

Panzura Use Cases

Archive Backup Global NAS

London

Shanghai

New York CIFS and NFS

•  Lower cost of management, reduce complexity •  Manage one copy - Authoritative copy lives centrally •  Share globally - Access from anywhere •  Secure & Minimize Capacity

•  Encryption/Compression/Deduplication - •  Elastic Provisioning – Increase/Decrease usage as needed

Random Access Cloud Storage

Deduplication Encryption Multiple Gbps

Medical Images Market Data Seismic Data

Symantec NetBackup Tivoli TSM

Deduplication

Encryption Multiple Gbps

20:1 save factor Unlimited cloud store Random Access NO TAPES

Hong Kong

Page 18: Panzura & Scality - Cloud Storage made seamless - Cloud Expo New York City 2012

CONFIDENTIAL - Copyright ©2011 Panzura, Inc. All rights reserved.

The&Panzura&Advantage&

!  Mul$ple'Use'Cases'•  Primary&Consolidated&NAS&with&decentralized&Local&File&Service&•  Mul3Dsite&collabora3on&with&a&single&files&system&•  Automa3c&CloudDbased&data&protec3on:&archive,&backup,&disaster&recovery&

!  Key'Solu$on'IP'&'Features'•  Panzura&global&locking&manager&and&global&file&system&•  Leverage&Public&&Enterprise&Cloud&(Object)&Storage&•  Panzura&opera3ng&system,&1U,&2U,&or&virtual&appliance&

Panzura: Cloud Storage Made Seamless

!  Momentum'in'Market'•  Expanding&channel&•  Major&Global2000&firms&as&customers&•  Red Herring finalist •  Best of Interop Winner