MANAGING THE INFORMATION EXPLOSION WITH OPEN, SOFTWARE ... · MANAGING THE INFORMATION EXPLOSION...

MANAGING THE INFORMATION EXPLOSIONWITH OPEN, SOFTWARE-DEFINED STORAGE

Gerald SternaglBU Manager Storage, EMEAEmail: [email protected], 6th 2013

Session title2RHS: Managing the Information Explosion

AGENDA

● Changes in the storage market● Open, Software-defined● Red Hat Storage Overview● Use Cases● TCO & Customer example● Gluster Community● Q&A


THE INFORMATION EXPLOSION

Main growth drivers:Virtualisation, Cloud, Mobile Computing and Big Data

Source: IDC's Digital Universe Study, Dec 2012


CORNERSTONE OF THE NEW SOFTWARE DEFINED DATACENTER

COMPUTECOMPUTE

SOFTWARE- DEFINED / BASED COMPUTE

(Virtualization)

SOFTWARE- DEFINED / BASED COMPUTE

(Virtualization)

STORAGESTORAGE

SOFTWARE-DEFINED / BASED STORAGE

SOFTWARE-DEFINED / BASED STORAGE

NETWORKINGNETWORKING

SOFTWARE-DEFINED / BASED NETWORKING

SOFTWARE-DEFINED / BASED NETWORKING

ENVIRONMENTALENVIRONMENTAL

SOFTWARE-DEFINED / BASED FACILITIES

SOFTWARE-DEFINED / BASED FACILITIES

DATA CENTER FABRIC DATA CENTER FABRIC

DATACENTER EVOLUTION


ENTERPRISEMOBILITY

INCREASE DATA, APPLICATION AND INFRASTRUCTURE AGILITY

CLOUD APPLICATIONS

CONVERGED COMPUTE AND STORAGE

FILE SERVICES OPEN OBJECT APIs

OPEN, SOFTWARE-DEFINED STORAGE PLATFORM

SCALE-OUT STORAGE ARCHITECTURE

PHYSICAL

Standard x86 systemsScale-out NAS solutions

VIRTUAL

Include idle or legacy resources

CLOUD

EBSEBS

BIG DATA WORKLOADSENTERPRISE APPLICATIONS

DATA SERVICES

PERSISTENT DATA STORES


RED HAT STORAGEFOR ON-PREMISE

SERVER (CPU/MEM)

1TB

• Global namespace

• Aggregates CPU, memory,network capacity.

• Deploys on Red Hat-supported servers and underlying storage: DAS, JBOD.

• Scale out linearly.

• Scale out performance and capacity as needed.

• Replicate synchronouslyand asynchronously.

RED HAT STORAGE DEPLOYMENT ON-PREMISE

RED HAT STORAGEFOR ON-PREMISE

1TB

Scale out performance, capacity, and availability

Sca

le u

p c

apac

ity

SINGLE GLOBAL NAMESPACE

...

...SERVER(CPU/MEM)

............ ... ...


RED HAT STORAGE SERVER FOR PUBLIC CLOUD

RED HAT STORAGEFOR PUBLIC CLOUD

EBS

Scale out performance, capacity, and availability

Sca

le u

p c

apac

ity

• GlusterFS Amazon Machine Images (AMIs)

• The only way to achieve high availability of Elastic Block Storage (EBS)

• Multiple EBS devices pooled

• POSIX compatible (no application to rewrite required to run on Amazon EC2)

• Scale out capacity and performance as needed

SINGLE GLOBAL NAMESPACE

RED HAT STORAGE DEPLOYMENT ON AMAZON CLOUD

...

...EC2

............ ... ...

Now available as AWS test-driveNow available as AWS test-drive


CIFS HADOOP ENABLEMENT

REPLICATION

MULTI-SITE DR

MULTI-TENANT:NAMESPACE AND ENCRYPT

MULTI-TENANT:QoS (CGROUPS)

VOLUMESNAPSHOT

CLIENT/ PRESENTATION

BACKEND/ PERSIST

SAMBA USER APP QEMU

SWIFT

MANAGE

FUSE NFS

TRANSLATORS

TRANSLATORS

GLUSTERFS FRAMEWORK

GLUSTERFS

NETWORK STACK

NETWORK DEVICE PLATFORM BLOCK DEVICE

HARDWARE ENABLEMENT

LOCAL FILESYSTEM

LOGICAL VOLUME MANAGEMENT

XFS OTHER

RED HAT ENTERPRISE LINUX

PL

AT

FO

RM

MA

NA

GE

AB

ILIT

Y

RED HAT STORAGE TECHNOLOGY STACK


RED HAT STORAGE SCALABILITY

2 4 6 8 10 12 14 160

2000

4000

6000

8000

10000

12000

14000

Sequential Read Transfer Rates

glusterfs,repl=1 glusterfs,repl=2

Gluster-NFS,repl=1 Gluster-NFS,repl=2

Servers

MB/s

2 4 6 8 10 12 14 160

2000

4000

6000

8000

10000

12000

14000

Sequential Write Transfer Rates

glusterfs,repl=1 glusterfs,repl=2

Gluster-NFS,repl=1 Gluster-NFS,repl=2

Servers

MB/s


DESIGNED FOR MANAGING UNSTRUCTURED DATA

SUPPORTING A WIDE RANGE OF ENTERPRISE AND EMERGING WORKLOADS


RED HAT STORAGE FOR OPENSTACK


ENSURE GLOBAL DATA PROTECTION AND AVAILABILITYTRANSPARENTLY DISTRIBUTE DATA GLOBALY

SITE A SITE B

REMOTE SITE / DR


BRING APPLICATIONS CLOSER TO THE DATA

CONVERGING COMPUTE AND STORAGE

INCREASE AGILITY

REDUCE LATENCY

PROCESS DATA LOCALLY

REDUCE COSTS

STORAGE RESIDENT APPLICATIONS


HIGHLY AVAILABLE CLOUD STORAGE FOR AMAZON EC2LEVERAGE THE ELASTICITY OF THE CLOUD WITHOUT RE-WRITING YOUR APPLICATIONS

US East (N. Virginia)US East (N. Virginia) Ireland (Cork)

CREATING HIGHLY AVAILABLE, SCALEABLE EBS STORAGE POOLS - ACROSS ZONES


DELIVER COST EFFECTIVE ELASTIC CAPACITY AND PERFORMANCE53% - 78% REDUCTION IN COSTS

SOURCE: IDC REPORT – THE ECONOMICS OF SOFTWARE BASED STORAGE

YEAR


“Red Hat worked with us the entire way as we designed and built our architectures, helping with best practices, design considerations and layout, performance testing, and migration.”

MOHIT ANCHLIAARCHITECT, INTUIT TURBO TAX

PROBLEM NEEDED A FAST, RELIABLE, AND COST-EFFECTIVE STORAGE SOLUTION

TO MEET GROWING SAAS LINE OF BUSINESS

TAX RETURNS AND OTHER DATA WERE BEING STORED AS BLOBS IN AN EXPENSIVE ORACLE DB

SOLUTION RED HAT STORAGE SERVER 2.O FOR ON-PREMISE OBJECT STORAGE

HP DL2000s AND APACHE CASSANDRA

BENEFITS SCALEABLE ON-DEMAND STORAGE FOR UNSTRAUCTURED DATA

COST EFFECTIVE SOLUTION THAT LEVERAGES COMMODITY HARDWARE

MEET GROWING CAPACITY AND PEAK PERFORMACE NEEDS

ACHIEVE MULTI-SITE DISASTER RECOVERY

MANAGING SPRAWLING UNSTRUCTURED FINANCIAL DATA


WHAT DO THE ANALYSTS SAY?


DELIVERING AGILITY AND COST ADVANTAGE

FOUNDATION FOR HYBRID CLOUD AND BIG DATA

DEPLOY DATA ANYWHERE PHYSICAL, VIRTUAL CLOUD

ELASTIC CAPACITY AND PERFORMACE

MODERN, SECURE FILE AND OBJECT STORAGE

ENSURE DATA PROTECTION AND AVAILABILITY

CONVERGE COMPUTE AND STORAGE

RED HAT STORAGESERVER

DELIVERING THE NEXT GENERATION OF OPEN SOFTWARE-DEFINED STORAGE TODAY

DESIGNED FOR TODAYS IT & DATA ECONOMICS

MANAGING UNSTRUCTUREDDATA AT SCALE


COMMUNITY INNOVATION

SNAPSHOTTING

CHANGE DETECTION

COMPRESSION

pNFS AND NFSv4 SUPPORT

GLUSTER.ORG COMMUNITY FORGE ENHANCEMENTS AND PROJECTS

FILE VERSIONING

3-WAY REPLICATION

ERASURE CODING

SMB 3.0 SUPPORT

TRANSLATORS EXTENSION FOR PYTHON

PUPPET MANAGEMENTMODULE

GTOP - MONITORING

GLUSTER PROFILING

NDMP SERVER

SELINUX SUPPORT

PMUX – LIGHTWEIGHT MAP REDUCE

MULTI-MASTER GEO-REPLICATION

Session title

Non confidential 2121 RHS: Managing the Information Explosion

SKILL UP AND CERTIFY ON RED HAT STORAGE SERVER ADMINISTRATION (RH236)

New 2-Day Emerging Technology Workshop to learn how to install, configure, and maintain a cluster of Red Hat Storage servers.

Prepares you for the Storage Admin exam (EX236) and to achieve the Red Hat Certificate of Expertise in Hybrid Cloud Storage.

Note: Red Hat Storage Server Administration is part of our new emerging technology series of courses. Emerging technologies courses are feature- and functionality-focused and are conducted like guided labs, with little lecture

Audience: Senior System Administrators and Storage Administrators interested in deploying scalable, highly available storage on off-the-shelf hardware or in the cloud.

Length: 2 Days

Training units: 7

Price: varies per region

TRAINING CERTIFICATION

Red Hat Storage Server Administration (RH236)

Red Hat Certificate of Expertise in Hybrid Cloud Storage

Session title

Non confidential 2222 RHS: Managing the Information Explosion

RED HAT STORAGE INFORMATION RESOURCES

RED HAT STORAGE PRODUCT INFORMATION

HTTP://WWW.REDHAT.COM/PRODUCTS/STORAGE-SERVER/

RED HAT STORAGE SOLUTIONS

HTTP://WWW.REDHAT.COM/PROMO/LIBERATE/SOLUTIONS.HTML

RED HAT STORAGE CUSTOMER SUCCESS STORIES

HTTP://WWW.REDHAT.COM/PROMO/LIBERATE/RESOURCES.HTML

RED HAT STORAGE SERVICES

HTTP://WWW.REDHAT.COM/PROMO/LIBERATE/SERVICES.HTML

GLUSTER COMMUNITY FORGE

HTTP://FORGE.GLUSTER.ORG

GLUSTER COMMUNITY HTTP://WWW.GLUSTER.ORG

MANAGING THE INFORMATION EXPLOSION WITH OPEN, SOFTWARE ... · MANAGING THE INFORMATION EXPLOSION...

Documents

Transcript of MANAGING THE INFORMATION EXPLOSION WITH OPEN, SOFTWARE ... · MANAGING THE INFORMATION EXPLOSION...