Introduction To GlusterFS
Audio is available via VoIP or Landline.
For VoIP
You will be connected to audio using your
computer‟s speakers or headset.
For Landline:
Please select Use Telephone after joining the
Webinar.
US/Canada attendees dial (805) 309-0021
Access Code 232-976-193
A Better Way To Do Storage 2
John Kreisa Vice President
Marketing
Gluster, Inc.
Tom TrainerDirector
Product Marketing
Gluster, Inc.
Jacob Shucart Senior Systems Engineer
Gluster, Inc.
Today’s Speakers
A Better Way To Do Storage 3
Poll Question
Are you using GlusterFS today?– Yes, in a test environment
– Yes, it‟s deployed in a production environment
– No, however we are considering it
– Just researching
A Better Way To Do Storage 4
History of Gluster
How it all started– Backgrounds in high performance, clustered computing
– Working at Lawrence Livermore National Labs
• AB Periasamy & Hitesh Chellani design “Thunder”
• One of the worlds fastest super computers
• On Intel commodity hardware
• Solved filesystem scalability and performance limitations
– Large customer in oil & gas persuaded them to focus on storage
– Gluster founded by Hitesh & AB to bring technology to market
Result: award winning technology
Thunder
A Better Way To Do Storage 5
What is the Gluster File System?
A scale-out file system for Network Attached Storage (NAS)
– Highly available
– Linearly scalable performance
GlusterFS provides
– Flexibility to deploy in ANY
environment
– Scalability to Petabytes & beyond
– Superior storage economics
A Better Way To Do Storage 6
GlusterFS Architecture Design Goals
Elasticity – Flexibility adapt to growth/reduction
– Add, delete volumes & users
– Without disruption
Scale linearly – Multiple dimensions
• Performance
• Capacity
– Aggregated resources
Eliminate metadata– Improve file access speed
Simplicity – Ease of management
– No complex Kernel patches
– Run in user space
Capacity
Per
form
ance
A Better Way To Do Storage 7
Key Differentiators
Filesystem runs in user space
Software only
Open source
Modular, stackable storage OS architecture
Data stored in native formats
No metadata – Elastic hashing
A Better Way To Do Storage 8
User Space
Filesystem Runs in User Space
GlusterFS
Server(CPU/Mem)
1 TB
1 TB
1 TB
1 TB
1 TB
1 TB
1 TB
1 TB
1 TB
1 TB
1 TB 1 TB
Kernel
1 TB 1 TB
Not tied to kernel
No reassemblies
Independence
A Better Way To Do Storage 9
Software Only
Hardware agnostic
Superior storage economics & flexibility – Data center / private cloud use commodity hardware
– Public cloud – i.e. AWS, RackSpace, GoGrid – pay for only what you need
No lock-in– Hardware vendors-at purchase time or in the future
– Public or private cloud
– Performance, capacity, or availability levels
– GlusterFS – not proprietary, files are stored in native formats (i.e. EXT4)
A Better Way To Do Storage 10
Open Source
200,000+ downloads– ~12,000 /month
500+ registered deployments– 45 countries
2,500+ registered users– Mailing lists, Forums, etc.
Active community– Diverse testing environments
– Bugs identification and fixes
– Code contributions
Member of broader ecosystem– OpenStack, Linux Foundation, Open
Virtualization Alliance
Global Adoption
A Better Way To Do Storage 11
Modular, Stackable Storage OS Architecture
NAS protocols
Replication
Global namespace
Clustered & replicated
Built-in failover
Self healing
POSIX compliant
No metadata server
Elastic hash
Thin provisioning
Flexible storage configurations
NFS, CIFS, GlusterFS, HTTP(s), WebDAV, (S)FTP
Interface – Protocols - Replication
Services to the public network
Gluster Server
Public Network | Storage Server Network1Gb, 10Gb, Infiniband
64-bit Linux distributionsRHEL, Fedora, Debian, CentOS, Ubuntu, SUSE
Unlimited number of filesElastic hash function
Native format ext3 or ext4 recommended / POSIX compliant
Disk storage Local to host(Gluster Server), SAS, SATA, SCSI attached JBODs, Fibre
Channel supportedISCSI supported – for low I/O Apps
A Better Way To Do Storage 12
Elastic Hashing
No metadata server
An algorithmic approach– Unique hash tag for each file stored
– Tags stored within the file system
– Rapid file read – low latency
Figure 1
Figure 2Figure 3
*Figures 1,2,3 are examples only
A Better Way To Do Storage 13
A Standard Gluster Deployment
Standard clients
running standard apps
Over any standard IP
network
Access application
data, as files & folders,
in a global namespace,
using a variety of
standard protocols
Stored in a
commoditized,
virtualized, scale-out,
centrally managed pool
DAS, SAN, NAS
Gluster Global Namespace (NFS, CIFS, Gluster Native)
Application data
Clients/Apps Clients/Apps Clients/Apps
IP Network
VMs VMDK VMDK
virtual storage pool
A Better Way To Do Storage 14
Unifying Public and Private Cloud Storage
Client/AppsClient/Apps
Private Cloud Public Cloud
Replication
Gluster Global Namespace
Client/AppsClient/Apps
Client/AppsClient/Apps
Client/AppsClient/Apps
Client/Apps
IP Network
A Better Way To Do Storage 15
Deployment Scenarios Common Solutions Built on GlusterFS
Media serving (CDN)
Large scale file storage
Tier 2 & 3 archive
File sharing
Multi-tenant file systems
Storage for High Performance
Computing (HPC)
IaaS storage layer
Disaster recovery
Backup & restore
Private cloud
A Better Way To Do Storage 16
Pandora Internet Radio
Problem• Explosive user & title growth
• As many as 12 file formats for each song
• „Hot‟ content and long tail
Solution• Three data centers, each with a six-node
GlusterFS cluster
• Replication for high availability
• 250+ TB total capacity
Benefits• Easily scale capacity
• Centralized management; one administrator
to manage day-to-day operations
• No changes to application
• Higher reliability
• 1.2 PB of audio served
per week
• 13 million files
• Over 50 GB/sec peak
traffic
A Better Way To Do Storage 17
Brightcove
Problem• Cloud-based online video platform
• Explosive customer & title growth
• Massive video in multiple locations
• Costs rising, esp. with HD formats
Solution• Complete scale-out based on commodity
DAS/JBOD
• Replication for high availability
• 1PB total capacity
Benefits• Easily scale capacity
• Centralized management; one administrator
to manage day-to-day operations
• Higher reliability
• Path to multi-site
• Over 1 PB currently in
Gluster
• Separate 4 PB project
in the works
A Better Way To Do Storage 18
Cincinnati Bell Technology Solutions
Problem• Host a dedicated enterprise cloud solution
• Large scale VMware environment
• Need high availability
Solution• Gluster for VM storage, NFS to clients
• SAS drives on back-end
• Replication for high availability
Benefits• Storage provisioning from 6 wks to 15 min.
• Vendor agnostic storage
• Low cost of service delivery
• Elastic growth
• Large scale VM
storage
• Low cost service
delivery for enterprise
customer
• Drastic reduction in
provisioning time
A Better Way To Do Storage 19
Problem• Capacity growth from 144TB to 1+PB
• Multiple distributed users/departments
• Multi OS access - Windows, Linux and Unix
Solution• GlusterFS Cluster
• Solaris/ZFS/x4500 w/ InfiniBand
• Native CIFS/ NFS access
Benefits• Capacity on demand / pay as you grow
• Centralized management
• Higher reliability
• OPEX decreased by 10X
Partners Healthcare
• Over 500 TB
• 9 Sun “Thumper”
systems in cluster
Private Cloud: Centralized Storage as a Service
A Better Way To Do Storage 20
4 Supported Ways to Consume GlusterFS
Virtual Machines– GlusterFS deployable on the leading virtual machines
Amazon Web Services (AWS)– GlusterFS deployed within Amazon Machine Image (AMI)
RightScale Cloud Management – GlusterFS is available within a RightScale ServerTemplate
– Deployable via the RightScale Cloud Management Dashboard
Storage software appliance– Deployable on bare metal and supports any hardware on the Red Hat Hardware
Compatibility List (HCL) of certified servers and storage
A Better Way To Do Storage 21
Select Gluster Customers
A Better Way To Do Storage 22
Summary
GlusterFS – A scale-out NAS file system
Flexibility, scalability, superior economics
Innovative architecture provides a better way to do
storage
A Better Way To Do Storage 23
Your turn - ask our experts
Questions and Answers
Try Gluster for free here: http://www.gluster.com/trybuy/
Additional resources here: http://www.gluster.com/products/resources/
Join the community: http://www.gluster.org/
Follow on twitter: @gluster.
Read our blog: http://blog.gluster.com/
Contact us at: [email protected] or 1-800-805-5215
Top Related