How Open Source Will Change How You Think about Storage - LGI Tech Summit
-
Upload
scott-ryan -
Category
Technology
-
view
36 -
download
1
Transcript of How Open Source Will Change How You Think about Storage - LGI Tech Summit
![Page 1: How Open Source Will Change How You Think about Storage - LGI Tech Summit](https://reader035.fdocuments.us/reader035/viewer/2022062902/58ef4cff1a28ab1d7d8b45f1/html5/thumbnails/1.jpg)
SCOTT RYAN, SVP & GM STORAGE PRODUCTS
HOW OPEN SOURCE WILL CHANGE THE WAY YOU THINK ABOUT STORAGESeptember 14, 2014
![Page 2: How Open Source Will Change How You Think about Storage - LGI Tech Summit](https://reader035.fdocuments.us/reader035/viewer/2022062902/58ef4cff1a28ab1d7d8b45f1/html5/thumbnails/2.jpg)
STORAGE MARKET DYNAMICS
THE RISE OF OPEN SOURCE STORAGE PROJECTS
- RETHINKING STORAGE
SESSION OUTLINE
![Page 3: How Open Source Will Change How You Think about Storage - LGI Tech Summit](https://reader035.fdocuments.us/reader035/viewer/2022062902/58ef4cff1a28ab1d7d8b45f1/html5/thumbnails/3.jpg)
THE RISE OF OPEN SOURCE STORAGE PROJECTS
- RETHINKING STORAGE
SESSION OUTLINE
STORAGE MARKET DYNAMICS
![Page 4: How Open Source Will Change How You Think about Storage - LGI Tech Summit](https://reader035.fdocuments.us/reader035/viewer/2022062902/58ef4cff1a28ab1d7d8b45f1/html5/thumbnails/4.jpg)
DATA STORAGE “SHORTFALL”Data stores are growing exponentially, while IT budgets are not
20232013
IT BUDGET2% CAGR
(2013-2023)
IT ProfessionalsWill Shoulder a Greater Storage
Burden
STORAGE CAPACITY62% CAGR
(2013-2023)
230 GBPer IT Pro
2013
1,231 GB
Per IT Pro2023
HDDs are becoming more dense, but $/GB decline is slowing
Software and hardware advances are needed to close the gap
Source: IDC, The Digital Universe of Opportunities: Rich Dataand the Increasing Value of the Internet of Things, April 2014
![Page 5: How Open Source Will Change How You Think about Storage - LGI Tech Summit](https://reader035.fdocuments.us/reader035/viewer/2022062902/58ef4cff1a28ab1d7d8b45f1/html5/thumbnails/5.jpg)
ORGANIZATIONS ARE RETHINKING STORAGE
2016 2017 2018 2019 2020$0
$5,000
$10,000
$15,000
$20,000
$25,000
$30,000
$35,000
$40,000
$45,000
$50,000
Hyperscale Software-defined StorageEnterprise Software-defined StorageEnterprise Traditional Storage
TAM
(milli
ons)
Source: Wikibon
Traditional SAN/NAS storage market is in accelerating
decline
Software-defined storage (SDS) grows from 12% to 49%
between 2016-2020
Most of the SDS marketis hyperscale today
Enterprise SDS is smaller to date, but where the faster
growth is expected
![Page 6: How Open Source Will Change How You Think about Storage - LGI Tech Summit](https://reader035.fdocuments.us/reader035/viewer/2022062902/58ef4cff1a28ab1d7d8b45f1/html5/thumbnails/6.jpg)
SOFTWARE-DEFINED STORAGE (SDS)SDS ENABLES ABSTRACTION OF THE
HARDWAREFROM THE SOFTWARE
Independence from
high-cost proprietary HW +
SW systems leads to better
pricing and freedom of choice
Hardware is treated
as a pool, scalableacross multiple storage systems
Innovative functionality,
easier to manage, faster to
implement,and more flexible
to scale-out
Integral part of the software-defined
data center (SDDC)
KEY BENEFITS
![Page 7: How Open Source Will Change How You Think about Storage - LGI Tech Summit](https://reader035.fdocuments.us/reader035/viewer/2022062902/58ef4cff1a28ab1d7d8b45f1/html5/thumbnails/7.jpg)
TRADITIONAL VS. SDS
Lower cost, standardized supply chain
Increased operational flexibility
More programmability, agility, and control
More flexible, well-integrated technology
TRADITIONAL SDS
ProprietaryHardware
Scale-UpArchitecture
Hardware-BasedInnovation
Closed DevelopmentProcess
Common,Off-The-Shelf
HardwareScale-Out
Architecture
Software-BasedInnovation
Open DevelopmentProcess
![Page 8: How Open Source Will Change How You Think about Storage - LGI Tech Summit](https://reader035.fdocuments.us/reader035/viewer/2022062902/58ef4cff1a28ab1d7d8b45f1/html5/thumbnails/8.jpg)
STORAGE MARKET DYNAMICS
THE RISE OF OPEN SOURCE STORAGE PROJECTS
SESSION OUTLINE
- RETHINKING STORAGE
![Page 9: How Open Source Will Change How You Think about Storage - LGI Tech Summit](https://reader035.fdocuments.us/reader035/viewer/2022062902/58ef4cff1a28ab1d7d8b45f1/html5/thumbnails/9.jpg)
OPEN SOURCE =GOOD BUSINESS
NEARLY 9 in 10 SAY THAT OPEN SOURCEGREATLY IMPACTS THE SPEED OF INNOVATION – ALIGNING WITH TIME TO MARKET FOR NEW PRODUCTS
UP FROM 45% IN 2014
NEARLY 8 in 10 SAY THAT OPEN SOURCE IMPROVES MARGINS AND GROWS REVENUE
OVER
65%GAIN COMPETITIVE
ADVANTAGE
![Page 10: How Open Source Will Change How You Think about Storage - LGI Tech Summit](https://reader035.fdocuments.us/reader035/viewer/2022062902/58ef4cff1a28ab1d7d8b45f1/html5/thumbnails/10.jpg)
COTS HARDWARE + OPEN SOURCE SOFTWARE + COMMUNITYWHAT IS OPEN SOURCE STORAGE?
Support & Maintenance
Proprietary Software
Proprietary HardwareCPUCPUCPU
DiskDiskDisk
Enterprise Products & Services
Open Source Software
COTS Hardware
By 2018 Open Source Storage will gain 20% of the market, approx. $10B*
CPUCPUCPU
DiskDiskDisk
*(Gartner, “2014 Strategic Roadmap for Storage”, March 2014)
![Page 11: How Open Source Will Change How You Think about Storage - LGI Tech Summit](https://reader035.fdocuments.us/reader035/viewer/2022062902/58ef4cff1a28ab1d7d8b45f1/html5/thumbnails/11.jpg)
OPEN SOURCE STORAGE STACKDISTRIBUTEDPROCESSING
CLOUDCOMPUTING
OS
STORAGE
DATABASE
SWIFT
![Page 12: How Open Source Will Change How You Think about Storage - LGI Tech Summit](https://reader035.fdocuments.us/reader035/viewer/2022062902/58ef4cff1a28ab1d7d8b45f1/html5/thumbnails/12.jpg)
TOP OPEN SOURCE STORAGE PROJECTS• Number one storage choice for OpenStack installations• Contributors include RedHat, Intel, SanDisk, CERN, and
Yahoo• Block, File, Object: RADOS, RBD, Ceph FS, S3, Swift
• Over 11M downloads in the last 12 months• File: GlusterFS, CIFS, NFS• RedHat ownership increasing project interest
92 authors/last mo
1,139 commits/last mo
39 authors/last mo
234 commits/last mo
• Part of the OpenStack project• Contributors include SwiftStack, RedHat, HPE, Intel,
Rackspace, IBM• Object: Swift
30 authors/last mo
48 commits/last mo
SWIFT
![Page 13: How Open Source Will Change How You Think about Storage - LGI Tech Summit](https://reader035.fdocuments.us/reader035/viewer/2022062902/58ef4cff1a28ab1d7d8b45f1/html5/thumbnails/13.jpg)
CEPH INTRODUCTION• Open source software-defined storage • Massively scalable• Object, block and file system storage in a single
platform• Runs on COTS hardware – saving cost and offering
improved flexibilityOBJECTRADOS S3/SWIFT
ObjectObject
Object
Object
Object
Object
Object
FILENFS CIFS
BLOCKRBD
![Page 14: How Open Source Will Change How You Think about Storage - LGI Tech Summit](https://reader035.fdocuments.us/reader035/viewer/2022062902/58ef4cff1a28ab1d7d8b45f1/html5/thumbnails/14.jpg)
CEPH BASICS• Massively Scalable to Exabytes• Self-healing and Self-managing• Automatic distribution of replicas• Auto-rebalancing• Redundancy though data replication• Rack and data center aware• No need for RAID• Fully distributed – no single point of
failure• APIs and cloud integration for self-
service
RGWA web
services gateway for
object storage
LIBRADOSA library allowing apps to directly access
RADOS
RADOSA software-based reliable, autonomous,
distributed object store comprised of self-healing, self-managing, intelligent storage
nodes and lightweight monitors
RBDA reliable,
fully distributed
block device
CEPH FSA
distributed file system with POSIX semantics
Application Host / VM Client
![Page 15: How Open Source Will Change How You Think about Storage - LGI Tech Summit](https://reader035.fdocuments.us/reader035/viewer/2022062902/58ef4cff1a28ab1d7d8b45f1/html5/thumbnails/15.jpg)
WHAT ABOUT THE HARDWARE?Original Design Manufacturers (ODM)• Provide a more cost effective storage
infrastructure- ODMs operate on 10% GM versus 60-70%
• Strong ecosystem of design and build partners• Have built strength in parts depots and field
support• Through necessity with many large web-scale
companies buying direct• Intel white-box design helps fast-track their
designs• Quick release cycles and adopt newer
technology quickly
![Page 16: How Open Source Will Change How You Think about Storage - LGI Tech Summit](https://reader035.fdocuments.us/reader035/viewer/2022062902/58ef4cff1a28ab1d7d8b45f1/html5/thumbnails/16.jpg)
STORAGE MARKET DYNAMICS
THE RISE OF OPEN SOURCE STORAGE PROJECTS
SESSION OUTLINE
- RETHINKING STORAGE
![Page 17: How Open Source Will Change How You Think about Storage - LGI Tech Summit](https://reader035.fdocuments.us/reader035/viewer/2022062902/58ef4cff1a28ab1d7d8b45f1/html5/thumbnails/17.jpg)
File & Object Services Node(Provides S3, Swift, NFS, CIFS)
Performance Data Node(2 SSDs, 10 HDDs)
Capacity Data Node(6 SSDs, 30 HDDs)
Starts small,
Expands tomultiple racks
Applications
OPENEXASCALESTORAGE
![Page 18: How Open Source Will Change How You Think about Storage - LGI Tech Summit](https://reader035.fdocuments.us/reader035/viewer/2022062902/58ef4cff1a28ab1d7d8b45f1/html5/thumbnails/18.jpg)
OPENEXASCALESTORAGE
RADOS RBD NFS CIFSS3 Swift
Object Pools Block Pools
Self-Healing
Auto-Balancing Scrubbing Thin
Provisioning Snapshots
HA Ethernet
CRUSH Map & Placement Groups
VolumesBuckets VolumesBuckets
Cap Data Nodes Perf Data NodesHigh Cap Data Nodes
SSDs HDDs SSDs HDDsSSDs HDDs
Software-defined Storage Delivered on Qualified Hardware Support for Hardware & Software
![Page 19: How Open Source Will Change How You Think about Storage - LGI Tech Summit](https://reader035.fdocuments.us/reader035/viewer/2022062902/58ef4cff1a28ab1d7d8b45f1/html5/thumbnails/19.jpg)
of the Top 25 Service Providers in North America
Several of the Top Service Providers
in Europe
6
Including
TRUST
VISION
PERFORMANCE
COST
Proven Performance
VOD, Cloud DVR need consistent speed
Multi-workload & Open Source
Economics of SDS are Strong
FEATURES Fast-paced community development
WHY?
CUSTOMERS
![Page 20: How Open Source Will Change How You Think about Storage - LGI Tech Summit](https://reader035.fdocuments.us/reader035/viewer/2022062902/58ef4cff1a28ab1d7d8b45f1/html5/thumbnails/20.jpg)
VIDEO OPENSTACK SYNC-N-SHARE BACK-UP / DR
OPEN STORAGE USE CASES
Power next generation
video services with advanced, proven
storage.
Simplify storage management
and service provisioning
for OpenStack.
Solve the “shadow IT”
problem – maintain compliance and
secure intellectual property
Utilize the cost economics
and scaling of object on one
multi-workload system
![Page 21: How Open Source Will Change How You Think about Storage - LGI Tech Summit](https://reader035.fdocuments.us/reader035/viewer/2022062902/58ef4cff1a28ab1d7d8b45f1/html5/thumbnails/21.jpg)
• Media file storage for customer-facing application• Drop-in replacement for legacy object backend• Minimal resistance to increasing scale• Multi-protocol capable for future service• Fast transaction capable
FOR MEDIA
![Page 22: How Open Source Will Change How You Think about Storage - LGI Tech Summit](https://reader035.fdocuments.us/reader035/viewer/2022062902/58ef4cff1a28ab1d7d8b45f1/html5/thumbnails/22.jpg)
QUESTIONS?