Cleversafe august 2016
-
Upload
joe-krotz -
Category
Technology
-
view
564 -
download
0
Transcript of Cleversafe august 2016
IBM Cloud Object Storage
Turn massive storage challenges into a business advantage.
Joe KrotzIBM CTS – Cloud and Storage Systems
August 2016
2Page© 2016 IBM Corporation
Today, data is everything
2Page
IBM has acquires Cleversafe – The Leading Object Store Provider!Software Company• Founded in 2004 in Chicago• Shipping product since
2008
Software Defined Object Storage• Over 100 people dedicated
to software development
Runs on Industry Standard x86• Certified platforms to
provide enterprise grade experience, predictable performance and support
Over 300 Patents AwardedObject Storage Leader two years in a rowMultiple Exabytes in Production
Acquired by IBM 2015
Notable Milestones
IDC Report onObject Storage MarketDecember 2014• Customer spending growing
27% per year• Total market projected to be
$28B in three years• Cleversafe highlighted
as “Market Leader and Market Share Leader”
Gartner Report – Object Storage – March 2016• Cleversafe highlighted as
leader in Critical Capabilities
Unstructured Data is growing exponentially which is exactly why Cleversafe is so critical
* Ex
abyt
es
2009 2010 2011 2012 2013 2014 2015 2016 20170
20
40
60
80
100
120
Unstructured Data
Structured Data
Source: IDC
Unstructured data growth of60–80%
per year creates
Web-scale storage needs
*1 exabyte = 1,000 petabytes =1 million terabytes = 1 billion gigabytes
Problem - Traditional and Legacy Storage Designed for Transactional, Not Unstructured Data
Web-scale requires a new storage architecture Objects 1000x larger
HD videos/images/audio Genomic/seismic data Internet of Things/social media
Large and growing storage requirementUp to exabytes with always-on availability and zero-touch, carrier-grade security
Legacy storage won’t scale and is less cost-effective Traditional storage requires copies, replication, mirroring and disaster recovery
(DR) to protect data—Cleversafe can help eliminate those requirements, and can help lower both cost and complexity
Can also reduce requirements for power, cooling and management for lower TCO
Cleversafe provides web-scale performance/capacity at any time with zero downtime operations
Multiple Interface: customer deployment flexibility Industry standard object API compatibility
Cleversafe has the strengths and differentiators our customers demand!
Availability – No downtime during software upgrades, hardware refreshes, and in the face of disk, node, and site failures.
Security - Encryption for data at rest provides government grade security, no single disk, node or site contains enough information to constitute a data breach with built in key management.
Scalability – Scale performance and/or capacity at any time with no downtime to operations
Efficiency – Less raw storage means less power, cooling and floors pace resulting in lowest TCO
Manageability– No RAID sets or replication schemes to manage. Manage more petabytes with less people.
Object storage EFFICIENCY is defined by Cleversafe.
$70% +
TCO Savings
How to build a highly reliable storage systemfor 1 Petabyte of usable data?
RAID 6 + Replication
Cleversafe®
Original1.20 PB Raw
Onsite mirror1.20 PB Raw
Remote copy1.20 PB Raw
1 PB3.6 PB
9003.6x3.6x
3 FTEReplication/
backupExtra Software
Usable StorageRaw Storage4TB Disks
Racks RequiredFloor SpaceOps Staffing
1 PB1.7 PB4321.7x1.7x.5 FTENoneNone
567 TB Raw 567 TB Raw567 TB Raw
Deployment Options – Traditional on PremiseSingle Site
Site B
Two Site
Geo Dispersed
Site A
Site B
Site C
Site AMost efficient storage for customers who do not need site tolerance
Mirroring for customers who require a more traditional deployment
Best mix of efficiency and availability providing site tolerance
Most Cleversafe customers are deployed in three or more sites
Original Data
Accesser® ApplianceAccesser®
Encrypted, Erasure Coded
Slices654321
10
1211
7
98
Slicestor® Appliances
SITE 1 SITE 2 SITE 3Storage Nodes
2432
876
121110
1 5 9
The Accesser® can be a physical appliance, virtual appliance, Accesser Application, Docker Container or Embedded Accesser.
The Accesser® transforms objects into slices and vice versa.
The Slicestor® stores slices of objects. (No more than one slice of a given object)The Slicestor® is a physical appliance.
Slicestor® and Accesser appliances are built using commodity hardware components, and are available from Cleversafe and certified partners.
The Cleversafe Architecture
Original Data
Accesser®
Encrypted, Erasure Coded
Slices654321
10
1211
7
98
Slicestor® Appliances
SITE 1 SITE 2 SITE 324
32
876
121110
1 5 9
The Cleversafe Architecture Expansion FactorThe number of slices created from an object by the Accesser is the IDA width (12 here)
The IDA (7 of 12 here) is configurable, providing the flexibility to optimize reliability, availability, and efficiency.
The smaller number of slices required for the Accesser to read the stored object is the IDA threshold (7 here)
Width divided by threshold (12/7 or 1.7 in this example) is called the IDA expansion factor and ranges from 1.3 to 1.8. Usable storage capacity times expansion factor equals raw storage required.
Accesser® Appliance
Original DataEncrypted
Data
Writing Data to Cleversafe
Erasure Coded Slices Erasure
coding is used to transform the data into a customizable number of slices
2
7654321
7654321
12111098
Original object is encrypted1
Original Data Encrypted Data
Writing Data to CleversafeErasure Coded Slices
Erasure coding is used to transform the data into a customizable number of slices
2
7654321
654321
SITE 1 SITE 2 SITE 3
Storage N
odes
Each slice is written
to a separate
storage node. In this example, the storage nodes are geographically dispersed across 3 sites.
32432
876
121110
10
1211
7
98
1 5 9
Original object is encrypted1
Reading Data from Cleversafe
Reads can be performed using any 7 of the 12 slices• The number of slices created on write is called the width
(12 here)• The number of slices required to read is called the
threshold (7 here)• This example is a “7 of 12” Information Dispersal
Algorithm (IDA)7654321
SITE 1 SITE 3
Storage N
odes
2
2 43
7
1 6
SITE 2
9x9s redundancy creates one of the most robust Object Storage solutions on the market today!
Reads can be performed using any 7 of the 12 slices• The number of slices created on write is called the width (12 here)• The number of slices required to read is called the threshold (7 here)• This example is a “7 of 12” Information Dispersal Algorithm (IDA)
7654321
SITE 1 SITE 3
Storage N
odes
2
2 43
7
1 6
SITE 2
Even an entire site outage (plus one additional storage node outage) can be tolerated!
Reading Data from Cleversafe
Cleversafe Reliability Perspective Reliability is at the heart of Cleversafe development.
Cleversafe erasure coding is inline so you can be assured data is at its fullest protection level once ingested. It is not a post process.
24x7 background rebuild processes & PerfectBits™ mitigate against unrecoverable read errors on a disk as well as recover from disk and node failure.
Cleversafe systems can be designed with over 10 9’s of permanent reliability
Cleversafe Use Cases
Initial Deployment Options
On-premise Dedicated/Hybrid Public• Cleversafe based product
offering with S3 and Swift accessibility managed by customer’s operations staff
• Dedicated: Cleversafe based product offering with S3 and Swift accessibility in SoftLayer facilities managed by IBM
• Hybrid: Cleversafe based product offering with S3 and Swift accessibility in combined on-premise and SoftLayer deployments managed by customer and IBM SoftLayer resources
• Standard: Swift based shared offering with full Swift accessibility and standard object price/SLA
• Nearline: Cleversafe based shared offering with full Swift accessibility and nearline price/SLA
• Select: Cleversafe based shared offering with partial S3 and Swift accessibility and standard object price/SLA
Active Archive
Backup
Enterprise Collaboration
Storage as a Service
Content Repository
…….. via a set of flexible, scalable deployment models: on-premise, hybrid cloud or appliance
Value
Benefits
Value
Benefits
Value Value
Benefits
Benefits
Scalable backup and always-on data availability for dependable recovery and security at lower infrastructure costs.
Keep content accessible with a scalable, reliable and secure always accessible data archive.
Fuel workplace productivity across the globe with secure, distributed access to valuable content
Deliver new levels of storage capacity and availability with carrier-grade security.
Entrust business-critical data to a reliable, scalable, safe and secure storage platform with built in fault tolerances.
• Efficiently distributed backups across sites.
• Secure data at rest without replication
• Restore and recover from disasters faster.
• Easily manage storage costs and security.
• Provide global data access through a variety of platforms
• Reduce storage mgmt costs and complexity
• Efficiently scale system to customer demands
• Easily integrate mgmt into existing workflows.
• Store a single digital copy of digital assets
• Access content globally
• Efficiently manage content.
• Real time access to entire data set.
• Strong reliability and availability provide continuous access to data even in the event of site outages
Scalability Reliability Availability Efficiency Security Manageability
Benefits
Value
Enterprise Storage as a Service
NAS ServicesFile synch and shareArchive
Services Video On Demand services
• Scale: PB+ and expanding. New services• Security: zero touch security for all content• Availability: always-on availability for 2.5 years and new capacity in
minutes• Manageability: lower overall data center cost with high service levels• Economics: 80% savings over old (legacy storage) approach and 43%
over AWS• Key Decision Makers: Corporate IT and storage team
Active Archive – Web Based Photo Sharing
Users upload photo and video content via web based application
Photo and video objects are sent to Cleversafe via REST based protocols
Metadata is captured and stored
• Scale – 130 petabytes and growing: more than 50 Billion images stored• Security – 50,000+ uploads per minute with zero touch security • Always-on availability – SLA of 100% download on demand – even during
CA to Nevada datacenter move• Manageability – 3 Administrators manage entire environment• Economics – Operating costs reduced by more than 70%• Key decision makers – Technical team backed by financial cost cutting
mandates
Mobile Services Content / Voicemail Backup
S3 compliant phone backup application protects cell phone
content by copying to Cleversafe
• Scale: 25PB serving 10M mobile - Service is now expanding to deliver enterprise services for mail and storage on demand.
• Security: Main driver and requirement for the customer• Availability: 24x 7 availability.• Economics: a reliable 80% savings means that KDDI can expand its
business profitably without IT in the way.• Key Decision Makers: Technical teams
Scale your offerings without hesitationDeliver competitive enterprise and consumer services by cost-efficiently storing, analyzing, and accessing data at scale with 100% confidence. That's why Cleversafe provides an object storage platform for unlimited service expansion and agility that's easy to manage and easy to scale. With Cleversafe, service providers can focus on developing and managing their offerings, and eliminate concerns about the storage infrastructure underneath.
Content Repository Backup Enterprise
Collaboration Archive
Solutions for Service Providers
Create consistent, engaging experiencesFrom 4K resolutions to on-demand expectations, the size and volume of media files has exploded. Media and entertainment companies are under increasing pressure to quickly produce, deliver and store new content across multiple distribution channels. As volumes swell to petabyte+ levels, companies are relying on Cleversafe's accessible, reliable cloud storage solutions to protect digital assets such as feature-length movies, production content, imagery, documents, and more. Our massive object storage repository enables users to generate the content they need to meet production demands today—and support business goals tomorrow.
Content Repository Enterprise Collaboration
Archive
Solutions for Media and Entertainment
Put medical progress firstIn the healthcare industry, life depends on data. That's why Cleversafe delivers innovative cloud storage solutions built for the next medical breakthrough. With Cleversafe's always accessible and secure data repositories, health and life science organizations can get back to focusing on what really matters: treating patients and conducting research.
Backup Enterprise Collaboration
Solutions for Health Care & Life Sciences
Secure customer trust and business complianceIn an increasingly competitive mobile landscape, protecting customer data is a business imperative. Cleversafe's secure, scalable cloud storage solutions help financial and insurance organizations eliminate data vulnerability at scale and meet increasingly strict compliance regulations.
Backup Enterprise Collaboration Archive
Solutions for Financial Services
Serve the public good with cloud efficiency, world-class security, and always-on availability.Leverage cloud storage at petabyte-and-beyond scale—and drastically reduce cost. Cleversafe, backed by In-Q-Tel, offers government agencies object storage with perpetual software licenses and meets COOP & DR requirements with out replication. So you can efficiently store and access sensitive data with total control, knowing that information is secure and inaccessible to unauthorized users—even in the unlikely event of a site or server compromise.
Backup Enterprise Collaboration Archive
Solutions for Government
Cleversafe economics beat AWS and legacy storage!
480 TB 960 TB 1920 TB 3840 TB$0
$2,000,000
$4,000,000
$6,000,000
$8,000,000
$10,000,000 S3
dsNet
Cost: 29–61%+ lower
Current NAS DR protected
Current NAS single copy
NAS Gateway and dsNet
dsNet object protected
$8,400
$4,210
$1,613
$1,053
Cleversafe
Cleversafe vs AWS S3 Cleversafe vs NAS
Cost: 80%+ lower
Cleversafe
S3
Cleversafe’s Competitive Differentiators
DISK LIFECYCLE MANAGEMENT
Predict drive failures and take appropriate
action
Zero-Touch Encryption
No need for 3rd party encryption or key
management
Flexible, Reliable ECData is strongly
consistent and fully protected on write
Flexible Licensing Model
On-premise perpetual or dedicated/public
subscription
Software Defined / Hardware Aware
Robust management window
SOFTWARE PACKAGED WITH OSNo need to install and manage a separate
OS
Flexible Deployment Model
On-Prem, Off-Prem & Hybrid
Proven at Massive Scale
Customers with well over 100PB in
production
Reduce Cost & Complexity
Less HW, facilities, staff leads to
efficiency at massive scale
Cleversafe Business Value
Half the Storage Footprint
Cleversafe's requires 50% less storage capacity than traditional storage approaches, which means lower overhead costs such as power and cooling expenses.
Increased Business Flexibility
Nine nines system reliability and 100% uptime enables businesses to expand, relocate and deploy new data centers with less risks and lower costs.
At Least 15x More Efficient to Manage
Cleversafe's intuitive software allows storage architects and administrators to scale and manage the storage environment easily, freeing up time for other mission-critical tasks.
For more information:Websites:
https://www.cleversafe.com/
http://www-03.ibm.com/systems/storage/
http://www.ibm.com/cloud-computing/us/en/
Product Pages:
http://www-03.ibm.com/systems/storage/flash/
http://www-03.ibm.com/systems/storage/storwize/
http://www-03.ibm.com/systems/storage/disk/xiv/
IBM RedBooks
https://www.redbooks.ibm.com/
Thank you!