Introducing Backblaze B2, the lowest cost cloud storage on the planet.
41
@GlebBudman What When Who Storage Developer Conference September 23, 2015 Gleb Budman, CEO Learnings From Nearly A Decade Of Building Low-Cost Cloud Storage `
-
Upload
backblaze -
Category
Technology
-
view
4.860 -
download
1
Transcript of Introducing Backblaze B2, the lowest cost cloud storage on the planet.
@GlebBudman
WhatWhen
Who
Storage Developer ConferenceSeptember 23, 2015Gleb Budman, CEO
Learnings From Nearly A Decade Of Building Low-Cost Cloud
Storage
`
@GlebBudman
150+PETABYTES
@GlebBudman
@GlebBudman
@GlebBudman
@GlebBudman
Glacier? Nearline? S3-Infrequent Access?
• Backblaze B2 is still 40% - 250% lower cost
• Doesn’t make you wait for your data
• Doesn’t penalize for deletes
• Doesn’t penalize for access
@GlebBudman
The Cloud Storage Stack
Culture
Business Process
Software
Hardware
Datacenter
@GlebBudman
DatacenterConvert Kilowatts-to-Kilobits
@GlebBudman
Datacenter
Goal: • Convert kilowatts-to-bits
Considerations:• Local cost of power and real
estate• Don’t ignore taxes, economic
zones• Climate• Building and system efficiency• Proximity to ops team & good
people• Connectivity
Resource: Backblaze Datacenter RFP https://www.backblaze.com/blog/backblaze-datacenter-grows-1000x-datacenter-2-0-needed-apply-within/
@GlebBudman
HardwareConnect Hard Drives to the
Internet
@GlebBudman
Backblaze Storage Pod
@GlebBudman
Don’t Make Hardware Redundant
@GlebBudman
Server Power Supply Desktop Power SupplyVS
Use Commodity Parts
@GlebBudman
Use Consumer Hard Drives
@GlebBudman
Insource & Do the Math for Drive Purchases
@GlebBudman
Hardware
Goal: • Connect hard drives to
the Internet
Considerations:• Don’t make hardware
redundant• Use commodity parts• Use consumer hard drives• Insource & use math for
drive purchases
Resource: Backblaze Storage Pod https://www.backblaze.com/storage-pod.html/
@GlebBudman
http://www.pbs.org/wgbh/nova/body/brain-transplants.html
SoftwarePut All Intelligence Here
@GlebBudman
Backblaze Vault
@GlebBudman
Avoid Choke Points
@GlebBudman
Algorithmically Monitor SMART Stats
@GlebBudman
VS
Plan for Silent Corruption
@GlebBudman
Put Replication Above the File System
http://infosthetics.com/archives/2009/06/a_visual_expedition_inside_the_linux_file_systems.html
@GlebBudman
Run Out of Resources Simultaneously
@GlebBudman
Model & Monitor Storage Burn
@GlebBudman
SoftwareGoal: • Put all intelligence here
Considerations:• Avoid choke points• Algorithmically monitor SMART
stats• Plan for Silent Corruption• Put replication above the file
system• Run out of resources
simultaneously• Model & monitor storage burnResource: Backblaze Vault
https://www.backblaze.com/blog/vault-cloud-storage-architecture/
@GlebBudman
Business ProcessesOptimize for TCO
@GlebBudman
Design for Failure…
@GlebBudman
…But Fix Failures Quickly
@GlebBudman
Create Repeatable Repairs
@GlebBudman
Standardize Pod Chassis
@GlebBudman
ROI Drives Automation
@GlebBudman
Workflow for Storage Buffer
@GlebBudman
Goal: • Optimize for TCO
Business Processes
Resource: Backblaze Drive Process https://www.backblaze.com/blog/alas-poor-stephen-is-dead/
Considerations:• Design for failure, but fix failures
quickly• Create repeatable repairs (drive swap,
chassis swap)• Standardize pod chassis• ROI drives automation• Workflow for storage buffer
(different buffer types; e.g. 11 PB in a day)
@GlebBudman
CultureQuestion “Conventional Wisdom”
Image by Michael Carahttps://www.flickr.com/photos/michael_cala
/
@GlebBudman
No Hardware Worshippers
@GlebBudman
http://365datacenters.com/blog/local-cloud-storage-beats-public-cloud/
Agile Extends to Hardware
@GlebBudman
Relentless Focus on Cost
• Is this required?• Is there a comparable lower cost option?• Can business processes work around this?• Can software work around this?
@GlebBudman
Culture
Goal: • Question “conventional wisdom”
Considerations:• No hardware worshippers• Agile extends to hardware• Relentless focus on cost
Resource: Backblaze Agile Hardware Process https://www.backblaze.com/blog/designing-the-next-storage-pod/
@GlebBudman
@GlebBudman
@GlebBudman
Learnings from nearly a decade of building low-cost cloud
storage.Backblaze.com/B2 => Lowest cost cloud
storageBackblaze.com/blog => Cloud storage
resources
Gleb Budman@glebbudman
