London Ceph Day: Ceph for SMBs: Are we there yet?
-
Upload
inktank -
Category
Technology
-
view
491 -
download
8
description
Transcript of London Ceph Day: Ceph for SMBs: Are we there yet?
![Page 1: London Ceph Day: Ceph for SMBs: Are we there yet?](https://reader034.fdocuments.us/reader034/viewer/2022042623/54b4a3534a7959bb5e8b4570/html5/thumbnails/1.jpg)
Ceph for SMBs Are we there yet?
Martin Gerhard Loschwitz
© 2013 hastexo Professional Services GmbH. All rights reserved.
![Page 2: London Ceph Day: Ceph for SMBs: Are we there yet?](https://reader034.fdocuments.us/reader034/viewer/2022042623/54b4a3534a7959bb5e8b4570/html5/thumbnails/2.jpg)
Who?
![Page 3: London Ceph Day: Ceph for SMBs: Are we there yet?](https://reader034.fdocuments.us/reader034/viewer/2022042623/54b4a3534a7959bb5e8b4570/html5/thumbnails/3.jpg)
![Page 4: London Ceph Day: Ceph for SMBs: Are we there yet?](https://reader034.fdocuments.us/reader034/viewer/2022042623/54b4a3534a7959bb5e8b4570/html5/thumbnails/4.jpg)
![Page 5: London Ceph Day: Ceph for SMBs: Are we there yet?](https://reader034.fdocuments.us/reader034/viewer/2022042623/54b4a3534a7959bb5e8b4570/html5/thumbnails/5.jpg)
SMBs? Why even bother?
![Page 6: London Ceph Day: Ceph for SMBs: Are we there yet?](https://reader034.fdocuments.us/reader034/viewer/2022042623/54b4a3534a7959bb5e8b4570/html5/thumbnails/6.jpg)
What is an SMB?
![Page 7: London Ceph Day: Ceph for SMBs: Are we there yet?](https://reader034.fdocuments.us/reader034/viewer/2022042623/54b4a3534a7959bb5e8b4570/html5/thumbnails/7.jpg)
Number of employees & revenue per year
![Page 8: London Ceph Day: Ceph for SMBs: Are we there yet?](https://reader034.fdocuments.us/reader034/viewer/2022042623/54b4a3534a7959bb5e8b4570/html5/thumbnails/8.jpg)
Do these work for IT?
![Page 9: London Ceph Day: Ceph for SMBs: Are we there yet?](https://reader034.fdocuments.us/reader034/viewer/2022042623/54b4a3534a7959bb5e8b4570/html5/thumbnails/9.jpg)
Cloud & Automation: Do more work
with less people
![Page 10: London Ceph Day: Ceph for SMBs: Are we there yet?](https://reader034.fdocuments.us/reader034/viewer/2022042623/54b4a3534a7959bb5e8b4570/html5/thumbnails/10.jpg)
Revenue: May be low, but high when compared to the actual work effort
![Page 11: London Ceph Day: Ceph for SMBs: Are we there yet?](https://reader034.fdocuments.us/reader034/viewer/2022042623/54b4a3534a7959bb5e8b4570/html5/thumbnails/11.jpg)
Long story short: Typical SMB definitions don’t work well for IT
![Page 12: London Ceph Day: Ceph for SMBs: Are we there yet?](https://reader034.fdocuments.us/reader034/viewer/2022042623/54b4a3534a7959bb5e8b4570/html5/thumbnails/12.jpg)
Also, IT is different from most
other businesses
![Page 13: London Ceph Day: Ceph for SMBs: Are we there yet?](https://reader034.fdocuments.us/reader034/viewer/2022042623/54b4a3534a7959bb5e8b4570/html5/thumbnails/13.jpg)
Storage is a perfect example for this!
![Page 14: London Ceph Day: Ceph for SMBs: Are we there yet?](https://reader034.fdocuments.us/reader034/viewer/2022042623/54b4a3534a7959bb5e8b4570/html5/thumbnails/14.jpg)
Ceph is interesting for both SMB providers and
SMB customers
![Page 15: London Ceph Day: Ceph for SMBs: Are we there yet?](https://reader034.fdocuments.us/reader034/viewer/2022042623/54b4a3534a7959bb5e8b4570/html5/thumbnails/15.jpg)
Which features make Ceph interesting for SMBs?
![Page 16: London Ceph Day: Ceph for SMBs: Are we there yet?](https://reader034.fdocuments.us/reader034/viewer/2022042623/54b4a3534a7959bb5e8b4570/html5/thumbnails/16.jpg)
Commodity Hardware
![Page 17: London Ceph Day: Ceph for SMBs: Are we there yet?](https://reader034.fdocuments.us/reader034/viewer/2022042623/54b4a3534a7959bb5e8b4570/html5/thumbnails/17.jpg)
No Vendor Lock-In
![Page 18: London Ceph Day: Ceph for SMBs: Are we there yet?](https://reader034.fdocuments.us/reader034/viewer/2022042623/54b4a3534a7959bb5e8b4570/html5/thumbnails/18.jpg)
Scale-Out
![Page 19: London Ceph Day: Ceph for SMBs: Are we there yet?](https://reader034.fdocuments.us/reader034/viewer/2022042623/54b4a3534a7959bb5e8b4570/html5/thumbnails/19.jpg)
Open Source
![Page 20: London Ceph Day: Ceph for SMBs: Are we there yet?](https://reader034.fdocuments.us/reader034/viewer/2022042623/54b4a3534a7959bb5e8b4570/html5/thumbnails/20.jpg)
Low price per Megabyte
![Page 21: London Ceph Day: Ceph for SMBs: Are we there yet?](https://reader034.fdocuments.us/reader034/viewer/2022042623/54b4a3534a7959bb5e8b4570/html5/thumbnails/21.jpg)
40TB, 3 replicas = € 21.000
![Page 22: London Ceph Day: Ceph for SMBs: Are we there yet?](https://reader034.fdocuments.us/reader034/viewer/2022042623/54b4a3534a7959bb5e8b4570/html5/thumbnails/22.jpg)
Typical situation: SMBs migrating
away from SANs
![Page 23: London Ceph Day: Ceph for SMBs: Are we there yet?](https://reader034.fdocuments.us/reader034/viewer/2022042623/54b4a3534a7959bb5e8b4570/html5/thumbnails/23.jpg)
Typical SMB use cases for storage
![Page 24: London Ceph Day: Ceph for SMBs: Are we there yet?](https://reader034.fdocuments.us/reader034/viewer/2022042623/54b4a3534a7959bb5e8b4570/html5/thumbnails/24.jpg)
Virtualization storage
![Page 25: London Ceph Day: Ceph for SMBs: Are we there yet?](https://reader034.fdocuments.us/reader034/viewer/2022042623/54b4a3534a7959bb5e8b4570/html5/thumbnails/25.jpg)
KVM/Qemu: Yay
![Page 26: London Ceph Day: Ceph for SMBs: Are we there yet?](https://reader034.fdocuments.us/reader034/viewer/2022042623/54b4a3534a7959bb5e8b4570/html5/thumbnails/26.jpg)
VMWare, HyperV: Ouch
![Page 27: London Ceph Day: Ceph for SMBs: Are we there yet?](https://reader034.fdocuments.us/reader034/viewer/2022042623/54b4a3534a7959bb5e8b4570/html5/thumbnails/27.jpg)
Backup storage
![Page 28: London Ceph Day: Ceph for SMBs: Are we there yet?](https://reader034.fdocuments.us/reader034/viewer/2022042623/54b4a3534a7959bb5e8b4570/html5/thumbnails/28.jpg)
MO
N
MO
N
MO
N
Users
Objects
OS
D
OS
D
OS
D
OS
D
OS
D
OS
D
OS
D
OS
D
OS
D
OS
D
OS
D
OS
D
OS
D
OS
D
Ceph Block Device Block-level interface
driver for Ceph
Ceph Object Gateway
ReSTful API to access Ceph
CephFS POSIX file system access to Ceph
![Page 29: London Ceph Day: Ceph for SMBs: Are we there yet?](https://reader034.fdocuments.us/reader034/viewer/2022042623/54b4a3534a7959bb5e8b4570/html5/thumbnails/29.jpg)
MO
N
MO
N
MO
N
Users
Objects
OS
D
OS
D
OS
D
OS
D
OS
D
OS
D
OS
D
OS
D
OS
D
OS
D
OS
D
OS
D
OS
D
OS
D
Ceph Block Device Block-level interface
driver for Ceph
Ceph Object Gateway
ReSTful API to access Ceph
CephFS POSIX file system access to Ceph
![Page 30: London Ceph Day: Ceph for SMBs: Are we there yet?](https://reader034.fdocuments.us/reader034/viewer/2022042623/54b4a3534a7959bb5e8b4570/html5/thumbnails/30.jpg)
But no specific backup features
![Page 31: London Ceph Day: Ceph for SMBs: Are we there yet?](https://reader034.fdocuments.us/reader034/viewer/2022042623/54b4a3534a7959bb5e8b4570/html5/thumbnails/31.jpg)
CDN-like storage
![Page 32: London Ceph Day: Ceph for SMBs: Are we there yet?](https://reader034.fdocuments.us/reader034/viewer/2022042623/54b4a3534a7959bb5e8b4570/html5/thumbnails/32.jpg)
MO
N
MO
N
MO
N
Users
Objects
OS
D
OS
D
OS
D
OS
D
OS
D
OS
D
OS
D
OS
D
OS
D
OS
D
OS
D
OS
D
OS
D
OS
D
Ceph Block Device Block-level interface
driver for Ceph
Ceph Object Gateway
ReSTful API to access Ceph
CephFS POSIX file system access to Ceph
![Page 33: London Ceph Day: Ceph for SMBs: Are we there yet?](https://reader034.fdocuments.us/reader034/viewer/2022042623/54b4a3534a7959bb5e8b4570/html5/thumbnails/33.jpg)
May require application porting
![Page 34: London Ceph Day: Ceph for SMBs: Are we there yet?](https://reader034.fdocuments.us/reader034/viewer/2022042623/54b4a3534a7959bb5e8b4570/html5/thumbnails/34.jpg)
Cloud Computing
![Page 35: London Ceph Day: Ceph for SMBs: Are we there yet?](https://reader034.fdocuments.us/reader034/viewer/2022042623/54b4a3534a7959bb5e8b4570/html5/thumbnails/35.jpg)
Challenges
![Page 36: London Ceph Day: Ceph for SMBs: Are we there yet?](https://reader034.fdocuments.us/reader034/viewer/2022042623/54b4a3534a7959bb5e8b4570/html5/thumbnails/36.jpg)
File storage
![Page 37: London Ceph Day: Ceph for SMBs: Are we there yet?](https://reader034.fdocuments.us/reader034/viewer/2022042623/54b4a3534a7959bb5e8b4570/html5/thumbnails/37.jpg)
CIFS / NFS: Meh
![Page 38: London Ceph Day: Ceph for SMBs: Are we there yet?](https://reader034.fdocuments.us/reader034/viewer/2022042623/54b4a3534a7959bb5e8b4570/html5/thumbnails/38.jpg)
The Gateway problem
![Page 39: London Ceph Day: Ceph for SMBs: Are we there yet?](https://reader034.fdocuments.us/reader034/viewer/2022042623/54b4a3534a7959bb5e8b4570/html5/thumbnails/39.jpg)
iSCSI
![Page 40: London Ceph Day: Ceph for SMBs: Are we there yet?](https://reader034.fdocuments.us/reader034/viewer/2022042623/54b4a3534a7959bb5e8b4570/html5/thumbnails/40.jpg)
Looks good, eh? Well, it isn’t.
![Page 41: London Ceph Day: Ceph for SMBs: Are we there yet?](https://reader034.fdocuments.us/reader034/viewer/2022042623/54b4a3534a7959bb5e8b4570/html5/thumbnails/41.jpg)
Involves iSCSI on top of RBD
![Page 42: London Ceph Day: Ceph for SMBs: Are we there yet?](https://reader034.fdocuments.us/reader034/viewer/2022042623/54b4a3534a7959bb5e8b4570/html5/thumbnails/42.jpg)
Results in loopback RBD mappings
![Page 43: London Ceph Day: Ceph for SMBs: Are we there yet?](https://reader034.fdocuments.us/reader034/viewer/2022042623/54b4a3534a7959bb5e8b4570/html5/thumbnails/43.jpg)
RBD mappings are kernel processes
![Page 44: London Ceph Day: Ceph for SMBs: Are we there yet?](https://reader034.fdocuments.us/reader034/viewer/2022042623/54b4a3534a7959bb5e8b4570/html5/thumbnails/44.jpg)
Kernel processes may not move into Swap
![Page 45: London Ceph Day: Ceph for SMBs: Are we there yet?](https://reader034.fdocuments.us/reader034/viewer/2022042623/54b4a3534a7959bb5e8b4570/html5/thumbnails/45.jpg)
Now imagine this …
![Page 46: London Ceph Day: Ceph for SMBs: Are we there yet?](https://reader034.fdocuments.us/reader034/viewer/2022042623/54b4a3534a7959bb5e8b4570/html5/thumbnails/46.jpg)
Ceph needs memory, flushes cache
![Page 47: London Ceph Day: Ceph for SMBs: Are we there yet?](https://reader034.fdocuments.us/reader034/viewer/2022042623/54b4a3534a7959bb5e8b4570/html5/thumbnails/47.jpg)
Flushes stuff that belongs to the RBD mapping
![Page 48: London Ceph Day: Ceph for SMBs: Are we there yet?](https://reader034.fdocuments.us/reader034/viewer/2022042623/54b4a3534a7959bb5e8b4570/html5/thumbnails/48.jpg)
RBD tries to flush stuff by writing back to Ceph
![Page 49: London Ceph Day: Ceph for SMBs: Are we there yet?](https://reader034.fdocuments.us/reader034/viewer/2022042623/54b4a3534a7959bb5e8b4570/html5/thumbnails/49.jpg)
Deadlock (under heavy load)
![Page 50: London Ceph Day: Ceph for SMBs: Are we there yet?](https://reader034.fdocuments.us/reader034/viewer/2022042623/54b4a3534a7959bb5e8b4570/html5/thumbnails/50.jpg)
iSCSI
![Page 51: London Ceph Day: Ceph for SMBs: Are we there yet?](https://reader034.fdocuments.us/reader034/viewer/2022042623/54b4a3534a7959bb5e8b4570/html5/thumbnails/51.jpg)
iSCSI
![Page 52: London Ceph Day: Ceph for SMBs: Are we there yet?](https://reader034.fdocuments.us/reader034/viewer/2022042623/54b4a3534a7959bb5e8b4570/html5/thumbnails/52.jpg)
HDD efficiency
![Page 53: London Ceph Day: Ceph for SMBs: Are we there yet?](https://reader034.fdocuments.us/reader034/viewer/2022042623/54b4a3534a7959bb5e8b4570/html5/thumbnails/53.jpg)
3 2U-Server 22 HDDs 4TB each 2 Replicas
![Page 54: London Ceph Day: Ceph for SMBs: Are we there yet?](https://reader034.fdocuments.us/reader034/viewer/2022042623/54b4a3534a7959bb5e8b4570/html5/thumbnails/54.jpg)
“Don’t do that”
![Page 55: London Ceph Day: Ceph for SMBs: Are we there yet?](https://reader034.fdocuments.us/reader034/viewer/2022042623/54b4a3534a7959bb5e8b4570/html5/thumbnails/55.jpg)
8 HDDs 4TB each 2 Replicas
9 2U-servers
![Page 56: London Ceph Day: Ceph for SMBs: Are we there yet?](https://reader034.fdocuments.us/reader034/viewer/2022042623/54b4a3534a7959bb5e8b4570/html5/thumbnails/56.jpg)
OSDs need RAM & CPU
![Page 57: London Ceph Day: Ceph for SMBs: Are we there yet?](https://reader034.fdocuments.us/reader034/viewer/2022042623/54b4a3534a7959bb5e8b4570/html5/thumbnails/57.jpg)
Replication efficiency
![Page 58: London Ceph Day: Ceph for SMBs: Are we there yet?](https://reader034.fdocuments.us/reader034/viewer/2022042623/54b4a3534a7959bb5e8b4570/html5/thumbnails/58.jpg)
Multi-DC installations
![Page 59: London Ceph Day: Ceph for SMBs: Are we there yet?](https://reader034.fdocuments.us/reader034/viewer/2022042623/54b4a3534a7959bb5e8b4570/html5/thumbnails/59.jpg)
Summary
![Page 60: London Ceph Day: Ceph for SMBs: Are we there yet?](https://reader034.fdocuments.us/reader034/viewer/2022042623/54b4a3534a7959bb5e8b4570/html5/thumbnails/60.jpg)
goo.gl/S1sYZ (me on Google+)
twitter.com/hastexo
hastexo.com