Ceph Intro and Architectural Overview by Ross Turk
-
Upload
buildacloud -
Category
Technology
-
view
2.694 -
download
19
description
Transcript of Ceph Intro and Architectural Overview by Ross Turk
![Page 1: Ceph Intro and Architectural Overview by Ross Turk](https://reader030.fdocuments.us/reader030/viewer/2022020711/54b7b6024a7959181f8b45ee/html5/thumbnails/1.jpg)
Ceph Intro & Architectural OverviewRoss TurkVP Community, Inktank
![Page 2: Ceph Intro and Architectural Overview by Ross Turk](https://reader030.fdocuments.us/reader030/viewer/2022020711/54b7b6024a7959181f8b45ee/html5/thumbnails/2.jpg)
2
ME ME ME ME ME ME.I made a slide today. It’s all about me.
Ross TurkVP Community, Inktank
[email protected]@rossturk
inktank.com | ceph.com
![Page 3: Ceph Intro and Architectural Overview by Ross Turk](https://reader030.fdocuments.us/reader030/viewer/2022020711/54b7b6024a7959181f8b45ee/html5/thumbnails/3.jpg)
3
CLOUD SERVICES
COMPUTE NETWORK STORAGE
the future of storage™
![Page 4: Ceph Intro and Architectural Overview by Ross Turk](https://reader030.fdocuments.us/reader030/viewer/2022020711/54b7b6024a7959181f8b45ee/html5/thumbnails/4.jpg)
4
HUMAN
COMPUTER TAPE
HUMAN
ROCK
HUMAN
INK
PAPER
![Page 5: Ceph Intro and Architectural Overview by Ross Turk](https://reader030.fdocuments.us/reader030/viewer/2022020711/54b7b6024a7959181f8b45ee/html5/thumbnails/5.jpg)
5
HUMAN
COMPUTER TAPE
![Page 6: Ceph Intro and Architectural Overview by Ross Turk](https://reader030.fdocuments.us/reader030/viewer/2022020711/54b7b6024a7959181f8b45ee/html5/thumbnails/6.jpg)
6
YOUTECHNOLOG
YYOUR DATA
![Page 7: Ceph Intro and Architectural Overview by Ross Turk](https://reader030.fdocuments.us/reader030/viewer/2022020711/54b7b6024a7959181f8b45ee/html5/thumbnails/7.jpg)
7
How Much Store Things All Human History?!writing
paper
computers
distributed storage
cloud computing
gaaaaaaaaahhhh!!!!!!
carving
![Page 8: Ceph Intro and Architectural Overview by Ross Turk](https://reader030.fdocuments.us/reader030/viewer/2022020711/54b7b6024a7959181f8b45ee/html5/thumbnails/8.jpg)
8
HUMAN COMPUTER DISK
DISK
DISK
DISK
DISK
DISK
DISK
HUMAN
HUMAN
![Page 9: Ceph Intro and Architectural Overview by Ross Turk](https://reader030.fdocuments.us/reader030/viewer/2022020711/54b7b6024a7959181f8b45ee/html5/thumbnails/9.jpg)
9
DISK
DISK
DISK
DISK
DISK
DISK
DISK
DISK
DISK
DISK
DISK
DISK
HUMAN
HUMAN
HUMAN
HUMAN
HUMAN
HUMAN
HUMANHUMAN
HUMANHUMAN
HUMAN
HUMANHUMAN
HUMAN
HUMAN
HUMAN
HUMAN
HUMAN
HUMAN
HUMAN
HUMAN
HUMAN
COMPUTER
![Page 10: Ceph Intro and Architectural Overview by Ross Turk](https://reader030.fdocuments.us/reader030/viewer/2022020711/54b7b6024a7959181f8b45ee/html5/thumbnails/10.jpg)
10
DISK
DISK
DISK
DISK
DISK
DISK
DISK
DISK
DISK
DISK
DISK
DISK
HUMAN
HUMAN
HUMAN
HUMAN
HUMAN
HUMAN
HUMANHUMAN
HUMANHUMAN
HUMAN
HUMANHUMAN
HUMAN
HUMAN
HUMAN
HUMAN
HUMAN
HUMAN
HUMAN
HUMAN
HUMAN
GIANT SPENDY
COMPUTER
![Page 11: Ceph Intro and Architectural Overview by Ross Turk](https://reader030.fdocuments.us/reader030/viewer/2022020711/54b7b6024a7959181f8b45ee/html5/thumbnails/11.jpg)
11
DISKCOMPUTE
R
HUMAN
HUMAN
HUMAN
DISKCOMPUTE
RDISK
COMPUTER
DISKCOMPUTE
RDISK
COMPUTER
DISKCOMPUTE
RDISK
COMPUTER
DISKCOMPUTE
RDISK
COMPUTER
DISKCOMPUTE
RDISK
COMPUTER
DISKCOMPUTE
R
![Page 12: Ceph Intro and Architectural Overview by Ross Turk](https://reader030.fdocuments.us/reader030/viewer/2022020711/54b7b6024a7959181f8b45ee/html5/thumbnails/12.jpg)
12
HUMAN
HUMAN
HUMAN
DISKCOMPUTE
RDISK
COMPUTER
DISKCOMPUTE
RDISK
COMPUTER
DISKCOMPUTE
RDISK
COMPUTER
DISKCOMPUTE
RDISK
COMPUTER
DISKCOMPUTE
RDISK
COMPUTER
DISKCOMPUTE
RDISK
COMPUTER
![Page 13: Ceph Intro and Architectural Overview by Ross Turk](https://reader030.fdocuments.us/reader030/viewer/2022020711/54b7b6024a7959181f8b45ee/html5/thumbnails/13.jpg)
13
DISKCOMPUTE
RDISK
COMPUTER
DISKCOMPUTE
RDISK
COMPUTER
DISKCOMPUTE
RDISK
COMPUTER
DISKCOMPUTE
RDISK
COMPUTER
“STORAGE APPLIANCE”
![Page 14: Ceph Intro and Architectural Overview by Ross Turk](https://reader030.fdocuments.us/reader030/viewer/2022020711/54b7b6024a7959181f8b45ee/html5/thumbnails/14.jpg)
14Storage ApplianceMichael Moll, Wikipedia / CC BY-SA 2.0
![Page 15: Ceph Intro and Architectural Overview by Ross Turk](https://reader030.fdocuments.us/reader030/viewer/2022020711/54b7b6024a7959181f8b45ee/html5/thumbnails/15.jpg)
15
SUPPORT AND MAINTENANCE
PROPRIETARY SOFTWARE
PROPRIETARY HARDWARE
DISKCOMPUTE
RDISK
COMPUTER
DISKCOMPUTE
RDISK
COMPUTER
34% of 2012 revenue(5.2 billion dollars)
1.1 billion in R&Dspent in 2012
1.6 million square feetof manufacturing space
![Page 16: Ceph Intro and Architectural Overview by Ross Turk](https://reader030.fdocuments.us/reader030/viewer/2022020711/54b7b6024a7959181f8b45ee/html5/thumbnails/16.jpg)
16
1010100110
1010110011
1001100101
1001101011
1001100111
1001010011
THE CLOUD
![Page 17: Ceph Intro and Architectural Overview by Ross Turk](https://reader030.fdocuments.us/reader030/viewer/2022020711/54b7b6024a7959181f8b45ee/html5/thumbnails/17.jpg)
17
SUPPORT AND MAINTENANCE
PROPRIETARY SOFTWARE
PROPRIETARY HARDWARE
DISKCOMPUTE
RDISK
COMPUTER
DISKCOMPUTE
RDISK
COMPUTER
STANDARD HARDWARE
DISKCOMPUTE
RDISK
COMPUTER
DISKCOMPUTE
RDISK
COMPUTER
OPEN SOURCE SOFTWARE
ENTERPRISE SUBSCRIPTION
(optional)
![Page 18: Ceph Intro and Architectural Overview by Ross Turk](https://reader030.fdocuments.us/reader030/viewer/2022020711/54b7b6024a7959181f8b45ee/html5/thumbnails/18.jpg)
18
![Page 19: Ceph Intro and Architectural Overview by Ross Turk](https://reader030.fdocuments.us/reader030/viewer/2022020711/54b7b6024a7959181f8b45ee/html5/thumbnails/19.jpg)
19
OPEN SOURCE
COMMUNITY-FOCUSED
SCALABLE
NO SINGLE POINT OF FAILURE
SOFTWARE BASEDSELF-
MANAGING
philosophy design
![Page 20: Ceph Intro and Architectural Overview by Ross Turk](https://reader030.fdocuments.us/reader030/viewer/2022020711/54b7b6024a7959181f8b45ee/html5/thumbnails/20.jpg)
20
8 years & 20,000 commits later…
![Page 21: Ceph Intro and Architectural Overview by Ross Turk](https://reader030.fdocuments.us/reader030/viewer/2022020711/54b7b6024a7959181f8b45ee/html5/thumbnails/21.jpg)
21
![Page 22: Ceph Intro and Architectural Overview by Ross Turk](https://reader030.fdocuments.us/reader030/viewer/2022020711/54b7b6024a7959181f8b45ee/html5/thumbnails/22.jpg)
22
RADOS
A reliable, autonomous, distributed object store comprised of self-healing, self-managing, intelligent storage nodes
LIBRADOS
A library allowingapps to directlyaccess RADOS,with support forC, C++, Java,Python, Ruby,and PHP
RBD
A reliable and fully-distributed block device, with a Linux kernel client and a QEMU/KVM driver
CEPH FS
A POSIX-compliant distributed file system, with a Linux kernel client and support for FUSE
RADOSGW
A bucket-based REST gateway, compatible with S3 and Swift
APP APP HOST/VM CLIENT
![Page 23: Ceph Intro and Architectural Overview by Ross Turk](https://reader030.fdocuments.us/reader030/viewer/2022020711/54b7b6024a7959181f8b45ee/html5/thumbnails/23.jpg)
23
RADOS
A reliable, autonomous, distributed object store comprised of self-healing, self-managing, intelligent storage nodes
LIBRADOS
A library allowingapps to directlyaccess RADOS,with support forC, C++, Java,Python, Ruby,and PHP
RBD
A reliable and fully-distributed block device, with a Linux kernel client and a QEMU/KVM driver
CEPH FS
A POSIX-compliant distributed file system, with a Linux kernel client and support for FUSE
RADOSGW
A bucket-based REST gateway, compatible with S3 and Swift
APP APP HOST/VM CLIENT
![Page 24: Ceph Intro and Architectural Overview by Ross Turk](https://reader030.fdocuments.us/reader030/viewer/2022020711/54b7b6024a7959181f8b45ee/html5/thumbnails/24.jpg)
24
DISK
FS
DISK DISK
OSD
DISK DISK
OSD OSD OSD OSD
FS FS FSFS btrfsxfsext4
MMM
![Page 25: Ceph Intro and Architectural Overview by Ross Turk](https://reader030.fdocuments.us/reader030/viewer/2022020711/54b7b6024a7959181f8b45ee/html5/thumbnails/25.jpg)
25
M
M
M
HUMAN
![Page 26: Ceph Intro and Architectural Overview by Ross Turk](https://reader030.fdocuments.us/reader030/viewer/2022020711/54b7b6024a7959181f8b45ee/html5/thumbnails/26.jpg)
26
Monitors:• Maintain cluster
membership and state• Provide consensus for
distributed decision-making• Small, odd number• These do not serve stored
objects to clients
M
OSDs:• 10s to 10000s in a cluster• One per disk• (or one per SSD, RAID group…)• Serve stored objects to
clients• Intelligently peer to perform
replication and recovery tasks
![Page 27: Ceph Intro and Architectural Overview by Ross Turk](https://reader030.fdocuments.us/reader030/viewer/2022020711/54b7b6024a7959181f8b45ee/html5/thumbnails/27.jpg)
27
RADOS
A reliable, autonomous, distributed object store comprised of self-healing, self-managing, intelligent storage nodes
LIBRADOS
A library allowingapps to directlyaccess RADOS,with support forC, C++, Java,Python, Ruby,and PHP
RBD
A reliable and fully-distributed block device, with a Linux kernel client and a QEMU/KVM driver
CEPH FS
A POSIX-compliant distributed file system, with a Linux kernel client and support for FUSE
RADOSGW
A bucket-based REST gateway, compatible with S3 and Swift
APP APP HOST/VM CLIENT
![Page 28: Ceph Intro and Architectural Overview by Ross Turk](https://reader030.fdocuments.us/reader030/viewer/2022020711/54b7b6024a7959181f8b45ee/html5/thumbnails/28.jpg)
28
LIBRADOS
M
M
M
APP
socket
![Page 29: Ceph Intro and Architectural Overview by Ross Turk](https://reader030.fdocuments.us/reader030/viewer/2022020711/54b7b6024a7959181f8b45ee/html5/thumbnails/29.jpg)
LLIBRADOS• Provides direct access to
RADOS for applications• C, C++, Python, PHP, Java,
Erlang• Direct access to storage
nodes• No HTTP overhead
![Page 30: Ceph Intro and Architectural Overview by Ross Turk](https://reader030.fdocuments.us/reader030/viewer/2022020711/54b7b6024a7959181f8b45ee/html5/thumbnails/30.jpg)
30
RADOS
A reliable, autonomous, distributed object store comprised of self-healing, self-managing, intelligent storage nodes
LIBRADOS
A library allowingapps to directlyaccess RADOS,with support forC, C++, Java,Python, Ruby,and PHP
RBD
A reliable and fully-distributed block device, with a Linux kernel client and a QEMU/KVM driver
CEPH FS
A POSIX-compliant distributed file system, with a Linux kernel client and support for FUSE
RADOSGW
A bucket-based REST gateway, compatible with S3 and Swift
APP APP HOST/VM CLIENT
![Page 31: Ceph Intro and Architectural Overview by Ross Turk](https://reader030.fdocuments.us/reader030/viewer/2022020711/54b7b6024a7959181f8b45ee/html5/thumbnails/31.jpg)
31
M
M
M
LIBRADOS
RADOSGW
APP
socket
REST
![Page 32: Ceph Intro and Architectural Overview by Ross Turk](https://reader030.fdocuments.us/reader030/viewer/2022020711/54b7b6024a7959181f8b45ee/html5/thumbnails/32.jpg)
32
RADOS Gateway:• REST-based object
storage proxy• Uses RADOS to store
objects• API supports buckets,
accounts• Usage accounting for
billing• Compatible with S3 and
Swift applications
![Page 33: Ceph Intro and Architectural Overview by Ross Turk](https://reader030.fdocuments.us/reader030/viewer/2022020711/54b7b6024a7959181f8b45ee/html5/thumbnails/33.jpg)
33
RADOS
A reliable, autonomous, distributed object store comprised of self-healing, self-managing, intelligent storage nodes
LIBRADOS
A library allowingapps to directlyaccess RADOS,with support forC, C++, Java,Python, Ruby,and PHP
CEPH FS
A POSIX-compliant distributed file system, with a Linux kernel client and support for FUSE
RADOSGW
A bucket-based REST gateway, compatible with S3 and Swift
APP APP HOST/VM CLIENT
RBD
A reliable and fully-distributed block device, with a Linux kernel client and a QEMU/KVM driver
![Page 34: Ceph Intro and Architectural Overview by Ross Turk](https://reader030.fdocuments.us/reader030/viewer/2022020711/54b7b6024a7959181f8b45ee/html5/thumbnails/34.jpg)
34
M
M
M
VM
LIBRADOS
LIBRBD
VIRTUALIZATION CONTAINER
![Page 35: Ceph Intro and Architectural Overview by Ross Turk](https://reader030.fdocuments.us/reader030/viewer/2022020711/54b7b6024a7959181f8b45ee/html5/thumbnails/35.jpg)
35
LIBRADOS
M
M
M
LIBRBD
CONTAINER
LIBRADOS
LIBRBD
CONTAINERVM
![Page 36: Ceph Intro and Architectural Overview by Ross Turk](https://reader030.fdocuments.us/reader030/viewer/2022020711/54b7b6024a7959181f8b45ee/html5/thumbnails/36.jpg)
36
LIBRADOS
M
M
M
KRBD (KERNEL MODULE)
HOST
![Page 37: Ceph Intro and Architectural Overview by Ross Turk](https://reader030.fdocuments.us/reader030/viewer/2022020711/54b7b6024a7959181f8b45ee/html5/thumbnails/37.jpg)
37
RADOS Block Device:• Storage of disk images in
RADOS• Decouples VMs from host• Images are striped across
the cluster (pool)• Snapshots• Copy-on-write clones• Support in:• Mainline Linux Kernel
(2.6.39+)• Qemu/KVM, native Xen
coming soon• OpenStack, CloudStack,
Nebula, Proxmox
![Page 38: Ceph Intro and Architectural Overview by Ross Turk](https://reader030.fdocuments.us/reader030/viewer/2022020711/54b7b6024a7959181f8b45ee/html5/thumbnails/38.jpg)
38
RADOS
A reliable, autonomous, distributed object store comprised of self-healing, self-managing, intelligent storage nodes
LIBRADOS
A library allowingapps to directlyaccess RADOS,with support forC, C++, Java,Python, Ruby,and PHP
RBD
A reliable and fully-distributed block device, with a Linux kernel client and a QEMU/KVM driver
CEPH FS
A POSIX-compliant distributed file system, with a Linux kernel client and support for FUSE
RADOSGW
A bucket-based REST gateway, compatible with S3 and Swift
APP APP HOST/VM CLIENT
![Page 39: Ceph Intro and Architectural Overview by Ross Turk](https://reader030.fdocuments.us/reader030/viewer/2022020711/54b7b6024a7959181f8b45ee/html5/thumbnails/39.jpg)
39
M
M
M
CLIENT
0110
datametadata
![Page 40: Ceph Intro and Architectural Overview by Ross Turk](https://reader030.fdocuments.us/reader030/viewer/2022020711/54b7b6024a7959181f8b45ee/html5/thumbnails/40.jpg)
40
Metadata Server• Manages metadata for a
POSIX-compliant shared filesystem• Directory hierarchy• File metadata (owner,
timestamps, mode, etc.)• Stores metadata in RADOS• Does not serve file data to
clients• Only required for shared
filesystem
![Page 41: Ceph Intro and Architectural Overview by Ross Turk](https://reader030.fdocuments.us/reader030/viewer/2022020711/54b7b6024a7959181f8b45ee/html5/thumbnails/41.jpg)
41
What Makes Ceph Unique?Part one: CRUSH
![Page 42: Ceph Intro and Architectural Overview by Ross Turk](https://reader030.fdocuments.us/reader030/viewer/2022020711/54b7b6024a7959181f8b45ee/html5/thumbnails/42.jpg)
42
APP??
DC
DC
DC
DC
DC
DC
DC
DC
DC
DC
DC
DC
![Page 43: Ceph Intro and Architectural Overview by Ross Turk](https://reader030.fdocuments.us/reader030/viewer/2022020711/54b7b6024a7959181f8b45ee/html5/thumbnails/43.jpg)
43How Long Did It Take You To Find Your Keys This Morning?azmeen, Flickr / CC BY 2.0
![Page 44: Ceph Intro and Architectural Overview by Ross Turk](https://reader030.fdocuments.us/reader030/viewer/2022020711/54b7b6024a7959181f8b45ee/html5/thumbnails/44.jpg)
44
APP
DC
DC
DC
DC
DC
DC
DC
DC
DC
DC
DC
DC
![Page 45: Ceph Intro and Architectural Overview by Ross Turk](https://reader030.fdocuments.us/reader030/viewer/2022020711/54b7b6024a7959181f8b45ee/html5/thumbnails/45.jpg)
45Dear Diary: Today I Put My Keys on the Kitchen CounterBarnaby, Flickr / CC BY 2.0
![Page 46: Ceph Intro and Architectural Overview by Ross Turk](https://reader030.fdocuments.us/reader030/viewer/2022020711/54b7b6024a7959181f8b45ee/html5/thumbnails/46.jpg)
46
APP
DC
DC
DC
DC
DC
DC
DC
DC
DC
DC
DC
DC
A-G
H-N
O-T
U-Z
F*
![Page 47: Ceph Intro and Architectural Overview by Ross Turk](https://reader030.fdocuments.us/reader030/viewer/2022020711/54b7b6024a7959181f8b45ee/html5/thumbnails/47.jpg)
47I Always Put My Keys on the Hook By the Doorvitamindave, Flickr / CC BY 2.0
![Page 48: Ceph Intro and Architectural Overview by Ross Turk](https://reader030.fdocuments.us/reader030/viewer/2022020711/54b7b6024a7959181f8b45ee/html5/thumbnails/48.jpg)
48
HOW DO YOUFIND YOUR KEYS
WHEN YOUR HOUSEIS
INFINITELY BIGAND
ALWAYS CHANGING?
![Page 49: Ceph Intro and Architectural Overview by Ross Turk](https://reader030.fdocuments.us/reader030/viewer/2022020711/54b7b6024a7959181f8b45ee/html5/thumbnails/49.jpg)
49The Answer: CRUSH!!!!!pasukaru76, Flickr / CC SA 2.0
![Page 50: Ceph Intro and Architectural Overview by Ross Turk](https://reader030.fdocuments.us/reader030/viewer/2022020711/54b7b6024a7959181f8b45ee/html5/thumbnails/50.jpg)
50
10 10 01 01 10 10 01 11 01 10
10 10 01 01 10 10 01 11 01 10
hash(object name) % num pg
CRUSH(pg, cluster state, rule set)
![Page 51: Ceph Intro and Architectural Overview by Ross Turk](https://reader030.fdocuments.us/reader030/viewer/2022020711/54b7b6024a7959181f8b45ee/html5/thumbnails/51.jpg)
51
10 10 01 01 10 10 01 11 01 10
10 10 01 01 10 10 01 11 01 10
![Page 52: Ceph Intro and Architectural Overview by Ross Turk](https://reader030.fdocuments.us/reader030/viewer/2022020711/54b7b6024a7959181f8b45ee/html5/thumbnails/52.jpg)
52
CRUSH• Pseudo-random placement
algorithm• Fast calculation, no lookup• Repeatable, deterministic• Statistically uniform
distribution• Stable mapping• Limited data migration on
change• Rule-based configuration• Infrastructure topology aware• Adjustable replication• Weighting
![Page 53: Ceph Intro and Architectural Overview by Ross Turk](https://reader030.fdocuments.us/reader030/viewer/2022020711/54b7b6024a7959181f8b45ee/html5/thumbnails/53.jpg)
53
CLIENT
??
![Page 54: Ceph Intro and Architectural Overview by Ross Turk](https://reader030.fdocuments.us/reader030/viewer/2022020711/54b7b6024a7959181f8b45ee/html5/thumbnails/54.jpg)
54
![Page 55: Ceph Intro and Architectural Overview by Ross Turk](https://reader030.fdocuments.us/reader030/viewer/2022020711/54b7b6024a7959181f8b45ee/html5/thumbnails/55.jpg)
55
![Page 56: Ceph Intro and Architectural Overview by Ross Turk](https://reader030.fdocuments.us/reader030/viewer/2022020711/54b7b6024a7959181f8b45ee/html5/thumbnails/56.jpg)
56
![Page 57: Ceph Intro and Architectural Overview by Ross Turk](https://reader030.fdocuments.us/reader030/viewer/2022020711/54b7b6024a7959181f8b45ee/html5/thumbnails/57.jpg)
57
CLIENT
??
![Page 58: Ceph Intro and Architectural Overview by Ross Turk](https://reader030.fdocuments.us/reader030/viewer/2022020711/54b7b6024a7959181f8b45ee/html5/thumbnails/58.jpg)
58
What Makes Ceph UniquePart two: thin provisioning
![Page 59: Ceph Intro and Architectural Overview by Ross Turk](https://reader030.fdocuments.us/reader030/viewer/2022020711/54b7b6024a7959181f8b45ee/html5/thumbnails/59.jpg)
59
LIBRADOS
M
M
M
VM
LIBRBD
VIRTUALIZATION CONTAINER
![Page 60: Ceph Intro and Architectural Overview by Ross Turk](https://reader030.fdocuments.us/reader030/viewer/2022020711/54b7b6024a7959181f8b45ee/html5/thumbnails/60.jpg)
60
HOW DO YOUSPIN UP
THOUSANDS OF VMsINSTANTLY
ANDEFFICIENTLY?
![Page 61: Ceph Intro and Architectural Overview by Ross Turk](https://reader030.fdocuments.us/reader030/viewer/2022020711/54b7b6024a7959181f8b45ee/html5/thumbnails/61.jpg)
61
144 0 0 0 0
instant copy
= 144
![Page 62: Ceph Intro and Architectural Overview by Ross Turk](https://reader030.fdocuments.us/reader030/viewer/2022020711/54b7b6024a7959181f8b45ee/html5/thumbnails/62.jpg)
62
4144
CLIENT
write
write
write
= 148
write
![Page 63: Ceph Intro and Architectural Overview by Ross Turk](https://reader030.fdocuments.us/reader030/viewer/2022020711/54b7b6024a7959181f8b45ee/html5/thumbnails/63.jpg)
63
4144
CLIENTread
read
read
= 148
![Page 64: Ceph Intro and Architectural Overview by Ross Turk](https://reader030.fdocuments.us/reader030/viewer/2022020711/54b7b6024a7959181f8b45ee/html5/thumbnails/64.jpg)
64
What Makes Ceph Unique?Part three: clustered metadata
![Page 65: Ceph Intro and Architectural Overview by Ross Turk](https://reader030.fdocuments.us/reader030/viewer/2022020711/54b7b6024a7959181f8b45ee/html5/thumbnails/65.jpg)
65POSIX Filesystem MetadataBarnaby, Flickr / CC BY 2.0
![Page 66: Ceph Intro and Architectural Overview by Ross Turk](https://reader030.fdocuments.us/reader030/viewer/2022020711/54b7b6024a7959181f8b45ee/html5/thumbnails/66.jpg)
66
M
M
M
CLIENT
0110
![Page 67: Ceph Intro and Architectural Overview by Ross Turk](https://reader030.fdocuments.us/reader030/viewer/2022020711/54b7b6024a7959181f8b45ee/html5/thumbnails/67.jpg)
67
M
M
M
![Page 68: Ceph Intro and Architectural Overview by Ross Turk](https://reader030.fdocuments.us/reader030/viewer/2022020711/54b7b6024a7959181f8b45ee/html5/thumbnails/68.jpg)
68
one tree
three metadata servers
??
![Page 69: Ceph Intro and Architectural Overview by Ross Turk](https://reader030.fdocuments.us/reader030/viewer/2022020711/54b7b6024a7959181f8b45ee/html5/thumbnails/69.jpg)
69
![Page 70: Ceph Intro and Architectural Overview by Ross Turk](https://reader030.fdocuments.us/reader030/viewer/2022020711/54b7b6024a7959181f8b45ee/html5/thumbnails/70.jpg)
70
![Page 71: Ceph Intro and Architectural Overview by Ross Turk](https://reader030.fdocuments.us/reader030/viewer/2022020711/54b7b6024a7959181f8b45ee/html5/thumbnails/71.jpg)
71
![Page 72: Ceph Intro and Architectural Overview by Ross Turk](https://reader030.fdocuments.us/reader030/viewer/2022020711/54b7b6024a7959181f8b45ee/html5/thumbnails/72.jpg)
72
![Page 73: Ceph Intro and Architectural Overview by Ross Turk](https://reader030.fdocuments.us/reader030/viewer/2022020711/54b7b6024a7959181f8b45ee/html5/thumbnails/73.jpg)
73
DYNAMIC SUBTREE PARTITIONING
![Page 74: Ceph Intro and Architectural Overview by Ross Turk](https://reader030.fdocuments.us/reader030/viewer/2022020711/54b7b6024a7959181f8b45ee/html5/thumbnails/74.jpg)
74
Getting Started With Ceph
Read about the latest version of Ceph.• The latest stuff is always at http://ceph.com/get
Deploy a test cluster using ceph-deploy.• Read the quick-start guide at http://ceph.com/qsg
Deploy a test cluster on the AWS free-tier using Juju.• Read the guide at http://ceph.com/juju
Read the rest of the docs!• Find docs for the latest release at http://ceph.com/docs
Have a working cluster up quickly.
![Page 75: Ceph Intro and Architectural Overview by Ross Turk](https://reader030.fdocuments.us/reader030/viewer/2022020711/54b7b6024a7959181f8b45ee/html5/thumbnails/75.jpg)
75
Getting Involved With Ceph
Most project discussion happens on the mailing list.• Join or view archives at http://ceph.com/list
IRC is a great place to get help (or help others!)• Find details and historical logs at http://ceph.com/irc
The tracker manages our bugs and feature requests.• Register and start looking around at
http://ceph.com/tracker
Doc updates and suggestions are always welcome.• Learn how to contribute docs at http://ceph.com
/docwriting
Help build the best storage system around!
![Page 76: Ceph Intro and Architectural Overview by Ross Turk](https://reader030.fdocuments.us/reader030/viewer/2022020711/54b7b6024a7959181f8b45ee/html5/thumbnails/76.jpg)
76
Ceph Cuttlefish (v0.61.x)
1. New ceph-deploy provisioning tool2. New Chef cookbooks3. Fully-tested packages for RHEL (in EPEL)4. RGW authentication management API5. RADOS pool quotas6. New ceph df7. RBD incremental snapshots
Best Ceph ever.