Morphlabs open stack_capacity_planning_130829
-
Upload
aedocw -
Category
Technology
-
view
186 -
download
0
Transcript of Morphlabs open stack_capacity_planning_130829
![Page 1: Morphlabs open stack_capacity_planning_130829](https://reader033.fdocuments.us/reader033/viewer/2022060121/5594aeaf1a28ab984b8b45bc/html5/thumbnails/1.jpg)
© 2013 Morph labs Inc . A l l R igh ts Reserved
PRESENTED BY : Christopher Aedo, CTO
CO NF ID EN T I A L & PR O PR IE TA RY
OpenStack Capacity Planning8-29-2013
1
![Page 2: Morphlabs open stack_capacity_planning_130829](https://reader033.fdocuments.us/reader033/viewer/2022060121/5594aeaf1a28ab984b8b45bc/html5/thumbnails/2.jpg)
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
Who the hell am I?
•Christopher Aedo ([email protected])
•Morphlabs CTO
•20+ year IT veteran (started at Arthur Andersen but NOT responsible for ENRON debacle!)
•Familiar with this “OpenStacks” thing
•Work with many very very smart people at Morphlabs, and in the OpenStack community
•Met Vint Cerf once!
•That’s what I look like in the Grand Canyon
2
![Page 3: Morphlabs open stack_capacity_planning_130829](https://reader033.fdocuments.us/reader033/viewer/2022060121/5594aeaf1a28ab984b8b45bc/html5/thumbnails/3.jpg)
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
Morphlabs Profile
3
Headquartered in Los Angeles• Venture Funded $22M • 55 Employees• Operations in Japan, Philippines and Singapore• US Operations established in 2009
Successful Open Source Entrepreneurs• Apache Geronimo > IBM Websphere • Apache ActiveMQ > Progress Software
Deployments in the US and Asia
OpenStack Foundation Founding Member
![Page 4: Morphlabs open stack_capacity_planning_130829](https://reader033.fdocuments.us/reader033/viewer/2022060121/5594aeaf1a28ab984b8b45bc/html5/thumbnails/4.jpg)
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
Agenda
Provide a useful structure and related information to help guide your thinking when it comes to planning an OpenStack deployment.Areas covered:
•Hypervisor choice
•Workload considerations
•Compute node capacity thoughts
•Storage (block and object)
•REVISIT THIS SLIDE WHEN OTHERS ARE COMPLETE!
4
![Page 5: Morphlabs open stack_capacity_planning_130829](https://reader033.fdocuments.us/reader033/viewer/2022060121/5594aeaf1a28ab984b8b45bc/html5/thumbnails/5.jpg)
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
Thank You!
Tom FifieldDiane FlemingAnne GentleLorin HochsteinAdam HydeJonathan ProulxEverett ToewsJoe Topjian
5
![Page 6: Morphlabs open stack_capacity_planning_130829](https://reader033.fdocuments.us/reader033/viewer/2022060121/5594aeaf1a28ab984b8b45bc/html5/thumbnails/6.jpg)
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
oh crap!
6
![Page 7: Morphlabs open stack_capacity_planning_130829](https://reader033.fdocuments.us/reader033/viewer/2022060121/5594aeaf1a28ab984b8b45bc/html5/thumbnails/7.jpg)
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
Want the easy answers?
7
![Page 8: Morphlabs open stack_capacity_planning_130829](https://reader033.fdocuments.us/reader033/viewer/2022060121/5594aeaf1a28ab984b8b45bc/html5/thumbnails/8.jpg)
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
Unlimited budget
8
![Page 9: Morphlabs open stack_capacity_planning_130829](https://reader033.fdocuments.us/reader033/viewer/2022060121/5594aeaf1a28ab984b8b45bc/html5/thumbnails/9.jpg)
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
Unlimited time
9
![Page 10: Morphlabs open stack_capacity_planning_130829](https://reader033.fdocuments.us/reader033/viewer/2022060121/5594aeaf1a28ab984b8b45bc/html5/thumbnails/10.jpg)
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
Organized team of geniuses
10
![Page 11: Morphlabs open stack_capacity_planning_130829](https://reader033.fdocuments.us/reader033/viewer/2022060121/5594aeaf1a28ab984b8b45bc/html5/thumbnails/11.jpg)
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
Total agreement on expectations
11
![Page 12: Morphlabs open stack_capacity_planning_130829](https://reader033.fdocuments.us/reader033/viewer/2022060121/5594aeaf1a28ab984b8b45bc/html5/thumbnails/12.jpg)
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
Getting started
12
![Page 13: Morphlabs open stack_capacity_planning_130829](https://reader033.fdocuments.us/reader033/viewer/2022060121/5594aeaf1a28ab984b8b45bc/html5/thumbnails/13.jpg)
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
Getting started
13
![Page 14: Morphlabs open stack_capacity_planning_130829](https://reader033.fdocuments.us/reader033/viewer/2022060121/5594aeaf1a28ab984b8b45bc/html5/thumbnails/14.jpg)
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
Spare server
14
![Page 15: Morphlabs open stack_capacity_planning_130829](https://reader033.fdocuments.us/reader033/viewer/2022060121/5594aeaf1a28ab984b8b45bc/html5/thumbnails/15.jpg)
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
Devstack!
15
![Page 16: Morphlabs open stack_capacity_planning_130829](https://reader033.fdocuments.us/reader033/viewer/2022060121/5594aeaf1a28ab984b8b45bc/html5/thumbnails/16.jpg)
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
First crossroad...
16
![Page 17: Morphlabs open stack_capacity_planning_130829](https://reader033.fdocuments.us/reader033/viewer/2022060121/5594aeaf1a28ab984b8b45bc/html5/thumbnails/17.jpg)
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
Private cloud
17
Source: http://www.privatecloudandhosting.info/wp-content/uploads/2013/04/private-cloud1.png
![Page 18: Morphlabs open stack_capacity_planning_130829](https://reader033.fdocuments.us/reader033/viewer/2022060121/5594aeaf1a28ab984b8b45bc/html5/thumbnails/18.jpg)
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
You know your users and workload
18
![Page 19: Morphlabs open stack_capacity_planning_130829](https://reader033.fdocuments.us/reader033/viewer/2022060121/5594aeaf1a28ab984b8b45bc/html5/thumbnails/19.jpg)
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
19
Public Cloud!(I couldn’t find an image that screamed “Public Cloud” unfortunately.)
![Page 20: Morphlabs open stack_capacity_planning_130829](https://reader033.fdocuments.us/reader033/viewer/2022060121/5594aeaf1a28ab984b8b45bc/html5/thumbnails/20.jpg)
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
Users and workload likely unknown
20
![Page 21: Morphlabs open stack_capacity_planning_130829](https://reader033.fdocuments.us/reader033/viewer/2022060121/5594aeaf1a28ab984b8b45bc/html5/thumbnails/21.jpg)
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
Profile your workloads if possible
•Load test!
•Benchmark!
•Get a sense of IOPS with iostat!
•Quick, someone yell out their favorite profiling methodology!
21
![Page 22: Morphlabs open stack_capacity_planning_130829](https://reader033.fdocuments.us/reader033/viewer/2022060121/5594aeaf1a28ab984b8b45bc/html5/thumbnails/22.jpg)
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
22
Hypervisor
![Page 23: Morphlabs open stack_capacity_planning_130829](https://reader033.fdocuments.us/reader033/viewer/2022060121/5594aeaf1a28ab984b8b45bc/html5/thumbnails/23.jpg)
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
23
Hypervisor
![Page 24: Morphlabs open stack_capacity_planning_130829](https://reader033.fdocuments.us/reader033/viewer/2022060121/5594aeaf1a28ab984b8b45bc/html5/thumbnails/24.jpg)
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
24
Compute Density
![Page 25: Morphlabs open stack_capacity_planning_130829](https://reader033.fdocuments.us/reader033/viewer/2022060121/5594aeaf1a28ab984b8b45bc/html5/thumbnails/25.jpg)
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
Compute Density
25
(overcommit fraction * physical cores)---------------------------------
vcores per instance
ephemeral storage desiredvs.
physical storage available
![Page 26: Morphlabs open stack_capacity_planning_130829](https://reader033.fdocuments.us/reader033/viewer/2022060121/5594aeaf1a28ab984b8b45bc/html5/thumbnails/26.jpg)
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
Major vectors
•Budget•New/existing equipment•Space/power, desired performance•How much compute per node?•How much RAM per node?•How much storage per VM?•How many IOPS will you need?
26
![Page 27: Morphlabs open stack_capacity_planning_130829](https://reader033.fdocuments.us/reader033/viewer/2022060121/5594aeaf1a28ab984b8b45bc/html5/thumbnails/27.jpg)
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
Speaking of IOPS
FOR EXAMPLE:• Model: Western Digital VelociRaptor 2.5" SATA hard drive
• Rotational speed: 10,000 RPM
• Average latency: 3 ms (0.003 seconds)
• Average seek time: 4.2 (r)/4.7 (w) = 4.45 ms (0.0045 seconds)
• Calculated IOPS for this disk: 1/(0.003 + 0.0045) = about 133 IOPS
27
Source: http://www.techrepublic.com/blog/the-enterprise-cloud/calculate-iops-in-a-storage-array/
![Page 28: Morphlabs open stack_capacity_planning_130829](https://reader033.fdocuments.us/reader033/viewer/2022060121/5594aeaf1a28ab984b8b45bc/html5/thumbnails/28.jpg)
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
Factual Statistic
87% of the people viewing this presentation would appreciate a graph right about now.
28
![Page 29: Morphlabs open stack_capacity_planning_130829](https://reader033.fdocuments.us/reader033/viewer/2022060121/5594aeaf1a28ab984b8b45bc/html5/thumbnails/29.jpg)
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
Storage and IOPS dictate density possible
29
![Page 30: Morphlabs open stack_capacity_planning_130829](https://reader033.fdocuments.us/reader033/viewer/2022060121/5594aeaf1a28ab984b8b45bc/html5/thumbnails/30.jpg)
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
Thinking about density
32 physical cores96 virtual cores (3x overcommit)1tb storage (@10gb/vcore)192gb RAM needed (overcommit possible)50 IOPS/VM (that’s on the low side)5000 IOPS required~125 IOPS per 10k SAS12 100gb disks RAID10: ~1500 IOPS
30
![Page 31: Morphlabs open stack_capacity_planning_130829](https://reader033.fdocuments.us/reader033/viewer/2022060121/5594aeaf1a28ab984b8b45bc/html5/thumbnails/31.jpg)
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
Thinking about density
~125 IOPS per 10k SAS12 100gb disks RAID10: ~1500 IOPS50 IOPS/VM (that’s on the low side)30 VMs12 physical cores (3x overcommit)60 gb RAM (@2gb/vcore)300 gb storage (@10gb/vcore)
31
![Page 32: Morphlabs open stack_capacity_planning_130829](https://reader033.fdocuments.us/reader033/viewer/2022060121/5594aeaf1a28ab984b8b45bc/html5/thumbnails/32.jpg)
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
STORAGE
32
Storage
![Page 33: Morphlabs open stack_capacity_planning_130829](https://reader033.fdocuments.us/reader033/viewer/2022060121/5594aeaf1a28ab984b8b45bc/html5/thumbnails/33.jpg)
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
STORAGE
33
Storage
![Page 34: Morphlabs open stack_capacity_planning_130829](https://reader033.fdocuments.us/reader033/viewer/2022060121/5594aeaf1a28ab984b8b45bc/html5/thumbnails/34.jpg)
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
STORAGE
34
Storage
NEED MORE STORAGE!
![Page 35: Morphlabs open stack_capacity_planning_130829](https://reader033.fdocuments.us/reader033/viewer/2022060121/5594aeaf1a28ab984b8b45bc/html5/thumbnails/35.jpg)
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
STORAGE
35
Storage
I’LL GET MORE TAPES
FAST!
![Page 36: Morphlabs open stack_capacity_planning_130829](https://reader033.fdocuments.us/reader033/viewer/2022060121/5594aeaf1a28ab984b8b45bc/html5/thumbnails/36.jpg)
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
STORAGE
36
Storage
DID YOU SEE BREAKING BAD LAST
NIGHT?
![Page 37: Morphlabs open stack_capacity_planning_130829](https://reader033.fdocuments.us/reader033/viewer/2022060121/5594aeaf1a28ab984b8b45bc/html5/thumbnails/37.jpg)
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
STORAGE
37
Storage
OMFG YES!
![Page 38: Morphlabs open stack_capacity_planning_130829](https://reader033.fdocuments.us/reader033/viewer/2022060121/5594aeaf1a28ab984b8b45bc/html5/thumbnails/38.jpg)
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
STORAGE
38
Storage
![Page 39: Morphlabs open stack_capacity_planning_130829](https://reader033.fdocuments.us/reader033/viewer/2022060121/5594aeaf1a28ab984b8b45bc/html5/thumbnails/39.jpg)
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
STORAGE
39
Storage
SO... THOSE TAPES, SOON? NOW?
![Page 40: Morphlabs open stack_capacity_planning_130829](https://reader033.fdocuments.us/reader033/viewer/2022060121/5594aeaf1a28ab984b8b45bc/html5/thumbnails/40.jpg)
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
NETWORKING
40
![Page 41: Morphlabs open stack_capacity_planning_130829](https://reader033.fdocuments.us/reader033/viewer/2022060121/5594aeaf1a28ab984b8b45bc/html5/thumbnails/41.jpg)
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
NETWORKING
41
![Page 42: Morphlabs open stack_capacity_planning_130829](https://reader033.fdocuments.us/reader033/viewer/2022060121/5594aeaf1a28ab984b8b45bc/html5/thumbnails/42.jpg)
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
NETWORKING
42
![Page 43: Morphlabs open stack_capacity_planning_130829](https://reader033.fdocuments.us/reader033/viewer/2022060121/5594aeaf1a28ab984b8b45bc/html5/thumbnails/43.jpg)
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
43
Cloud Controller
![Page 44: Morphlabs open stack_capacity_planning_130829](https://reader033.fdocuments.us/reader033/viewer/2022060121/5594aeaf1a28ab984b8b45bc/html5/thumbnails/44.jpg)
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
Outgrowing your cloud controller
44
![Page 45: Morphlabs open stack_capacity_planning_130829](https://reader033.fdocuments.us/reader033/viewer/2022060121/5594aeaf1a28ab984b8b45bc/html5/thumbnails/45.jpg)
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
Outgrowing your cloud controller
45
![Page 46: Morphlabs open stack_capacity_planning_130829](https://reader033.fdocuments.us/reader033/viewer/2022060121/5594aeaf1a28ab984b8b45bc/html5/thumbnails/46.jpg)
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
Outgrowing your cloud controller
46
![Page 47: Morphlabs open stack_capacity_planning_130829](https://reader033.fdocuments.us/reader033/viewer/2022060121/5594aeaf1a28ab984b8b45bc/html5/thumbnails/47.jpg)
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
Outgrowing your cloud controller
47
![Page 48: Morphlabs open stack_capacity_planning_130829](https://reader033.fdocuments.us/reader033/viewer/2022060121/5594aeaf1a28ab984b8b45bc/html5/thumbnails/48.jpg)
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
MONITORING
48
![Page 49: Morphlabs open stack_capacity_planning_130829](https://reader033.fdocuments.us/reader033/viewer/2022060121/5594aeaf1a28ab984b8b45bc/html5/thumbnails/49.jpg)
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
49
Contact: Christopher [email protected]
Thank You!