Rackspace Private Cloud presentation for ChefConf 2013
-
Upload
joe-breu -
Category
Technology
-
view
1.311 -
download
1
Transcript of Rackspace Private Cloud presentation for ChefConf 2013
![Page 1: Rackspace Private Cloud presentation for ChefConf 2013](https://reader031.fdocuments.us/reader031/viewer/2022020105/554bcd1fb4c905ac708b46ec/html5/thumbnails/1.jpg)
1
April 26, 2013
Deploying OpenStack with Chef and Operational Tooling
#chefconf 2013
![Page 2: Rackspace Private Cloud presentation for ChefConf 2013](https://reader031.fdocuments.us/reader031/viewer/2022020105/554bcd1fb4c905ac708b46ec/html5/thumbnails/2.jpg)
RACKSPACE® HOSTING | WWW.RACKSPACE.COM
Who Are We?
Justin Shepherd
Principal Architect
Rackspace Private Cloud
github.com/galstrom21
Joseph Breu
Deployment Engineer
Rackspace Private Cloud
github.com/rackerjoe
@rackerjoe
![Page 3: Rackspace Private Cloud presentation for ChefConf 2013](https://reader031.fdocuments.us/reader031/viewer/2022020105/554bcd1fb4c905ac708b46ec/html5/thumbnails/3.jpg)
3RACKSPACE® HOSTING | WWW.RACKSPACE.COM
• Only consume Open Source projects
• All changes go upstream
• CHEF-3889 - tunables for postgres
• CHEF-3849 - redirect login bug
• Everything must be automated through the deployment and management stacks.
• Everything we build is Open Souce
• https:/github.com/rcbops
• github.com/rcbops-cookbooks
Rackspace Private Cloud Philosophy
![Page 4: Rackspace Private Cloud presentation for ChefConf 2013](https://reader031.fdocuments.us/reader031/viewer/2022020105/554bcd1fb4c905ac708b46ec/html5/thumbnails/4.jpg)
4RACKSPACE® HOSTING | WWW.RACKSPACE.COM
• Jenkins is used for testing and gating of our cookbooks
• Syntax Verification (pep8, foodcritic)
• Unit Tests for OpenCenter
• Full deployment of OpenStack utilizing the cookbooks with the proposed changeset applied
• Functional Tests of OpenStack
• OpenStack API Testing
• OpenStack CLI Testing
• Upstream opscode cookbooks are tested before inclusion
Testing
![Page 5: Rackspace Private Cloud presentation for ChefConf 2013](https://reader031.fdocuments.us/reader031/viewer/2022020105/554bcd1fb4c905ac708b46ec/html5/thumbnails/5.jpg)
5RACKSPACE® HOSTING | WWW.RACKSPACE.COM
How Did We Get Here?
5
![Page 6: Rackspace Private Cloud presentation for ChefConf 2013](https://reader031.fdocuments.us/reader031/viewer/2022020105/554bcd1fb4c905ac708b46ec/html5/thumbnails/6.jpg)
6RACKSPACE® HOSTING | WWW.RACKSPACE.COM
• Installing Bexar and Cactus by hand
• Problems
• Deployed from trunk
• No packages available for distributions
• Not easily repeatable
• Not easily supported
In The BeginningEarly 2011
![Page 7: Rackspace Private Cloud presentation for ChefConf 2013](https://reader031.fdocuments.us/reader031/viewer/2022020105/554bcd1fb4c905ac708b46ec/html5/thumbnails/7.jpg)
7RACKSPACE® HOSTING | WWW.RACKSPACE.COM
Defining Our Mission
7
![Page 8: Rackspace Private Cloud presentation for ChefConf 2013](https://reader031.fdocuments.us/reader031/viewer/2022020105/554bcd1fb4c905ac708b46ec/html5/thumbnails/8.jpg)
8RACKSPACE® HOSTING | WWW.RACKSPACE.COM
• We need to make it easy to install
• We need to make the installation repeatable
• We need to model “Real World Deployments”
The MissionEarly 2011
![Page 9: Rackspace Private Cloud presentation for ChefConf 2013](https://reader031.fdocuments.us/reader031/viewer/2022020105/554bcd1fb4c905ac708b46ec/html5/thumbnails/9.jpg)
9RACKSPACE® HOSTING | WWW.RACKSPACE.COM
Automating OpenStack Deployment
9
![Page 10: Rackspace Private Cloud presentation for ChefConf 2013](https://reader031.fdocuments.us/reader031/viewer/2022020105/554bcd1fb4c905ac708b46ec/html5/thumbnails/10.jpg)
10
RACKSPACE® HOSTING | WWW.RACKSPACE.COM
• Deploying Cactus and Diablo
• Puppet
• Inherited from OpenStack Team
• djeep based
• Very simplistic, not flexible
• Represented the developer case - not real world deployments
10
Automate!Late 2011
![Page 11: Rackspace Private Cloud presentation for ChefConf 2013](https://reader031.fdocuments.us/reader031/viewer/2022020105/554bcd1fb4c905ac708b46ec/html5/thumbnails/11.jpg)
11
RACKSPACE® HOSTING | WWW.RACKSPACE.COM
Mission Status
We need to make it easy to install FAIL
We need to make the installation repeatable PASS
We need to model “Real World Deployments” FAIL
![Page 12: Rackspace Private Cloud presentation for ChefConf 2013](https://reader031.fdocuments.us/reader031/viewer/2022020105/554bcd1fb4c905ac708b46ec/html5/thumbnails/12.jpg)
12
RACKSPACE® HOSTING | WWW.RACKSPACE.COM
• Crowbar
• Dell platform for deployment
• Chef based
• Very heavyweight
• ISO installation
• Boot shim for system discovery
• Used for a few deployments and contributed code upstream
• Upgrades were painful or not possible at all
12
Automate!Late 2011 - Diablo
![Page 13: Rackspace Private Cloud presentation for ChefConf 2013](https://reader031.fdocuments.us/reader031/viewer/2022020105/554bcd1fb4c905ac708b46ec/html5/thumbnails/13.jpg)
13
RACKSPACE® HOSTING | WWW.RACKSPACE.COM
Mission Status
We need to make it easy to install Almost Passed
We need to make the installation repeatable PASS
We need to model “Real World Deployments” Almost Passed
![Page 14: Rackspace Private Cloud presentation for ChefConf 2013](https://reader031.fdocuments.us/reader031/viewer/2022020105/554bcd1fb4c905ac708b46ec/html5/thumbnails/14.jpg)
14
RACKSPACE® HOSTING | WWW.RACKSPACE.COM
Feature Creep
14
![Page 15: Rackspace Private Cloud presentation for ChefConf 2013](https://reader031.fdocuments.us/reader031/viewer/2022020105/554bcd1fb4c905ac708b46ec/html5/thumbnails/15.jpg)
15
RACKSPACE® HOSTING | WWW.RACKSPACE.COM
• We need to make it easy to install
• We need to make the installation repeatable
• We need to mode “Real World Deployments”
• We need to handle updates
• We need to quickly consume new OpenStack services
• We need to plug into existing infrastructure (PXE, DNS, LDAP, etc)
15
We now need to…March 2012
![Page 16: Rackspace Private Cloud presentation for ChefConf 2013](https://reader031.fdocuments.us/reader031/viewer/2022020105/554bcd1fb4c905ac708b46ec/html5/thumbnails/16.jpg)
16
RACKSPACE® HOSTING | WWW.RACKSPACE.COM
How did Puppet do?
We need to make it easy to install FAIL
We need to make the installation repeatable PASS
We need to model “Real World Deployments” FAIL
We need to handle updates FAIL
We need to quickly consume new OpenStack Services FAIL
We need to plug into existing infrastructure FAIL
![Page 17: Rackspace Private Cloud presentation for ChefConf 2013](https://reader031.fdocuments.us/reader031/viewer/2022020105/554bcd1fb4c905ac708b46ec/html5/thumbnails/17.jpg)
17
RACKSPACE® HOSTING | WWW.RACKSPACE.COM
How did Crowbar do?
We need to make it easy to install Almost Passed
We need to make the installation repeatable PASS
We need to model “Real World Deployments” Almost Passed
We need to handle updates FAIL
We need to quickly consume new OpenStack Services FAIL
We need to plug into existing infrastructure FAIL
![Page 18: Rackspace Private Cloud presentation for ChefConf 2013](https://reader031.fdocuments.us/reader031/viewer/2022020105/554bcd1fb4c905ac708b46ec/html5/thumbnails/18.jpg)
18
RACKSPACE® HOSTING | WWW.RACKSPACE.COM
Next Steps in Automation
18
![Page 19: Rackspace Private Cloud presentation for ChefConf 2013](https://reader031.fdocuments.us/reader031/viewer/2022020105/554bcd1fb4c905ac708b46ec/html5/thumbnails/19.jpg)
19
RACKSPACE® HOSTING | WWW.RACKSPACE.COM
• Deploying Essex
• Started to build our own cookbooks
• Heavy utilization of Chef search
• Modeled real world deployments
• Support for multiple Operating Systems
Next Steps in AutomationMarch 2012
![Page 20: Rackspace Private Cloud presentation for ChefConf 2013](https://reader031.fdocuments.us/reader031/viewer/2022020105/554bcd1fb4c905ac708b46ec/html5/thumbnails/20.jpg)
20
RACKSPACE® HOSTING | WWW.RACKSPACE.COM
• Deploying Folsom
• Creating LWRPs for REST based Services
• Rewrites of many cookbooks to support multiple Operating Systems
• Debian and RedHat based
• Search wrapper functions for ease of use
Next Steps in AutomationLate 2012
![Page 21: Rackspace Private Cloud presentation for ChefConf 2013](https://reader031.fdocuments.us/reader031/viewer/2022020105/554bcd1fb4c905ac708b46ec/html5/thumbnails/21.jpg)
21
RACKSPACE® HOSTING | WWW.RACKSPACE.COM
How did we do?
We need to make it easy to install PASSED
We need to make the installation repeatable PASSED
We need to model “Real World Deployments” PASSED
We need to handle updates PASSED
We need to quickly consume new OpenStack Services PASSED
We need to plug into existing infrastructure Almost PASSED
![Page 22: Rackspace Private Cloud presentation for ChefConf 2013](https://reader031.fdocuments.us/reader031/viewer/2022020105/554bcd1fb4c905ac708b46ec/html5/thumbnails/22.jpg)
22
RACKSPACE® HOSTING | WWW.RACKSPACE.COM
More Feature Creep
22
![Page 23: Rackspace Private Cloud presentation for ChefConf 2013](https://reader031.fdocuments.us/reader031/viewer/2022020105/554bcd1fb4c905ac708b46ec/html5/thumbnails/23.jpg)
23
RACKSPACE® HOSTING | WWW.RACKSPACE.COM
• We need to make it easy to install
• We need to make the installation repeatable
• We need to mode “Real World Deployments”
• We need to handle updates
• We need to quickly consume new OpenStack services
• We need to plug into existing infrastructure (PXE, DNS, LDAP, etc)
• We need provide Highly Available OpenStack Services
• We need to provide support for Vendor Integration for Block Storage
• We need to support Software Defined Networks
23
We now need to…December 2012
![Page 24: Rackspace Private Cloud presentation for ChefConf 2013](https://reader031.fdocuments.us/reader031/viewer/2022020105/554bcd1fb4c905ac708b46ec/html5/thumbnails/24.jpg)
24
RACKSPACE® HOSTING | WWW.RACKSPACE.COM
• keepalived for failover IP
• haproxy for load balancing REST based services
• Multi-master MySQL replication and keepalived
• Active/Passive RabbitmQ and keepalived
• This is sketchy in Folsom - better in Grizzly
Creating Highly Available ServicesEarly 2013
![Page 25: Rackspace Private Cloud presentation for ChefConf 2013](https://reader031.fdocuments.us/reader031/viewer/2022020105/554bcd1fb4c905ac708b46ec/html5/thumbnails/25.jpg)
25
RACKSPACE® HOSTING | WWW.RACKSPACE.COM
• Support for multiple Cinder Backends
• Currently NetApp and EMC
• Support for SDN
• Currently only OVS
• LDAP Support
• Greenfield LDAP deployments only
• No AD support... yet...
Other ServicesEarly 2013
![Page 26: Rackspace Private Cloud presentation for ChefConf 2013](https://reader031.fdocuments.us/reader031/viewer/2022020105/554bcd1fb4c905ac708b46ec/html5/thumbnails/26.jpg)
26
RACKSPACE® HOSTING | WWW.RACKSPACE.COM
How did we do?
We need to make it easy to install FAILED!
We need to make the installation repeatable PASSED
We need to model “Real World Deployments” PASSED
We need to handle updates PASSED
We need to quickly consume new OpenStack Services PASSED
We need to plug into existing infrastructure PASSED
We need to provide Highly Available OpenStack services
PASSED
We need to provide support for Vendor Integration for Block Storage
PASSED
We need to Support Software Defined Networks PASSED
![Page 27: Rackspace Private Cloud presentation for ChefConf 2013](https://reader031.fdocuments.us/reader031/viewer/2022020105/554bcd1fb4c905ac708b46ec/html5/thumbnails/27.jpg)
27
RACKSPACE® HOSTING | WWW.RACKSPACE.COM
The Tipping Point
27
![Page 28: Rackspace Private Cloud presentation for ChefConf 2013](https://reader031.fdocuments.us/reader031/viewer/2022020105/554bcd1fb4c905ac708b46ec/html5/thumbnails/28.jpg)
28
RACKSPACE® HOSTING | WWW.RACKSPACE.COM
• We had a system that can do real interesting things
• You now need to have staff with strong Chef knowledge to use it
• And strong OpenStack knowledge...
• OpenSource Chef is great for some things – but not everything
• We need to orchestrate changes across a cluster
• We need to do it in a defined order
The Tipping PointEarly 2013
![Page 29: Rackspace Private Cloud presentation for ChefConf 2013](https://reader031.fdocuments.us/reader031/viewer/2022020105/554bcd1fb4c905ac708b46ec/html5/thumbnails/29.jpg)
29
RACKSPACE® HOSTING | WWW.RACKSPACE.COM
OpenCenter
29
![Page 30: Rackspace Private Cloud presentation for ChefConf 2013](https://reader031.fdocuments.us/reader031/viewer/2022020105/554bcd1fb4c905ac708b46ec/html5/thumbnails/30.jpg)
30
RACKSPACE® HOSTING | WWW.RACKSPACE.COM
• Simplifies, speeds up deployment
• Lowers Operator overhead
• Minimizes the internal OpenStack knowledge
• Provides resiliency in the Cloud
• API for command line access
What is OpenCenter?
![Page 31: Rackspace Private Cloud presentation for ChefConf 2013](https://reader031.fdocuments.us/reader031/viewer/2022020105/554bcd1fb4c905ac708b46ec/html5/thumbnails/31.jpg)
31
RACKSPACE® HOSTING | WWW.RACKSPACE.COM
What is OpenCenter?
![Page 32: Rackspace Private Cloud presentation for ChefConf 2013](https://reader031.fdocuments.us/reader031/viewer/2022020105/554bcd1fb4c905ac708b46ec/html5/thumbnails/32.jpg)
32
RACKSPACE® HOSTING | WWW.RACKSPACE.COM
What is OpenCenter
![Page 33: Rackspace Private Cloud presentation for ChefConf 2013](https://reader031.fdocuments.us/reader031/viewer/2022020105/554bcd1fb4c905ac708b46ec/html5/thumbnails/33.jpg)
33
RACKSPACE® HOSTING | WWW.RACKSPACE.COM
Lowers Operator Overhead
![Page 34: Rackspace Private Cloud presentation for ChefConf 2013](https://reader031.fdocuments.us/reader031/viewer/2022020105/554bcd1fb4c905ac708b46ec/html5/thumbnails/34.jpg)
34
RACKSPACE® HOSTING | WWW.RACKSPACE.COM
Resiliency for Private Cloud
![Page 35: Rackspace Private Cloud presentation for ChefConf 2013](https://reader031.fdocuments.us/reader031/viewer/2022020105/554bcd1fb4c905ac708b46ec/html5/thumbnails/35.jpg)
35
RACKSPACE® HOSTING | WWW.RACKSPACE.COM
Solver – Automates Operator Tasks
![Page 36: Rackspace Private Cloud presentation for ChefConf 2013](https://reader031.fdocuments.us/reader031/viewer/2022020105/554bcd1fb4c905ac708b46ec/html5/thumbnails/36.jpg)
36
RACKSPACE® HOSTING | WWW.RACKSPACE.COM
Extensible
Write your own Python/Bash scripts to create workflows that extend OpenCenter
![Page 37: Rackspace Private Cloud presentation for ChefConf 2013](https://reader031.fdocuments.us/reader031/viewer/2022020105/554bcd1fb4c905ac708b46ec/html5/thumbnails/37.jpg)
37
RACKSPACE® HOSTING | WWW.RACKSPACE.COM
How did we do?
We need to make it easy to install PASSED
We need to make the installation repeatable PASSED
We need to model “Real World Deployments” PASSED
We need to handle updates PASSED
We need to quickly consume new OpenStack Services PASSED
We need to plug into existing infrastructure PASSED
We need to provide Highly Available OpenStack services
PASSED
We need to provide support for Vendor Integration for Block Storage
PASSED
We need to Support Software Defined Networks PASSED
![Page 38: Rackspace Private Cloud presentation for ChefConf 2013](https://reader031.fdocuments.us/reader031/viewer/2022020105/554bcd1fb4c905ac708b46ec/html5/thumbnails/38.jpg)
38
RACKSPACE® HOSTING | WWW.RACKSPACE.COM
Errata
38
![Page 39: Rackspace Private Cloud presentation for ChefConf 2013](https://reader031.fdocuments.us/reader031/viewer/2022020105/554bcd1fb4c905ac708b46ec/html5/thumbnails/39.jpg)
39
RACKSPACE® HOSTING | WWW.RACKSPACE.COM
• Partial Searches and Templates
• Remove dependencies on monitoring and logging
• Make our cookbooks more easily consumable
• Upstream our cookbooks to the OpsCode OpenStack repos
• Utilize OpenStack CI testing and gating
Looking forward
![Page 40: Rackspace Private Cloud presentation for ChefConf 2013](https://reader031.fdocuments.us/reader031/viewer/2022020105/554bcd1fb4c905ac708b46ec/html5/thumbnails/40.jpg)
4040
RACKSPACE® HOSTING | 5000 WALZEM ROAD | SAN ANTONIO, TX 78218
US SALES: 1-800-961-2888 | US SUPPORT: 1-800-961-4454 | WWW.RACKSPACE.COM
RACKSPACE® HOSTING | © RACKSPACE US, INC. | RACKSPACE® AND FANATICAL SUPPORT® ARE SERVICE MARKS OF RACKSPACE US, INC. REGISTERED IN THE UNITED STATES AND OTHER COUNTRIES. | WWW.RACKSPACE.COM