Cluster as a Service: dodai
2012.10.16
Xiaohua GuanNTT DATA INTELLILINK
1
At the beginning
• etherpad http://etherpad.openstack.org/grizzly-dodai
● slideshare http://www.slideshare.net/guanxiaohua2k6/dod
ai-grizzly-14755367
2
Agenda
• dodai
• dodai-deploy
• dodai-compute
• Demo of install as a service
3
What’s dodai
• It’s CaaS(Cluster as a Service)
• dodai = dodai-deploy + dodai-compute
4
CaaS : Cluster as a Service
Server pool
Clusters for each private cloud
Allocate serversfrom server pool
Return serversto server pool
Private cloud - A Private cloud - B Private cloud - CElasticPrivateCloud
5
dodai = dodai-deploy + dodai-compute
6
What’s dodai-deploy?
• A software management tool for distributed environment
• With license Apache2• Please visit
http://github.com/nii-cloud/dodai-deploy
7
History of dodai-deploy
8
What’s the features
• It’s a Framework• It’s Fast• It’s Scalable• It’s Easy to use
9
It’s a Framework
• Provide templates for various softwares– Openstack– Hadoop– SGE– Eucalyptus
• Templates are customizable by user
• Templates can be added by user
10
It’s Fast
• Deploy parallelly in distributed environment– Considering dependencies of components
• nova-api depends on mysql server.
11
0 1 2 3 4 5 6 7 80
10
20
30
40
50
60
70
hadoop installation time
number of data node
time(second)
It’s Scalable
• dodai-deploy server can be scaled such as …
12
It’s easy to use
• Web UI•
• CLI commands– script/cli.rb SERVER RESOURCE ACTION [PARAM1 PARAM2 …]
• REST APIs– Provide REST APIs simulator in WEB UI. Enjoy it.
13
How does dodai-deploy work?
Ruby on Rails
MCollective
puppetdodai-deploy server
dodai-deploy nodes
14
More details
15
What’s new today
• Install as a Service
• Support for Multi-OSes
• Support for Folsom
16
Install as a Service
• Provide installation of softwares as a service
• No longer installation of dodai-deploy server– Global dodai-deploy server
• Add nodes belongs to user
• User defined proposals(templates)
17
Install as a Service
18
Install as a Service
19
Multi-OSes
• Support for CentOS– With same UI, but different set up scripts for dodai-deploy– setup-env.centos/setup.sh …
• Support OpenStack Essex CentOS now
20
Support for Folsom
• Folsom Release– Compute
• Nova• Horizon• Quantum• Cinder
– Glance– Keystone
21
What's the next of dodai-deploy
• Construct a global server to provide "Install as a Service"
• Provide more templates for popular softwares
• Add function to upload the template of new software
22
What’s dodai-compute?
● Bare metal version of nova(diablo)
• With license Apache2
• Please visit
http://github.com/nii-cloud/dodai-compute
23
What’s features?
• Provide the same interface with nova to operate on physical machines.
• Prepare installed machines in resource pool.
• Separate network logically with OpenFlow switch.
24
What’s inside dodai-compute
OpenFlow controllermodified nova
OpenFlow switch
cobbler
25
What’s the next of dodai-compute
• Shorten the time of installation– With kexec to bypass BIOS, shorten the time from
10'15” to 1'30”
• Provide console of physical machine to users– Implement with SOL(Serial on LAN) of IPMI
• Start machine with “Wake on LAN”
26
Demo: Install as a Service
• Construct a multiple compute nodes openstack folsom cloud on EC2– nova-compute node X 3– others X 1
• Steps– 1. register a new user– 2. create instances on EC2 and add as nodes– 3. create a proposal– 4. install– 5. test– 6. use dashboard
27
Summary
• dodai– CaaS
• dodai-deploy– http://github.com/nii/dodai-deploy– Multiple OSes supported (Ubuntu, CentOS)– Install as a Service– Folsom supported
• dodai-compute
– http://github.com/nii/dodai-compute– Bare metal version of nova– Minimize installation time with kexec– Provide console of machine to user with IPMI's SOL
28
29
Questions?
30
Thank you very much!