1. The Cirrus & Cumulus Project:Build a Scientific Cloud for a Data Center Lizhe Wang and Marcel Kunze Steinbuch Centre for Computing (SCC) Karlsruhe Institute of Technology (KIT)Germany

2. Karlsruhe Institute of Technology (KIT)

Cooperation between Research Centre Karlsruhe und Karlsruhe University

Largest scientific center in Germany

8.000 scientists, 18.000 students

Annual budget: > 500 Million Euro

R&D focus: Energy research and Nanotechnology

> + 3. Google Trends: Grid Computing vs. Cloud Computing |Autor|Steinbuch Centre for Computing|06.09.2007 4. OpenCirrus Cloud Computing Research Testbed http://cloudtestbed.com

An open, internet-scale global testbed for cloud computing research

• a tool for collaborative research

• focus: data center management & cloud services

Resources:

• Multi-continent, multi-datacenter, cloud computing system

• Centers of Excellence around the globe

• • each with 100400+ nodes and up to ~2PB storage

• • and running a suite of cloud services

Structure: a loose federation

• Sponsors: HP Labs, Intel Research, Yahoo!

• Partners: UIUC, Singapore IDA, KIT, NSF

• Members: System and application development

Available towards end of the year

Great opportunity for Cloud R&D

May 21, 2010 Hewlett-Packard Company 5. Physical and Virtual Resource Sets (PRS, VRS) experiment save/restore 6. A possible Definition of Cloud Computing

Definition

• A computing Cloud is a set of network enabled services, providing scalable, QoS guaranteed, inexpensive computing platforms on demand, which could be accessed in a simple and pervasive way .

Functionalities

• SaaS: Software as a Service

• HaaS: Hardware as a Service

• DaaS: Data as a Service

• PaaS: Platform as a Service

• IaaS:Infrastructure as a Service

7. Anatomy of Cloud Computing

Key features

• User-centric access

• On-demand service provisioning

• QoS guaranteed offer

• Autonomy

• Scalability & flexibility

Enabling technologies

• Virtualization

• Service flow/workflow orchestration

• Web service & SOA

• Web 2.0

• World-wide distributed storage & file system

• Parallel & distributed programming model

8. Clouds vs. Grids: A Comparison Difficult use and deploymentNeed new user interface, e.g., commands, APIs, SDKs, services Easy to use/deploy, no complex user interface required User interface Special application domains like High Energy Physics Suited for generic applications ApplicationWell developed, maintained and documented Proprietary, several reference implementations exist (e.g. Amazon) Middleware Publicly funded: Use for freeCommercial: Pay-as-you-go Business ModelGeographically distributed, heterogeneous resource, no central control, VO Research and academic organization One or few data centers, heterogeneous/homogeneous resource under central control,Industry and Business Infrastructure Resource sharingJob executionProvide desired computing platform via network enabled services Objective No Yes On-demand provisioning Little supportPossibleQoSHPC, Grid infrastructure, middleware, Virtualization, SaaS, Web 2.0, Web service, Enablingtechnology Grid Computing Cloud Computing 9. Cumulus: A Cloud Computing Prototype 10. Re-engineering the Globus Virtual Workspace Service (GVWS)

GVWS Limitations

• Force all backends to install GVWS control agents

• Cloud users need to select network solutions

• Cloud users need to prepare VM images

Re-engineering the GVWS for the Cumulus

• Remove GVWS control agents, GVWS frontend talks directly to LVMS, e.g., OpenNEbula

• • Consider the similar scenario: Globus + PBS

• The forward network requirements to LVMS

• Prepare VM image via OS Farm for users

11. OpenNEbula as a Backend

TheCumulusfrontend communicates with OpenNEbula via:

• SSH

• XML-RPC

Improvement

• NISLDAP: shared user management -oneadmin

• NFS OCFS (Oracle Cluster File System):shared volumes for VM images

Can develop other plug-in, embedded in theCumulusfrontend, for other LVMS, e.g., VMware Virtual Infrastructure

12. OS Farm as a VM Provisioning Tool

Development of CERN OpenLab

OS Farm as server to generate VM images

Can accept HTTP requirements, or viawget:

• wget http://www.fzk.de/osfarm/create?name=&transfer=http&

• class=slc_old&arch=i386&filetype=.tar&group=core&group=base

A Java client is embedded in the Cumulus frontend to invoke OS Farm service dynamically.

13. The forward Network Solution

Users do not need to specify the network configuration of a VM

Users only get network access to VM, e.g., IP address or hostname + domain name

Cumulusforwards the network requirements to backend (LVMS), e.g., OpenNEbula

Network solutions onCumulusbackend:

• OpenNEbula starts a VM, listens to central DHCP server, arranges an IP address to VM, returns it toCumulusfrontend

• Set hostname when the virtual machine is created

• Lease an IP address from the IP pool

Cumulusfrontend returns the IP address or the host name to the client.

14. Thank you! Question? Contact:Lizhe Wang, Marcel Kunze Steinbuch Centre for Computing (SCC)Karlsruhe Institute of Technology (KIT)Hermann-von-Helmholtz-Platz 1D-76344 Eggenstein-Leopoldshafen, Germany[email_address] [email_address]