Post on 16-Apr-2017
CloudComputing in
D-Grid
S. Freitag
D-Grid
DGRZR
Cloud atDGRZR
D-Grid andCloudComputing
Cloud Computing in D-GridScience Days 2010
Stefan Freitag
Robotics Research InstituteDortmund University of Technology
03. November 2010
CloudComputing in
D-Grid
S. Freitag
D-Grid
DGRZR
Cloud atDGRZR
D-Grid andCloudComputing
Collaboration of Mad Rocket Scientists
Site B
Site A
Site C
Site D
CloudComputing in
D-Grid
S. Freitag
D-Grid
DGRZR
Cloud atDGRZR
D-Grid andCloudComputing
(D-) Grid
Grid
. . . coordinated resource sharing and problem solving indynamic multi-institutional virtual organizations (Foster/Kesselmann/ Tuecke, 2001)
. . . enables resource virtualization, on-demand provisioning,and service (resource) sharing between organizations(Plaszczak/ Wellner, 2005)
Aim of the German Grid Initiative D-Grid
Establish a national e-infrastructure
Sustainable & longterm Grid infrastructure in GermanyTargeted towards public research and private-publicpartnerships involving SME
CloudComputing in
D-Grid
S. Freitag
D-Grid
DGRZR
Cloud atDGRZR
D-Grid andCloudComputing
Time line
D-Grid started late as other countries like UK or USA startedGrid initiatives in the late 1990s or early 2000s.
CloudComputing in
D-Grid
S. Freitag
D-Grid
DGRZR
Cloud atDGRZR
D-Grid andCloudComputing
Time line
CloudComputing
CloudComputing in
D-Grid
S. Freitag
D-Grid
DGRZR
Cloud atDGRZR
D-Grid andCloudComputing
Projects in D-Grid
In total: 35 projects in D-Grid
Infrastructure & Services
DGI, IVOM, D-MON, SuGI, SLA4D-Grid, . . .
Academic
HEP-CG, C3-Grid, AstroGrid-D, MediGrid, TextGrid, . . .
Academic & SME Cooperation
AeroGrid (T-Systems SfR), BIS-Grid, Biz2Grid, FinGrid(Deutsche Bank, Dresdener Bank), GDI-Grid, . . .
CloudComputing in
D-Grid
S. Freitag
D-Grid
DGRZR
Cloud atDGRZR
D-Grid andCloudComputing
Projects in D-Grid
CloudComputing in
D-Grid
S. Freitag
D-Grid
DGRZR
Cloud atDGRZR
D-Grid andCloudComputing
Compute and Storage Resources
30.000 CPUcores
5 PByte ofstorage
2009: 140 MioCPUh consumedby users
CloudComputing in
D-Grid
S. Freitag
D-Grid
DGRZR
Cloud atDGRZR
D-Grid andCloudComputing
Utilization 2008 2010
9000000AstroGrid-D adBWGrid bw
7000000
8000000
9000000AstroGrid-D adBWGrid bwMediGrid mdTotalLinear (Total)
6000000
7000000
8000000
9000000AstroGrid-D adBWGrid bwMediGrid mdTotalLinear (Total)
4000000
5000000
6000000
7000000
8000000
9000000CPUh
AstroGrid-D adBWGrid bwMediGrid mdTotalLinear (Total)
2000000
3000000
4000000
5000000
6000000
7000000
8000000
9000000CPUh
AstroGrid-D adBWGrid bwMediGrid mdTotalLinear (Total)
1000000
2000000
3000000
4000000
5000000
6000000
7000000
8000000
9000000CPUh
AstroGrid-D adBWGrid bwMediGrid mdTotalLinear (Total)
0
1000000
2000000
3000000
4000000
5000000
6000000
7000000
8000000
9000000
Jul08
Aug08
Sep08
Okt08
Nov0
8
Dez0
8
Jan09
Feb09
Mrz09
Apr09
Mai09
Jun09
Jul09
Aug09
Sep09
Okt09
Nov0
9
Dez0
9
Jan10
Feb10
Mrz10
Apr10
Mai10
Jun10
CPUh
AstroGrid-D adBWGrid bwMediGrid mdTotalLinear (Total)
0
1000000
2000000
3000000
4000000
5000000
6000000
7000000
8000000
9000000
Jul08
Aug08
Sep08
Okt08
Nov0
8
Dez0
8
Jan09
Feb09
Mrz09
Apr09
Mai09
Jun09
Jul09
Aug09
Sep09
Okt09
Nov0
9
Dez0
9
Jan10
Feb10
Mrz10
Apr10
Mai10
Jun10
CPUh
AstroGrid-D adBWGrid bwMediGrid mdTotalLinear (Total)
CloudComputing in
D-Grid
S. Freitag
D-Grid
DGRZR
Cloud atDGRZR
D-Grid andCloudComputing
Current Software Stack
Compute middleware
gLite 3.2
UNICORE 6
Globus Toolkit 4
Storage middleware
dCache 1.9
OGSA-DAI
CloudComputing in
D-Grid
S. Freitag
D-Grid
DGRZR
Cloud atDGRZR
D-Grid andCloudComputing
Software Stack
OGSADAI
Databases
SEdCache
VSiteUNICORE
CEgLite
GRAMWS
Compute Frontends
dCache
Storage Frontends
PoolToolkitGlobus
Torque & MAUIFile
Systems
Online StorageWorker nodes
Functionality of this stack is ensured by running a test bedcontaining all services
CloudComputing in
D-Grid
S. Freitag
D-Grid
DGRZR
Cloud atDGRZR
D-Grid andCloudComputing
Software Stack Extension by CloudVSiteUNICORE CEgLite GRAMWSTorque & MAUIWorker NodesPlatform VirtualizationGlobus ToolkitCloudMiddlewareNew: Platform virtualization and Cloud middleware
CloudComputing in
D-Grid
S. Freitag
D-Grid
DGRZR
Cloud atDGRZR
D-Grid andCloudComputing
Hardware and Service Setup at DGRZR
Compute Middleware
gLite 3.1 and 3.2
UNICORE 5 and 6
Globus Toolkit 4.0.8
Storage Middleware
dCache 1.9.5
OGSA-DAI WSRF 2.2
Hardware
2048 CPU cores, 108 TByte storage
SLES10 SP3 with Xen, all services deployed in VMs
CloudComputing in
D-Grid
S. Freitag
D-Grid
DGRZR
Cloud atDGRZR
D-Grid andCloudComputing
OpenNebula
Statement on homepage
Standard-based open-source toolkit to build private, public andhybrid clouds. [...] provides flexible architecture, interfaces andcomponents that fit into any existing data center.
Supports Xen, KVM and VMware (libvirt)
Interfaces also with Amazon EC2 and ElasticHosts
Other users
CERN (cloud infrastructure consisting of 3,200 cores)
NIKHEF
China Mobile (Big Cloud project)
CloudComputing in
D-Grid
S. Freitag
D-Grid
DGRZR
Cloud atDGRZR
D-Grid andCloudComputing
OpenNebula at Dortmund
Slightly modified ONE 2.0 RC1 (October 2010)
Xen infrastructure and ssh image transfer
User interaction via CLI and management console
CloudComputing in
D-Grid
S. Freitag
D-Grid
DGRZR
Cloud atDGRZR
D-Grid andCloudComputing
Executions Hosts & Virtual Networks
CloudComputing in
D-Grid
S. Freitag
D-Grid
DGRZR
Cloud atDGRZR
D-Grid andCloudComputing
Worker Node Template
NAME = udown300VCPU = 8MEMORY = 13312
OS = [ boo t l o a d e r = / roo t / b in /domUloader . py ]
DISK = [ sou r c e = /wn s l 54 x86 64 . img ,t a r g e t = xvda , r e a don l y = no ]
DISK = [ type = swap , s i z e = 1024 ,t a r g e t = xvdb , r e a don l y = no
]DISK = [ type = b l o ck , c l o n e = yes ,
s ou r c e = / dev/ c c i s s / c0d0p4 ,t a r g e t = xvdc , r e a don l y = no
]NIC = [ NETWORK = DGRZRWorkernodes ,
IP = 129 . 217 . 242 . 166]
CloudComputing in
D-Grid
S. Freitag
D-Grid
DGRZR
Cloud atDGRZR
D-Grid andCloudComputing
Further plans at DGRZR
Present situation
Deployment of worker nodes (Private Cloud)
Access to Cloud interfaces for D-Grid/ external users
Split physical resources in Cloud & Grid partition
Dynamic change of partition sizes
Preemption or suspension of virtual machines priority?Job types: simple batch jobs, MPI jobs, services
Customer classes: bronze, silver, gold
CloudComputing in
D-Grid
S. Freitag
D-Grid
DGRZR
Cloud atDGRZR
D-Grid andCloudComputing
(How) Should D-Grid deal with Clouds?
Situation in 2009
Utilization of compute resources 140 Mio CPUh consumed,but this was only around 50% of the available CPUh
1/2 of D-Grid compute resources are idle
Not really acceptable for a sustainable operation
Introduce compute cloud interface as new pillar
Not only my opinion. . .
Grid is too complex and hence not attractive to SMEs
CloudComputing in
D-Grid
S. Freitag
D-Grid
DGRZR
Cloud atDGRZR
D-Grid andCloudComputing
Grid complexity Resource Access
Grid
Application for X.509 certificate (1-2 days)
Contact Certification authorityContact Registration authority (f2f required)
Application for VO membership (hours - days)
Updating of the authorization information on the Gridresources (hours - days)
Cloud
Register once via e. g. web and specify name, credit cardinformation, . . .
CloudComputing in
D-Grid
S. Freitag
D-Grid
DGRZR
Cloud atDGRZR
D-Grid andCloudComputing
Grid complexity Service Interaction
CloudComputing in
D-Grid
S. Freitag
D-Grid
DGRZR
Cloud atDGRZR
D-Grid andCloudComputing
Cloud-Enabling D-Grid
Project start was on 01.06.2010, duration: 2 years
fluid Operations eCloudManager (eCM)
Self-service component for e. g. application deploymentand resource monitoring
D-Grid operators can use eCM for resource provisioningand data center operations
Accounting & billing modules integrated in eCM
Supports professional storage (NetApp, EMC, . . . )
Supports VMware, XenServer and Hyper-V
Supports EC2 (external)
SAP, LaaS
CloudComputing in
D-Grid
S. Freitag
D-Grid
DGRZR
Cloud atDGRZR
D-Grid andCloudComputing
Open issues
Technical level
User management
Authorization
Accounting & Billing
Monitoring
Information system
Legal issues (e. g. liability)
Legal status of a virtual organization?
Company constituted under Civil law (Gesellschaftburgerlichen Rechts)
Joint and several liability
CloudComputing in
D-Grid
S. Freitag
D-Grid
DGRZR
Cloud atDGRZR
D-Grid andCloudComputing
User management
D-Grid
VO central user management
Resources query VOMRS servers and generate a mappingVO member local user IDAttribute-based authorization
Cloud (OpenNebula)
Local user management, no attributes
To Do
Enable Cloud middleware to query VOM(R)S servers
Can the concept of VOs be supported by cloudmiddleware?
CloudComputing in
D-Grid
S. Freitag
D-Grid
DGRZR
Cloud atDGRZR
D-Grid andCloudComputing
Accounting
D-Grid
Jobs pass along the compute middleware and reach theLRMS
LRMS job accounting information published via DGAS 1
Cloudjobs do not start at LRMS level
Cloud (OpenNebula)
Basic accounting features
To Do
Evaluation of collectable metrics
Translation of this metrics to a D-Grid compatible format
1Distributed Grid Accounting System
CloudComputing in
D-Grid
S. Freitag
D-Grid
DGRZR
Cloud atDGRZR
D-Grid andCloudComputing
Information System
Each Grid middleware uses a separate information system:BDII, CIS, MDS
D-MON2 gathers and aggregates the information
Development of a Cloud middleware adapter
To Do
Which information to publish? Available appliances,hardware limits (#CPU cores, RAM, . . . )
Cloud Resource Broker
2 http://www.d-grid.de/index.php?id=401
http://www.d-grid.de/index.php?id=401
CloudComputing in
D-Grid
S. Freitag
D-Grid
DGRZR
Cloud atDGRZR
D-Grid andCloudComputing
Conclusion and Future Challenges
Conclusion
Cloudification of D-Grid Resource Center Ruhr
Prototypic integration of a cloud middleware
Open issues for integration of compute clouds in D-Grid
Future Challenges
Virtual Organizations in Clouds
Cloudification of D-Grid
Why should Grid providers get cloudy?
Service Level Agreements
CloudComputing in
D-Grid
S. Freitag
D-Grid
DGRZR
Cloud atDGRZR
D-Grid andCloudComputing
Questions?
Slides available:
http://www.slideshare.net/stefanfreitag
BlogGrid at Dortmund
http://gridatdortmund.blogspot.com/
D-GridD-Grid Resource Center RuhrCloud at DGRZRD-Grid and Cloud Computing