Introduction to GridsIntroduction to GridsBy: Fetahi Z. WuhibBy: Fetahi Z. Wuhib

[CSD2004-Team19][CSD2004-Team19]

DefinitionDefinition

A grid is a software framework providing layers of A grid is a software framework providing layers of services to access and manage services to access and manage distributeddistributed hardware hardware and software resourcesand software resources Owned by different organizationsOwned by different organizations Resource location immaterial as long as connected through a Resource location immaterial as long as connected through a

computer networkcomputer network

Grid computing aims at creating a simple, large, powerful Grid computing aims at creating a simple, large, powerful and self managing virtual computer from Virtual and self managing virtual computer from Virtual OrganizationsOrganizations

A Virtual Organization [VO] is a group of people or A Virtual Organization [VO] is a group of people or institutions with some common purpose or interest that institutions with some common purpose or interest that want to share and use resourceswant to share and use resources Common sharing rulesCommon sharing rules

What are the resources?What are the resources?

Computation power: run applications on the gridComputation power: run applications on the grid Requires an application to be split into separate parts Requires an application to be split into separate parts

to run on different processors to run on different processors StorageStorage

Primary/Secondary storagePrimary/Secondary storage Striping/mirroring/replica’sStriping/mirroring/replica’s

Communication linksCommunication links Software/application and/or licensesSoftware/application and/or licenses Special equipmentSpecial equipment etcetc

Internet Vs GridInternet Vs Grid

Just as the World Wide Web allows people Just as the World Wide Web allows people to share content via Internet protocols, grid to share content via Internet protocols, grid computing---allows widely dispersed computing---allows widely dispersed organizations to share resourcesorganizations to share resources

Grid software componentsGrid software components

Management softwareManagement software Keep track of resources and usersKeep track of resources and users

Donor softwareDonor software Running on machines contributing resourcesRunning on machines contributing resources

Submission softwareSubmission software Used to submit “jobs”Used to submit “jobs”

SchedulesSchedules Assign “jobs” to resourcesAssign “jobs” to resources

Requirements for a GridRequirements for a Grid

A grid should allow a highly controlled, A grid should allow a highly controlled, direct access “sharing” relationship direct access “sharing” relationship between any potential participantsbetween any potential participants Interoperability is a key issue Interoperability is a key issue Protocols Protocols Standard services made available over the Standard services made available over the

protocolsprotocols Applications should be developed so that they Applications should be developed so that they

will be able to run over the “grid” will be able to run over the “grid” SDK/API SDK/API

Grid ArchitectureGrid Architecture

Layered architectureLayered architecture Protocols at each Protocols at each

layer build on the layer build on the capabilities of lower capabilities of lower layerslayers

Architecture neck at Architecture neck at collective/Resource collective/Resource layerlayer Minimal set of Minimal set of

protocols allow many protocols allow many high level appshigh level apps

Grid

Pro

toco

l Arc

hite

ctur

e

Application

Collective

Resource

Fabric

Connectivity

FabricFabric

Interface to local controlInterface to local control Provides resources to which access is mediated by Provides resources to which access is mediated by

the grid protocolsthe grid protocols Implements local operations that occur as a Implements local operations that occur as a

result of higher layer applicationsresult of higher layer applications Include computational resources, storage Include computational resources, storage

systems, applications, network resources, etcsystems, applications, network resources, etc Employ “local” protocols to achieve desired Employ “local” protocols to achieve desired

operationoperation If “local” protocol lacks required functionality, this If “local” protocol lacks required functionality, this

layer fills in the gap.layer fills in the gap.

ConnectivityConnectivity

Define core communication/authentication Define core communication/authentication protocolsprotocols Communication protocols are used to Communication protocols are used to

exchange data between fabric layer resourcesexchange data between fabric layer resources Include transport, routing and naming Include transport, routing and naming

protocolsprotocols Currently protocols form the TCP/IP stack are Currently protocols form the TCP/IP stack are

used [IP/TCP/UDP/DNS/OSPF]used [IP/TCP/UDP/DNS/OSPF]

……connectivityconnectivity

Authentication protocol should supportAuthentication protocol should support Single sign onSingle sign on DelegationDelegation Interoperability with existing protocolsInteroperability with existing protocols User based trust User based trust

Existing authentication protocols don’t Existing authentication protocols don’t support the above listed characteristicssupport the above listed characteristics A new protocol that extends over existing A new protocol that extends over existing

authentication protocols is requiredauthentication protocols is required

ResourceResource

Sharing a Sharing a singlesingle resource through underlying resource through underlying communication protocolscommunication protocols

Two major classesTwo major classes Information protocols: state of the resource, e.g. load, Information protocols: state of the resource, e.g. load,

costcost Management protocols: negotiate access to a Management protocols: negotiate access to a

resourceresource

Forms the neck of the grid architecture: should Forms the neck of the grid architecture: should define a small and focused sets that capture the define a small and focused sets that capture the fundamental sharing mechanismsfundamental sharing mechanisms

CollectiveCollective

Coordinating Coordinating multiplemultiple resources unlike the resources unlike the underlying layerunderlying layer Interactions across multiple resourcesInteractions across multiple resources

Domain minimized from general to highly Domain minimized from general to highly application specificapplication specific

E.g. E.g. Directory Services used to display existence Directory Services used to display existence

/availability of resources/availability of resources Monitoring and diagnostics services support Monitoring and diagnostics services support

monitoring of VO resources for failures, overload, monitoring of VO resources for failures, overload, congestion, intrusion, etccongestion, intrusion, etc

ApplicationsApplications

User applications that operate within a VO User applications that operate within a VO environmentenvironment

Constructed by calling upon services Constructed by calling upon services defined at any of the lower layersdefined at any of the lower layers

The Globus ToolkitThe Globus Toolkit

Open source software toolkit used for Open source software toolkit used for building gridsbuilding grids

Developed by the Globus AllianceDeveloped by the Globus Alliance addresses issues of security, information addresses issues of security, information

discovery, resource management, data discovery, resource management, data management, communication, fault management, communication, fault detection, and portabilitydetection, and portability

……the Globus Toolkitthe Globus Toolkit

Based on the GSI (Grid Security Based on the GSI (Grid Security Infrastructure)Infrastructure)

Three major componentsThree major components Resource management [GRAM]Resource management [GRAM] Information services [MDS]Information services [MDS] Data management [GridFTP]Data management [GridFTP]

What next??What next??

Globus server bundle installation Globus server bundle installation successfulsuccessful

Study the 3 major components of GlobusStudy the 3 major components of Globus Give special focus on GridFTPGive special focus on GridFTP P2P file sharing??P2P file sharing??

Study the possibility of implementing this Study the possibility of implementing this interfaceinterface

Tack så mycket!Tack så mycket!