Computational Science Portals: Grid Portal Toolkit (GridPort)
Grid Portals
description
Transcript of Grid Portals
![Page 1: Grid Portals](https://reader035.fdocuments.us/reader035/viewer/2022081520/56815a65550346895dc7adc5/html5/thumbnails/1.jpg)
Grid Portals
ITCS 4010 Grid Computing, 2005, UNC-Charlotte, B. Wilkinson.
![Page 2: Grid Portals](https://reader035.fdocuments.us/reader035/viewer/2022081520/56815a65550346895dc7adc5/html5/thumbnails/2.jpg)
Grid Portal
• “A web-based application server enhanced with the necessary software to communicate to grid services and resources”
• “Provides application scientist a customized view of software and hardware resources from a web browser” [1]
[1] “Grid Computing Making the Global Infrastructure a Reality” ed. F. Berman, G. C. Fox and A. J. G. Hey, Wiley, 2003, Chapter 27 “The Grid portal development kit” by J. Novotny.
![Page 3: Grid Portals](https://reader035.fdocuments.us/reader035/viewer/2022081520/56815a65550346895dc7adc5/html5/thumbnails/3.jpg)
From a paper “GridSphere: A Portal Framework For Building Collaborations” by J. Novotny, M. Russell, and O. Wehrens
![Page 4: Grid Portals](https://reader035.fdocuments.us/reader035/viewer/2022081520/56815a65550346895dc7adc5/html5/thumbnails/4.jpg)
Grid Portals• Uses a Web browser interface
– Can use from anywhere.
• Hides details of Grid middleware– Good!!
![Page 5: Grid Portals](https://reader035.fdocuments.us/reader035/viewer/2022081520/56815a65550346895dc7adc5/html5/thumbnails/5.jpg)
Grid Portals• Provides
– Access to grid information– Access to grid services– Automated execution of applications/jobs– Workflow management– File management– Single sign-on to grid resources
![Page 6: Grid Portals](https://reader035.fdocuments.us/reader035/viewer/2022081520/56815a65550346895dc7adc5/html5/thumbnails/6.jpg)
Access to Grid Services• Security Services
– management of certificates– access to virtual organization (people)
• Remote File Management– access to files and directories– moving files
• Remote job management– job submission– workflow management
![Page 7: Grid Portals](https://reader035.fdocuments.us/reader035/viewer/2022081520/56815a65550346895dc7adc5/html5/thumbnails/7.jpg)
Access to Information
• Portals also provide access to information -- anything related to tasks at hand, including communication with virtual organization.
• In fact, some portals started simply as informational portals in the same vein as web portals such as yahoo.
![Page 8: Grid Portals](https://reader035.fdocuments.us/reader035/viewer/2022081520/56815a65550346895dc7adc5/html5/thumbnails/8.jpg)
Grid Portal Toolkit History
Several portal “toolkits” developed since mid-1990’s.
Used for application specific grid projects, orfor general-purpose grid portals
![Page 9: Grid Portals](https://reader035.fdocuments.us/reader035/viewer/2022081520/56815a65550346895dc7adc5/html5/thumbnails/9.jpg)
Three-tiered architectureTypical arrangement on early grid portals
From: The Grid Core Technologies by M. Li and M Baker, Wiley, 2005
![Page 10: Grid Portals](https://reader035.fdocuments.us/reader035/viewer/2022081520/56815a65550346895dc7adc5/html5/thumbnails/10.jpg)
Proxy Credential server
• Commonly “myProxy” credential management system.
• Used to store grid credentials that can be retrieved as needed to renew credentials for long running jobs etc.
![Page 11: Grid Portals](https://reader035.fdocuments.us/reader035/viewer/2022081520/56815a65550346895dc7adc5/html5/thumbnails/11.jpg)
Early Portal Toolkit Examples
1990s:• The Grid Portal Development Kit
(GPDK) (not now supported)– Used Java Server Pages (JSPs) fro
prosentation layer, and JavaBeans to access backend.
• NPACI Grid Portal Toolkit (Gridport) (National Partnership for Advanced Computational Infrastructure)
![Page 12: Grid Portals](https://reader035.fdocuments.us/reader035/viewer/2022081520/56815a65550346895dc7adc5/html5/thumbnails/12.jpg)
• GridPort 2.0– Perl-based Grid portal toolkit
• Ninf Portal– JSP/Java Servlet front-end– GridSpeed portal, an extension of
Ninf
![Page 13: Grid Portals](https://reader035.fdocuments.us/reader035/viewer/2022081520/56815a65550346895dc7adc5/html5/thumbnails/13.jpg)
![Page 14: Grid Portals](https://reader035.fdocuments.us/reader035/viewer/2022081520/56815a65550346895dc7adc5/html5/thumbnails/14.jpg)
Application-Based Portals
• Portals often specialized to a particular application.– for example, grid portal for high energy
physics.
• Portal toolkits give ability to taylor portal to application or user.
![Page 15: Grid Portals](https://reader035.fdocuments.us/reader035/viewer/2022081520/56815a65550346895dc7adc5/html5/thumbnails/15.jpg)
MPI program
Starting job
From a paper”Building GridPortals: The NPACI Grid Portal Toolkit” by M. P. Thomas and J. R. Boisseau.
NPACI Hotpage Grid portal(based upon GridPort)
![Page 16: Grid Portals](https://reader035.fdocuments.us/reader035/viewer/2022081520/56815a65550346895dc7adc5/html5/thumbnails/16.jpg)
Adapted from slides “The NCSA Alliance Portal and the Open Grid Computing Environment Project” by D. Gannon, G. Fox, B. Plale, M. Pierce, M. Thomas, C. Severance, G. von Lazewski, and J. Alameda.
![Page 17: Grid Portals](https://reader035.fdocuments.us/reader035/viewer/2022081520/56815a65550346895dc7adc5/html5/thumbnails/17.jpg)
DOE Fusion Grid Portal
Adapted from slides “Reuseable Grid Portral Components” by M Thomas.
![Page 18: Grid Portals](https://reader035.fdocuments.us/reader035/viewer/2022081520/56815a65550346895dc7adc5/html5/thumbnails/18.jpg)
Linked Environments for Atmospheric Discovery (LEAD)
Adapted from slides “Reuseable Grid Portral Components” by M Thomas.
![Page 19: Grid Portals](https://reader035.fdocuments.us/reader035/viewer/2022081520/56815a65550346895dc7adc5/html5/thumbnails/19.jpg)
NEES – www.neesgrid.org• George E. Brown, Jr. Network for Earthquake
Engineering Simulation– Large Installations of physical equipment for
earthquake experiments and simulations– Part of the award is to make equipment available
for remote collaborators
• Focus is on collaboration and experimental equipment sharing in addition to access to computation
From slides “The NCSA Alliance Portal and the Open Grid Computing Environment Project” by D. Gannon, G. Fox, B. Plale, M. Pierce, M. Thomas, C. Severance, G. von Lazewski, and J. Alameda.
![Page 20: Grid Portals](https://reader035.fdocuments.us/reader035/viewer/2022081520/56815a65550346895dc7adc5/html5/thumbnails/20.jpg)
Network for Earthquake Eng. and Simulation (NEESGrid)
Adapted from slides “Reuseable Grid Portral Components” by M Thomas.
![Page 21: Grid Portals](https://reader035.fdocuments.us/reader035/viewer/2022081520/56815a65550346895dc7adc5/html5/thumbnails/21.jpg)
• Early grid portals “tools” not very flexible.
• Tied to specific programming tools and grid software, such as Globus 2.4.
• Specific programming structure not suitable for users to develop portals themselves.
• Not standardized APIs.
![Page 22: Grid Portals](https://reader035.fdocuments.us/reader035/viewer/2022081520/56815a65550346895dc7adc5/html5/thumbnails/22.jpg)
Portal Implementation
• Should be flexible, meet grid industry standards, be able to be extended using parts developed by others.
• General approach currently is to use “software components” called portlets.
![Page 23: Grid Portals](https://reader035.fdocuments.us/reader035/viewer/2022081520/56815a65550346895dc7adc5/html5/thumbnails/23.jpg)
Software Component
• Object defined by precise public interface and includes a set of standard behaviors.
• Software components contained in a framework.
• Components follow a set of rules to interoperate.
• Installation of components should be easily done.
![Page 24: Grid Portals](https://reader035.fdocuments.us/reader035/viewer/2022081520/56815a65550346895dc7adc5/html5/thumbnails/24.jpg)
Portals with Portlets• Portal server consists of portlets• Each portlet provides certain functionality
and a window within the portal.• Each portlet can be associated with a
particular grid service• User can have any number of portlets as
he/she wishes (will be associated with user’s persistent context).
![Page 25: Grid Portals](https://reader035.fdocuments.us/reader035/viewer/2022081520/56815a65550346895dc7adc5/html5/thumbnails/25.jpg)
Portlets provided for:
– Management of user proxy certificates– Remote file Management via Grid FTP– News/Message systems
• for collaborations– Grid Event/Logging service– Access to OGSA services – Access to directory services– Specialized Application Factory access
• Distributed applications• Workflow
– Access to Metadata Index tools• User searchable index
![Page 26: Grid Portals](https://reader035.fdocuments.us/reader035/viewer/2022081520/56815a65550346895dc7adc5/html5/thumbnails/26.jpg)
Portal Server
MyProxyServer
MetadataDirectoryService(s)
Directory& indexServices
ApplicationFactoryServices
Messagingand group
collaboration
Event andlogging
Services
Portal Server
Adapted from slides “The NCSA Alliance Portal and the Open Grid Computing Environment Project” by D. Gannon, G. Fox, B. Plale, M. Pierce, M. Thomas, C. Severance, G. von Lazewski, and J. Alameda.
![Page 27: Grid Portals](https://reader035.fdocuments.us/reader035/viewer/2022081520/56815a65550346895dc7adc5/html5/thumbnails/27.jpg)
Portlet Approach to Grid Services
Portal Server
MyProxyServer
MetadataDirectoryService(s)
Directory& indexServices
ApplicationFactoryServices
Messagingand group
collaboration
Event andlogging
Services
Portlet1
Portlet2
Portlet3
Portlet4
Portlet5
Portlet6
Adapted from slides “The NCSA Alliance Portal and the Open Grid Computing Environment Project” by D. Gannon, G. Fox, B. Plale, M. Pierce, M. Thomas, C. Severance, G. von Lazewski, and J. Alameda.
![Page 28: Grid Portals](https://reader035.fdocuments.us/reader035/viewer/2022081520/56815a65550346895dc7adc5/html5/thumbnails/28.jpg)
A Pane and portlet
ProxyManagerPortlet
The currentVisible pane
Adapted from slides “The NCSA Alliance Portal and the Open Grid Computing Environment Project” by D. Gannon, G. Fox, B. Plale, M. Pierce, M. Thomas, C. Severance, G. von Lazewski, and J. Alameda.
![Page 29: Grid Portals](https://reader035.fdocuments.us/reader035/viewer/2022081520/56815a65550346895dc7adc5/html5/thumbnails/29.jpg)
Advantages of Portlet Approach• Easy to add new grid services and reconfigure
user’s view (context)
• Different software developers can provide portals to be plugged into portal– Many parties developing portal and portlet tools --
Jetspeed (Apache), Websphere (IBM), GridSphere, …
• Portal/portlet standard called JSR 168 emerging (portlet Java Specification Request open standard).
![Page 30: Grid Portals](https://reader035.fdocuments.us/reader035/viewer/2022081520/56815a65550346895dc7adc5/html5/thumbnails/30.jpg)
Portal Layout
![Page 31: Grid Portals](https://reader035.fdocuments.us/reader035/viewer/2022081520/56815a65550346895dc7adc5/html5/thumbnails/31.jpg)
National Science FoundationMiddleware Initiative (NMI)
• Started in 2001 initially over 3 years “to create and deploy advanced network services that simplify access to diverse Internet information and services.”
• Provides a centralized location for important grid software.
• Current NMI package includes Globus, Condor, MPI-G2, and:– a new grid portal project called OGCEGrid
(funding started Sept 2003).
![Page 32: Grid Portals](https://reader035.fdocuments.us/reader035/viewer/2022081520/56815a65550346895dc7adc5/html5/thumbnails/32.jpg)
Consortium established “Fall 2003 to foster collaborations and shareable components
with portal developers worldwide”
The following screenshots taken from http://www.ogce.org
![Page 33: Grid Portals](https://reader035.fdocuments.us/reader035/viewer/2022081520/56815a65550346895dc7adc5/html5/thumbnails/33.jpg)
Membership:Join/participate in different topic groups (Group tabs across top).
![Page 34: Grid Portals](https://reader035.fdocuments.us/reader035/viewer/2022081520/56815a65550346895dc7adc5/html5/thumbnails/34.jpg)
Schedule: Maintain a personal or group calendar.
![Page 35: Grid Portals](https://reader035.fdocuments.us/reader035/viewer/2022081520/56815a65550346895dc7adc5/html5/thumbnails/35.jpg)
Resources:Users and groups can upload/share documents and URLs.
![Page 36: Grid Portals](https://reader035.fdocuments.us/reader035/viewer/2022081520/56815a65550346895dc7adc5/html5/thumbnails/36.jpg)
Discussion:Participate in discussions with other members of your group
![Page 37: Grid Portals](https://reader035.fdocuments.us/reader035/viewer/2022081520/56815a65550346895dc7adc5/html5/thumbnails/37.jpg)
Chat:Engage other members of your group in online discussion.
![Page 38: Grid Portals](https://reader035.fdocuments.us/reader035/viewer/2022081520/56815a65550346895dc7adc5/html5/thumbnails/38.jpg)
Proxy Manager and Job Submit:Obtain/manage Grid credentials to access Grid resources through browser.
Also shown are GRAM job launchers and sample "ping" portlet.
![Page 39: Grid Portals](https://reader035.fdocuments.us/reader035/viewer/2022081520/56815a65550346895dc7adc5/html5/thumbnails/39.jpg)
LDAP Browser: Navigate LDAP server of your choice.
![Page 40: Grid Portals](https://reader035.fdocuments.us/reader035/viewer/2022081520/56815a65550346895dc7adc5/html5/thumbnails/40.jpg)
Grid FTP: Use your credential to browse remote directories/upload/download files.
![Page 41: Grid Portals](https://reader035.fdocuments.us/reader035/viewer/2022081520/56815a65550346895dc7adc5/html5/thumbnails/41.jpg)
Grid Context:Store arbitrary web objects (movies, web pages, audio
files) in a customizable, annotated directory tree.
![Page 42: Grid Portals](https://reader035.fdocuments.us/reader035/viewer/2022081520/56815a65550346895dc7adc5/html5/thumbnails/42.jpg)
GridPort Information Repository Portlets:Several GPIR portlets available for browsing.
![Page 43: Grid Portals](https://reader035.fdocuments.us/reader035/viewer/2022081520/56815a65550346895dc7adc5/html5/thumbnails/43.jpg)
GridPort Job Sequencing Portlets To set up sequences of jobs through a scheduler.
![Page 44: Grid Portals](https://reader035.fdocuments.us/reader035/viewer/2022081520/56815a65550346895dc7adc5/html5/thumbnails/44.jpg)
Anabas Impromptu: real time shared display, audio, and chats.
![Page 45: Grid Portals](https://reader035.fdocuments.us/reader035/viewer/2022081520/56815a65550346895dc7adc5/html5/thumbnails/45.jpg)
Newsgroups:Portlets allow users to participate in/administer online newsgroup.
![Page 46: Grid Portals](https://reader035.fdocuments.us/reader035/viewer/2022081520/56815a65550346895dc7adc5/html5/thumbnails/46.jpg)
OGRE Demo: use of OGRE for job management.
![Page 47: Grid Portals](https://reader035.fdocuments.us/reader035/viewer/2022081520/56815a65550346895dc7adc5/html5/thumbnails/47.jpg)
Java CoG Workflow:Portlet allows you to set up a Java CoG-based Workflow.
![Page 48: Grid Portals](https://reader035.fdocuments.us/reader035/viewer/2022081520/56815a65550346895dc7adc5/html5/thumbnails/48.jpg)
Application Management:Example interface around MyProxy, GRAM, and GridFTP.
![Page 49: Grid Portals](https://reader035.fdocuments.us/reader035/viewer/2022081520/56815a65550346895dc7adc5/html5/thumbnails/49.jpg)
Condor Portlets:To submit and monitor jobs through Condor.