The LEAD Portal: An OGCE based weather science gateway
-
Upload
marcuschristie -
Category
Technology
-
view
935 -
download
0
description
Transcript of The LEAD Portal: An OGCE based weather science gateway
The LEAD Portal: An OGCE based weather science gateway
Marcus Christie and Suresh MarruIndiana University
LEAD Project (www.leadproject.org)
The Weather Challenge (WxChallenge)
WxChallenge - LEAD Portal Beta Testers
… and others
So, what’s the value to the participants?
So, what’s the value to the participants?
So, what’s the value to the participants?
So, what’s the value to the participants?
So, what’s the value to the participants?
So, what’s the value to the participants?
So, what’s the value to the participants?
Outcome
•Total participants: 10•Total workflows: 279•Total data storage: 2.6 TB (including non weather challenge participants)
•Total SUs: 52925 (including non weather challenge participants)
•Workflow success rate: 78%/36%
The Architecture of Gateway ServicesThe Users Desktop.The Users Desktop.
Gateway Services
Grid Portal Server
Grid Portal Server
Physical Resource Layer
Core Grid Services
Proxy CertificateServer / vault
Proxy CertificateServer / vault
Application EventsApplication EventsResource BrokerResource Broker
User MetadataCatalog
User MetadataCatalog
Replica MgmtReplica Mgmt
ApplicationWorkflow
ApplicationWorkflow
App. Resourcecatalogs
App. Resourcecatalogs
ApplicationDeployment
ApplicationDeployment
ExecutionManagement
ExecutionManagement
InformationServices
InformationServices
SelfManagement
SelfManagement
DataServices
DataServices
ResourceManagement
ResourceManagement
SecurityServicesSecurityServices
OGSA-like Layer
Info/History
•Staffing: 2 FTE + several graduate students•Fall 2004: Started work on the LEAD Portal (uPortal)
•Spring 2005: Selected GridSphere•Spring 2006: Integrated with BPEL workflow engine and updated metadata schema
•Summer 2006: First went “live” supporting Unidata Users’ Workshop
•Spring 2007: WxChallenge and Spring Forecast experiments
TeraGrid Resources
Big Red
Data CapacitorNCSA’s Tungsten andMercury
SPRUCE at UC
Security: Registering for an account
Security:Verifying Email Address
Security: Email address confirmed
Security: Administrator Approving
Security: Administrator Approving
Security: User gets acceptance email
Security: User can now log in
Security: Verifying user account
A Tale of Two Authorization Systems
LEADLEAD
Portal
- authenticate with identity certificate-verify authorization
GSIGSI
TeraGrid
- community account- proxy certificate
ApplicationService
ApplicationService
AuthZ
App Service
LEAD Architecture + Auditing
LEAD Portal
Notification Broker
GPEL Workflow Engine
App Service
App ServiceAuditingService
GRAM Gatekeeper
1. Portal registers workflow
2. Portal submits workflow
3. WF engine invokesapp services
4. Launch GRAM jobs
5. Audit notifs6. Queries for charge
Challenges, Lessons Learned
•Globus reliability issues– Become best friends with your RPs
•Gateway priorities– Make sure you know for what audience you are
building your gateway
•Security– It’s a lot harder as an afterthought
•Production deployment– You’ll want to be serious about separate
deployments; and it will cost you
Future Work
•Give user’s more control– Allow editing of model configurations– Allow users to burn their own allocations– Allow users to bring in their own software– Running ensembles
•Data-driven workflows•Fault tolerance/monitoring•Repackaging
Wrap Up
•Go to http://portal.leadproject.org to request an account
•For more information about OGCE– Tuesday, 4:30-5:00: Building a Grid Portal for
TeraGrid’s Big Red– Wednesday, 9:30-10:00: Grid Portlets and
Services from the Open Grid Computing Environments (OGCE) Collaboration (Software Provider Forum)
•Questions?