An Overview of the Open Grid Forum (v2) · • Craig A. Lee, President • The Aerospace...
Transcript of An Overview of the Open Grid Forum (v2) · • Craig A. Lee, President • The Aerospace...
© 2006 OpenGridForum
An Overview of the
Open Grid Forum (v2)
2009
www.ogf.org
© 2007 OpenGridForum 2
The OGF Mission Statement
" OGF is an open community committed to
driving the rapid evolution and adoption of
applied distributed computing. Applied
Distributed Computing is critical to developing
new, innovative and scalable applications and
infrastructures that are essential to
productivity in the enterprise and within the
science community."
© 2007 OpenGridForum
How Do We Do This?
• Community Building & Outreach
• Best Practices & Standards
3
© 2007 OpenGridForum
Why Do We Do This?
• Distributed Computing Systems are –
well – distributed
• Geographically distributed
• Resources
• Administrative Organizations
• Users
• Enabling the integration and use of
such resources on the behalf of all
stakeholders requires a venue like OGF
4
© 2007 OpenGridForum 5
Example of an OperationalDistributed Infrastructure: EGEE
Community, Best Practices & Standards
Make This Possible Across Six Continents
© 2007 OpenGridForum
An Overview of the Overview
• An Introduction to the Organization
• Current Products
• Impacts
• Vision & Evolutionary Directions
6
© 2007 OpenGridForum 7
OGF Organizational Structure
OGF
Europe
© 2007 OpenGridForum 8
OGF Leadership
• Craig A. Lee, President
• The Aerospace Corporation
• Chris Smith, VP Standards
• Platform Computing
• Ian Osborne, VP Enterprise
• Intellect UK
• David Wallom, VP e-Research
• Oxford e-Research Centre
• Joel Replogle, Director
• OGF
© 2007 OpenGridForum 9
OGF Board of Directors
• Steven Newhouse, Chairman, Technical Director, EGEE
• Charlie Catlett, Argonne National Lab
• Wolfgang Gentzsch, DEISA
• Andrew Grimshaw, University of Virginia
• Neil Chue Hong, University of Southampton
• Hiro Kishimoto, Fujitsu
• Silvana Muscella, Trust-IT Services/OGF-Europe
• Satoshi Sekiguchi, AIST
• Walter Stewart, CANARIE
• Paul Strong, eBay
© 2007 OpenGridForum 10
A Little History
• June 1999
• First Grid Forum meeting
• NASA Ames, Mountain View, California
• March 2001
• First Global Grid Forum
• NIKHEF/SARA, Amsterdam
• June 2006
• Merged with the Enterprise Grid Alliance to become
the Open Grid Forum
• February 2008
• OGF-Europe funded
© 2007 OpenGridForum
OGF-EUROPE:
Making an impact
• Promoting the value of standardisation to enable
innovation
• Industry Expert Group
• Connecting user groups to share best practices &
transform them into standards
• Community Outreach Seminars
• Supporting the development and implementation
of European standards with end-users,
developers, diverse groups
• International Events
• Ensuring OGF standards are aligned with the
needs of European stakeholders
11
© 2007 OpenGridForum 12
Method of Operations
• Working groups• Chartered to define a standard through one or more
documents according to a schedule with milestones
• Research groups• Chartered to investigate any interesting topic by running
workshops and writing documents (except standards)
• Community groups• Chartered to build community by identifying requirements,
common practices, running workshops, and writingdocuments (except standards)
• Three meetings a year• Plenaries
• Workshops
• Group sessions
• Birds-of-a-Feather meetings (BoFs)
• Co-location with other relevant organizations
© 2007 OpenGridForum
How These Work Together
13
© 2007 OpenGridForum
The Standards Council
14
© 2007 OpenGridForum
The Enterprise Council
15
© 2007 OpenGridForum
The e-Research Council
16
© 2007 OpenGridForum
An Overview of the Overview
• An Introduction to the Organization
• Current Products
• Impacts
• Vision & Evolutionary Directions
17
© 2007 OpenGridForum 18
The OGF Document Series
• OGF documents produced through an open processmanaged by the OGF Editor• Groups submit drafts through Area Director
• Editor reviews for clarity and format
• Manages public comment period
• Assigns GFD number
• Document types (number as of May 2009)• GFD-I -- Informational Document (73)
• GFD-E -- Experimental Document (14)
• GFD-C -- Community Practice (12)
• GFD-R -- Recommendation (32)
• http://www.ogf.org/ggf_docs_final.htm
© 2007 OpenGridForum 19
OGF Compute-Related Standards
Job ManagementOGSA-BES(GFD 108)
HPC Domain Specific ProfileHPC Basic Profile
(GFD 114)
ArchitectureOGSA EMS Scenarios
(GFD 106)
Use CasesGrid Scheduling Use Cases
(GFD 64)
EducationISV Primer(GFD 141)
AgreementWS-Agreement
(GFD 107)
Programming InterfaceDRMAA
(GFD 22/133)
Programming InterfaceSAGA
(GFD 90)
AccountingUsage Record
(GFD 98)
InformationGLUE Schema
(Draft)
Job Definition
File TransferHPC File Staging
(GFD 135)
Job DescriptionJSDL
(GFD 56/136)
Application DescriptionHPC Application
(GFD 111)
Application DescriptionSPMD Application
(GFD 115)
Job ParameterizationParameter Sweep
(Draft)
Extend
Uses
Produces
Describes
Supports
Profiles
© 2007 OpenGridForum 20
OGF Data-Related Standards
UnstructuredData
(Disk, Tape)
StructuredData
(Database)
Storage ManagementSRM (GFD 129)
AccessByte-I/O (GFD 87/88)
TransportGridFTP (GFD 20)
Access & ManagementDAIS (GFD 74,75,76)
NamingRNS (GFD 101)
MovementDMI (GFD 134)
Data FormatDescription Language
Information DisseminationInfoD (GFD 110)
Storage NetworkCommunity
Existing
Possible
© 2007 OpenGridForum 21
Job Definition
HPC Basic Profile
File TransferHPC File Staging
(GFD 135)
Job DescriptionJSDL
(GFD 56/136)
Job ManagementOGSA-BES(GFD 108)
HPC Specific Job ManagementHPC Basic Profile
(GFD 114)
Application DescriptionHPC Application
(GFD 111)
SecuritySSL/TLS(IETF)
SecurityWS-Security
(OASIS)
Extend
Uses
Compute Resources
Provides Access To
Combines
References EducationISV Primer(GFD 141)
© 2007 OpenGridForum 22
Running Applications Remotely
• ISV Remote Computing Usage Primer, GFD-I.141
• How to use sets of OGF standards for different scenarios
• www.ogf.org/RemoteExecution
© 2007 OpenGridForum
An Overview of the Overview
• An Introduction to the Organization
• Current Products
• Impacts
• Vision & Evolutionary Directions
23
© 2007 OpenGridForum
Impacts
• Impacts Material Goes Here
24
© 2007 OpenGridForum
An Overview of the Overview
• An Introduction to the Organization
• Current Products
• Impacts
• Vision & Evolutionary Directions
25
© 2007 OpenGridForum 26
Vast Array of ApplicationScenarios Driving Evolution
Data Center Migration
© 2007 OpenGridForum 27
Strategy to Achieve this Vision
• Strategy
• Proactively lead the development of newdistributed computing technologies relevantto our stakeholders
• Engage with all relevant organizations anduser groups working on the same goals
• Current OGF Strategic Activities
• Grids and Clouds
• Cyberinfrastructure Requirements
• Production Grid Interoperability
• Geospatial Application Domains
© 2007 OpenGridForum 28
OGF Cloud Leadership
• OCCI is a major effort that could gain traction in the cloud arena• Important group members and very active mailing list
• Pushing for cloud coordination with industry and other SDOs• SATCCI Meeting, March 23, DC
• federalcloudcomputing.wik.is/index.php?title=March_23%2C_2009
• SCRM telecons• IBM, Cisco, Sun, Fujitsu, OCC, NIST attended last call• Organizations to post cloud activity summaries on SRCM wiki
• Cloud Standards Summit, July 13, DC• federalcloudcomputing.wik.is/July_15%2c_2009• Originally scheduled for July 15 but moved to accommodate the following
• Cloud Computing Symposium, July 15, DC• Hosted by National Defense University, www.ndu.edu/irmc/ilss/ilss_events.html• Vivek Kundra (US Federal CIO) to keynote• Cloud Standards Summit trying to get an outbrief slot
• CloudWorld• Co-located w/ NGDC and OpenSource World, August 12-13, San Francisco• OGF personnel on CloudWorld Program and Advisory Committees• Chris Smith (OGF VP Standards) to present on behalf of OGF Enterprise
• OGF-27 Workshops (proposed): “Grid to Cloud” and “HPC in Cloud”
• Goals:• Identify concrete coordination activities before July 13 meeting• Increase cloud work -- and membership -- in OGF
© 2007 OpenGridForum 29
CyberInfrastructure Requirements
• Series of three workshops to provide input to both
• EGEE to EGI transition, and
• TeraGrid to XD transition
• Primary focus: community requirements for interoperability
• First workshop (OGF-26) concentrated on the methods
used in previous requirements gathering exercises:
• UK e-Science, UK NGS, TeraGrid and Globus
• OGF informational document will be produced on this session
describing the benefits and disadvantages of different methods of
information capture
• Subsequent workshops at Banff (OGF-27) and Munich
(OGF-28) to analyze requirements data and make
concrete recommendations
© 2007 OpenGridForum 30
Production Grids
• Production Grid Infrastructures WG formed to nail-down
interoperability standards
• Follow-on to Grid Interoperation Now (GIN) Community Group
• Includes EGEE, OSG, NAREGI, NorduGrid, TeraGrid, NGS
• Ambitious charter including (but not exhaustively):
• Production Grid Infrastructure Roadmap Document (GFD-I)
• Secure Job and Data Management Profile in Production Grids
(GFD-R.P)
• Secure Information Profile in Production Grids (GFD-R-P)
• Secure Accounting Profile in Production Grids (GFD-R-P)
• Secure Monitoring Profile in Production Grids (GFD-R-P)
© 2007 OpenGridForum 31
Geospatial Domain
• Good showing in OGC OWS-6• JSDL used in GeoProcessing Workflow Task
• Airport Disaster Response and Debris Flow scenarios
• Engineering Report in final preparation -- public release soon
• OGC wants to plan even more collaboration in OWS-7• Potential increased use of JSDL, HPC-BP and WSRF
• Geospatial community represents a huge potential adoption base• G-OWS ad hoc WG to implement all key OGC standards on gLite
• EGU Earth and Space Science Informatics soliciting OGF participation
• Key OGC standards have serious commercial adoption
• OGC has ~360 organizational members
• OGC-OGF Strategy Session, Tuesday, May 26• George Percivall, OGC Chief Architect, key participant
• Goals:• Identify joint OGC-OGF technical goals -- for OWS-7 and longer term
• Update MOU with new, technical goals
• Bidirectional community engagement: increased OGF membershipincreased OGF membership
© 2007 OpenGridForum 32
Upcoming Events!
• OGF-27• Banff, Alberta, Canada, Oct 12-16, 2009
• With IEEE Grid 2009 & Cybera/CANARIE Natl Summit
• OGF-28• Munich, Germany
• March 8-12, 2010