An Overview of the Open Grid Forum (v2) · • Craig A. Lee, President • The Aerospace...

32
© 2006 OpenGridForum An Overview of the Open Grid Forum (v2) 2009 www.ogf.org

Transcript of An Overview of the Open Grid Forum (v2) · • Craig A. Lee, President • The Aerospace...

Page 1: An Overview of the Open Grid Forum (v2) · • Craig A. Lee, President • The Aerospace Corporation • Chris Smith, VP Standards • Platform Computing • Ian Osborne, VP Enterprise

© 2006 OpenGridForum

An Overview of the

Open Grid Forum (v2)

2009

www.ogf.org

Page 2: An Overview of the Open Grid Forum (v2) · • Craig A. Lee, President • The Aerospace Corporation • Chris Smith, VP Standards • Platform Computing • Ian Osborne, VP Enterprise

© 2007 OpenGridForum 2

The OGF Mission Statement

" OGF is an open community committed to

driving the rapid evolution and adoption of

applied distributed computing. Applied

Distributed Computing is critical to developing

new, innovative and scalable applications and

infrastructures that are essential to

productivity in the enterprise and within the

science community."

Page 3: An Overview of the Open Grid Forum (v2) · • Craig A. Lee, President • The Aerospace Corporation • Chris Smith, VP Standards • Platform Computing • Ian Osborne, VP Enterprise

© 2007 OpenGridForum

How Do We Do This?

• Community Building & Outreach

• Best Practices & Standards

3

Page 4: An Overview of the Open Grid Forum (v2) · • Craig A. Lee, President • The Aerospace Corporation • Chris Smith, VP Standards • Platform Computing • Ian Osborne, VP Enterprise

© 2007 OpenGridForum

Why Do We Do This?

• Distributed Computing Systems are –

well – distributed

• Geographically distributed

• Resources

• Administrative Organizations

• Users

• Enabling the integration and use of

such resources on the behalf of all

stakeholders requires a venue like OGF

4

Page 5: An Overview of the Open Grid Forum (v2) · • Craig A. Lee, President • The Aerospace Corporation • Chris Smith, VP Standards • Platform Computing • Ian Osborne, VP Enterprise

© 2007 OpenGridForum 5

Example of an OperationalDistributed Infrastructure: EGEE

Community, Best Practices & Standards

Make This Possible Across Six Continents

Page 6: An Overview of the Open Grid Forum (v2) · • Craig A. Lee, President • The Aerospace Corporation • Chris Smith, VP Standards • Platform Computing • Ian Osborne, VP Enterprise

© 2007 OpenGridForum

An Overview of the Overview

• An Introduction to the Organization

• Current Products

• Impacts

• Vision & Evolutionary Directions

6

Page 7: An Overview of the Open Grid Forum (v2) · • Craig A. Lee, President • The Aerospace Corporation • Chris Smith, VP Standards • Platform Computing • Ian Osborne, VP Enterprise

© 2007 OpenGridForum 7

OGF Organizational Structure

OGF

Europe

Page 8: An Overview of the Open Grid Forum (v2) · • Craig A. Lee, President • The Aerospace Corporation • Chris Smith, VP Standards • Platform Computing • Ian Osborne, VP Enterprise

© 2007 OpenGridForum 8

OGF Leadership

• Craig A. Lee, President

• The Aerospace Corporation

• Chris Smith, VP Standards

• Platform Computing

• Ian Osborne, VP Enterprise

• Intellect UK

• David Wallom, VP e-Research

• Oxford e-Research Centre

• Joel Replogle, Director

• OGF

Page 9: An Overview of the Open Grid Forum (v2) · • Craig A. Lee, President • The Aerospace Corporation • Chris Smith, VP Standards • Platform Computing • Ian Osborne, VP Enterprise

© 2007 OpenGridForum 9

OGF Board of Directors

• Steven Newhouse, Chairman, Technical Director, EGEE

• Charlie Catlett, Argonne National Lab

• Wolfgang Gentzsch, DEISA

• Andrew Grimshaw, University of Virginia

• Neil Chue Hong, University of Southampton

• Hiro Kishimoto, Fujitsu

• Silvana Muscella, Trust-IT Services/OGF-Europe

• Satoshi Sekiguchi, AIST

• Walter Stewart, CANARIE

• Paul Strong, eBay

Page 10: An Overview of the Open Grid Forum (v2) · • Craig A. Lee, President • The Aerospace Corporation • Chris Smith, VP Standards • Platform Computing • Ian Osborne, VP Enterprise

© 2007 OpenGridForum 10

A Little History

• June 1999

• First Grid Forum meeting

• NASA Ames, Mountain View, California

• March 2001

• First Global Grid Forum

• NIKHEF/SARA, Amsterdam

• June 2006

• Merged with the Enterprise Grid Alliance to become

the Open Grid Forum

• February 2008

• OGF-Europe funded

Page 11: An Overview of the Open Grid Forum (v2) · • Craig A. Lee, President • The Aerospace Corporation • Chris Smith, VP Standards • Platform Computing • Ian Osborne, VP Enterprise

© 2007 OpenGridForum

OGF-EUROPE:

Making an impact

• Promoting the value of standardisation to enable

innovation

• Industry Expert Group

• Connecting user groups to share best practices &

transform them into standards

• Community Outreach Seminars

• Supporting the development and implementation

of European standards with end-users,

developers, diverse groups

• International Events

• Ensuring OGF standards are aligned with the

needs of European stakeholders

11

Page 12: An Overview of the Open Grid Forum (v2) · • Craig A. Lee, President • The Aerospace Corporation • Chris Smith, VP Standards • Platform Computing • Ian Osborne, VP Enterprise

© 2007 OpenGridForum 12

Method of Operations

• Working groups• Chartered to define a standard through one or more

documents according to a schedule with milestones

• Research groups• Chartered to investigate any interesting topic by running

workshops and writing documents (except standards)

• Community groups• Chartered to build community by identifying requirements,

common practices, running workshops, and writingdocuments (except standards)

• Three meetings a year• Plenaries

• Workshops

• Group sessions

• Birds-of-a-Feather meetings (BoFs)

• Co-location with other relevant organizations

Page 13: An Overview of the Open Grid Forum (v2) · • Craig A. Lee, President • The Aerospace Corporation • Chris Smith, VP Standards • Platform Computing • Ian Osborne, VP Enterprise

© 2007 OpenGridForum

How These Work Together

13

Page 14: An Overview of the Open Grid Forum (v2) · • Craig A. Lee, President • The Aerospace Corporation • Chris Smith, VP Standards • Platform Computing • Ian Osborne, VP Enterprise

© 2007 OpenGridForum

The Standards Council

14

Page 15: An Overview of the Open Grid Forum (v2) · • Craig A. Lee, President • The Aerospace Corporation • Chris Smith, VP Standards • Platform Computing • Ian Osborne, VP Enterprise

© 2007 OpenGridForum

The Enterprise Council

15

Page 16: An Overview of the Open Grid Forum (v2) · • Craig A. Lee, President • The Aerospace Corporation • Chris Smith, VP Standards • Platform Computing • Ian Osborne, VP Enterprise

© 2007 OpenGridForum

The e-Research Council

16

Page 17: An Overview of the Open Grid Forum (v2) · • Craig A. Lee, President • The Aerospace Corporation • Chris Smith, VP Standards • Platform Computing • Ian Osborne, VP Enterprise

© 2007 OpenGridForum

An Overview of the Overview

• An Introduction to the Organization

• Current Products

• Impacts

• Vision & Evolutionary Directions

17

Page 18: An Overview of the Open Grid Forum (v2) · • Craig A. Lee, President • The Aerospace Corporation • Chris Smith, VP Standards • Platform Computing • Ian Osborne, VP Enterprise

© 2007 OpenGridForum 18

The OGF Document Series

• OGF documents produced through an open processmanaged by the OGF Editor• Groups submit drafts through Area Director

• Editor reviews for clarity and format

• Manages public comment period

• Assigns GFD number

• Document types (number as of May 2009)• GFD-I -- Informational Document (73)

• GFD-E -- Experimental Document (14)

• GFD-C -- Community Practice (12)

• GFD-R -- Recommendation (32)

• http://www.ogf.org/ggf_docs_final.htm

Page 19: An Overview of the Open Grid Forum (v2) · • Craig A. Lee, President • The Aerospace Corporation • Chris Smith, VP Standards • Platform Computing • Ian Osborne, VP Enterprise

© 2007 OpenGridForum 19

OGF Compute-Related Standards

Job ManagementOGSA-BES(GFD 108)

HPC Domain Specific ProfileHPC Basic Profile

(GFD 114)

ArchitectureOGSA EMS Scenarios

(GFD 106)

Use CasesGrid Scheduling Use Cases

(GFD 64)

EducationISV Primer(GFD 141)

AgreementWS-Agreement

(GFD 107)

Programming InterfaceDRMAA

(GFD 22/133)

Programming InterfaceSAGA

(GFD 90)

AccountingUsage Record

(GFD 98)

InformationGLUE Schema

(Draft)

Job Definition

File TransferHPC File Staging

(GFD 135)

Job DescriptionJSDL

(GFD 56/136)

Application DescriptionHPC Application

(GFD 111)

Application DescriptionSPMD Application

(GFD 115)

Job ParameterizationParameter Sweep

(Draft)

Extend

Uses

Produces

Describes

Supports

Profiles

Page 20: An Overview of the Open Grid Forum (v2) · • Craig A. Lee, President • The Aerospace Corporation • Chris Smith, VP Standards • Platform Computing • Ian Osborne, VP Enterprise

© 2007 OpenGridForum 20

OGF Data-Related Standards

UnstructuredData

(Disk, Tape)

StructuredData

(Database)

Storage ManagementSRM (GFD 129)

AccessByte-I/O (GFD 87/88)

TransportGridFTP (GFD 20)

Access & ManagementDAIS (GFD 74,75,76)

NamingRNS (GFD 101)

MovementDMI (GFD 134)

Data FormatDescription Language

Information DisseminationInfoD (GFD 110)

Storage NetworkCommunity

Existing

Possible

Page 21: An Overview of the Open Grid Forum (v2) · • Craig A. Lee, President • The Aerospace Corporation • Chris Smith, VP Standards • Platform Computing • Ian Osborne, VP Enterprise

© 2007 OpenGridForum 21

Job Definition

HPC Basic Profile

File TransferHPC File Staging

(GFD 135)

Job DescriptionJSDL

(GFD 56/136)

Job ManagementOGSA-BES(GFD 108)

HPC Specific Job ManagementHPC Basic Profile

(GFD 114)

Application DescriptionHPC Application

(GFD 111)

SecuritySSL/TLS(IETF)

SecurityWS-Security

(OASIS)

Extend

Uses

Compute Resources

Provides Access To

Combines

References EducationISV Primer(GFD 141)

Page 22: An Overview of the Open Grid Forum (v2) · • Craig A. Lee, President • The Aerospace Corporation • Chris Smith, VP Standards • Platform Computing • Ian Osborne, VP Enterprise

© 2007 OpenGridForum 22

Running Applications Remotely

• ISV Remote Computing Usage Primer, GFD-I.141

• How to use sets of OGF standards for different scenarios

• www.ogf.org/RemoteExecution

Page 23: An Overview of the Open Grid Forum (v2) · • Craig A. Lee, President • The Aerospace Corporation • Chris Smith, VP Standards • Platform Computing • Ian Osborne, VP Enterprise

© 2007 OpenGridForum

An Overview of the Overview

• An Introduction to the Organization

• Current Products

• Impacts

• Vision & Evolutionary Directions

23

Page 24: An Overview of the Open Grid Forum (v2) · • Craig A. Lee, President • The Aerospace Corporation • Chris Smith, VP Standards • Platform Computing • Ian Osborne, VP Enterprise

© 2007 OpenGridForum

Impacts

• Impacts Material Goes Here

24

Page 25: An Overview of the Open Grid Forum (v2) · • Craig A. Lee, President • The Aerospace Corporation • Chris Smith, VP Standards • Platform Computing • Ian Osborne, VP Enterprise

© 2007 OpenGridForum

An Overview of the Overview

• An Introduction to the Organization

• Current Products

• Impacts

• Vision & Evolutionary Directions

25

Page 26: An Overview of the Open Grid Forum (v2) · • Craig A. Lee, President • The Aerospace Corporation • Chris Smith, VP Standards • Platform Computing • Ian Osborne, VP Enterprise

© 2007 OpenGridForum 26

Vast Array of ApplicationScenarios Driving Evolution

Data Center Migration

Page 27: An Overview of the Open Grid Forum (v2) · • Craig A. Lee, President • The Aerospace Corporation • Chris Smith, VP Standards • Platform Computing • Ian Osborne, VP Enterprise

© 2007 OpenGridForum 27

Strategy to Achieve this Vision

• Strategy

• Proactively lead the development of newdistributed computing technologies relevantto our stakeholders

• Engage with all relevant organizations anduser groups working on the same goals

• Current OGF Strategic Activities

• Grids and Clouds

• Cyberinfrastructure Requirements

• Production Grid Interoperability

• Geospatial Application Domains

Page 28: An Overview of the Open Grid Forum (v2) · • Craig A. Lee, President • The Aerospace Corporation • Chris Smith, VP Standards • Platform Computing • Ian Osborne, VP Enterprise

© 2007 OpenGridForum 28

OGF Cloud Leadership

• OCCI is a major effort that could gain traction in the cloud arena• Important group members and very active mailing list

• Pushing for cloud coordination with industry and other SDOs• SATCCI Meeting, March 23, DC

• federalcloudcomputing.wik.is/index.php?title=March_23%2C_2009

• SCRM telecons• IBM, Cisco, Sun, Fujitsu, OCC, NIST attended last call• Organizations to post cloud activity summaries on SRCM wiki

• Cloud Standards Summit, July 13, DC• federalcloudcomputing.wik.is/July_15%2c_2009• Originally scheduled for July 15 but moved to accommodate the following

• Cloud Computing Symposium, July 15, DC• Hosted by National Defense University, www.ndu.edu/irmc/ilss/ilss_events.html• Vivek Kundra (US Federal CIO) to keynote• Cloud Standards Summit trying to get an outbrief slot

• CloudWorld• Co-located w/ NGDC and OpenSource World, August 12-13, San Francisco• OGF personnel on CloudWorld Program and Advisory Committees• Chris Smith (OGF VP Standards) to present on behalf of OGF Enterprise

• OGF-27 Workshops (proposed): “Grid to Cloud” and “HPC in Cloud”

• Goals:• Identify concrete coordination activities before July 13 meeting• Increase cloud work -- and membership -- in OGF

Page 29: An Overview of the Open Grid Forum (v2) · • Craig A. Lee, President • The Aerospace Corporation • Chris Smith, VP Standards • Platform Computing • Ian Osborne, VP Enterprise

© 2007 OpenGridForum 29

CyberInfrastructure Requirements

• Series of three workshops to provide input to both

• EGEE to EGI transition, and

• TeraGrid to XD transition

• Primary focus: community requirements for interoperability

• First workshop (OGF-26) concentrated on the methods

used in previous requirements gathering exercises:

• UK e-Science, UK NGS, TeraGrid and Globus

• OGF informational document will be produced on this session

describing the benefits and disadvantages of different methods of

information capture

• Subsequent workshops at Banff (OGF-27) and Munich

(OGF-28) to analyze requirements data and make

concrete recommendations

Page 30: An Overview of the Open Grid Forum (v2) · • Craig A. Lee, President • The Aerospace Corporation • Chris Smith, VP Standards • Platform Computing • Ian Osborne, VP Enterprise

© 2007 OpenGridForum 30

Production Grids

• Production Grid Infrastructures WG formed to nail-down

interoperability standards

• Follow-on to Grid Interoperation Now (GIN) Community Group

• Includes EGEE, OSG, NAREGI, NorduGrid, TeraGrid, NGS

• Ambitious charter including (but not exhaustively):

• Production Grid Infrastructure Roadmap Document (GFD-I)

• Secure Job and Data Management Profile in Production Grids

(GFD-R.P)

• Secure Information Profile in Production Grids (GFD-R-P)

• Secure Accounting Profile in Production Grids (GFD-R-P)

• Secure Monitoring Profile in Production Grids (GFD-R-P)

Page 31: An Overview of the Open Grid Forum (v2) · • Craig A. Lee, President • The Aerospace Corporation • Chris Smith, VP Standards • Platform Computing • Ian Osborne, VP Enterprise

© 2007 OpenGridForum 31

Geospatial Domain

• Good showing in OGC OWS-6• JSDL used in GeoProcessing Workflow Task

• Airport Disaster Response and Debris Flow scenarios

• Engineering Report in final preparation -- public release soon

• OGC wants to plan even more collaboration in OWS-7• Potential increased use of JSDL, HPC-BP and WSRF

• Geospatial community represents a huge potential adoption base• G-OWS ad hoc WG to implement all key OGC standards on gLite

• EGU Earth and Space Science Informatics soliciting OGF participation

• Key OGC standards have serious commercial adoption

• OGC has ~360 organizational members

• OGC-OGF Strategy Session, Tuesday, May 26• George Percivall, OGC Chief Architect, key participant

• Goals:• Identify joint OGC-OGF technical goals -- for OWS-7 and longer term

• Update MOU with new, technical goals

• Bidirectional community engagement: increased OGF membershipincreased OGF membership

Page 32: An Overview of the Open Grid Forum (v2) · • Craig A. Lee, President • The Aerospace Corporation • Chris Smith, VP Standards • Platform Computing • Ian Osborne, VP Enterprise

© 2007 OpenGridForum 32

Upcoming Events!

• OGF-27• Banff, Alberta, Canada, Oct 12-16, 2009

• With IEEE Grid 2009 & Cybera/CANARIE Natl Summit

• OGF-28• Munich, Germany

• March 8-12, 2010