OGSA-DAI in OMII-Europe Neil Chue Hong EPCC, University of Edinburgh.

OGSA-DAI in OMII-EuropeNeil Chue Hong

EPCC, University of Edinburgh

3EU project: RIO31844-OMII-EUROPE

It’s all aboutDATA

location

administration

description

diversityscale

security

longevity

integration

discovery

processing

transfer

storage

access


Data Service Goals

Make access transparent

Make integration easy

Make management simple


Data Service Challenges

Diversity

Scale

Ownership

Security

of data resource types, vendors, middleware, schema, metadata

of collections, formats, geographical, political and social distance

on individual, group, and organisation levels; intersecting yet independent

for client, service and data owner;at many levels, with many tradeoffs


OGSA-DAI In One Slide

• An extensible framework for data access and integration.

• Expose heterogeneous data resources to a grid through web services.

• Interact with data resources:– Queries and updates.– Data transformation /

compression– Data delivery.

• Customise for your project using– Additional Activities– Client Toolkit APIs– Data Resource handlers

• A base for higher-level services– federation, mining, visualisation


MySQL

OGSA-DAI service

Engine

SQLQuery

JDBCData

Resources

Activities

DB2

The OGSA-DAI Framework

GZip GridFTPXPath

XMLDB

XIndice

readFile

File

SWISSPROT

XSLT

SQLServer

Data-bases

ApplicationApplicationClient ToolkitClient Toolkit


MySQL

OGSA-DAI service

Engine

SQLQuery

JDBC

SQL

JDBC

SQL

JDBC

SQL

JDBC

SQL

JDBC

MultipleSQL GDS

SQLQuery


Challenges for OMII-Europe

Diversity

Scale

Ownership

Security

of data resource types, vendors, middleware, schema, metadata

of collections, formats, geographical, political and social distance

on individual, group, and organisation levels; intersecting yet independent

for client, service and data owner;at many levels, with many tradeoffs

OMII-Europe

OGSA-DAI


Challenge 1: Grid Middleware

• OGSA-DAI currently runs on GT4, OMII_2 and Axis 1.2– want to extend this to UNICORE(GS), EGEE,

CrownGrid• Different, but similar architectural models

– addressing and naming– versioning

• Unicore/GS prototype developed (no security)• MUST keep client APIs the same

– ideally service code and configuration will stay similar


Challenge 2: Security

• OGSA-DAI uses GSI for GT4, and WSS4J for Axis/OMII– x509 cert based, TLS and MLS– many security levels: macro, service, resource, activity

• Want to utilise standards where possible– move to SAML– interaction with other OMII-Europe work

• Delegation, authorisation, etc., should support a single developer model, multiple provider implementations


Challenge 3: Interoperation and Intersection

• The technology must work together in mixed and dynamic domains– security is of primary importance– also data transfer– both together would be nice

• Many other “supplemental” components will need to interoperate for full functionality– e.g. discovery services, auditing services

• If we solve this, we make the Grid useful


Admin domain 3

Admin domain 2

Admin domain 1

Three Challenges Together

How do we handle?– security

delegation between middleware

– addressing DBs across domains

DB1MyNotes

OGSA-DAIDS1GT4

OGSA-DAIDS2

EGEE

OGSA-DAIDS3

UNICORE

DB2Results1

DB3Results2

DB4GroupDB

Distributed query

Resilient query

Update

Results transfer

Data operation workflow


Summary

• Data services provide a means of addressing the challenges of managing and using increasing amounts of data

• OGSA-DAI provides components which present a model of transparency and abstraction for data resources

• OMII-Europe aims to extend OGSA-DAI services to address challenges of differing middleware, diverse security domains and interoperation between intersecting dynamic virtual organisations


Thank you for listening

Any questions?

http://www.omii-europe.com

http://www.ogsadai.org.uk

OGSA-DAI in OMII-Europe Neil Chue Hong EPCC, University of Edinburgh.

Documents

Transcript of OGSA-DAI in OMII-Europe Neil Chue Hong EPCC, University of Edinburgh.