AstroGrid How to make your data famous OR One-click PhD creation.

13
AstroGrid How to make your data famous OR One-click PhD creation

Transcript of AstroGrid How to make your data famous OR One-click PhD creation.

Page 1: AstroGrid How to make your data famous OR One-click PhD creation.

AstroGrid

How to make your data famous

OR

One-click PhD creation

Page 2: AstroGrid How to make your data famous OR One-click PhD creation.

Talk The Talk

What is it?

What are we trying to do?

Focus: datacenters

Focus: workflows

Publishing data

Using AstroGrid

Page 3: AstroGrid How to make your data famous OR One-click PhD creation.

What is AstroGrid?

IVOAUK Effort: Prototype VO infrastructure for IVOA Produce working ‘grid’ UK datacenters

ROE, Cambridge, JBO, MSSL, Leicester

PPARC/IVOA FundedApprox 20 programmers + scientists ROE: Clive, John, Me, Peter. (+Bob, Andy) (+Mike, Nigel, etc)

Finish by end 2004

Page 4: AstroGrid How to make your data famous OR One-click PhD creation.

What are we doing?

Design Astronomical Grid InfrastructureBuild a UK Astronomical Grid What’s a Grid?

Components: Datacenter Registry MySpace Application Server ‘Portal’ User Interface Workflow – designer & executer

Example: Brown Dwarfs

Page 5: AstroGrid How to make your data famous OR One-click PhD creation.

Data

Data

Archived Data

Data

Data

Archived Data

DataDataRe-processed

Data

You are hereData

Data

Your data

Your data

Your data

Data W arehouses

Radio data

Radio catalogues -processed data

X-Ray data

Infra-Redcatalogues

Sky Surveys

OpticalCatalogues

Legacy data

Legacy data

Page 6: AstroGrid How to make your data famous OR One-click PhD creation.

Datacenters

Data publishing mechanism

Web Services

Queries

Page 7: AstroGrid How to make your data famous OR One-click PhD creation.

Web

Ser

vice

inte

rfac

e

Con

nect

ion

& A

utho

risat

ion

Man

ager Q ue rie r

P lug-in SQ LD atabase

A stronom ica lD a ta

Q ueryLanguage

V O T ab le

S Q L R esu lts

S Q L

Example SQL-based catalogue datacenter

Inte

rnet

Page 8: AstroGrid How to make your data famous OR One-click PhD creation.

Datacenters

Data publishing mechanism

Web Services

Queries

Security

Upload

Page 9: AstroGrid How to make your data famous OR One-click PhD creation.

Workflow

Create:Flows, Sequences, BranchesSave, Edit, Test

Execute:Press buttonGo and drink coffee……go on holiday…

Page 10: AstroGrid How to make your data famous OR One-click PhD creation.

Using AstroGrid

Code-your-own:Web Service client toolkits

Perl, Python, Java, etc – and FORTRAN!AstroGrid delegates (Java)

Portal GUIs

Combinations

Page 11: AstroGrid How to make your data famous OR One-click PhD creation.

Publishing Data

Single download & install

Connect to data……depends on data!

IVOA compatible……when it happens

Execute:Go on holiday

Page 12: AstroGrid How to make your data famous OR One-click PhD creation.

Challenges

Agreeing standards…

Completing ‘critical mass’

User acceptanceMake sure it worksMake sure it’s easyProvide more science

Page 13: AstroGrid How to make your data famous OR One-click PhD creation.

Summary

UK effort: Influencing IVOA IVOA standards compatible

Data publishing easierGreatly extends data available to astronomersNot quite a pipe dream: Data sets being published now