Post on 21-Jan-2016
A PPARC funded project
Astro-Wise meeting
06-07 April 2004OmegaCEN,Kapteyn Institute,Groningen
Tony LindeAstroGrid Project Manager
University of Leicester
06-May-2004 Astro-Wise meeting, Kapteyn Institute, Groningen 2
AstroGrid OverviewApproachArchitectureUsageItn05/06Astro-Wise & VObsFollow-up
06-May-2004 Astro-Wise meeting, Kapteyn Institute, Groningen 3
Overview of AstroGrid/-2Duration: Sept 2001 – Dec 2007Funding: £7.7M (PPARC)Personnel: ~26 (23.4 FTE)Goal: Develop VObs Infrastructure
Deploy UK VObsScope: Astrophysics, Solar, STP, …
Optical, X-Ray, Radio, …Phase A: Sept 2001 – Dec 2002
Analysis, R&D, ArchitecturePhase B: Jan 2003 – Dec 2004
Build, test & deliverAstroGrid-2: Jan 2005 – Dec 2007Structure tbd
06-May-2004 Astro-Wise meeting, Kapteyn Institute, Groningen 4
AstroGrid consortiumEdinburghLeicesterCambridgeMSSLJBORALQUB
AstroGrid-2 + Bristol Exeter Leeds Portsmouth
06-May-2004 Astro-Wise meeting, Kapteyn Institute, Groningen 5
Lead PersonnelProject Lead Andy Lawrence (Edinburgh)
al@roe.ac.uk
Project Scientist Nic Walton (Cambridge)
naw@ast.cam.ac.uk
Project Manager Tony Linde (Leicester)
ael@star.le.ac.uk
Technical Lead Keith Noddle (Leicester)
ktn@star.le.ac.uk
06-May-2004 Astro-Wise meeting, Kapteyn Institute, Groningen 6
Links
FP5 AVO, FP6 Euro-VO (UK rep)US-NVOIVOA Standards workgroups
GGF, Globus, OGSA-DAIOther e-Science projects in UK GridPP, myGrid, EGSO, …
06-May-2004 Astro-Wise meeting, Kapteyn Institute, Groningen 7
Project ApproachAgile: iterative & incremental development
Open project: Wiki
http://wiki.astrogrid.org/bin/view/Astrogrid/WebHome
Forum http://forum.astrogrid.org/index.php
News http://news.astrogrid.org/index.php
Jabber via jabber.astrogrid.org
Open Source code http://www.astrogrid.org/maven/build/index.html
06-May-2004 Astro-Wise meeting, Kapteyn Institute, Groningen 8
Development ApproachIterative full cycle each iteration 3 month(-ish) iterations
Incremental add functionality each iteration refactor wherever necessary
Use-case driven from ‘key 10’ science cases http://wiki.astrogrid.org/bin/view/Astrogrid/ScienceProblems
Architecture led http://wiki.astrogrid.org/bin/view/Agdoc/ArchVision http://wiki.astrogrid.org/bin/view/Agdoc/ArchOverview http://wiki.astrogrid.org/bin/view/AG2/ArchitectureNotes
06-May-2004 Astro-Wise meeting, Kapteyn Institute, Groningen 9
Technology choices
design : UML, TogetherSoft ControlCenterdevelopment language : Java
Web services
source control : CVSIDE/build/integrate : Eclipse/Ant/MavenJava libraries: ApachePortal : Apache Cocoon
06-May-2004 Astro-Wise meeting, Kapteyn Institute, Groningen 10
VObs StructureComponent-based can install any/all components
Decentralised no single product nor centre
Service-based web services
06-May-2004 Astro-Wise meeting, Kapteyn Institute, Groningen 11
ComponentsPortalRegistrySecurityCommunityWorkflowData AccessMySpaceApplications
06-May-2004 Astro-Wise meeting, Kapteyn Institute, Groningen 12
AstroGrid-2Aspects Extension
Infrastructure Grid (GT4+) integration Intelligent resource discovery (semantic grid)
Additional components Data exploration Agents: eStar integration Client-based access: VO Workbench
Technical Scope http://wiki.astrogrid.org/bin/view/AG2/TechnicalScope
06-May-2004 Astro-Wise meeting, Kapteyn Institute, Groningen 13
AstroGrid-2 Layer Diagram
06-May-2004 Astro-Wise meeting, Kapteyn Institute, Groningen 14
AstroGrid usePortal WorkflowWorkflow is key to AstroGrid
06-May-2004 Astro-Wise meeting, Kapteyn Institute, Groningen 15
WorkflowSequence Sequential steps
Flow Steps executed in parallel
Step Application/Tool, Data query Configured via XForm specification
To be enhanced later or Query form
Workflow definition Subset of BPEL
06-May-2004 Astro-Wise meeting, Kapteyn Institute, Groningen 16
Create Workflow
06-May-2004 Astro-Wise meeting, Kapteyn Institute, Groningen 17
Add tools to steps
06-May-2004 Astro-Wise meeting, Kapteyn Institute, Groningen 18
Configure step: data query
06-May-2004 Astro-Wise meeting, Kapteyn Institute, Groningen 19
Configure step: tool
06-May-2004 Astro-Wise meeting, Kapteyn Institute, Groningen 20
Submit workflow, Check status
06-May-2004 Astro-Wise meeting, Kapteyn Institute, Groningen 21
Data query step
Insert valid ADQL (v0.7.?)Assisted query builder this iteration
06-May-2004 Astro-Wise meeting, Kapteyn Institute, Groningen 22
MySpace: virtual storage
Operations: Copy, Delete, Move Upload from file, URL
End-point Multiple servers per manager Usually hidden from user
06-May-2004 Astro-Wise meeting, Kapteyn Institute, Groningen 23
eg Copy file, Upload file
06-May-2004 Astro-Wise meeting, Kapteyn Institute, Groningen 24
Registry: Query
06-May-2004 Astro-Wise meeting, Kapteyn Institute, Groningen 25
Registry detailsConforms to IVOA stdExtended: ApplicationDefinitio
n
AstroGrid CEA
06-May-2004 Astro-Wise meeting, Kapteyn Institute, Groningen 26
Registry harvest
Admin function, so usually invisible
06-May-2004 Astro-Wise meeting, Kapteyn Institute, Groningen 27
Itn05: Complex workflow: AVO Demo
Canned imagesACE
AstroGrid wrapping of SExtractor
VOTMerge AstroGrid VOTable
‘federation’
HyperZ AstroGrid wrapping
of HyperZ
CEA
06-May-2004 Astro-Wise meeting, Kapteyn Institute, Groningen 28
Itn06: Jan 2005 AVO DemoBuild on the Itn05 tool
Image access (SIAP) Add in extra redshift
applications Bpz ANNz
Access wider data resources
WFS GOODS plus IR
Deploy on 'real' machines
Disk Compute
06-May-2004 Astro-Wise meeting, Kapteyn Institute, Groningen 29
Itn06: Solar science case: CMEs
06-May-2004 Astro-Wise meeting, Kapteyn Institute, Groningen 30
Astro-Wise & VObsKey points Make data available Publish metadata
Rapid dissemination (push harvesting) Versioning / describing / retiring of products
Other Pipeline services available
Custom UIs Re-process data
User-derived products Agent interfaces
06-May-2004 Astro-Wise meeting, Kapteyn Institute, Groningen 31
Astro-Wise linksData model IVOA DM group (Jonathan McDowell) AstroGrid Interop group (Anita Richards)
Beta testing AstroGrid software AstroGrid deployment AVO demos
06-May-2004 Astro-Wise meeting, Kapteyn Institute, Groningen 32
Follow-upBeta testing
Contact Nic Walton
Component Deployment Data Centre MySpace Local Registry Community
Contact Nic Walton
Software cooperation MySpace Workflow Data Centre Registry metadata updating
Contact Tony Linde, Keith Noddle