AstroGrid: Virtual Observatory ServiceIntegrating IPHAS Data into the VO Data Products from...
Transcript of AstroGrid: Virtual Observatory ServiceIntegrating IPHAS Data into the VO Data Products from...
-
AstroGrid: Virtual AstroGrid: Virtual Observatory ServiceObservatory Service
Nicholas WaltonNicholas WaltonAstroGrid and Euro-VO Technology Centre
Project Scientist (Institute of Astronomy,
University of Cambridge)
-
Nicholas Walton: AstroGrid @ OGF20: May 9, 2007 p2 Printed: 11/05/07
AstroGrid: UK's Virtual ObservatoryAstroGrid: UK's Virtual ObservatoryEmpowerment of scientistsEmpowerment of scientists
● Improve the quality, ease, speed and cost effectiveness of on-line astronomy
● Make comparison and integration of data seamless● Removing barriers to multi-wavelength astronomy● Enable acces to very large data sets● http://www.astrogrid.org
http://www.astrogrid.org/
-
Nicholas Walton: AstroGrid @ OGF20: May 9, 2007 p3 Printed: 11/05/07
http://www.astrogird.org/launch
AstroGrid 2007.1 Release: Jan 2007AstroGrid 2007.1 Release: Jan 2007
http://www.astrogird.org/launch
-
Nicholas Walton: AstroGrid @ OGF20: May 9, 2007 p4 Printed: 11/05/07
S2-147 a SNR5o x 5o Hα-r’Credit: A Ziljstra, J irwin
● Simple workbench access to VO services● Concept of 'MySpace': virtual user space for data,
workflows, results– ability to share with research teams, collaborators– longer term – support publication of user data: analagous to
ebay, c.f. astro-ph vs ADS● Powerful, yet simple tools to enable data discovery
– astroscope● System to support creation of user defined workflows
– find data, process data, inteprete data– save workflows
● Range of applications on server and client side
AstroGrid: A place for scienceAstroGrid: A place for science
-
Nicholas Walton: AstroGrid @ OGF20: May 9, 2007 p5 Printed: 11/05/07
AstroGrid – an eScience ProjectAstroGrid – an eScience Project● Open source – see http://software.astrogrid.org ● Web service technologies
– developed in Java– utilises the Apache toolset– Eclipse IDE for development– Maven/Ant for building– JUnit for testing– CVS for code control
● Distributed project development– Plone and Wiki – Bugzilla– Jabber
● Professional development team
http://software.astrogrid.org/
-
Nicholas Walton: AstroGrid @ OGF20: May 9, 2007 p6 Printed: 11/05/07
Data, Application, Compute AssetsData, Application, Compute Assets
GUI Application
GUI Application
Desktop
Community
Data centre
Algorithm
Data set
Algorithm
Data set
CPU
Resource list
CPU
User details
-
Nicholas Walton: AstroGrid @ OGF20: May 9, 2007 p7 Printed: 11/05/07
Assets turned into client & servicesAssets turned into client & services
GUI Application App server
GUI ApplicationData server
GUI ApplicationVOSpace
GUI ApplicationCommunity
Desktop
Community
Data centre
GUI ApplicationApp server
GUI ApplicationRegistry
VO support
Resourcelist
Dataset
GUI ApplicationGUI with
Astro Runtime
GUI ApplicationWorkflow
engine Userdetails
App
App
DatasetApp
-
Nicholas Walton: AstroGrid @ OGF20: May 9, 2007 p8 Printed: 11/05/07
AstroGrid stack – Server w/f engineAstroGrid stack – Server w/f engine
Workbench etc.
Astro Runtime (AR)
Workflow engine
Worker services (app servers; data servers)
Compute/DB resources
Desktop app
Library
“JES”:Web
serviceWeb
services
-
Nicholas Walton: AstroGrid @ OGF20: May 9, 2007 p9 Printed: 11/05/07
Access controlAccess control
Community/MyProxy
Desktop application, e.g. Taverna
Worker services
Astro Runtime
User details CPU, storage,archives etc. Access policy
{User-name, password, community}
{User-name, password}
X.509/RFC3820proxy
X.509/RFC3820proxy
X.509/RFC3820proxy
-
Nicholas Walton: AstroGrid @ OGF20: May 9, 2007 p10 Printed: 11/05/07
AG SystemAG System
-
Nicholas Walton: AstroGrid @ OGF20: May 9, 2007 p11 Printed: 11/05/07
AstroGrid WorkbenchAstroGrid Workbench● User Interface to VO
services● Delivery via Java Webstart
technology● Components
– Registry– Find Data– Work with Apps– Workflows– Client Visualisation
● Enables Science
-
Nicholas Walton: AstroGrid @ OGF20: May 9, 2007 p12 Printed: 11/05/07
Registries – c.f. 'AstroGoogle'Registries – c.f. 'AstroGoogle'● As an astronomer – how do you find the data that you require?● VO solution: Registries, used to discover and locate resource
● A list of resource descriptions, described by structured metadata: enables automated searching and processing
● Types of resource– Generic services, web services,
applications, …– Data collections– VO-specific resources (e.g. MySpace
servers)● Collects all global information
– US NVO, F-CDS, J-JVO, etc
-
Nicholas Walton: AstroGrid @ OGF20: May 9, 2007 p13 Printed: 11/05/07
AstroGrid: MySpaceAstroGrid: MySpace● Virtual disk space where you
can store results, temporary files, and new things like query files and workflow files, so you can adjust and re-run jobs on a later day.
● Visible from any computer.
-
Nicholas Walton: AstroGrid @ OGF20: May 9, 2007 p14 Printed: 11/05/07
Plastic – VO tools on the desktopPlastic – VO tools on the desktop
-
Nicholas Walton: AstroGrid @ OGF20: May 9, 2007 p15 Printed: 11/05/07
Example Large Scale Survey: Example Large Scale Survey: the IPHAS Survey of the Galactic Planethe IPHAS Survey of the Galactic Plane
● IPHAS: The Isaac Newton Telescope/ Wide Field Camera Photometric H-alpha Survey of the Norther Galactic Plane (PI: Janet Drew: Imperial, UK)
● Element of the wider IPHAS/VPHAS+/UVEX consortium: forming EGAPS (European Galactic Plane Surveys) – see http://www.egaps.org
– large collaboration of scienctists from ~10 countries● Key Goals: Large scale Milky Way structure and study of
early and late type populations (preferentially selected via H-alpha emission line properties)
http://www.egaps.org/
-
Nicholas Walton: AstroGrid @ OGF20: May 9, 2007 p16 Printed: 11/05/07
IPHAS data source: 2.5-m INT + WFSIPHAS data source: 2.5-m INT + WFS
-
Nicholas Walton: AstroGrid @ OGF20: May 9, 2007 p17 Printed: 11/05/07
Survey ProductsSurvey Products• Photometric catalogue ~200
million objects in North• ~ SDSS size catalogue• Detection of ~50000 Hα-
emitting objects
-
Nicholas Walton: AstroGrid @ OGF20: May 9, 2007 p18 Printed: 11/05/07
IPHAS: ImagesIPHAS: Images
IC 5070 – the pelican nebula: Credit Nick Wright (UCL)
-
Nicholas Walton: AstroGrid @ OGF20: May 9, 2007 p19 Printed: 11/05/07
Integrating IPHAS Data into the VOIntegrating IPHAS Data into the VO
● Data Products from Cambridge survey pipeline include:– FITS images (per image pointing)– FITS table catalogues (per image pointing)– Single unified merged object source catalogues
● Sybase IQ DMS system● Access to these products expedited by use of AstroGrid
interface mechanisms:– Images: via Simple Image Access protocol service– Catalogues (FITS tables): – Merged catalogues: Data Set Access component to database
-
Nicholas Walton: AstroGrid @ OGF20: May 9, 2007 p20 Printed: 11/05/07
SIAP Image serviceSIAP Image service● Simple Image Access to IPHAS
images– physically data distributed from
the Cambridge Astronomical Survey Unit (CASU @ IoA, Cambridge)
● Accessible through standard Virtual Observatory (VO) interfaces - e.g. AstroGrid Workbench
-
Nicholas Walton: AstroGrid @ OGF20: May 9, 2007 p21 Printed: 11/05/07
-
Nicholas Walton: AstroGrid @ OGF20: May 9, 2007 p22 Printed: 11/05/07
Catalogue AccessCatalogue Access● Catalogue data available both as FITS
tables on a per pointing basis● In release – unified object catalogues
List of tables inthe database
Selected tableTable DescriptionTable Columns
Query being built
-
Nicholas Walton: AstroGrid @ OGF20: May 9, 2007 p23 Printed: 11/05/07
SQL query selecting IPHAS field 7300o objects = 24000 sources
-
Nicholas Walton: AstroGrid @ OGF20: May 9, 2007 p24 Printed: 11/05/07
ClosingClosing● Key Links
– AstroGrid: http://www.astrogrid.org– AstroGrid Science: http://www2.astrogrid.org/science – AstroGrid software : http://software.astrogrid.org/ – Euro-VO: http://www.euro-vo.org – IVOA: http://www.ivoa.net
http://www.astrogrid.org/http://www2.astrogrid.org/sciencehttp://software.astrogrid.org/http://www.euro-vo.org/http://www.ivoa.net/