VO-oriented activities of the CDPP

HDMC VxO SPASE 10-12 June 2008

VO-oriented activities of the CDPP

M. Gangloff, E. Budnik, M. Bouchemit

C. Jacquey, V. Génot, N. André, B. Cecconi, B. Lavraud

Key points of the CDPP activities: Involvement in SPASE Searchable registriesAMDAIVOA connection (OV-France)

Projects under development: EUROPLANET/IDISTime-Table exchange (CAA , CDPP, QSAS, CL)

Project in perspective: HELIO-2


EuroPlaNet• What is EuroPlaNet ?• What is IDIS ? Current status• EuroPlaNet Resource inventory• IDIS Plasma Node Registry Demonstrator• IDIS Plasma Node Science Demonstrator

– What is AMDA ?– Access remote data in AMDA

• Current status ( data tree as a whole )• The future ( selected data only)

– Lessons learned – Event tables management with AMDA

• The future of EuroPlaNet (2009-2012)


What is EuroPlaNet ?• A European network for the development of planetary sciences in Europe

• Coordinates different activities :

• N1-Management• N2-Discipline working group• N3-Coordination of earth-based and space observations• N4-Outreach• N5-Personnel exchanges• N6-Meetings and conferences• N7-Integrated and Distributed Information Service (IDIS)

• IDIS will provide a common and user-friendly access to the data and information produced by the various types of research activities

• IDIS is the first step towards a European Planetary VO


EuroPlaNet IDIS Architecture

IDIS TOP NODEeuroplanet-idis.fi

Interiors and Surfaces DLR

Berlin

AtmospheresIPSL/SA

Paris

Plasma SciencesIWF Graz

CDPP Toulouse

Small bodies and Dust

INAF-IFSI Rome

Other labs Other labs Other labs Other labs

Node structure


Current status of IDIS

• Every node provides a web server with a list of resources

• Every node implements a prototype of searchable registry of resources in XML according to the SPASE model

• The Plasma Node implements 2 demonstrators : registry and science


Plasma Node Registry Demonstrator

– Set of XML descriptors of planetary plasma data (MAPSKP, VEX, MEX)

– Compliant with the SPASE data model 1.2.1

– eXist database (native XML, parameter level)

– Search engine ( measurement type, region)

– Goals: demonstration and experimentation


Plasma Node Registry Search Engine

• Available @ :http://cdpp-spase.cesr.fr:8800/exist-1.1.1/xquery/PlasmaNodeRegistry.xql

• Search criteria: – Time span– Measurement type– Observed region– Resource type ( numerical data , display data or catalog)

• Response:– Spase Xml descriptor – Possibility to use XSL style sheet to customize presentation

http://cdpp-spase.cesr.fr:8800/exist-1.1.1/xquery/PlasmaNodeRegistry.xql


Plasma Node registry Interface

Possibility to select a measurement type


Response is a list of SPASE descriptors


Plasma Node Science Demonstrator

• Based on the AMDA Service

• Access remote data (MAPSKP, Vex-MAG,HST) with a SPASE compatible description


AMDAAutomated Mutiple Dataset Analysis

Multi spacecraft and multi-instrument dataVisualisationUser defined parameter computationStandard model computationData and computed parameter extraction

Automated or visual search on the data

AMDA local database (CLUSTER, ACE, THEMIS, GEOTAIL, WIND, …, ISEE)

Access to remote databases (CDAWeb, MAPSKP, THEMIS/CESR, …)

Visualisation

Parameter editor

Download data

Conditional or Visual search

Remote data access

Time-Table manager

Service available @ http://cdpp-amda.cesr.fr

Possible to get a « guest « account for a limited period (one hour) or a permanent login


Data access in AMDALocal DB


AMDA : external tree

Select data on a remote server

Save parameter to user’s workspace


Access remote data in AMDA

Spase CompatibleRegistry

Local DB

MAPSKP(remote) VEX-MAG (remote) HST (remote)

AMDA

GetAvailableDataGetDatasetInfoGetDatasetURLs


Plasma Node registry interfaces

RegistrySpase XML Descriptors

MapsKPserver

Daily update

(data)(metadata)describes

WEB SERVICES

getAvailableData

data tree

getDatasetInfo

spase descriptor

getDatasetURLs

URLs of granules

AMDABuild data tree Build parameters

Wget(datasetURLs)

XQUERY


RegistrySpase XML Descriptors

MapsKPserver

Daily update

(data)(metadata)describes

WEB SERVICES

getAvailableData(measurementType= ThermalPlasma)

data tree

getDatasetInfo

spase descriptor

getDatasetURLs

URLs of granules

AMDABuild data tree Build parameters

Wget(datasetURLs)

XQUERY

Plasma Node registry interfaces


Lessons learned

• The SPASE model may be used for the EuroPlaNet IDIS Plasma Node

• Some additions/modifications needed to read data files

• Need to update some lists (coordinate systems, regions)


Cassini coordinate systems not available in the SPASE lists

[KSM, KSO, KG]


Use « ParameterKey » to read Elements


Time [UTC] Bx By Bz |B|

2004-182T00:00:58.000 0.897 5.648 -2.254 6.1472004-182T00:01:58.000 0.954 5.669 -2.222 6.1632004-182T00:02:58.000 0.897 5.648 -2.254 6.1472004-182T00:03:58.000 0.897 5.648 -2.254 6.147

An example of Data File : Magnetic Field in KG Coordinates

Field 0 Field 1 Field2 Field3 Field4

Parameter key


<dataset xml:id="MAG_KG"><parameter xml:id="VECTOR">

<data_type>FLOAT</data_type></parameter><parameter xml:id="MAGNITUDE">

<data_type>FLOAT</data_type></parameter>

</dataset>

An auxiliary XML descriptor is used to describe information needed to access the tabular data in an ASCII file


The future of EuroPlaNet (2009-2012)

Key challenge for FP 7

Datamodel (s) for planetology

The CDPP will be responsible for this work package


Event tables management in AMDA

• Time (or Event) Tables are collections of times when ‘something’ happens or time spans when some conditions are true.

• Currently produced and managed « manually » by the scientists for their own use or for a community of users.

• AMDA is increasing the possibilities of these tables : it provides a generic tool to create, manage and share these objects

• How to generate Time tables with AMDA :• With the search tool based on mathematical criteria applied to the contents of the

data• With the visual search tool

• AMDA can ingest Time Tables :• Coming from statistical studies ( e.g magnetopause crossing lists )• Produced by users

Current status:


VISUAL SEARCH

Record intervals of interest in time table by mouse click


Edit search criteria with math operators or functions

Define a time interval


<VOTABLE version="1.1"><DESCRIPTION> Time Table generated by AMDA @ CDPP; Conditions: MOM_C1(6)/MOM_C1(5)>1; Source: AMDA Search ; Creation Date : Tue Jun 3 14:10:39 2008; </DESCRIPTION> <RESOURCE> <DESCRIPTION> AMDA @ CDPP</DESCRIPTION><TABLE><FIELD datatype="char" name="Start Time" ID="TimeIntervalStart" ucd="time.start"><DESCRIPTION>time tag for beginning of interval</DESCRIPTION></FIELD><FIELD datatype="char" name="Stop Time" ID="TimeIntervalStop" ucd="time.stop"><DESCRIPTION>time tag for end of interval</DESCRIPTION></FIELD><DATA><TABLEDATA><TR><TD>2001-06-30T02:00:00</TD><TD>2001-06-30T04:10:00</TD></TR><TR><TD>2001-06-30T04:40:00</TD><TD>2001-06-30T06:20:00</TD></TR><TR><TD>2001-06-30T06:30:00</TD><TD>2001-06-30T07:10:00</TD></TR></TABLEDATA></DATA></TABLE></RESOURCE></VOTABLE>

An example of Time Table generated with AMDA

Tables may be exported in VOTable Format

(IVOA Standard to exchange tabular data)

Management of Time Tables


<TABLE><FIELD datatype="char" name="Start Time" ID="TimeIntervalStart" ucd="time.start"><DESCRIPTION>time tag for beginning of interval</DESCRIPTION></FIELD><FIELD datatype="char" name="Stop Time" ID="TimeIntervalStop" ucd="time.stop"><DESCRIPTION>time tag for end of interval</DESCRIPTION></FIELD><FIELD datatype="float" name="GeoMagnetic Latitude" ID="GeoMagLat" ><DESCRIPTION>Geomagnetic Latitude</DESCRIPTION></FIELD><FIELD datatype="float" name="GeoMagnetic Longitude" ID="GeoMagLon" ><DESCRIPTION>Geomagnetic Longitude</DESCRIPTION></FIELD><FIELD datatype="float" name="Local Time of onset" ID="onset" ><DESCRIPTION>Local Time of onset</DESCRIPTION></FIELD><DATA><TABLEDATA><TR><TD>2001-06-30T02:00:00</TD><TD>2001-06-30T04:10:00</TD><TD>66.33</TD><TD>161.37</TD><TD>23.06</TD>


Event tables : Next step

• Exchange of standardized time tables between data centres, services, tools.

• A complete description of a time table may be difficult :– Description of the data source– Description of search criteria : visual, mathematical– Description of the methods used (models, …)

• Use Spase « catalog » resource ?• A project started (early 2008) :

Exchange of TT between CAA QSAS CL and AMDA


In perspective : HELIO 2Virtual Observatory for the 4D heliosphere

VO for solar and solar system plasma dataAllow search, access, extraction of dataProvide tools and services for :

feature recognitioncatalogue managementdata mining…

Call: FP7-INFRASTRUCTURES-2008-2 , September 11, 2008

Likely interfaces with US VxOs and EUROPLANET-IDIS

VO-oriented activities of the CDPP

Documents

Transcript of VO-oriented activities of the CDPP