Aeolus Ground Processing: data flow, dissemination to ... · ESA UNCLASSIFIED – For Official Use...

13
ESA UNCLASSIFIED – For Official Use Aeolus Ground Processing: data flow, dissemination to users and viewing tools F.Buscaglione, G.Costa, C.Lopes – ESA/ESRIN (D/EOP-G) F.De Bruin – ESA/ESTEC (D/EOP-P) ADM-Aeolus Science and CAL/VAL Workshop Frascati, Italy, 10/02/2015

Transcript of Aeolus Ground Processing: data flow, dissemination to ... · ESA UNCLASSIFIED – For Official Use...

ESA UNCLASSIFIED – For Official Use

Aeolus Ground Processing: data flow, dissemination to users and viewing tools

F.Buscaglione, G.Costa, C.Lopes – ESA/ESRIN (D/EOP-G) F.De Bruin – ESA/ESTEC (D/EOP-P) ADM-Aeolus Science and CAL/VAL Workshop Frascati, Italy, 10/02/2015

Aeolus PDGS data flow | F.Buscaglione, G.Costa, C.Lopes, F.De Bruin | ESRIN, Frascati, Italy | 10/02/2015 | D/EOP-GMP | Slide 2

ESA UNCLASSIFIED – For Official Use

Outline

PDGS functional decomposition

Processing timeliness

Processing data flow

Data Quality Control

Near-Real-Time and Quasi-Real-Time

Data Dissemination to the users

Services to the users

Aeolus PDGS data flow | F.Buscaglione, G.Costa, C.Lopes, F.De Bruin | ESRIN, Frascati, Italy | 10/02/2015 | D/EOP-GMP | Slide 3

ESA UNCLASSIFIED – For Official Use

PDGS functional decomposition

Aeolus PDGS data flow | F.Buscaglione, G.Costa, C.Lopes, F.De Bruin | ESRIN, Frascati, Italy | 10/02/2015 | D/EOP-GMP | Slide 4

ESA UNCLASSIFIED – For Official Use

Processing timeliness

09H(or21H) 21H(or09H)

SENSING(satellite) orbit1

orbit2

orbit3

orbit4

orbit5

orbit6

orbit7

orbit8

orbit9

L1Bprocessing(APF-Tromsø) 1

2

3

4

5

6

7

8

9

L2Bprocessing(ECMWF-Reading)

AUX_METcoveringorbits1-6

1 (2ndpart)

2

3

4

5

6 (1stpart)

L2Aprocessing(APF-Tromsø) 1

2

3

4

5

TIMENOTTOSCALE

AUX_METcoverage

NRT

NRT

NRT

NRT

NRT

NRT

NRT

NRT

NRT

Aeolus PDGS data flow | F.Buscaglione, G.Costa, C.Lopes, F.De Bruin | ESRIN, Frascati, Italy | 10/02/2015 | D/EOP-GMP | Slide 5

ESA UNCLASSIFIED – For Official Use

Processing data flow

Aeolus PDGS data flow | F.Buscaglione, G.Costa, C.Lopes, F.De Bruin | ESRIN, Frascati, Italy | 10/02/2015 | D/EOP-GMP | Slide 6

ESA UNCLASSIFIED – For Official Use

Data Quality Control

Data Quality Control is applied at each processing stage

Each time a given product is generated and before it enters in the

archive (and thus in the following processing stages), a dedicated

screening is applied to evaluate its own quality.

Several criteria can be applied (e.g. threshold comparison, expected

values for flags, maximum variation, etc.)

For each file type (both products and auxiliary files) a set of checks is

defined and each individual result is reported inside the Quality Report

file

An overall flag (OK/NOK) given by the combination of all individual

checks is then evaluated and attached to the product under scrutiny and

used to enable/disable the usage of this file in the following processing

stages.

The Quality Report file is associated to the corresponding

product/auxiliary file and then disseminated to the users

Aeolus PDGS data flow | F.Buscaglione, G.Costa, C.Lopes, F.De Bruin | ESRIN, Frascati, Italy | 10/02/2015 | D/EOP-GMP | Slide 7

ESA UNCLASSIFIED – For Official Use

Near-Real-Time and Quasi-Real-Time

A given product is considered to be in Near-Real-Time (NRT)

condition as long as it is available to the user within three hours from

sensing

A given product is considered to be in Quasi-Real-Time (QRT)

condition as long as it is available to the user within thirty minutes

from sensing.

NRT condition is ensured for all the Level-1B products corresponding to

measurements performed during Svalbard non-blind orbits; NRT

condition is not met for the Svalbard blind orbits (3~4 per day)

No dedicated data in QRT condition is provided, anyway QRT condition is

ensured for the Level-1B data relevant to the data acquired during the

last ten minutes before the start of the dump at any Ground Station.

Aeolus PDGS data flow | F.Buscaglione, G.Costa, C.Lopes, F.De Bruin | ESRIN, Frascati, Italy | 10/02/2015 | D/EOP-GMP | Slide 8

ESA UNCLASSIFIED – For Official Use

Data dissemination to the users – 1

Data is available to the users via a dedicated dissemination server

Access is via the Single-Sign-On feature of the ESA Earth Observation

Only HTTPS protocol, no FTP protocol

Scripted and interactive data access/download is supported

Scripts require HTTPS POST function and handling of cookies

Scripts examples will be provided on ‘best-effort’ basis

Demo available during the workshop: https://addf.evo-pdgs.com/

• Limited capabilities and data content (only two days of L1A and L1B, no

geographical search)

• Credentials: username=addf password=Demo15++

• Certificates to be accepted!

• Will be switched off on Friday 13th February 2015 EOB

• Dedicated PC available in the Poster Room (James Cook) for free usage

• Comments/suggestions welcome at [email protected]

Aeolus PDGS data flow | F.Buscaglione, G.Costa, C.Lopes, F.De Bruin | ESRIN, Frascati, Italy | 10/02/2015 | D/EOP-GMP | Slide 9

ESA UNCLASSIFIED – For Official Use

Data dissemination to the users – 2 https://addf.evo-pdgs.com/

Aeolus PDGS data flow | F.Buscaglione, G.Costa, C.Lopes, F.De Bruin | ESRIN, Frascati, Italy | 10/02/2015 | D/EOP-GMP | Slide 10

ESA UNCLASSIFIED – For Official Use

Services to the user community – 1 web portal – SWARM example

mission selection

mission selection

general mission information

latest news

Aeolus PDGS data flow | F.Buscaglione, G.Costa, C.Lopes, F.De Bruin | ESRIN, Frascati, Italy | 10/02/2015 | D/EOP-GMP | Slide 11

ESA UNCLASSIFIED – For Official Use

Services to the user community – 2 web portal – SWARM example

latest results news

useful links

Aeolus PDGS data flow | F.Buscaglione, G.Costa, C.Lopes, F.De Bruin | ESRIN, Frascati, Italy | 10/02/2015 | D/EOP-GMP | Slide 12

ESA UNCLASSIFIED – For Official Use

Services to the user community – 3 Useful links for Aeolus

Under preparation

Potential candidates:

• Level-1B availability (including NRT condition)

• Selected locations pass prediction:

– Selected location XYZ

– Selected location JKL

Orbit # AOS (UTC) LOS (UTC) Min ground track distance (km)

156 12/10/2017 05:35:26 12/10/2017 05:43:40 25.8

157 12/10/2017 07:07:17 12/10/2017 07:16:35 37.2

Orbit # Overpass time (UTC) Ascending/Descending Min ground track distance (km)

156 12/10/2017 05:25:16 ASC 12.5

157 12/10/2017 07:27:07 DESC 8.5

Aeolus PDGS data flow | F.Buscaglione, G.Costa, C.Lopes, F.De Bruin | ESRIN, Frascati, Italy | 10/02/2015 | D/EOP-GMP | Slide 13

ESA UNCLASSIFIED – For Official Use