Aeolus Ground Processing: data flow, dissemination to ... · ESA UNCLASSIFIED – For Official Use...
Transcript of Aeolus Ground Processing: data flow, dissemination to ... · ESA UNCLASSIFIED – For Official Use...
ESA UNCLASSIFIED – For Official Use
Aeolus Ground Processing: data flow, dissemination to users and viewing tools
F.Buscaglione, G.Costa, C.Lopes – ESA/ESRIN (D/EOP-G) F.De Bruin – ESA/ESTEC (D/EOP-P) ADM-Aeolus Science and CAL/VAL Workshop Frascati, Italy, 10/02/2015
Aeolus PDGS data flow | F.Buscaglione, G.Costa, C.Lopes, F.De Bruin | ESRIN, Frascati, Italy | 10/02/2015 | D/EOP-GMP | Slide 2
ESA UNCLASSIFIED – For Official Use
Outline
PDGS functional decomposition
Processing timeliness
Processing data flow
Data Quality Control
Near-Real-Time and Quasi-Real-Time
Data Dissemination to the users
Services to the users
Aeolus PDGS data flow | F.Buscaglione, G.Costa, C.Lopes, F.De Bruin | ESRIN, Frascati, Italy | 10/02/2015 | D/EOP-GMP | Slide 3
ESA UNCLASSIFIED – For Official Use
PDGS functional decomposition
Aeolus PDGS data flow | F.Buscaglione, G.Costa, C.Lopes, F.De Bruin | ESRIN, Frascati, Italy | 10/02/2015 | D/EOP-GMP | Slide 4
ESA UNCLASSIFIED – For Official Use
Processing timeliness
09H(or21H) 21H(or09H)
SENSING(satellite) orbit1
orbit2
orbit3
orbit4
orbit5
orbit6
orbit7
orbit8
orbit9
L1Bprocessing(APF-Tromsø) 1
2
3
4
5
6
7
8
9
L2Bprocessing(ECMWF-Reading)
AUX_METcoveringorbits1-6
1 (2ndpart)
2
3
4
5
6 (1stpart)
L2Aprocessing(APF-Tromsø) 1
2
3
4
5
TIMENOTTOSCALE
AUX_METcoverage
NRT
NRT
NRT
NRT
NRT
NRT
NRT
NRT
NRT
Aeolus PDGS data flow | F.Buscaglione, G.Costa, C.Lopes, F.De Bruin | ESRIN, Frascati, Italy | 10/02/2015 | D/EOP-GMP | Slide 5
ESA UNCLASSIFIED – For Official Use
Processing data flow
Aeolus PDGS data flow | F.Buscaglione, G.Costa, C.Lopes, F.De Bruin | ESRIN, Frascati, Italy | 10/02/2015 | D/EOP-GMP | Slide 6
ESA UNCLASSIFIED – For Official Use
Data Quality Control
Data Quality Control is applied at each processing stage
Each time a given product is generated and before it enters in the
archive (and thus in the following processing stages), a dedicated
screening is applied to evaluate its own quality.
Several criteria can be applied (e.g. threshold comparison, expected
values for flags, maximum variation, etc.)
For each file type (both products and auxiliary files) a set of checks is
defined and each individual result is reported inside the Quality Report
file
An overall flag (OK/NOK) given by the combination of all individual
checks is then evaluated and attached to the product under scrutiny and
used to enable/disable the usage of this file in the following processing
stages.
The Quality Report file is associated to the corresponding
product/auxiliary file and then disseminated to the users
Aeolus PDGS data flow | F.Buscaglione, G.Costa, C.Lopes, F.De Bruin | ESRIN, Frascati, Italy | 10/02/2015 | D/EOP-GMP | Slide 7
ESA UNCLASSIFIED – For Official Use
Near-Real-Time and Quasi-Real-Time
A given product is considered to be in Near-Real-Time (NRT)
condition as long as it is available to the user within three hours from
sensing
A given product is considered to be in Quasi-Real-Time (QRT)
condition as long as it is available to the user within thirty minutes
from sensing.
NRT condition is ensured for all the Level-1B products corresponding to
measurements performed during Svalbard non-blind orbits; NRT
condition is not met for the Svalbard blind orbits (3~4 per day)
No dedicated data in QRT condition is provided, anyway QRT condition is
ensured for the Level-1B data relevant to the data acquired during the
last ten minutes before the start of the dump at any Ground Station.
Aeolus PDGS data flow | F.Buscaglione, G.Costa, C.Lopes, F.De Bruin | ESRIN, Frascati, Italy | 10/02/2015 | D/EOP-GMP | Slide 8
ESA UNCLASSIFIED – For Official Use
Data dissemination to the users – 1
Data is available to the users via a dedicated dissemination server
Access is via the Single-Sign-On feature of the ESA Earth Observation
Only HTTPS protocol, no FTP protocol
Scripted and interactive data access/download is supported
Scripts require HTTPS POST function and handling of cookies
Scripts examples will be provided on ‘best-effort’ basis
Demo available during the workshop: https://addf.evo-pdgs.com/
• Limited capabilities and data content (only two days of L1A and L1B, no
geographical search)
• Credentials: username=addf password=Demo15++
• Certificates to be accepted!
• Will be switched off on Friday 13th February 2015 EOB
• Dedicated PC available in the Poster Room (James Cook) for free usage
• Comments/suggestions welcome at [email protected]
Aeolus PDGS data flow | F.Buscaglione, G.Costa, C.Lopes, F.De Bruin | ESRIN, Frascati, Italy | 10/02/2015 | D/EOP-GMP | Slide 9
ESA UNCLASSIFIED – For Official Use
Data dissemination to the users – 2 https://addf.evo-pdgs.com/
Aeolus PDGS data flow | F.Buscaglione, G.Costa, C.Lopes, F.De Bruin | ESRIN, Frascati, Italy | 10/02/2015 | D/EOP-GMP | Slide 10
ESA UNCLASSIFIED – For Official Use
Services to the user community – 1 web portal – SWARM example
mission selection
mission selection
general mission information
latest news
Aeolus PDGS data flow | F.Buscaglione, G.Costa, C.Lopes, F.De Bruin | ESRIN, Frascati, Italy | 10/02/2015 | D/EOP-GMP | Slide 11
ESA UNCLASSIFIED – For Official Use
Services to the user community – 2 web portal – SWARM example
latest results news
useful links
Aeolus PDGS data flow | F.Buscaglione, G.Costa, C.Lopes, F.De Bruin | ESRIN, Frascati, Italy | 10/02/2015 | D/EOP-GMP | Slide 12
ESA UNCLASSIFIED – For Official Use
Services to the user community – 3 Useful links for Aeolus
Under preparation
Potential candidates:
• Level-1B availability (including NRT condition)
• Selected locations pass prediction:
– Selected location XYZ
– Selected location JKL
Orbit # AOS (UTC) LOS (UTC) Min ground track distance (km)
156 12/10/2017 05:35:26 12/10/2017 05:43:40 25.8
157 12/10/2017 07:07:17 12/10/2017 07:16:35 37.2
Orbit # Overpass time (UTC) Ascending/Descending Min ground track distance (km)
156 12/10/2017 05:25:16 ASC 12.5
157 12/10/2017 07:27:07 DESC 8.5