Post on 30-Dec-2020
Integrations of the ESA Geohazards and Hydrology Exploitation Platforms with the
EGI infrastructureCesare Rossi, Cloud Solutions Manager
Krakow, September 29th 2016
About our CompanyTerradue’s fact sheet
We support Earth Sciencesat many scales
”“
PassionatePeople15
EU Nationalities5
DevOps Culture1
Thematic Exploitation Platforms
■ Develop and employ open-source software
■ Implement standards■ Implement infrastructure
independence■ Include pay-per-use options
■ Leverage also commercial providers
■ Secure IPR■ Be community and impact
driven■ Enable sustainability
The fundamental principle is to move the User to the data and tools
”From TEP Official Website
“
Principles
Thematic Exploitation Platforms
■ Specific fields in the domain○ Geohazards domain
■ Earthquakes■ Volcanoes■ Landslides
○ Hydrology domain■ Hydrological modelling■ Flood mapping■ Water quality monitoring
■ Data-intensive research○ Targeted data○ Targeted software
THEMATIC Exploitation Platforms
■ Very fast access to large volume of data○ EO data
○ In-situ data
■ Distributed processing○ Hybrid Cloud infrastructure
○ Access to GRID resources
Thematic EXPLOITATION Platforms
■ Collaborative tools○ Referencing Publications
○ Sharing processing results
■ Different roles○ Community scientists
○ Data providers
○ Resource providers
Thematic Exploitation PLATFORMS
Geohazards and Hydrology TEPs
■ SaaS “Software-as-a-Service”○ Offering your EO processor on
the platform as a Service
○ With your data selection
■ PaaS “Platform-as-a-Service”○ Hadoop Cloud Sandboxes
“processor incubation chambers”
○ Catalogue for EO dataset and
time series and Data Storage
Infrastructure services
Terradue Cloud PlatformHybrid infrastructure
Cloudstack
Interoute
EC2 - powered by jclouds
Amazon Web Services
OCCI
EGI Federated Cloud
Opennebula registered partner
Terradue
Cloudsigma API [upcoming]
Cloudsigma
AWS
EGI
CSG
IRT
T2
EGI Foundation and Terradue partnershipKey outcomes
The M2M communication is realised through the Open Cloud Computing Interface (OCCI), ensuring integration, portability, interoperability and innovation.
Use of standard interfaces
We can rely on well-defined operational processes, having the EGI Foundation partner acting as single point of contact of the EGI Federated Cloud.
Reliable operations
We use Cloud resources within the European boundaries. In fact, it is mandatory for certain processing services due to their organisations’ policies.
European cloud resources
The partnership with EGI Foundation enhances the sustainability of the involved projects, helping in maintaining the systems operational beyond the life of the relative projects.
Project(s) sustainability
Integration Process
the technical requirements
Analysing
the OCCI interfaceIntegrating
functional and performance results
Evaluating
Assess Develop Validate Operate
users to run near real-time processing
Supporting
Integration RoadmapWhere do we stand
2015 2016 2017 2018
Feas
ibili
ty
stud
yIn
fras
truc
ture
se
tup
Dev
elop
men
tR
C A
ccep
tanc
e
GEP
and
H
EP P
ilots
Mon
itor a
nd
impr
ove
SLA
s
Mon
itor a
nd
impr
ove
SLA
s
GEP
Pilo
ts
RC
Acc
epta
nce
Current Agreements StatusWhat we access from EGI
800 360 6
GB RAM vCPUs Resource Centers
DemoGeohazards TEP systematic processing
The data are automatically selected on a regular basis, according to different policies:
■ Time driven■ Data driven
Scheduled User Processing
https://geohazards-tep.eo.esa.int
DemoGeohazards TEP systematic processing
It’s a data driven systematic processing. The service will follow a ramp-up period starting from September 2016 until Spring 2017:
■ EU Tectonic area■ World tectonic area (40%)■ World tectonic area (70%)■ World tectonic area (100%)
DLR InSAR Browse Medium Resolution Service
https://geohazards-tep.eo.esa.int
Will be supported by
DemoGeohazards TEP systematic processing
It’s a data driven systematic processing. This service provides an amplitude and coherence product at 50m systematically from Sentinel-1 data for a number of volcanoes globally.
DLR InSAR High Resolution Change Monitoring Service
https://geohazards-tep.eo.esa.int
Will be supported by
DemoGeohazards TEP processing on-demand
The User triggers the processing services from the Geobrowser Web interface.The User searches and filters the EO data from an Opensearch Catalogue, then passes the selected inputs to a processing service.
User-Driven processing
https://geohazards-tep.eo.esa.int
DemoGeohazards TEP processing on-demand
ADORE stands for Automated DORIS Environment. It is development started at the University of Miami Geodesy Group, to help researchers generate interferograms with ease. They are open-source projects.
Interferometry with ADORE DORIS
https://geohazards-tep.eo.esa.int
DemoGeohazards TEP processing on-demand
Land surface temperature map (Celsius degrees) obtained by multi-spectral optical sensors (LANDSAT 8) generated in GeoTIFF format.Upcoming versions will process S-2 and S-3 data.
INGV STEMP Optical chain for Volcanoes
https://geohazards-tep.eo.esa.int
Will be supported by
Thank you !
https://www.terradue.com