Post on 05-Sep-2019
www.snowflakesoftware.com www.seazone.com
Marine and Coastal Data Services in the Cloud
Richard Rombouts - Snowflake Software Ltd. &
Keiran Millard – SeaZone Solutions Ltd.
www.snowflakesoftware.com www.seazone.com
www.snowflakesoftware.com www.seazone.com
Marine Geospatial Data
Inspired Marine Data?
www.snowflakesoftware.com www.seazone.com
SeaZone HydroSpatial
• Global • Base
• One
Content
Cove
rage
www.snowflakesoftware.com www.seazone.com
Becoming Inspired
Discover Metadata
HydroSpatial Base
INSPIRE
MEDIN
Application Schema
INSPIRE Themes
Feature Catalogue
ISO 19131
HS Base
Build
Use Available for others to use
www.snowflakesoftware.com www.seazone.com
HydroSpatial Base and INSPIRE
Hydrography8.24%
Transport Networks13.48%
Land Cover8.99%
Elevation1.87%Geology
4.87%
Agricultural and aquaculture facilities
3.37%
Area management/restriction/re
gulation zones and reporting units
11.24%
Buildings8.61%
Habitats and biotopes
3.00%Human health and safety
2.62%
Land Use
0.75%
Species distribution
2.62%
Natural Risk Zones3.00%
Utility and governmental services10.49%
Production and industrial facilities16.48%
Sea Regions0.37%
www.snowflakesoftware.com www.seazone.com
How to expose INSPIRE features?
Hydrography8.24%
Transport Networks13.48%
Land Cover8.99%
Elevation1.87%Geology
4.87%
Agricultural and aquaculture facilities
3.37%
Area management/restriction/re
gulation zones and reporting units
11.24%
Buildings8.61%
Habitats and biotopes
3.00%Human health and safety
2.62%
Land Use
0.75%
Species distribution
2.62%
Natural Risk Zones3.00%
Utility and governmental services10.49%
Production and industrial facilities16.48%
Sea Regions0.37%
WFS
SR:Coastline
EL:Bathymetry HY:InterTidalArea
TN:ShipRoute
www.snowflakesoftware.com www.seazone.com
Cloud Data Services • Data as a Service (DaaS) is not new!
Do it yourself
Partner
Out-source
www.snowflakesoftware.com www.seazone.com
Cloud Data Service Infrastructure
WFS WFS WFS WFS
API Management
Administration Services Data Publication Services
Data Maintenance
Transform Publish Validate
Receive Validate Load
Hydro spatial
Service Monitoring & Testing
Performance & Capability (Ad-hoc)
Availability
(Continuous)
Workflow
Validation fails
www.snowflakesoftware.com www.seazone.com
Data Maintenance Infrastructure
WFS WFS WFS WFS
API Management
Data Publication Services
HydroSpatial
Hydrographical Offices
OGR2OGR Esri
FileGeoDB
Current configuration
www.snowflakesoftware.com www.seazone.com
Data Maintenance Infrastructure
WFS WFS WFS WFS
API Management
Data Publication Services
HydroSpatial
Hydrographical Offices
Workflow
Transform, Validate, Publish
Workflow
Validate, Load
Planned configuration
www.snowflakesoftware.com www.seazone.com
Database Cluster • Configuration
– Postgres database cluster (EnterpriseDB) on Amazon Web Services
• Benefits of Cluster: – Can start with two database instances and increase number of
instances as demand increases – Data automatically replicated between instances – Can establish database instances in different geographic regions
(e.g. Europe, North America, Middle East) to ensure QoS
www.snowflakesoftware.com www.seazone.com
Configuring the Data Services • Publishing from single source to multiple
schemas (eg. INSPIRE, S-100) • Using off-the-shelf software • Rapid configuration and deployment of
new data services
www.snowflakesoftware.com www.seazone.com
DEMONSTRATION Configuring Data Services with GO Publisher
www.snowflakesoftware.com www.seazone.com
Deploying Data Services • Once schema transformation configured –
project is deployed within WFS • But first need to configure WFS settings:
– GetCapabilities – Encoding format (compressed/uncompressed) – Servlet pattern
• Finally, generate WFS war and deploy to application server
www.snowflakesoftware.com www.seazone.com
Deploying Data Services
Desktop
Server
HydroSpatial
Translation configuration
Data Request
Schema translation
Data Request
Schema translation
Database Records
Database Records
SQL Query
SQL Query
Database table information
www.snowflakesoftware.com www.seazone.com
DEMONSTRATION Deploying Data Services with GO Publisher
www.snowflakesoftware.com www.seazone.com
API Management Services • Security:
• Firewalls, ports • usernames/password
• Analytics and Reporting • Billing and Payments • Bad requests
• Malformed/Malicious • Request the world or data
outside allowable area of interest
www.snowflakesoftware.com www.seazone.com
API Management Services WFS Proxy
www.snowflakesoftware.com www.seazone.com
Administrator Services Service Monitoring & Testing
Performance & Capability (Ad-hoc )
Availability (Continuous)
Requirements: • GetCapabilities & DescribeFeatureType
Response: <10 seconds • GetFeature: Bounding Box for 1 feature ≤
30 seconds • 50 simultaneous users
Measurement: • 10 requests submitted per second for 50
simultaneous users • Combination of GetCapabilities,
DescribeFeatureType & GetFeature • Sustained for 1 min
Requirements: • Available 99% of time • Max unplanned downtime = 3.63 days/yr • Periods of planned downtime for are
maintenance excluded
Measurement: • 10 requests submitted per hour • Monitoring is continuous for lifetime of service • Combination of requests
www.snowflakesoftware.com www.seazone.com
Using the Data Services
www.snowflakesoftware.com www.seazone.com
DEMONSTRATION Using the Data Services in Quantum GIS
www.snowflakesoftware.com www.seazone.com
www.snowflakesoftware.com www.seazone.com
Richard Rombouts
richard.rombouts@snowflakesoftware.com @RichRombouts ; @Sflakesoftware
Keiran Millard keiran.millard@seazone.com @SeaZoneDotCom