www.SAFORAH.org

Grid-enabled OGC Environment for EO Data and Services

in Support of Canada’s Forest Applications

Hao Chen1, David G. Goodenough1,2, Liping Di 3, Aimin Guan1, Andrew Dyk1 and Geordie Hobart1

1Natural Resources Canada, Canadian Forest Service, Canada2Department of Computer Science, University of Victoria, Canada

3Center for Spatial Information Science and Systems

George Mason University, USA

© September 25, 2007

www.SAFORAH.org

Outlines

Background information Data grid Grid services OGC user interfaces CUDOS Applications and impact Conclusions

www.SAFORAH.org

Background

Canada contains 10% of the world’s forests. To monitor forest resources, large amounts of Earth Observation (EO) data are collected by the Canadian Forest Service (CFS) and stored at various locations across Canada.

Most of EO data are currently managed separately by each research group from acquisition to archiving. To enhance EO collaboration within CFS and improve the return on investment of data purchases, new systems leading to a greater pooling of EO data resources are required.

SAFORAH or System of Agents for Forest Observation Research with Advanced Hierarchies is a grid computing infrastructure to manage, catalogue and archive EO data within a geographically distributed network of diverse computational resources.

EO data in SAFORAH is available through either a set of OGC Web services or the Catalogue and User Data Ordering System (CUDOS).

www.SAFORAH.org

Forest Monitoring with Remote Sensing

www.SAFORAH.org

SAFORAH Participating Partners

Natural Resources Canada (NRCan)

Canadian Space Agency (CSA)

GeoConnections

University of Victoria (UVic)

Center for Spatial Information Science and Systems (CSISS)

George Mason University (GMU)

MacDonald, Dettwiler and Associates Ltd. (MDA)

Environment Canada (EC)

Agriculture and Agri-Food Canada (AAFC)

BC Common Information Technology Services (CITS)

Canada Foundation for Innovation (CFI)

www.SAFORAH.org

SAFORAH System Architecture

www.SAFORAH.org

Grid Computing Provides middleware for seamless, scalable and secure access to

a wide variety of geographically distributed computational resources: data storage facilities, supercomputers, computer clusters ...

Hides the complexity of the infrastructure from users and presents them a single unified resource to solve large scale computational problems.

Supports collaborative and national applications in a dynamic virtual-organization (VO) environment.

www.SAFORAH.org

Open-Source Grid Middleware The Open Grid Services Architecture (OGSA) developed by the

Global Grid Forum specifies a set of standard interfaces for the Grid services. (as architecture)

The Web Services Resource Framework (WSRF) is a product of the Open Grid Forum and states the relationship between stateful resources and Web services that OGSA needs. (as infrastructure)

Globus Toolkit 4 (GT-4) for service-oriented grids: An open source software toolkit used for building grids by the

Globus Alliance (http://www.globus.org); Realization of the OGSA requirements; First implementation of WSRF; Development of grids having a service-oriented-architecture

(SOA). Main Grid software to establish the SAFORAH data Grid.

www.SAFORAH.org

SAFORAH Grid Connectivity SAFORAH data grid networks

Digital certificate signed by Grid Canada; CANARIE fibre backbone across Canada at 10 Gbps.

Connection in progressConnection in progress Operational connectionOperational connection

PFC A FC

L FC No FC

UV ic

G rid C o m p u tin gN e tw o rk

PROFESSIONAL W ORKSTATION

COMPACT

PROFESSIONAL WORKSTATION

G e o g ra phyU V ic

C S A

A A F C

P o rta ls

D a ta S to ra g eU V ic

E C C W S

N R C a n C F S

N R C a n C F S

N R C a n C F S

N R C a n C F S

www.SAFORAH.org

ECGWCS

PFCGWCS

AFCGWCSEC

GWCS

Grid-enabled Services and OGC Service Portals

Globus Toolkit 4.0.4

HDF-EOS

GeoTIFF

WCS Portal

CSW Portal

ClientOther OGC Services

GCSW

WMS Portal

Grid Tier

ROS

MDS

CGS

GWCS(PFC)

OGC Tier

User Tier

RLS

MetadataMetadata

GWMS(PFC)

www.SAFORAH.org

Grid-enabled OGC Services Grid-enabled Web Coverage Service (GWCS) provides access

to distributed EO data and information products managed by the SAFORAH data grid.

Grid-enabled Web Map Service (GWMS) responses to user’s rendering requests to dynamically produce static maps from geo-referenced EO data managed by the SAFORAH data grid.

Grid-enabled Catalogue Service for Web (GCSW) provides Grid-based archiving, publishing, managing, and querying of geospatial data and services and facilitates transparent access to the replica data and related services under the Grid environment.

Grid-enabled OGC services Work as Grid services. Allow authorized Grid clients to access and interact with the services

directly. Allow other OGC clients to access these Grid-enabled OGC

services through the OGC Web portals.

www.SAFORAH.org

Replica Location Service (RLS) Intend to be one of a set of services for providing data replication

management in grids. Maintain and provide access to mapping information from logical

names for data items to target names. Include Local Replica Catalog (LRC) and Replica Location Index

(RLI) ― Aggregated state information contained in one or more LRCs.

RLS requires: ODBC

Recommended version 3.51.2 MYODBC

Recommended version 3.51.10 MySQL

Recommended version 4.1.21

LRC/RLI ServerLRC/RLI Server

ODBC (libiodbc)ODBC (libiodbc)

MYODBCMYODBC

MySQL ServerMySQL Server

DBDB

LRC (2) LRC (2)

RLI (1) RLI (2)

www.SAFORAH.org

Replica and Optimization Service (ROS)

Use RLS and MDS to provide replica and optimization service. Monitoring and Discovery System (MDS) is a GT-4 service and

provides information about available resources on the Grid and their status. Determine which host has lowest workload and fastest

response time to service a user request. RLS provides all possible host names containing replica data

from available grid nodes where physical data are stored. ROS selects an optimized

source for service.

RLS

ROS

MDS

www.SAFORAH.org

Control Grid Service Control Grid Service (CGS) is a central management service,

which takes EO data request from a portal and works with other Grid services collectively to generate response for the user’s request.

WCS Portal WMS Portal

GCSW

GWCS

GWMSCGS

ROS

RLS

www.SAFORAH.org

WCS, CSW and WMS Portals Three OGC Web portals were implemented and act as the

common interfaces for OGC users and other OGC enabled geospatial information systems.

Web Coverage Service (WCS) v1.0.0

Web Map Service (WMS) v1.3.0

Catalogue Service for Web (CSW) v2.0 The portals convert a standard OGC request to a Grid-enabled

service request or unwrap a Grid service response back to a standard OGC service response so that OGC users can seamlessly access EO data in the SAFORAH grid.

Portals have the responsibility for user access control and for signing into the SAFORAH data Grid using Grid Canada credentials.

www.SAFORAH.org

OGC Portals Access OGC services offered by SAFORAH

WCS

WMS

CSW

Portal validations Open GIS Test Suite (http://cite.opengeospatial.org) NFIS Test Server (https://ca.nfis.org).

Operation Name GET/POST

GetCapabilities http://www4.saforah.org/WCSPortal/WCSPortal?

DescribCoverage http://www4.saforah.org/WCSPortal/WCSPortal?

GetCoverage http://www4.saforah.org/WCSPortal/WCSPortal?

Operation Name POST

GetRecord http://www4.saforah.org/GridCSFPortal/GridCSFPortal?

Operation Name GET/POST

GetCapabilities http://www4.saforah.org/WMSPortal/WMSPortal?

GetMap http://www4.saforah.org/WMSPortal/WMSPortal?

www.SAFORAH.org

Act as a online portal to the SAFORAH data Grid. Support a variety of remote sensing satellites, sensors, and image types. Web access: http://www.saforah.org

Catalogue and User Data Ordering System (CUDOS) (by MacDonald, Dettwiler and Associates Ltd.)

www.SAFORAH.org

Example

Metadata in CUDOS

www.SAFORAH.org

Example of a remote sensing image (near Ottawa) from SPOT-4:

Authorized users can download/ingest EO images from/to the data grid via CUDOS.

CUDOS: Browse Image and Geological Location

View full size browse image View full size browse image buttonbutton

Geographical location Geographical location indicator mapindicator map

www.SAFORAH.org

Access Data via CUDOS or WCS Service

grid service

User defined geo-object Original data setLegend:

User request

User request:

User received:

CUDOS delivery OGC delivery

Original data set:

www.SAFORAH.org

SAFORAH Application Example - EOSD The Earth Observation for Sustainable Development (EOSD) of

Forests is an initiative of the Canadian Forest Service in partnership with the Canadian Space Agency to create products for forest inventory, forest carbon accounting, monitoring sustainable development, and landscape management.

Four Canadian Forestry Centres work in partnership with the Provinces and Territories to develop forest cover, biomass, and change maps of Canada’s forests. Pacific Forestry Centre, Victoria British Columbia Atlantic Forestry Centre, Cornerbrook Newfoundland Northern Forestry Centre, Edmonton Alberta Laurentian Forestry Centre, Québec

More than 1700 Landsat (TM/ETM+) images for all of Canada were used to develop forest information products.

www.SAFORAH.org

EOSD Landcover Products Coverage

Based upon the national topographic database (NTDB) national topographic system (NTS) map sheet framework and available for download on a 1:250,000 NTS map sheet basis. Each map sheet represents an area of approximately 14,850 square kilometers.

Total 630 tiles for the circa 2000 coverage.

www.SAFORAH.org

EO Images and Derived Information Products Current EO images and information products in SAFORAH

OGC access availableOGC access available

EO Platform Number of images Coverage Access

Landsat TM 884 Canada Public

Landsat ETM+ 876 Canada Public

Radarsat 1 >10 Variable coverage PFC, AAFC

Envisat ASAR 28 Hinton, Petawawa, Radisson PFC,LFC

Envisat MERIS 11 Hinton, Petawawa, Radisson PFC,LFC

Spot 3/4/5 >3 Hinton, Ottawa PFC, AAFC

Airborne AVIRIS 314 Variable coverage of Canada PFC

AirSAR >32 GVWD PFC

PROBA-1 CHRIS >167 Variable coverage of Canada PFC

ASTER >11 GVWD PFC

EO-1 Hyperion >13 Canada PFC

EO-1 ALI >14 Hinton, GVWD, Ottawa PFC, AAFC

EOSD Landcover 630 Across Canada Public

Canada Mosaic 3 Canada 2000 and 1990 Public

““>” Data ingestion in progress>” Data ingestion in progress

www.SAFORAH.org

Conclusions Built the SAFORAH data grid with GT-4 over CANARIE

broadband networks to provide seamless, scalable and secure access to a wide variety of geographically distributed computation resources.

Supported EO data collaboration for national forest monitoring programs in a dynamic virtual-organization (VO) environment (part of Grid Canada).

Implemented and deployed grid services in the GT-4 environment, which will lead to the next phase that is the evolution of real time EO data processing by using the supercomputer facilities and petabyte data storage utilities at the University of Victoria.

Provided standard OGC interfaces, including WMS, WCS and CS/W, to enhance information interchange with other geospatial information systems, including the Canadian Geospatial Data Infrastructure (CGDI).

www.SAFORAH.org

Acknowledgements

Support from: Natural Resources Canada, Canadian Space Agency, GeoConnections, Department of Computer Science at the University of Victoria, The National Forest Information System (NFIS).

DGG is also grateful for the support of the Natural Sciences and Engineering Research Council of

Canada (NSERC).