Cloud computing and web processing services
-
Upload
gasperi-jerome -
Category
Technology
-
view
290 -
download
0
description
Transcript of Cloud computing and web processing services
![Page 1: Cloud computing and web processing services](https://reader036.fdocuments.us/reader036/viewer/2022062616/549d1a8fb47959d4318b4909/html5/thumbnails/1.jpg)
RTS Techniques de l'Information et de la CommunicationCNES - Toulouse, France - October 1st, 2013
https://speakerdeck.com/jjrom/cloud-computing-and-web-processing-services
Cloud Computing & Web Processing Services
Jérôme Gasperi
![Page 2: Cloud computing and web processing services](https://reader036.fdocuments.us/reader036/viewer/2022062616/549d1a8fb47959d4318b4909/html5/thumbnails/2.jpg)
Cloud Computing Introduction
What we have done Issues
Web Processing ServicesIntroduction
What we have done Issues
What's next ?WPS on the cloud
![Page 3: Cloud computing and web processing services](https://reader036.fdocuments.us/reader036/viewer/2022062616/549d1a8fb47959d4318b4909/html5/thumbnails/3.jpg)
R&T Cloud Computing (2011) Use a cloud infrastructure to process Earth Observation data
![Page 4: Cloud computing and web processing services](https://reader036.fdocuments.us/reader036/viewer/2022062616/549d1a8fb47959d4318b4909/html5/thumbnails/4.jpg)
?
![Page 5: Cloud computing and web processing services](https://reader036.fdocuments.us/reader036/viewer/2022062616/549d1a8fb47959d4318b4909/html5/thumbnails/5.jpg)
host build consumeIAAS PAAS SAAS
![Page 6: Cloud computing and web processing services](https://reader036.fdocuments.us/reader036/viewer/2022062616/549d1a8fb47959d4318b4909/html5/thumbnails/6.jpg)
host build consumeIAAS PAAS SAAS
![Page 7: Cloud computing and web processing services](https://reader036.fdocuments.us/reader036/viewer/2022062616/549d1a8fb47959d4318b4909/html5/thumbnails/7.jpg)
Private or public ?
![Page 8: Cloud computing and web processing services](https://reader036.fdocuments.us/reader036/viewer/2022062616/549d1a8fb47959d4318b4909/html5/thumbnails/8.jpg)
process 1 €
store 5 €
access 0.5 €
to
+
1 time
per year
each time
(Very) approximative computations for a 20x20 km PA+XS Pleiades product (4 Go) - based on Amazon EC2 and S3 pricing (2012)
![Page 9: Cloud computing and web processing services](https://reader036.fdocuments.us/reader036/viewer/2022062616/549d1a8fb47959d4318b4909/html5/thumbnails/9.jpg)
process 1 €
store 5 €
access 0.5 €
to
+
1 time
per year
each time
(Very) approximative computations for a 20x20 km PA+XS Pleiades product (4 Go) - based on Amazon EC2 and S3 pricing (2012)
![Page 10: Cloud computing and web processing services](https://reader036.fdocuments.us/reader036/viewer/2022062616/549d1a8fb47959d4318b4909/html5/thumbnails/10.jpg)
Data security and user privacy cannot be guaranteed in public clouds
Majority of cloud providers are subject to governmental law (e.g. US patriot act)
![Page 11: Cloud computing and web processing services](https://reader036.fdocuments.us/reader036/viewer/2022062616/549d1a8fb47959d4318b4909/html5/thumbnails/11.jpg)
...so we choose a private solution
![Page 12: Cloud computing and web processing services](https://reader036.fdocuments.us/reader036/viewer/2022062616/549d1a8fb47959d4318b4909/html5/thumbnails/12.jpg)
Web browser
What we have done
eNovance (Paris)
![Page 13: Cloud computing and web processing services](https://reader036.fdocuments.us/reader036/viewer/2022062616/549d1a8fb47959d4318b4909/html5/thumbnails/13.jpg)
Web browser
What we have done
eNovance (Paris)
SRTM tile
Data
![Page 14: Cloud computing and web processing services](https://reader036.fdocuments.us/reader036/viewer/2022062616/549d1a8fb47959d4318b4909/html5/thumbnails/14.jpg)
Web browser
Processing (Orfeo Toolbox)
What we have done
eNovance (Paris)
SRTM tile
Data
![Page 15: Cloud computing and web processing services](https://reader036.fdocuments.us/reader036/viewer/2022062616/549d1a8fb47959d4318b4909/html5/thumbnails/15.jpg)
Hill Shading
Web browser
Processing (Orfeo Toolbox)
What we have done
eNovance (Paris)
SRTM tile
Data
![Page 16: Cloud computing and web processing services](https://reader036.fdocuments.us/reader036/viewer/2022062616/549d1a8fb47959d4318b4909/html5/thumbnails/16.jpg)
Hill Shading Projecting
Web browser
Processing (Orfeo Toolbox)
What we have done
eNovance (Paris)
SRTM tile
Data
![Page 17: Cloud computing and web processing services](https://reader036.fdocuments.us/reader036/viewer/2022062616/549d1a8fb47959d4318b4909/html5/thumbnails/17.jpg)
Hill Shading Projecting
Web browser
Processing (Orfeo Toolbox)
What we have done
VISUALIZEWMS Server
Tiling
eNovance (Paris)
SRTM tile
Data
![Page 18: Cloud computing and web processing services](https://reader036.fdocuments.us/reader036/viewer/2022062616/549d1a8fb47959d4318b4909/html5/thumbnails/18.jpg)
Conclusions
![Page 19: Cloud computing and web processing services](https://reader036.fdocuments.us/reader036/viewer/2022062616/549d1a8fb47959d4318b4909/html5/thumbnails/19.jpg)
Private cloud technologies are quite simple to implement. They reduce the cost of operation and maintenance by sharing a common infrastructure across multiple projects
![Page 20: Cloud computing and web processing services](https://reader036.fdocuments.us/reader036/viewer/2022062616/549d1a8fb47959d4318b4909/html5/thumbnails/20.jpg)
However...
![Page 21: Cloud computing and web processing services](https://reader036.fdocuments.us/reader036/viewer/2022062616/549d1a8fb47959d4318b4909/html5/thumbnails/21.jpg)
Transfering large volumes of data is problematic
However...
![Page 22: Cloud computing and web processing services](https://reader036.fdocuments.us/reader036/viewer/2022062616/549d1a8fb47959d4318b4909/html5/thumbnails/22.jpg)
Transfering large volumes of data is problematicThis is true for upload and download
However...
![Page 23: Cloud computing and web processing services](https://reader036.fdocuments.us/reader036/viewer/2022062616/549d1a8fb47959d4318b4909/html5/thumbnails/23.jpg)
...so
![Page 24: Cloud computing and web processing services](https://reader036.fdocuments.us/reader036/viewer/2022062616/549d1a8fb47959d4318b4909/html5/thumbnails/24.jpg)
Data and processes should be colocated
...so
![Page 25: Cloud computing and web processing services](https://reader036.fdocuments.us/reader036/viewer/2022062616/549d1a8fb47959d4318b4909/html5/thumbnails/25.jpg)
Data and processes should be colocatedProcessing results should be downloaded only if needed
...so
![Page 26: Cloud computing and web processing services](https://reader036.fdocuments.us/reader036/viewer/2022062616/549d1a8fb47959d4318b4909/html5/thumbnails/26.jpg)
Data and processes should be colocatedProcessing results should be downloaded only if neededBetter to offer a Web service to visualize/manipulate results
...so
![Page 27: Cloud computing and web processing services](https://reader036.fdocuments.us/reader036/viewer/2022062616/549d1a8fb47959d4318b4909/html5/thumbnails/27.jpg)
Data and processes should be colocatedProcessing results should be downloaded only if neededBetter to offer a Web service to visualize/manipulate resultsStandardize processes inputs/outputs description (e.g. WPS)
...so
![Page 28: Cloud computing and web processing services](https://reader036.fdocuments.us/reader036/viewer/2022062616/549d1a8fb47959d4318b4909/html5/thumbnails/28.jpg)
Web Processing Service (2012-2013)Set WPS on top of Orfeo Toolbox processing chains
![Page 29: Cloud computing and web processing services](https://reader036.fdocuments.us/reader036/viewer/2022062616/549d1a8fb47959d4318b4909/html5/thumbnails/29.jpg)
Web Processing Services (WPS) is an OGC standard which defines interfaces to publish, describe and execute geospatial processes
![Page 30: Cloud computing and web processing services](https://reader036.fdocuments.us/reader036/viewer/2022062616/549d1a8fb47959d4318b4909/html5/thumbnails/30.jpg)
WPS a ProcessingWeb application
![Page 31: Cloud computing and web processing services](https://reader036.fdocuments.us/reader036/viewer/2022062616/549d1a8fb47959d4318b4909/html5/thumbnails/31.jpg)
From pixel...Remote sensing image
What we have done
![Page 32: Cloud computing and web processing services](https://reader036.fdocuments.us/reader036/viewer/2022062616/549d1a8fb47959d4318b4909/html5/thumbnails/32.jpg)
From pixel...Remote sensing image
...to informationLand cover thematic map
What we have done
![Page 33: Cloud computing and web processing services](https://reader036.fdocuments.us/reader036/viewer/2022062616/549d1a8fb47959d4318b4909/html5/thumbnails/33.jpg)
mapshup Web application
http://mapshup.info
WPSConstellationhttp://www.constellation-sdi.org
Orfeo Toolbox Processing
http://orfeo-toolbox.org
![Page 34: Cloud computing and web processing services](https://reader036.fdocuments.us/reader036/viewer/2022062616/549d1a8fb47959d4318b4909/html5/thumbnails/34.jpg)
Orfeo Toolbox Remote sensing image libraryOpen SourceDevelopped by the French Space Agency
Processing
![Page 35: Cloud computing and web processing services](https://reader036.fdocuments.us/reader036/viewer/2022062616/549d1a8fb47959d4318b4909/html5/thumbnails/35.jpg)
Orfeo Toolbox More than 70 high level processing chains orthorectification segmentation classification etc.
Processing
![Page 36: Cloud computing and web processing services](https://reader036.fdocuments.us/reader036/viewer/2022062616/549d1a8fb47959d4318b4909/html5/thumbnails/36.jpg)
Orfeo Toolbox More than 70 high level processing chains orthorectification segmentation classification etc.
Processing
Supervised learning(land cover is computed from a set of "well known areas" given by user)
Based on SVM(http://en.wikipedia.org/wiki/Support_vector_machine)
![Page 37: Cloud computing and web processing services](https://reader036.fdocuments.us/reader036/viewer/2022062616/549d1a8fb47959d4318b4909/html5/thumbnails/37.jpg)
Constellation
WPS
Geospatial Networking ServicesOGC/ISO implementationsMulti platform (JAVA)OpenSource
WMS WFS CSW WPS
![Page 38: Cloud computing and web processing services](https://reader036.fdocuments.us/reader036/viewer/2022062616/549d1a8fb47959d4318b4909/html5/thumbnails/38.jpg)
mapshup Improves access to geospatial dataHTML + javascriptBased on OpenLayers and jQuery
Web application
![Page 39: Cloud computing and web processing services](https://reader036.fdocuments.us/reader036/viewer/2022062616/549d1a8fb47959d4318b4909/html5/thumbnails/39.jpg)
mapshup Supported data sources
WMS WFS CSW WPS OpenSearch
etc.Flickr
Youtube
GeoRSS
KML
Wikipedia
Google maps
Bing maps
OpenStreetMap MapBoxWMTS
Web application
![Page 40: Cloud computing and web processing services](https://reader036.fdocuments.us/reader036/viewer/2022062616/549d1a8fb47959d4318b4909/html5/thumbnails/40.jpg)
mapshup Supported data sources
See WPS demohttps://vimeo.com/67288678
WMS WFS CSW WPS OpenSearch
etc.Flickr
Youtube
GeoRSS
KML
Wikipedia
Google maps
Bing maps
OpenStreetMap MapBoxWMTS
Web application
![Page 42: Cloud computing and web processing services](https://reader036.fdocuments.us/reader036/viewer/2022062616/549d1a8fb47959d4318b4909/html5/thumbnails/42.jpg)
Conclusions
![Page 43: Cloud computing and web processing services](https://reader036.fdocuments.us/reader036/viewer/2022062616/549d1a8fb47959d4318b4909/html5/thumbnails/43.jpg)
WPS 1.0 lacks a true asynchronous process management...There is no way to cancel a launched process !
![Page 44: Cloud computing and web processing services](https://reader036.fdocuments.us/reader036/viewer/2022062616/549d1a8fb47959d4318b4909/html5/thumbnails/44.jpg)
However...
![Page 45: Cloud computing and web processing services](https://reader036.fdocuments.us/reader036/viewer/2022062616/549d1a8fb47959d4318b4909/html5/thumbnails/45.jpg)
WPS 2.0 defines a set of process management operations - GetStatus, Delete, Pause and Resume
However...
![Page 46: Cloud computing and web processing services](https://reader036.fdocuments.us/reader036/viewer/2022062616/549d1a8fb47959d4318b4909/html5/thumbnails/46.jpg)
WPS 2.0 defines a set of process management operations - GetStatus, Delete, Pause and ResumeThis is a must have to deploy asynchronous WPS on the cloud
However...
![Page 47: Cloud computing and web processing services](https://reader036.fdocuments.us/reader036/viewer/2022062616/549d1a8fb47959d4318b4909/html5/thumbnails/47.jpg)
WPS 2.0 defines a set of process management operations - GetStatus, Delete, Pause and ResumeThis is a must have to deploy asynchronous WPS on the cloudShould be an official OGC standard by the end of 2013
However...
![Page 48: Cloud computing and web processing services](https://reader036.fdocuments.us/reader036/viewer/2022062616/549d1a8fb47959d4318b4909/html5/thumbnails/48.jpg)
What's nextWPS on the cloud - OGC OWS-10 Testbeb
![Page 49: Cloud computing and web processing services](https://reader036.fdocuments.us/reader036/viewer/2022062616/549d1a8fb47959d4318b4909/html5/thumbnails/49.jpg)
Orthorectifying images hosted by a cloud infrastructure using WPS standardIn kind contribution to the «Open Mobility» thread of the OGC OWS-10 TestbebFinal delivery and demonstration April/May 2014
![Page 50: Cloud computing and web processing services](https://reader036.fdocuments.us/reader036/viewer/2022062616/549d1a8fb47959d4318b4909/html5/thumbnails/50.jpg)
Raw images
Processing
Data (Pléiades samples)
Client
Interoute (location : UK)
Services
PROCESSWPS Server
Orthorectify(OTB)VISUALIZE
WMS Server
SEARCHCSW Server
Metadata
+1
2
3
Assess Quality
Improve Quality
Services
Processing
Astrium GEO
Result
QualityWPS Server4 VISUALIZE
WMS Server
![Page 51: Cloud computing and web processing services](https://reader036.fdocuments.us/reader036/viewer/2022062616/549d1a8fb47959d4318b4909/html5/thumbnails/51.jpg)
Landsat Landsat
Landsat2. Click on '+' to process a new orthorectification. Process parameters are set by user and sent to an asynchronous WPS orthorectification process located on the
3. Result is displayed within the map trough a WMS
Landsat
4. Orthorectified image quality can be checked through "Assess Quality" WPS process located on the Result is displayed within the map as a WMS quality layer stored on the
1. Select raw image to orthorectify within CSW catalog located on theLaat
![Page 52: Cloud computing and web processing services](https://reader036.fdocuments.us/reader036/viewer/2022062616/549d1a8fb47959d4318b4909/html5/thumbnails/52.jpg)
RTS Techniques de l'Information et de la CommunicationCNES - Toulouse, France - October 1st, 2013
https://speakerdeck.com/jjrom/cloud-computing-and-web-processing-services
Cloud Computing & Web Processing Services
Jérôme Gasperi