Drupal Day 2011 - Thinking spatially with your open data
31
Thinking spatially with your open data “Spatial data deluge: please bring me an umbrella!” Juan Arévalo, Marco Giacomassi
-
Upload
drupalday -
Category
Technology
-
view
1.068 -
download
2
description
Talk di Juan Arevalo & Marco Giacomassi | Drupal Day Roma 2011 The Open Data movement is now moving a step forward, many governments, institutions and business have recently started the process of making information available to citizens and customers. Data is now seen as a powerful instrument to increase transparency in public administration and business on policies. About 80% of this information has a spatial component that is not entirely exploited yet. A range of open source solutions are now available to address this challenge, in this session we will explore their potential and possible applications. The so-called “data deluge” is here.. but we can build good umbrellas. Please come to learn more about it!
Transcript of Drupal Day 2011 - Thinking spatially with your open data
Thinking spatially with your open data“Spatial data deluge: please bring me an
umbrella!”Juan Arévalo, Marco Giacomassi
Data is everywhere...
- Decreto Legislativo 32/2010 di recepimento della Direttiva Inspire
- Metadata, interoperability, Web services, standards, data specifications, etc..
• Infrastructure for spatial information in Europe to support Community environmental policies:
Inspire Directive
Cost:
Total direct cost: 1.5 M € (76% Human Resources)Period: 2002-2006
Benefits:
Internal efficiency benefits: 500 hours per month (30€ hour)Recovery cost: 6 months
Is it worth it??
Open Data Movement
Open Data Applications
Spatial Data Infrastructures and Open Data
- About making data available- Data should be freely available
Two sides of the same coin:
Everything can be mapped!!
80% of the data has a spatial component
Data exploration and analysis through spatial operations
Spatial Data Formats
Programming languages
GIS Desktop Tools
Spatial Databases
Web Mapping Clients
Data processing...
Data mining tools: Business Intelligence
Spatial ETL ToolsExtract, automate and define a data flow process
Translate spatial data into the format that the end consumer requires
Load and integrate disparate data into a spatial database
Document your processing data steps
Execute process in a Parallel Computing Environment
Restructure the data into the required data model and coordinate system
The umbrella...
Spatial data cubes
- Store geometry in a data cube- Spatial query language (MDX)
- View agreggated data from different perspectives- Fast retrieval and anlysis of data
SOLAP Clients
SOLAP Clients
Spatial OLAP & Drupal
data feed
Spatial OLAP & Drupal
data feed
S. ETL
Spatial OLAP & Drupal
data feed workflow management
S. ETL DB S. CUBE
Spatial OLAP & Drupal
data feed workflow management frontend
S. ETL DB S. CUBE
geojsp
Conclusions
1. Huge amount of data with a spatial component that needs to be explored and analysed.
2. Availability and maturity of open source technologies and Know-how: OLAP and Geographical Information Systems (GIS).
3. Spatial OLAP merging OLAP and GIS via Open Source Tools.
Links and References
http://www.spatialytics.org/projects/geomondrian/http://www.spatialbi.orghttp://www.spatialytics.comhttp://www.geobi.orghttp://inspire.jrc.ec.europa.eu/reports/Study_reports/catalonia_impact_study_report.pdf
Questions?
Contacts
Marco Giacomassimail: [email protected]: @marcogiaco
Juan Arevalomail: [email protected]: NO!
Thank you!Grazie mille!
Muchas gracias!
“In the middle of difficulty lies
opportunity.”
Albert Einsten
