Drupal Day 2011 - Thinking spatially with your open data

Post on 22-Nov-2014

1.068 views 2 download

description

Talk di Juan Arevalo & Marco Giacomassi | Drupal Day Roma 2011 The Open Data movement is now moving a step forward, many governments, institutions and business have recently started the process of making information available to citizens and customers. Data is now seen as a powerful instrument to increase transparency in public administration and business on policies. About 80% of this information has a spatial component that is not entirely exploited yet. A range of open source solutions are now available to address this challenge, in this session we will explore their potential and possible applications. The so-called “data deluge” is here.. but we can build good umbrellas. Please come to learn more about it!

Transcript of Drupal Day 2011 - Thinking spatially with your open data

Thinking spatially with your open data“Spatial data deluge: please bring me an

umbrella!”Juan Arévalo, Marco Giacomassi

Data is everywhere...

- Decreto Legislativo 32/2010 di recepimento della Direttiva Inspire

- Metadata, interoperability, Web services, standards, data specifications, etc..

• Infrastructure for spatial information in Europe to support Community environmental policies:

Inspire Directive

Cost:

Total direct cost: 1.5 M € (76% Human Resources)Period: 2002-2006

Benefits:

Internal efficiency benefits: 500 hours per month (30€ hour)Recovery cost: 6 months

Is it worth it??

Open Data Movement

Open Data Applications

Spatial Data Infrastructures and Open Data

- About making data available- Data should be freely available

Two sides of the same coin:

Everything can be mapped!!

80% of the data has a spatial component

Data exploration and analysis through spatial operations

Spatial Data Formats

Programming languages

GIS Desktop Tools

Spatial Databases

Web Mapping Clients

Data processing...

Data mining tools: Business Intelligence

Spatial ETL ToolsExtract, automate and define a data flow process

Translate spatial data into the format that the end consumer requires

Load and integrate disparate data into a spatial database

Document your processing data steps

Execute process in a Parallel Computing Environment

Restructure the data into the required data model and coordinate system

The umbrella...

Spatial data cubes

- Store geometry in a data cube- Spatial query language (MDX)

- View agreggated data from different perspectives- Fast retrieval and anlysis of data

SOLAP Clients

SOLAP Clients

Spatial OLAP & Drupal

data feed

Spatial OLAP & Drupal

data feed

S. ETL

Spatial OLAP & Drupal

data feed workflow management

S. ETL DB S. CUBE

Spatial OLAP & Drupal

data feed workflow management frontend

S. ETL DB S. CUBE

geojsp

Conclusions

1. Huge amount of data with a spatial component that needs to be explored and analysed.

2. Availability and maturity of open source technologies and Know-how: OLAP and Geographical Information Systems (GIS).

3. Spatial OLAP merging OLAP and GIS via Open Source Tools.

Links and References

http://www.spatialytics.org/projects/geomondrian/http://www.spatialbi.orghttp://www.spatialytics.comhttp://www.geobi.orghttp://inspire.jrc.ec.europa.eu/reports/Study_reports/catalonia_impact_study_report.pdf

Questions?

Contacts

Marco Giacomassimail: marco@twinbit.ittwitter: @marcogiaco

Juan Arevalomail: juan@twinbit.ittwitter: NO!

Thank you!Grazie mille!

Muchas gracias!

“In the middle of difficulty lies

opportunity.”

Albert Einsten