Server side geo_tools_in_drupal_pnw_2012

31
GIS Tool in Drupal PNW Drupal Summit - Seattle October 20th, 2012 Mack Hardy & Tom Nightingale @AffinityBridge

description

Mack Hardy @mackaffinity from Affinity Bridge @affinitybridge discusses server side mapping tools for drupal, using PostGIS as a spatial backend, generating tiles and managing large sets of geodata and displaying it in Drupal CMS

Transcript of Server side geo_tools_in_drupal_pnw_2012

Page 1: Server side geo_tools_in_drupal_pnw_2012

GIS Tool in DrupalPNW Drupal Summit - Seattle

October 20th, 2012

Mack Hardy & Tom Nightingale@AffinityBridge

Page 2: Server side geo_tools_in_drupal_pnw_2012

History of Maps with Drupal Tools

Page 3: Server side geo_tools_in_drupal_pnw_2012

Location Module, proximity and filter

Page 4: Server side geo_tools_in_drupal_pnw_2012
Page 5: Server side geo_tools_in_drupal_pnw_2012
Page 6: Server side geo_tools_in_drupal_pnw_2012

Storage and Import

Page 7: Server side geo_tools_in_drupal_pnw_2012

Storage - GeoField

Where do we store data in drupal?

A common field format for geodata• WKT• Lat Lon• Bounding

Page 8: Server side geo_tools_in_drupal_pnw_2012
Page 9: Server side geo_tools_in_drupal_pnw_2012

Spatial Import

How do we import data from external sources?

Shapefiles

KML files

Uses GeoPHP and ogr2ogr

Spatial module -> Saves as WKT -> Geofield

http://drupal.org/project/spatial

Page 10: Server side geo_tools_in_drupal_pnw_2012

ogr2ogr

Wrapper module for the GDAL ogr2ogr library

- Spatial module calls ogr2ogr

- Converts data from source formats to WKT

http://drupal.org/project/ogr2ogr

Page 11: Server side geo_tools_in_drupal_pnw_2012

Query

Page 12: Server side geo_tools_in_drupal_pnw_2012

Sync_PostGIS Module

• Allows drupal to query PostGIS as a spatial query service, much in the way SOLR is used for search

• Syncs data from Drupal entities with geofields to PostGIS

• Provides query methods for testing intersection, within, buffer conditions

http://drupal.org/project/sync_postgis

Page 13: Server side geo_tools_in_drupal_pnw_2012

Sync_PostGIS Module

Page 14: Server side geo_tools_in_drupal_pnw_2012

What does sync_postgis tell us?

Intersections with other data pointsWithin a buffer of 5km

Page 15: Server side geo_tools_in_drupal_pnw_2012

Testing for Intersectionfunction geoquery_intersects($item1, $item2) { $params = array($item1, $item2); foreach ($params as &$param) { if (is_scalar($param)) { $param = array('entity_type' => 'node', 'eid' => $param); } } if ($connection = sync_postgis_get_postgis_connection()) { $geo_query = new syncPgQuery($connection); return $geo_query->booleanRelQuery('intersects', $params[0], $params[1])->execute(); }

Page 16: Server side geo_tools_in_drupal_pnw_2012

Testing for Buffer Distancefunction geoquery_dwithin($item1, $item2, $distance = 0, $srid = 4326) { $params = array($item1, $item2); foreach ($params as &$param) { if (is_scalar($param)) { $param = array('entity_type' => 'node', 'eid' => $param); } } if ($connection = sync_postgis_get_postgis_connection()) { $geo_query = new syncPgQuery($connection, $srid); return $geo_query->booleanRelQuery('dwithin', $params[0], $params[1], $distance)->execute(); }}

Page 17: Server side geo_tools_in_drupal_pnw_2012

Displaying the results

With the results from the PostGIS backend, we can show the user useful information

In this case they know that

- target is in the protected area - target intersects 2 traplines

- target is within a 5 km buffer of 4 other nodes of interest

Page 18: Server side geo_tools_in_drupal_pnw_2012

Scaling

Page 19: Server side geo_tools_in_drupal_pnw_2012

Beyond Vector Based Maps

We want to show huge datasets, the vector model requires "painting" the data onto the map, which is computationally expensive

Pre-rendering the dataset onto a tile, means the client can load the data quickly, and tiles are easy to cache

Obvious downside of caching, is that it doesn't work well with frequently changing data

Tilemill has been great for creating base tiles, but regenerating the entire tileset when the data changes is hard and time consuming

Page 20: Server side geo_tools_in_drupal_pnw_2012

Comparing Vector vs MB Tiles

Vector - 2.30 MB of transfer - Client side render

Tiles - 529 kB of transfer - Server side render

Page 21: Server side geo_tools_in_drupal_pnw_2012

Tilestache

Python application for serving tiles

tilestache takes inputs of : --- mbtiles which are pre-generated --- mapnik configuration (to generate tiles on the fly)--- vector (geojson, arcjson) --- combinations of these inputs as composite

We are generating using mapnik with PostGIS as a datasource

- provides a caching layer for serving tiles

Page 22: Server side geo_tools_in_drupal_pnw_2012

Composite maps from PostGIS Data

• base map satellite images• tilestache provides the data

layers from PostGIS via mapnik• leaflet map definition points to

layers in the layer switcher

Image credit http://mike.teczno.com/notes/tilestache.html

Page 23: Server side geo_tools_in_drupal_pnw_2012

WAX interactivity

• parcel data with tiles in JSON• on mouseover and on click behaviours• need to pre-cache WAX styling

Page 24: Server side geo_tools_in_drupal_pnw_2012

WAX interactivity

Page 25: Server side geo_tools_in_drupal_pnw_2012

WAX interactivity

Demo

Page 26: Server side geo_tools_in_drupal_pnw_2012

WAX interactivity

How UTF8 grid workshttp://mapbox.com/demo/visiblemap/

Page 27: Server side geo_tools_in_drupal_pnw_2012

Random Tools

Page 28: Server side geo_tools_in_drupal_pnw_2012

Leaflet Draw

Page 29: Server side geo_tools_in_drupal_pnw_2012

Leaflet Paste

Page 30: Server side geo_tools_in_drupal_pnw_2012

Search API

Next we want to be able to return data items from SOLR to a map

Search on non-geographic facets - just like a view

Search on geographic facets - facet controls pull data from PostGIS, or use SOLRs spatial extensions

http://drupal.org/project/search_api_location

Page 31: Server side geo_tools_in_drupal_pnw_2012

Discussion

[email protected]://affinitybridge.com