GeeCON Prague 2016 - Geospatial Graphs made easy with OrientDB

32
GeoSpatial Graphs made easy with Luigi Dell’Aquila Prague, 20-21 October 2016

Transcript of GeeCON Prague 2016 - Geospatial Graphs made easy with OrientDB

Page 1: GeeCON Prague 2016 - Geospatial Graphs made easy with OrientDB

GeoSpatial Graphs made easy with

Luigi Dell’Aquila

Prague, 20-21 October 2016

Page 2: GeeCON Prague 2016 - Geospatial Graphs made easy with OrientDB

Luigi Dell’Aquila Core Developer and Director of Consulting

OrientDB LTD Twitter: @ldellaquila http://www.orientdb.com

Page 3: GeeCON Prague 2016 - Geospatial Graphs made easy with OrientDB

Luigi Dell’Aquila @ldellaquila Prague, 20-21 October 2016

Our goal

Page 4: GeeCON Prague 2016 - Geospatial Graphs made easy with OrientDB

Luigi Dell’Aquila @ldellaquila Prague, 20-21 October 2016

Summary

•What is OrientDB

•OrientDB GeoSpatial API

•Importing Geo data (Node.js)

•Querying Geo data (OrientDB Studio)

•Displaying Geo data (Angular2, Google Maps)

•Adding Relationships - graph data

•Graph + Spatial queries

Page 5: GeeCON Prague 2016 - Geospatial Graphs made easy with OrientDB

Luigi Dell’Aquila @ldellaquila Prague, 20-21 October 2016

What is OrientDB•Multi-Model Database (Document, Graph and more)

•Tables Classes

•Extended SQL

•JOIN Physical Pointers

•Schema, No-Schema, Hybrid

•HTTP + Binary protocols

•Stand-alone or Embedded

•Distributed Multi-Master

•Apache 2 license

Page 6: GeeCON Prague 2016 - Geospatial Graphs made easy with OrientDB

Luigi Dell’Aquila @ldellaquila Prague, 20-21 October 2016

Install

•http://www.orientdb.com/download/

•http://central.maven.org/maven2/com/orientechnologies/orientdb-spatial/VERSION/orientdb-spatial-VERSION-dist.jar

> cd orientdb-community/bin/ > ./server.sh

Page 7: GeeCON Prague 2016 - Geospatial Graphs made easy with OrientDB

Luigi Dell’Aquila @ldellaquila Prague, 20-21 October 2016

OrientDB GeoSpatial Classes

•OPoint

•OLine

•OPolygon

•OMultiPoint

•OMultiline

•OMultiPlygon

Page 8: GeeCON Prague 2016 - Geospatial Graphs made easy with OrientDB

Luigi Dell’Aquila @ldellaquila Prague, 20-21 October 2016

OrientDB GeoSpatial Functions

•ST_GeomFromText(text)

•ST_Equals(geom, geom)

•ST_Contains(geom, geom)

•ST_Disjoint(geom, geom)

•ST_Intersects(geom, geom)

•ST_Distance_Sphere(geom, geom)

•and more…

Page 9: GeeCON Prague 2016 - Geospatial Graphs made easy with OrientDB

Luigi Dell’Aquila @ldellaquila Prague, 20-21 October 2016

Our Data Model CREATE CLASS POI EXTENDS V CREATE PROPERTY POI.location EMBEDDED OPoint CREATE INDEX POI.location on POI(location) SPATIAL ENGINE LUCENE CREATE CLASS Natural EXTENDS V CREATE PROPERTY Natural.location EMBEDDED OPolygon CREATE INDEX Natural.location on Natural(location) SPATIAL ENGINE LUCENE

CREATE CLASS Person EXTENDS V CREATE PROPERTY Person.location EMBEDDED OPoint CREATE CLASS FriendOf EXTENDS E

Page 10: GeeCON Prague 2016 - Geospatial Graphs made easy with OrientDB

Luigi Dell’Aquila @ldellaquila Prague, 20-21 October 2016

Our Data Source (WKT)

WKT,osm_id,name,type "POINT (14.4641804 50.0972109)",24569342,"Invalidovna, Metro B",station "POINT (14.4739792 50.1036789)",24569358,"Palmovka, Metro B",station "POINT (14.4921863 50.1062907)",24569412,"Českomoravská, Metro B",station

Page 11: GeeCON Prague 2016 - Geospatial Graphs made easy with OrientDB

Luigi Dell’Aquila @ldellaquila Prague, 20-21 October 2016

Now let’s import data!> npm init > npm install orientjs > npm install fast-csv > touch index.js

import files http://www.mapcruzin.com/free-czech-republic-maps.htm (convert to WKT using QGis)

Page 12: GeeCON Prague 2016 - Geospatial Graphs made easy with OrientDB

Luigi Dell’Aquila @ldellaquila Prague, 20-21 October 2016

Dependencies

var fs = require("fs")var ODatabase = require("orientjs").ODatabase var csv = require("fast-csv")

Page 13: GeeCON Prague 2016 - Geospatial Graphs made easy with OrientDB

Luigi Dell’Aquila @ldellaquila Prague, 20-21 October 2016

Read from CSVvar stream = fs.createReadStream("data/poland-poi.csv");var csvStream = csv.parse({headers: true}) .on("data", function(data){ console.log(data) }) .on("end", function(){ console.log("Done!") });stream.pipe(csvStream);

Page 14: GeeCON Prague 2016 - Geospatial Graphs made easy with OrientDB

Luigi Dell’Aquila @ldellaquila Prague, 20-21 October 2016

DB connectionvar db = new ODatabase({ host: "localhost", port: 2424, username: "admin", password: "admin", name: "geo"})

db.open().then(function(){ }

Page 15: GeeCON Prague 2016 - Geospatial Graphs made easy with OrientDB

Luigi Dell’Aquila @ldellaquila Prague, 20-21 October 2016

Insert

var insertElement = function(data){ db.insert().into(className).set( { name: data.name, type: data.type, location: db.rawExpression("ST_GeomFromText('"+data.WKT+"')") } ).one().then(function(){})}

Page 16: GeeCON Prague 2016 - Geospatial Graphs made easy with OrientDB

Luigi Dell’Aquila @ldellaquila Prague, 20-21 October 2016

Is it done?Not yet :-(

Node.js… asynchronous… promises…

Final version: https://github.com/luigidellaquila/wkt-to-orient

Page 17: GeeCON Prague 2016 - Geospatial Graphs made easy with OrientDB

Luigi Dell’Aquila @ldellaquila Prague, 20-21 October 2016

Querying geo data

We are here:

(50.10902, 14.5831653)

(lat, lon)

Page 18: GeeCON Prague 2016 - Geospatial Graphs made easy with OrientDB

Front-End!

Page 19: GeeCON Prague 2016 - Geospatial Graphs made easy with OrientDB

Luigi Dell’Aquila @ldellaquila Prague, 20-21 October 2016

Clone the scaffolding> git clone https://github.com/luigidellaquila/geospatial-demo > git checkout warsaw_demo_step0 > cd geospatial-demo > npm install

(it’s a clone of https://github.com/angular/quickstart)

> npm start

Page 20: GeeCON Prague 2016 - Geospatial Graphs made easy with OrientDB

Luigi Dell’Aquila @ldellaquila Prague, 20-21 October 2016

Clone the scaffolding> git clone https://github.com/luigidellaquila/geospatial-demo > git checkout warsaw_demo_step0 > cd geospatial-demo > npm install

(it’s a clone of https://github.com/angular/quickstart)

> npm start

> cd <orientdb-home>/www > ln -s <quickstart-path> > tsc -w

Page 21: GeeCON Prague 2016 - Geospatial Graphs made easy with OrientDB

Luigi Dell’Aquila @ldellaquila Prague, 20-21 October 2016

We need Google Maps

<script src=“https://maps.googleapis.com/maps/api/js?key=API_KEY" async defer></script>

Page 22: GeeCON Prague 2016 - Geospatial Graphs made easy with OrientDB

Luigi Dell’Aquila @ldellaquila Prague, 20-21 October 2016

Let’s display a map (app.html)

<div class=“container"> <div class="row"> <div class="col-md-12" id="map" style=“height:600px"></div> </div> </div>

Page 23: GeeCON Prague 2016 - Geospatial Graphs made easy with OrientDB

Luigi Dell’Aquila @ldellaquila Prague, 20-21 October 2016

Draw the map

drawMap(){ var controller = this; let mapProp = { center: new google.maps.LatLng(52.231807953759706, 21.013154983520508), zoom: 16, mapTypeId: google.maps.MapTypeId.ROADMAP }; controller.map = new google.maps.Map(document.getElementById("map"), mapProp); controller.map.addListener("click", function(point: any){ controller.zone.run(()=> { controller.lat = point.latLng.lat(); controller.lon = point.latLng.lng(); }); }); }

Page 24: GeeCON Prague 2016 - Geospatial Graphs made easy with OrientDB

Luigi Dell’Aquila @ldellaquila Prague, 20-21 October 2016

Create a Person

createPerson(): void{ var location = { // the location object } var queryString = ””; // OrientDB statement this.orient.command( queryString, (result) => { /* Success callback */ }, (error) => { /* Error callback */ } );}

Page 25: GeeCON Prague 2016 - Geospatial Graphs made easy with OrientDB

Luigi Dell’Aquila @ldellaquila Prague, 20-21 October 2016

Create a Person

createPerson(): void{ var location = { "@class": "OPoint", coordinates: [this.lon, this.lat] } var queryString = ””; // OrientDB statement this.orient.command( queryString, (result) => { /* Success callback */ }, (error) => { /* Error callback */ } );}

Page 26: GeeCON Prague 2016 - Geospatial Graphs made easy with OrientDB

Luigi Dell’Aquila @ldellaquila Prague, 20-21 October 2016

Create a Person

createPerson(): void{ var location = { "@class": "OPoint", coordinates: [this.lon, this.lat] } var queryString = `insert into Person set name = '${this.personName}', location = ${JSON.stringify(location)}`; this.orient.command( queryString, (result) => { /* Success callback */ }, (error) => { /* Error callback */ } );}

Page 27: GeeCON Prague 2016 - Geospatial Graphs made easy with OrientDB

Luigi Dell’Aquila @ldellaquila Prague, 20-21 October 2016

Create a PersoncreatePerson(): void{ var location = { "@class": "OPoint", coordinates: [this.lon, this.lat] } var queryString = `insert into Person set name = '${this.personName}', location = ${JSON.stringify(location)}`; this.orient.command( queryString, (res) => { let body = res.json(); let person = body.result[0]; this.addPersonToMap(person) }, (e) => { console.log(e) });}

Page 28: GeeCON Prague 2016 - Geospatial Graphs made easy with OrientDB

Luigi Dell’Aquila @ldellaquila Prague, 20-21 October 2016

Add Person Vertex to Orient via REST API

command(statement: string, success: (data: any) => void, error: (err: any) => void): void{ var url = this.url + "sql/-/-1" var headers = new Headers(); headers.append("Authorization", "Basic " + btoa(this.username+":"+this.password)); this.http.post( // HTTP POST url, // the URL JSON.stringify({ "command": statement // the SQL command }), {headers: headers} // the authentication data ).toPromise() .then(success) .catch(error);}

Page 29: GeeCON Prague 2016 - Geospatial Graphs made easy with OrientDB

Luigi Dell’Aquila @ldellaquila Prague, 20-21 October 2016

Add Person to the Map

addPersonToMap(personData:any){ let location = personData.location; let coordinates = location.coordinates; let controller = this; let marker = new google.maps.Marker({ position: {lat:coordinates[1], lng:coordinates[0]}, map: this.map, title: personData.name, rid: personData["@rid"] }); google.maps.event.addListener(marker, 'click', function() { controller.onMarkerClick(marker); });}

Page 30: GeeCON Prague 2016 - Geospatial Graphs made easy with OrientDB

Luigi Dell’Aquila @ldellaquila Prague, 20-21 October 2016

Add an edge between people (FriendOf)

createEdge(from:any, to:any): void{ this.orient.command( `create edge FriendOf from ${from.rid} to ${to.rid}`, (x)=>{console.log(x)}, (x)=>{console.log(x)} ) this.addEdgeBetweenMarkersToMap(from, to);}

Page 31: GeeCON Prague 2016 - Geospatial Graphs made easy with OrientDB

Query the Geospatial Graph

(DEMO)

Page 32: GeeCON Prague 2016 - Geospatial Graphs made easy with OrientDB

Thank you!