Graph databases in PHP @ PHPCon Poland 10-22-2011

David FunaroAlessandro Nadalin

GraphDB in PHP

domenica 23 ottobre 11

Agenda

•Theory•When to use a graph?•Why graphDB?•The graphDB community•OrientDB•OrientDB in PHP•Demo

Essential (Theory)

Binary Relation

Itchy Scratchy

Binary Relation

Vertex Vertex

Undirected Graph

Example: Friendship 6

Directed Edge

Vertex Vertex

Directed Edge

Vertex Vertex

Directed Graph

8Example: Followee

B D EG FA

Graph -> GraphDB

GraphDB is a database that use the Graph as its primary data structure

... when to use a graph ?

Web in ’99

Web in 2005

The social web

Your data is a graph

a tree is a graph

parent_id is a graph

Recommendations

Cinema A

Cinema B

Cinema C

Mr Bean

Thriller

lives in

location

Recommendations

Cinema A

Cinema B

Cinema C

Mr Bean

Thriller

lives in

location

shows x

x domenica 23 ottobre 11

Recommendations

Cinema A

Cinema B

Cinema C

Mr Bean

Thriller

lives in

location

shows x

Recommendations

Cinema A

Cinema B

Cinema C

Mr Bean

Thriller

lives in

location

shows x

✓ ✓

Recommendations

Cinema A

Cinema B

Cinema C

Mr Bean

Thriller

lives in

location

shows x

✓ ✓ x

Recommendations

Cinema A

Cinema B

Cinema C

Mr Bean

Thriller

lives in

location

shows x

x x x ✓

Recommendations

Cinema A

Cinema B

Cinema C

Mr Bean

Thriller

lives in

location

shows x

x x x ✓ ✓

Recommendations

Cinema A

Cinema B

Cinema C

Mr Bean

Thriller

lives in

location

shows x

x x x ✓ ✓ ✓

Recommendations

Cinema A

Cinema B

Cinema C

Mr Bean

Thriller

lives in

location

shows x

x x x ✓ ✓ ✓ ✓

Solve decision problems

Maximum flow

maximum flowGiven a dataset, calculate how to best organize it

travelling salesman problem

The pizza guy needs to deliver on A, B,C.

Decision base on distance, traffic, time and so on.

Shortest pathdomenica 23 ottobre 11

Identify "special" nodes of the graph

Given your dataset, organize some clusters

Are there some nodes which cannot belong to a cluster?

They probably have some properties different from the average

Given your dataset, organize some clusters

Are there some nodes which cannot belong to a cluster?

They probably have some properties different from the average

ACHTUNG!TERRORISTEN!

but ... why graphDB?

http://www.slideshare.net/slidarko/problemsolving-using-graph-traversals-searching-scoring-ranking-and-recommendation#

Representing a Graph in:

✓Relational Database

(mysql, oracle)

✓Document Oriented DB

(mongodb, couchdb)

✓XML Database

(MarkLogic, eXist-db)

http://www.slideshare.net/slidarko/problemsolving-using-graph-traversals-searching-scoring-ranking-and-recommendation#

Representing a Graph in:

where is the difference ?

A graph database is any storage system that provides index-free adjacency.

GraphDB

http://www.slideshare.net/slidarko/problemsolving-using-graph-traversals-searching-scoring-ranking-and-recommendation

Step by step example

Given a list of people, find their homepages

Tree-based DB WAY

David Funaro

put in the Search Engine2

Tree-based DB WAY

http://davidfunaro.com

David Funaro

Tree-based DB WAY

http://davidfunaro.com

David Funaro

The cost to find a single friend HP grows as the friends HP tables grows

GraphDB WAY

it’s like that the GraphDB has an additional information(the ancor <a>)

GraphDB WAY

get the embedded information(index)

www.odino.org

it’s like that the GraphDB has an additional information(the ancor <a>)

GraphDB WAY

<a href=”http://odino.org”>Alessandro Nadalin

The Anchor work as a local index to reach the document = index-free

adjacency

Local cost

The local cost is O(k) = Constant

Local cost

The local cost is O(k) = Constant

Local cost

Thus, as the graph grows in size, the cost of a local step remain the same

any database can implicity represent a graph

BUTonly a graph database make the graph

structure explicit

Benchmark

• 1 Million Vertex

• 4 Million Edge

• Scale Free Tolopogy

• Postgres VS Neo4J

• Both Hash and BTree

Deph RDBMS Graph

100ms 30ms

1000ms 500ms

10000ms 3000ms

100000ms

50000ms

N/A 100000ms

http://markorodriguez.com/2011/02/18/mysql-vs-neo4j-on-a-large-scale-graph-traversal/

Databases

community that is building and feeding the GraphDB ecosystem

ThinkerPopStack

GraphDB community

Blueprints is a collection of interfaces, implementations, ouplementations, and test suites for the property graph data

model. Blueprints is analogous to the JDBC, but for graph databases.

https://github.com/tinkerpop/blueprints/wiki/

data model and their implementation

provide a collection of "pipes" that are connected togheter to from processing

pipelines

a data flow Framework using Process Graph

a graph-based programming language.

a Turing-Complete graph-base programming language that compiles Gremlin syntax down to Pipes

a REST-full graph shell.

Allow blueprints graph to be exposed through a RESTful API (HTTP)

What's hot

OrientDB

Glossary

<10:05>RID

Cluster Position

Glossary

<10:05>RID

Cluster Position

Main features

Inheritance

class Bike

class Vehicle

class Car

class Bike

class Vehicle

class Car

SELECT FROM Vehicle WHERE owner = 1:1

class Bike

class Vehicle

class Car

can return records of class Bike or Car

Traversal

SELECT FROM fellas WHERE any() traverse(0,-1) ( @rid = [Michelle @rid] )66

67SELECT FROM fellas WHERE any() traverse(0,-1) ( @rid = [Michelle @rid] )

SELECT FROM fellas WHERE any() traverse(0,2) ( @rid = [Michelle @rid] )SELECT FROM fellas WHERE any() traverse(0,2) ( @rid = [Michelle @rid] )

SELECT FROM fellas WHERE any() traverse(0,2) ( @rid = [Michelle @rid] )

SQL synthax

beyond SQL

SELECT FROM authors WHERE book.title = ...

ACIDdomenica 23 ottobre 11

speaks JSON

{ "schema": { "name": "Address" }, "result": [{ "@type": "d", "@rid": "#13:0", "@version": 6, "@class": "Address", "type": "Residence", "street": "Piazza Navona, 1", "city": "#14:0", "nick": "Luca2" }, { ... ...

Double Protocol

Universal

Easy to interact with

binary

Blazing fast

binary

on-record SELECTs

SELECT FROM cats

SELECT FROM 11:0

SELECT FROM [11:0,11:1]

stress-free setupdomenica 23 ottobre 11

./orient/bin/server.sh

in-memory DB

or disk-persisted

Supports standards Supports standards

OrientDB

•Inheritance

•Traversal

•Sql syntax like

•ACID

•Speak JSON

•Double protocol

•on-record Select

•ThinkerPop Compliant

Oh, it's Java.

somebody started writing thebinary-protocol binding

https://github.com/AntonTerekhov/OrientDB-PHP( beta0.4.1, 28 April 2010 )

$db = new OrientDB($host, $port);

$record = $db->recordLoad('1:1', '*:-1');

// $record instance of OrientDBRecord

and others

Orient Library

... are writing a complete library

https://github.com/congow/Orient

Orient = PHP Library to work with OrientDB

Data Mapper

Query BuilderHTTP Binding

HTTP Binding

use Congow\Orient;use Congow\Orient\Foundation\Binding;

$driver = new Orient\Http\Client\Curl();$orient = new Binding($driver, '127.0.0.1', '2480', 'admin', 'admin', 'demo');

$response = $orient->query("SELECT FROM Address");

$output = json_decode($response->getBody());

foreach ($output->result as $address){ var_dump($address->street);}

{ "schema": { "name": "Address" }, "result": [{ "@type": "d", "@rid": "#13:0", "@version": 6, "@class": "Address", "type": "Residence", "street": "Piazza Navona, 1", "city": "#14:0", "nick": "Luca2" }, { ... ...

apart from ->query($SQL)

->get|delete|postClass($class)

->post|delete|put|getDocument($rid)

...and much more!

(connect, disconnect, ...)

Query Builder

use Congow\Orient\Query;

$query = new Query();$query->from(array('users'))->where('username = ?', "admin");

echo $query->getRaw(); // SELECT FROM users WHERE username = "admin"

$query->select(array('name', 'username', 'email'), false) ->from(array('12:0', '12:1'), false) ->where('any() traverse ( any() like "%danger%" )') ->orWhere("1 = ?", 1) ->andWhere("links = ?", 1) ->limit(20) ->orderBy('username') ->orderBy('name', true, true) ->range("12:0", "12:1");

SELECT name, username, email FROM [12:0, 12:1] WHERE any() traverse ( any() like "%danger%" ) OR 1 = "1" AND links = "1" ORDER BY name, username LIMIT 20 RANGE 12:0 12:1

Data Mapper

A Doctrine2 strange ODM

namespace Poland\PHPCon\Entity;

use Congow\Orient\ODM\Mapper\Annotations as ODM;

/*** @ODM\Document(class="Person")*/class Speaker{ /** * @ODM\Property( type="string") */ protected $name;

public function setName($name) { $this->name = $name; }

/*** @ODM\Document(class="Person")*/class Speaker{ /** * @ODM\Property(type="string") */ protected $name;

Domain Driven Design

{ "schema": { "name": "Speaker" }, "result": [{ "@type": "d", "@rid": "#1:0", "@version": 6, "@class": "Speaker", "name": "David Coallier" }, { ... ...

$david = $mapper->hydrate(json_decode($speaker));

$david instanceOf Poland\PHPCon\Entity\Speaker

Repository Pattern

$repo = $manager->getRepository('Speaker')

$speakers = $repo->findAll();

$speaker = $repo->find($rid);

$criteria = array('Name' => 'Lorna');

$lornas = $repo->findBy($criteria);

$criteria = array( 'Name' => 'Lorna', 'last_name' => 'Jane');

$lornaJ = $repo->findOneBy($criteria);

Know your boundaries

https://github.com/doctrine/common/tree/master/lib/Doctrine/Common/Persistence

Theory sucks.

id type page url

1 external NULL http://www.google.com

2 page 1 NULL

Menu items in RDBMS

rid title url

8:2 google google.com

Menu items in OrientDB

rid title page

9:1 home 1{ Link

PageLink ExternalLink

That’s all, folks!

David Funaro@ingdavidinohttp://davidfunaro.com

Alessandro Nadalin@_odino_

http://odino.org

Alessandro Nadalin@_odino_

http://odino.org

Credits

http://www.flickr.com/photos/sayamindu/5677281218/sizes/l/in/photostream/http://farm1.static.flickr.com/182/471383865_79d04aec36_o.pnghttp://farm1.static.flickr.com/134/318947873_12028f1b66_b.jpg

http://www.flickr.com/photos/atomdocs/3275758118/sizes/o/in/photostream/http://www.flickr.com/photos/pattipics/5229478393/sizes/o/in/photostream/

http://www.flickr.com/photos/kongharald/366597251/sizes/o/in/photostream/http://www.everaldo.com/

http://www.flickr.com/photos/tusnelda/6140792529/sizes/l/in/photostream/http://www.flickr.com/photos/mondi/5368644355/sizes/l/in/photostream/

http://www.flickr.com/photos/jayneandd/4191106566/sizes/l/in/photostream/http://www.flickr.com/photos/jooon/2093253534/sizes/l/in/photostream/

http://www.flickr.com/photos/bluedharma/89186151/sizes/o/in/photostream/http://www.flickr.com/photos/exfordy/2747089295/sizes/l/in/photostream/

http://www.flickr.com/photos/nostri-imago/3137422976/sizes/o/in/photostream/http://www.flickr.com/photos/fionasjournal/379587818/sizes/z/in/photostream/

http://www.flickr.com/photos/nperlapro/1297392267/http://www.flickr.com/photos/fastphive/28428808/sizes/m/in/photostream/

http://www.flickr.com/photos/rnugraha/2003147365/sizes/o/in/photostream/http://www.flickr.com/photos/zigazou76/4412946911/sizes/l/in/photostream/http://www.flickr.com/photos/greatnet/4667555436/sizes/l/in/photostream/

http://www.flickr.com/photos/mnsc/2768391365/sizes/l/in/photostream/http://www.flickr.com/photos/christmaswithak/4675962453/sizes/l/in/photostream/

http://www.amazon.com/Trainspotting-Irvine-Welsh/dp/0393314804http://www.flickr.com/photos/franconadalin59/5778176872/sizes/l/in/photostream/

http://farm6.static.flickr.com/5176/5474445627_875d621689_b.jpghttp://farm3.static.flickr.com/2243/2189435082_a16d3c89ae_b.jpghttp://farm3.static.flickr.com/2647/3816311930_ac52cff491_o.jpg

http://i130.photobucket.com/albums/p266/feike1977/PES6-4-3-3defencesettings.jpghttp://images.usatoday.com/life/_photos/2006/11/30/numb3rs-topper.jpg

http://www.flickr.com/photos/jakecaptive/3205277810/sizes/l/in/photostream/

Graph databases in PHP @ PHPCon Poland 10-22-2011

Technology

Transcript of Graph databases in PHP @ PHPCon Poland 10-22-2011

PHP Without PHP—Automattic

MySQL, PHP, Stuff - Jeremy Zawodnyjeremy.zawodny.com/mysql/phpcon/2003/MySQL-PHP-Stuff.pdf · MySQL, PHP, Stuff PHPCon East 2003 ... MySQL 4.0 • Query optimizer improvements ...

Bio-energy - praj.net · Europe Bio-energy newsletter Americas Customer: PHP Wieslaw Wawrzyniak, Poland Project Information: Feedstock Sugarcane juice/molasses , corn

Outline What is PHP? History of PHP Why PHP ? What is PHP file? What you need to start using PHP ? Syntax PHP code. echo & print Statement Variables.

Machine learning in php php con poland

Principles of Package Design (PHPCon Poland 2015)

PHPcon Poland - Static Analysis of PHP Code – How the Heck did I write so many Bugs?

PHP certification|PHP CERTIFICATION Coimbatore|PHP certification course in Coimbatore

Why Your Test Suite Sucks - PHPCon PL 2015

What is PHP? PHP stands for PHP: Hypertext Preprocessor PHP is a server-side scripting language, like ASP PHP scripts are executed on the server PHP supports.

In Kraków, Poland. Poland Location Kraków Poland.

Your code are my tests - PHPCon Poland 2014

Republic of the Philippines - San Fernando City · Amount of Bid PhP 1,633,940.79 PhP 1,637,512.45 PhP 1,638,799.86 Bid Security Amount PhP 85,000.00 PhP 85,000.00 PhP 85,000.00 ...

Reactive Architecture (PHPCon PL 2015)

PHP Introduction Internet teknologi 2 (ITNET2). Ingeniørhøjskolen i Århus Slide 2 Agenda PHP Introduction –PHP Basic Facts –PHP History –PHP Platform.

PHP (Hypertext Preprocessor) 1. PHP References From W3 Schools: PHP.

Design Patterns in PHP (PHPCon Italia)

PHP Basics (See PHP on line manual at: PHP - Overview Scripting vs Programming Code Examples – PHP; Perl; JSP PHP Strengths.

CCS 4370/6370: Web Programming Spring 2013 PHP Basics: Introduction to PHP a PHP file, PHP workings, running PHP. Basic PHP syntax variables, operators,

PHP Tutorial - Learn PHP