Using Docker, Neo4j, and Spring Cloud for Developing Microservices

Unless otherwise indicated, these slides are © 2016 Pivotal Software, Inc. and licensed under aCreative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/

Using Docker, Neo4j, and Spring Cloud for Developing Microservices

Kenny Bastani, Spring Developer Advocate, Pivotal @kennybastani

http://creativecommons.org/licenses/by-nc/3.0/

http://creativecommons.org/licenses/by-nc/3.0/

https://github.com/kbastani/spring-boot-graph-processing-example

Speaker Intro - Kenny Bastani

2


Ranking Twitter ProfilesUsing PageRank

3 https://github.com/kbastani/spring-boot-graph-processing-example



PageRank algorithm

4



PageRank algorithm

5


https://github.com/kbastani/spring-boot-graph-processing-example6



Tools we’ll be using

! Spring Boot

! Neo4j

! Apache Spark

! Docker

! RabbitMQ

9



Containerize all the things!

10


Connecting Neo4j and Apache Spark…to submit PageRank jobs




Request new Apache Spark job

16

Algorithm TypeRelationship Type



Export Neo4j graph to HDFS

17

New Job Request

HDFS Path: /../../graph.csv

Job Type: pagerank



Encoding a graph as an edge list

18

edge list

G B

H B

I B

K B

E B

F B

J B

D B

G E

H E

I E

K E …



Import edge list to Apache Spark

19

Process Job Request

HDFS Path: /../../graph.csv

Job Type: pagerank

graph.csv

0 1

1 2

2 3

0 3

2 1 …



Apply results back to Neo4j

20

Completed Job

HDFS Path: /../../results.csv

Job Type: pagerank

results.csv

0 .56

1 .42

2 .14

3 .25 …



Graph processing platform

21

Algorithm TypeRelationship Type



docker-compose.yml

! Demo

22


Building Microservices





24


26

Creating Spring Data Neo4j Repositories




What our application needs

! Repositories

• User repository (to manage and import users)

• Follows repository (to manage and import following relationships)

• Custom Cypher queries mapped to repository methods

! Domain model

• User — (our node entity)

• Follows — (our relationship entity)

! REST API

• Expose the resources of the domain as a REST API

27


Exposing repository APIs using Spring Data REST



Connecting to the Twitter API





We can override these properties as environment variables at runtime


Scheduling new PageRank jobs




Scheduling PageRank jobs from Neo4j

44


Scheduling new PageRank jobs



Ranking Dashboard



Ranking dashboard



Adding static web content



Ranking dashboard




Ranking dashboard

52



Add seed profiles

53



Choose 3 seed profiles

54



Discover new users and update rankings

56



Learn More. Stay Connected.

! Twitter: @kennybastani

! Spring: spring.io/team/kbastani

! Blog: kennybastani.com

! GitHub: github.com/kbastani

Twitter: twitter.com/springcentral

YouTube: spring.io/video

LinkedIn: spring.io/linkedin

Google Plus: spring.io/gplus


Using Docker, Neo4j, and Spring Cloud for Developing Microservices

Software

Transcript of Using Docker, Neo4j, and Spring Cloud for Developing Microservices