Lock Service with Paxos in Erlang

. . . . . .

MotivationImplementation

EvaluationConclusions

Lock Service with Paxos

Presenter: Emmanouil DimogerontakisTeammate: Muhammet OrazovSupervisor: Johan Montelius

CC© BY:© C©

EMDC KTH

December 5, 2012

Presenter: Emmanouil Dimogerontakis Teammate: Muhammet Orazov Supervisor: Johan Montelius CC© BY:© C©Lock Service with Paxos 1/19

. . . . . .

.. .1 Motivation

.. .2 Implementation

ArchitectureFault Tolerance & Optimizations

.. .3 Evaluation

Central LockExperiments

.. .4 Conclusions

. . . . . .

.. Paxos

. . . . . .

.. Paxos

. . . . . .

.. From Paxos to a Lock Service

Not Trivial

Paxos Replicated State Machine

Slot queue → Sequence of lock holders

Paxos round number = Slot number

Paxos decides who gets each slot

. . . . . .

Not Trivial

. . . . . .

Not Trivial

. . . . . .

Not Trivial

. . . . . .

Not Trivial

. . . . . .

.. .1 Motivation

.. .3 Evaluation

.. .4 Conclusions

. . . . . .

.. Abstract View

. . . . . .

.. Detailed View

. . . . . .

.. Use Case

. . . . . .

.. Use Case

. . . . . .

.. Use Case

. . . . . .

.. Use Case

. . . . . .

.. Use Case

. . . . . .

.. Use Case

. . . . . .

.. Use Case

. . . . . .

.. Use Case

. . . . . .

.. Use Case

. . . . . .

.. Use Case

. . . . . .

.. Process Fault Tolerance

Supervisor Tree

Process restarts aware that it has crashed

. . . . . .

.. Paxos Fault Tolerance

Acceptor persists asynchronously its state

Learner persists asynchronously the slot queue

Assignor persists asynchronously its state

. . . . . .

.. Optimizations

@COMPLETED:

3 Receiver handles the huge amount of requests

3 Shared Queue between Receiver and Proposer

3 Learner and Acceptor spawn separate writing process

@TODO:

7 Propose lock requests in batches

7 Leader

7 Garbage Collection

. . . . . .

.. Optimizations

@COMPLETED:

3 Receiver handles the huge amount of requests

3 Shared Queue between Receiver and Proposer

3 Learner and Acceptor spawn separate writing process

@TODO:

7 Propose lock requests in batches

7 Leader

7 Garbage Collection

. . . . . .

.. .1 Motivation

.. .3 Evaluation

.. .4 Conclusions

. . . . . .

.. Throughput

. . . . . .

.. Latency

. . . . . .

.. Cost of Availability

# of Paxos Nodes VS Latency and/or Throughput

Will look like:

. . . . . .

.. Cost of Availability

# of Paxos Nodes VS Latency and/or ThroughputWill look like:

. . . . . .

.. Cost of Fault Tolerance

Latency of Node Recovery VS Latency and/or Throughput

Will look like:

. . . . . .

.. Cost of Fault Tolerance

Latency of Node Recovery VS Latency and/or ThroughputWill look like:

. . . . . .

.. More

Proposer Timeouts VS Latency and/or Throughput

Paxos +/-Persistence VS Latency and/or Throughput

. . . . . .

.. .1 Motivation

.. .3 Evaluation

.. .4 Conclusions

. . . . . .

Find golden ratio: Performance vs Availability

Find golden ratio: Performance vs Fault Tolerance

Their combination?

Questions ?

. . . . . .

Find golden ratio: Performance vs Availability

Find golden ratio: Performance vs Fault Tolerance

Their combination?

Questions ?

. . . . . .

Part I.

Appendix

. . . . . .

.. Benchmarking Tool

Basho bench

Ability to write custom clients

Can simulate network dispatcher process

Lock Service with Paxos in Erlang

Technology

Transcript of Lock Service with Paxos in Erlang