Above the Clouds: Introducing Akka - GOTO...

Above the Clouds:Introducing Akka

Jonas BonérCEO @ Scalable Solutions

Twitter : @jboner

Thursday, May 12, 2011

The problem

It is way too hard to build:1. correct highly concurrent systems

2. truly scalable systems

3. fault-tolerant systems that self-heals

...using “state-of-the-art” tools

akkaIntroducing

Vision

Simpler

Concurrency

Scalability

Fault-tolerance

Vision

...with a single unified

Programming model

Runtime service

Manage system overload

Scale up & Scale out

Replicate and distribute for fault-tolerance

Transparent load balancingThursday, May 12, 2011

CORE SERVICES

ARCHITECTURE

ADD-ON MODULES

ARCHITECTURE

CLOUDY AKKA

FINANCE

• Stock trend Analysis & Simulation

• Event-driven messaging systems

BETTING & GAMING

• Massive multiplayer online gaming

• High throughput and transactional betting

TELECOM

• Streaming media network gateways

SIMULATION

• 3D simulation engines

E-COMMERCE

• Social media community sites

SOME EXAMPLES:

WHERE IS AKKA USED?

What is an Actor?

Behavior

Event-drivenThread

Behavior

Event-drivenThread

Behavior

Event-drivenThread

Behavior

Event-drivenThread

Behavior

Event-drivenThread

Behavior

Event-drivenThread

Behavior

Akka Actorsone tool in the toolbox

!"#$%&'($!)!"#$%

!*"##!&'()*+,!$+)$,-#!-$*',!.!!."/!$'()*+,!/!0

!!-$0!,+$+#1+!/!.!!!!!"#$!"#$%!/2!!!!!!!$'()*+,!3/!4!!!!!!5,#)*6)7$'()*+,8!!99

Actors

."*!$'()*+,!/!:$*',;<=&'()*+,>

Create Actors

$'()*+, is an -$*',?+<

."*!$'()*+,!/!:$*',;<=&'()*+,>@A*:,*

Start actors

."*!$'()*+,!/!:$*',;<=&'()*+,>@A*:,*$'()*+,@A*'5

Stop actors

$'()*+,!B!"#$%!

Send: !

fire-forget

CC!,+*(,)A!:!<(*(,+."*!<(*(,+!/!:$*',!BBB!D+AA:E+<(*(,+@:F:#*."*!,+A(6*!/!<(*(,+@,+A(6*

Send: !!!

returns the Future directly

Future."*!<(*(,+4G!<(*(,+HG!<(*(,+I!/!!!J(*(,+@+K5*L=M*,#)E>

<(*(,+4@:F:#*<(*(,+H@')&'K56+*+7<!/2!@@@8

<(*(,+4@$'K56+*+N#*O?+A(6*7@@@8!<(*(,+H@$'K56+*+N#*OPQ$+5*#')7@@@8<(*(,+I@$'K56+*+N#*O7<(*(,+H8

<(*(,+4!,+$+#1+!.!!!"#$!J''7R:,8!/2!S<''T9@:F:#*@,+A(6*

."*%<4!/!J(*(,+A@<(*(,+7$:66:R6+8

."*!<H!/!J(*(,+A@<#,A*&'K56+*+U;<7<(*(,+A8

."*!<I!/!J(*(,+A@,+U($+7<(*(,+A877QG!L8!/2!@@8

."*%<V!/!J(*(,+A@<'6U7W+,'87<(*(,+A877QG!L8!/2!@@@8

Future

Future."*!<(*(,+4!/!0&/!.!!:X!Y)*!!!!Z[!:$*',!BBB!\]+66'\!CC!,+*(,)A!^!!RX!M*,#)E!Z[!:$*',!BBB!:!!!!!!!CC!,+*(,)A!\40\!!$X!M*,#)E!Z[!:$*',!BBB!_!!!!!!!CC!,+*(,)A!\4V\9!12$*-!R!3!\[\!3!$

."*!<(*(,+H!/!0&/!.!!:!Z[!:$*',!BBB!?+`7\]+66'\8!$'66+$*!.!$:A+!?+A7QX!Y)*8!!!!/2!Q!9!!R!Z[!:$*',!BBB!?+`7:8!!!!!!!$'66+$*!.!$:A+!?+A7QX!M*,#)E8!/2!Q!9!!$!Z[!:$*',!BBB!?+`7_8!!!!!!!$'66+$*!.!$:A+!?+A7QX!M*,#)E8!/2!Q!99!12$*-!R!3!\[\!3!$

Dataflow234&/)!J(*(,+@<6'F

."*!QG!LG!W!/!a,'K#A+=Y)*>78

<6'F!.!!W!ZZ!Q78!3!L78!!5,#)*6)7\W!/!\!3!W7889<6'F!.!Q!ZZ!V0!9<6'F!.!L!ZZ!H!9

."*!,+A(6*!/!7:$*',!BB!D+AA:E+8@:A=M*,#)E>

Send: !!

uses Future under the hood and blocks until timeout or completion

!*"##!M'K+-$*',!$+)$,-#!-$*',!.!!-$0!,+$+#1+!/!.!!!!!"#$!bA+,7):K+8!/2!!!!!!!CC!(A+!,+56L!!!!!!A+6<@,+56L7S]#!T!3!):K+8!!99

HotSwap

A+6<!R+$'K+!.!!CC!)+F!R'UL!!!"#$!c+FD+AA:E+!/2!!!!!@@@!!9

HotSwap

:$*',!B!]'*MF:5!.!!CC!)+F!R'UL!!!"#$!c+FD+AA:E+!/2!!!!!@@@!!9

HotSwap

A+6<@()R+$'K+7)

!*"##!DL-$*',!$+)$,-#!-$*',!.!!A+6<@U#A5:*$O+,!/!d#A5:*$O+,A!!!!@)+F"O,+:Ue:A+Ud#A5:*$O+,7A+6<8!!!!@@@9

:$*',@U#A5:*$O+,!/!U#A5:*$O+,!CC!R+<',+!A*:,*+U

Set dispatcher

Remote Actors

CC!(A+!O'A*!f!5',*!#)!$')<#E-$*',@,+K'*+@A*:,*78

-$*',@,+K'*+@A*:,*7\6'$:6O'A*\G!H^^H8

Remote Server

Scalable implementation based on NIO (Netty) & Protobuf

Two types of

remote actorsClient initiated & managedServer initiated & managed

234&/)%-$*',@g

."*!A+,1#$+!/!,+K'*+@:$*',;<=DL-$*',>7O'A*G!5',*8

A+,1#$+!B!K+AA:E+

Client-managedsupervision works across nodes

234&/)%-$*',@g

,+K'*+@,+E#A*+,7SA+,1#$+X#UTG!:$*',;<=DLM+,1#$+>8

Server-managedregister and manage actor on server

client gets “dumb” proxy handle

server partThursday, May 12, 2011

."*!A+,1#$+!/!,+K'*+@:$*',J',7!!SA+,1#$+X#UTG!!!SU:,%A*:,TG!!!hhhh8

A+,1#$+!B!K+AA:E+

Server-managed

client part

234&/)%-$*',@g

,+K'*+@,+E#A*+,7:$*',;<=DLM+,1#$+>8,+K'*+@,+E#A*+,eLb(#U7:$*',;<=DLM+,1#$+>8,+K'*+@,+E#A*+,a+,M+AA#')7!!SA+,1#$+X#UTG!:$*',;<=DLM+,1#$+>8

,+K'*+@(),+E#A*+,7SA+,1#$+X#UT8!,+K'*+@(),+E#A*+,7:$*',?+<8

Server-managed

server partThursday, May 12, 2011

Remote ActorsClient-managedServer-managed

Problem Deployment (local vs remote) is a dev decision

We get a fixed and hard-coded topology Can’t change it dynamically and adaptively

Needs to be a deployment & runtime decision

Remoting in Akka 1.0

Clustered Actors(in development for upcoming Akka 2.0)

1:6!:$*',!/!:$*',;<=DL-$*',>7S315#$/.2!$T8

Address

Bind the actor to a virtual address

•Actor address is virtual and decoupled from how it is deployed

•If no deployment configuration exists then actor is deployed as local

•The same system can be configured as distributed without code change (even change at runtime)

•Write as local but deploy as distributed in the cloud without code change

•Allows runtime to dynamically and adaptively change topology

Deployment

:%%:!.!!:$*',!.!!!!U+56'LK+)*!.!!!!!!315#$/.2!$!.!!!!!!!!!!!!!!!!!!!!!!!!!,'(*+,!/!\6+:A*[$5(\!!!!!!!!$6(A*+,+U!.!!!!!!!!!!O'K+!!!!!!/!\)'U+X*+A*[)'U+[4\!!!!!!!!!!,+56#$:A!!/!I!!!!!!!!!!A*:*+6+AA!/!')!!!!!!!!9!!!!!!9!!!!9!!99

Deployment configuration

Deployment configuration Address

Deployment configuration Address Type of

load-balancing

Clusteredor Local

load-balancing

Clusteredor Local Home node

load-balancing

Nr of replicas in cluster

load-balancing

Nr of replicas in cluster

Stateful or Stateless

•Subscription-based cluster membership service•Highly available cluster registry for actors•Automatic cluster-wide deployment•Highly available centralized configuration service•Automatic replication with automatic fail-over upon

node crash•Transparent and user-configurable load-balancing•Transparent adaptive cluster rebalancing•Leader election•Durable mailboxes - guaranteed delivery

The runtime provides

•Publish/Subscribe (broker and broker-less)•Compute Grid (MapReduce)•Data Grid (querying etc)•Distributed STM (Transactional Memory)•Event Sourcing

Upcoming features

Akka Node

."*!5#)E!/!:$*',;<=a#)E>7S5#)ET8

."*!5')E!/!:$*',;<=a')E>7S5')ET8

5#)E!B!e:6675')E8

Akka Node

."*!5#)E!/!:$*',;<=a#)E>7S5#)ET8

."*!5')E!/!:$*',;<=a')E>7S5')ET8

5#)E!B!e:6675')E8

Ping Pong

Akka Node

AkkaCluster Node

Ping Pong

Akka Node

AkkaCluster Node

Ping Pong

AkkaCluster Node

Ping Pong

:%%:!.!!:$*',!.!!!!U+56'LK+)*!.!!!!!!5#)E!.9!!!!!!5')E!.!!!!!!!!!!!!!!!!!!!!!!!!!,'(*+,!/!\,'()U[,'R#)\!!!!!!!!$6(A*+,+U!.!!!!!!!!!!,+56#$:A!!/!I!!!!!!!!!!A*:*+6+AA!/!')!!!!!!!!9!!!!!!9!!!!9!!99

AkkaCluster Node

Ping Pong

:%%:!.!!:$*',!.!!!!U+56'LK+)*!.!!!!!!5#)E!.9!!!!!!5')E!.!!!!!!!!!!!!!!!!!!!!!!!!!,'(*+,!/!\,'()U[,'R#)\!!!!!!!!$6(A*+,+U!.!!!!!!!!!!,+56#$:A!!/!I!!!!!!!!!!A*:*+6+AA!/!')!!!!!!!!9!!!!!!9!!!!9!!99

AkkaCluster Node

AkkaCluster NodePing

:%%:!.!!:$*',!.!!!!U+56'LK+)*!.!!!!!!5#)E!.9!!!!!!5')E!.!!!!!!!!!!!!!!!!!!!!!!!!!,'(*+,!/!\,'()U[,'R#)\!!!!!!!!$6(A*+,+U!.!!!!!!!!!!,+56#$:A!!/!I!!!!!!!!!!A*:*+6+AA!/!')!!!!!!!!9!!!!!!9!!!!9!!99

AkkaCluster Node

:%%:!.!!:$*',!.!!!!U+56'LK+)*!.!!!!!!5#)E!.9!!!!!!5')E!.!!!!!!!!!!!!!!!!!!!!!!!!!,'(*+,!/!\,'()U[,'R#)\!!!!!!!!$6(A*+,+U!.!!!!!!!!!!,+56#$:A!!/!I!!!!!!!!!!A*:*+6+AA!/!')!!!!!!!!9!!!!!!9!!!!9!!99

ZooKeeperZooKeeperZooKeeperEnsemble

AkkaCluster Node

Let it crash fault-tolerance

Erlangmodel

9 nines

...let’s take a standard OO application

Which components have critically important state

and explicit error handling?

Classification of State• Scratch data• Static data• Supplied at boot time• Supplied by other components

• Dynamic data• Data possible to recompute• Input from other sources; data

that is impossible to recompute

Must be protected

by any means

Fault-tolerant onion-layered Error Kernel

ErrorKernel

Node 1 Node 2

6#)%7:$*',8()6#)%7:$*',8

A*:,*i#)%7:$*',8A5:F)i#)%=DL-$*',>

Linking

-66J',;)+M*,:*+EL7!!+,,',AG!!K:Qc,;<?+*,#+AG!!!F#*O#)"#K+?:)E+8

;)+J',;)+M*,:*+EL7!!+,,',AG!!K:Qc,;<?+*,#+AG!!!F#*O#)"#K+?:)E+8

Fault handlers

!*"##!M(5+,1#A',!$+)$,-#!-$*',!.!!<:(6*]:)U6+,!/!-66J',;)+M*,:*+EL7!!!!i#A*7$6:AA;<=Y66+E:6M*:*+PQ$+5*#')>8!!!!!^G!^00088

!!-$0!,+$+#1+!/!.!!!!!"#$!?+E#A*+,7:$*',8!/2!6#)%7:$*',8!!99

Supervision

!*"##!J:(6*"'6+,:)*M+,1#$+!$+)$,-#!-$*',!.!!@@@!!&.$//2-$%-$0!5,+?+A*:,*7,+:A')X!"O,'F:R6+8!/!.!!!!@@@!CC!$6+:)!(5!'$0&/$!,+A*:,*!!9!!&.$//2-$%-$0!5'A*?+A*:,*7,+:A')X!"O,'F:R6+8!/!.!!!!@@@!CC!#)#*!"0)$/!,+A*:,*!!99

Manage failure

AMQPDataflow

Security

...and much much more

scalaz

FSMSTM

Spring

Microkernel

Akka 1.1To be released today

Get it and learn morehttp://akka.io

EOFThursday, May 12, 2011

Above the Clouds: Introducing Akka - GOTO...

Documents

Transcript of Above the Clouds: Introducing Akka - GOTO...

Effective akka scalaio

Akka knolx

Akka patterns

Scalable Solutions · Akka: Simpler Concurrency, Scalability & Fault-tolerance through Actors Jonas Bonér Scalable Solutions jonas@jonasboner.com twitter: @jboner. The problem ...

Delivering Transformative Reactive systems on OpenShift ... · Why Akka Streams? Akka Streams is a DSL on top of Akka. Akka uses the actor model to create stateful services. Actors

Jonas Bonér Terracotta, Inc. jonas@terracotta.org Clustering the JVM using AOP.

TOLL FREE 1.866.328.5538 | bulletproofacademy · Using Akka sd_akka_a01_it_enus Akka Essentials Advanced Features of Akka sd_akka_a02_it_enus Java Multi-Tenant Cloud Programming Fundamentals

AKKA TECHNOLOGIES

Akka 2.0 Reloaded

Distributed Data Analytics Thorsten Papenbrock Akka Actor ... · Akka Streams Asynchronous, non-blocking, backpressured, reactive stream classes Akka Http Asynchronous, streaming-first

Fresh from the Oven (04.2015): Experimental Akka Typed and Akka Streams

Above the Clouds: Introducing Akka - GOTO Conferencegotocon.com/dl/goto-prague-2011/slides/FredrikEkholdt... · 2011-11-23 · Introducing Akka (çhkk ): The name comes from the goddess

Scalable Solutionsgotocon.com/dl/jaoo-aarhus-2010/slides/JonasBonen_AkkaSimpler... · Akka: Simpler Concurrency, Scalability & Fault-tolerance through Actors Jonas Bonér Scalable

Developing distributed applications with Akka and Akka Cluster

Akka 2.2.0

2010 AKKA NEWSLETTER Volume 3, Issue 1torakenryu.com/images/2010AKKAnewsletter.pdf · AKKA in Hungary AKKA in Europe June: AKKA Camp Volume 3, Issue 1 T he past year was a difficult

Akka vikas hazrati

Akka Documentation · 2019-03-28 · Akka Documentation, Release 1.1.3 1.2Why Akka? 1.2.1What features can the Akka platform offer, over the competition? Akka is an uniﬁed runtime

Akka Survey 2013 - downloads.typesafe.comdownloads.typesafe.com/website/general/Akka-Survey-2013.pdfQ What were the two biggest difficulties while learning Akka? Other Immutability

Akka Concurrency - Artima · Excerpt from Akka Concurrency Chapter 4 Akka Does Concurrency Akka is a domain-neutral concurrency toolkit designed for the purposes of building scalable,