The Declarative-Coordinated Model for Self-Optimization of Service Networks

Marat [email protected]/01/21@NS研＠博多

The Declarative-Coordinated Model

PDF: bit.do/160121

for Self-Optimization of Service Networks

#VNE #SDN #NGN #QoS #agents #autonomy #probing #networkmanagement

.

This Talk is about Cloud Networks• a network of DCs is a cloud -- say, Amazon EC2 with 9 regions

• a network of clouds is a federation -- say, Amazon x 1dc + IDCF x20dcs in Japan◦ we already start hitting the heterogeneity wall, since there is no solution yet, no

such federations exist today, but some are planned 03

• .. moving further to network edge, we find Akamai with its 30k+ cloudlets02 -- a class of its own◦ heterogeneity problem? in hardware NO, but in e2e network performance STRONG YES◦ but, Akamai has all the control, so, they manage to balance the load properly

• ... now, having incorporated all the devices at network edge you have thefog cloud

• ... on a side note... why cloud networks? ... well, because most networkingsoon will be done inside and/or by clouds

03 "Chameleon project" https://www.chameleoncloud.org (2014)

02 B.Frank+8 "Pushing CDN-ISP Collaboration to the Limit" ACM SIGCOMM Computer Communication Review (2013)

M.Zhanikeev -- [email protected] The Declarative-Coordinated Model for Self-Optimization of Service Networks -- bit.do/160121 2/17...

2/17

.

Cloudification Timeline and Scope

WiFi

Sca

le/s

ize o

f clo

udifi

edite

ms

Timeline

Mid-2015

Probablyshould not

cloudify

Should definitely cloudify

DataCenters

Racks IoV > VC

Desktop

APs,Beacons

Smartphone

Sensor

IoTDelegatednetworking


3/17

.

One Cloud Service.VNE Problem......stands for Virtual Network Embedding

APP

Cloud/DC

APP

APP

VM Container

APP

Cloud/DC

APP

APP ….

• service can provide thegraph of its apps

• graph can include end users inform of DC-user e2enetwork performance

• federated cloud known itsactual topology and can useVNE to map 04

04 M.Zhanikeev "A New VNE Method for More Responsive Networking in Many-to-Many Groups" 7th ICUFN (2015)


4/17

.

OSPF, QoS Routing → VNE

• OSPF optimizes one parameter (cost/weight) for one physical graph, and is NPHard

• QoS Routing optimizes multiple parameters for one path, and is NP Hard

• VNE maps one virtual graph on top of a physical graph and is NP Hard-er?◦ both OSPF and QoS Routing generalize into a VNE problem if complexity is ignored


5/17

.

VNE: Virtual Network Embedding.VNE is all about.....

.

... multiple virtual graphs mapped ontoone real/physical topology/graph

Physical layer

Virtual Layer 1

VN Request

2 Make VN

3 VN Reply

4 Virtual

Virtual

Physical

1. service sends the request in form of avirtual graph

2. NOC casts its magic 04 -- here wedepend on a good VNE heuristic (so far,

non-existent)

3. the mapping (IPs, ports, etc.) isreturned back to the service or,otherwise, the request is denied

4. the service uses its new servicenetwork



6/17

.

The Half-Way Point


7/17

.

Solution to the Complexity Problem

.The Obvious Solution is.....

.... the DiY design, that is, to let services self-optimize• however....

◦ it is one thing to self optimize in a non-cooperative environment◦ ... and quite another when clouds offer tools/envs/platforms thathelp self-optimize better

.Cloud Probing Technology.....

....is the best choice for non-cooperative environments


8/17

.

DiY (1) DC Probing• visualization of active probingacross 8 Amazon regions 05

california

ireland

oregon

saopaulo

singapore

sydneytokyo virginia

same DClarge bulk transfer

california

ireland

oregon

saopaulo

singapore

sydney

virginia

DC - other DCe2e delay

05 M.Zhanikeev "Performance Management of Cloud Populations via Cloud Probing" IPSJ JIP (related to http://goo.gl/f3QpiW) (2015)


9/17

.

DiY (2) Heroku Probing• this time probing between Amazon VMs and heroku dynos• obvious outcome (figures are vector=zoomable): heroku lives in Virginia DC• see details in 14

0

10

20

30

40

Thru

1k50

0k 1M 2M 3M

california.1b/1 california.1b/2 california.1b/3 california.1b/4 california.1b/5 california.1b/6 california.1b/7 california.1b/8 california.1b/9 california.1b/10 california.1b/11 california.1b/12 california.1b/13 california.1b/14 california.1b/15

frankfurt.1a/1 frankfurt.1a/2 frankfurt.1a/3 frankfurt.1a/4 frankfurt.1a/5 frankfurt.1a/6 frankfurt.1a/7 frankfurt.1a/8 frankfurt.1a/9 frankfurt.1a/10 frankfurt.1a/11 frankfurt.1a/12 frankfurt.1a/13 frankfurt.1a/14 frankfurt.1a/15

ireland.1a/1 ireland.1a/2 ireland.1a/3 ireland.1a/4 ireland.1a/5 ireland.1a/6 ireland.1a/7 ireland.1a/8 ireland.1a/9 ireland.1a/10 ireland.1a/11 ireland.1a/12 ireland.1a/13 ireland.1a/14 ireland.1a/15

oregon.2b/1 oregon.2b/2 oregon.2b/3 oregon.2b/4 oregon.2b/5 oregon.2b/6 oregon.2b/7 oregon.2b/8 oregon.2b/9 oregon.2b/10 oregon.2b/11 oregon.2b/12 oregon.2b/13 oregon.2b/14 oregon.2b/15

saopaulo.1a/1 saopaulo.1a/2 saopaulo.1a/3 saopaulo.1a/4 saopaulo.1a/5 saopaulo.1a/6 saopaulo.1a/7 saopaulo.1a/8 saopaulo.1a/9 saopaulo.1a/10 saopaulo.1a/11 saopaulo.1a/12 saopaulo.1a/13 saopaulo.1a/14 saopaulo.1a/15

singapore.1a/1 singapore.1a/2 singapore.1a/3 singapore.1a/4 singapore.1a/5 singapore.1a/6 singapore.1a/7 singapore.1a/8 singapore.1a/9 singapore.1a/10 singapore.1a/11 singapore.1a/12 singapore.1a/13 singapore.1a/14 singapore.1a/15

sydney.2b/1 sydney.2b/2 sydney.2b/3 sydney.2b/4 sydney.2b/5 sydney.2b/6 sydney.2b/7 sydney.2b/8 sydney.2b/9 sydney.2b/10 sydney.2b/11 sydney.2b/12 sydney.2b/13 sydney.2b/14 sydney.2b/15

tokyo.1c/1 tokyo.1c/2 tokyo.1c/3 tokyo.1c/4 tokyo.1c/5 tokyo.1c/6 tokyo.1c/7 tokyo.1c/8 tokyo.1c/9 tokyo.1c/10 tokyo.1c/11 tokyo.1c/12 tokyo.1c/13 tokyo.1c/14 tokyo.1c/15

virginia.1e/1 virginia.1e/2 virginia.1e/3 virginia.1e/4 virginia.1e/5 virginia.1e/6 virginia.1e/7 virginia.1e/8 virginia.1e/9 virginia.1e/10 virginia.1e/11 virginia.1e/12 virginia.1e/13 virginia.1e/14 virginia.1e/15

0

4

8

12

Thru

1k50

0k 1M 2M 3M

california.1b/1 california.1b/2 california.1b/3 california.1b/4 california.1b/5 california.1b/6 california.1b/7 california.1b/8 california.1b/9 california.1b/10 california.1b/11 california.1b/12 california.1b/13 california.1b/14 california.1b/15

frankfurt.1a/1 frankfurt.1a/2 frankfurt.1a/3 frankfurt.1a/4 frankfurt.1a/5 frankfurt.1a/6 frankfurt.1a/7 frankfurt.1a/8 frankfurt.1a/9 frankfurt.1a/10 frankfurt.1a/11 frankfurt.1a/12 frankfurt.1a/13 frankfurt.1a/14 frankfurt.1a/15

ireland.1a/1 ireland.1a/2 ireland.1a/3 ireland.1a/4 ireland.1a/5 ireland.1a/6 ireland.1a/7 ireland.1a/8 ireland.1a/9 ireland.1a/10 ireland.1a/11 ireland.1a/12 ireland.1a/13 ireland.1a/14 ireland.1a/15

oregon.2b/1 oregon.2b/2 oregon.2b/3 oregon.2b/4 oregon.2b/5 oregon.2b/6 oregon.2b/7 oregon.2b/8 oregon.2b/9 oregon.2b/10 oregon.2b/11 oregon.2b/12 oregon.2b/13 oregon.2b/14 oregon.2b/15

saopaulo.1a/1 saopaulo.1a/2 saopaulo.1a/3 saopaulo.1a/4 saopaulo.1a/5 saopaulo.1a/6 saopaulo.1a/7 saopaulo.1a/8 saopaulo.1a/9 saopaulo.1a/10 saopaulo.1a/11 saopaulo.1a/12 saopaulo.1a/13 saopaulo.1a/14 saopaulo.1a/15

singapore.1a/1 singapore.1a/2 singapore.1a/3 singapore.1a/4 singapore.1a/5 singapore.1a/6 singapore.1a/7 singapore.1a/8 singapore.1a/9 singapore.1a/10 singapore.1a/11 singapore.1a/12 singapore.1a/13 singapore.1a/14 singapore.1a/15

sydney.2b/1 sydney.2b/2 sydney.2b/3 sydney.2b/4 sydney.2b/5 sydney.2b/6 sydney.2b/7 sydney.2b/8 sydney.2b/9 sydney.2b/10 sydney.2b/11 sydney.2b/12 sydney.2b/13 sydney.2b/14 sydney.2b/15

tokyo.1c/1 tokyo.1c/2 tokyo.1c/3 tokyo.1c/4 tokyo.1c/5 tokyo.1c/6 tokyo.1c/7 tokyo.1c/8 tokyo.1c/9 tokyo.1c/10 tokyo.1c/11 tokyo.1c/12 tokyo.1c/13 tokyo.1c/14 tokyo.1c/15

14 M.Zhanikeev "Heroku is Best Modeled as a Bottle" http://goo.gl/j6JzPz (2015)


10/17

.

The Declarative-Coordinated Model


11/17

.

Declarative-Coordinated Model.It is all about.....

.

...each provider declaring its ownresources autonomously to facilitatecoordination when optimizing servicenetworks

Network Provider’s (NOC)

Agent

Service Traditional agents True Autonomy

• declaration◦ each NOC creates and declares its own

resources◦ example: e2e circuits to other

domains?

• autonomy◦ the point is that declaration can be

done completely autonomously,no need for global QoS management likein NGN

• coordination◦ under autonomy, optimization can

be achieved via coordination, instead ofthe traditional VNE with the NP-Hardlevel complexity


12/17

.

The New NOC

NOC Agents Service

Local monitoring

Req /Rep Optimize (VNE)

Discover S-A Coordination

A-A Coordination N-A Coordination

Traditional

Proposed


13/17

.

Numeric Analysis


14/17

.

Abilene Network and Setup.Abilene Network..

.

...11 nodes, 27 links, a real network in US, only topology is used, while node/linkcapacities are ignored (set to unit measures)

• VNE: implemented a standard method, seereview at 04

• Proposal: each node in a free agent,the service communicates to each andselects the one that provides the bestchoice at a given time -- the same stress(but distributed) is used



15/17

.

Results

0 2.95 5.9 8.85 11.8 14.75 17.7 20.65 23.6 26.55Decreasing order

0

20

40

60

80

100

Link

cong

estio

nVNECoordination (proposed)

Link states

0 2 4 6 8 10Decreasing order

1.681.741.8

1.861.921.982.042.1

2.162.22

Nod

e co

nges

tion

Node states

• link congestion is in %• node congestion is profile from 04 --log of sum of link congestions, basically

• one episode -- kept addinghub-n-spokes virtual networks untilfull

• coordination methoddrastically outperforms thetraditional VNE



16/17

.

That’s all, thank you ...


17/17

The Declarative-Coordinated Model for Self-Optimization of Service Networks

Technology

Transcript of The Declarative-Coordinated Model for Self-Optimization of Service Networks