Automated Bandwidth Allocation Problems in Data Centers Yifei Yuan, Anduo Wang, Rajeev Alur, Boon...

24
Automated Bandwidth Allocation Problems in Data Centers Yifei Yuan, Anduo Wang, Rajeev Alur, Boon Thau Loo University of Pennsylvania

Transcript of Automated Bandwidth Allocation Problems in Data Centers Yifei Yuan, Anduo Wang, Rajeev Alur, Boon...

Page 1: Automated Bandwidth Allocation Problems in Data Centers Yifei Yuan, Anduo Wang, Rajeev Alur, Boon Thau Loo University of Pennsylvania.

Automated Bandwidth Allocation Problems in Data Centers

Yifei Yuan, Anduo Wang, Rajeev Alur, Boon Thau LooUniversity of Pennsylvania

Page 2: Automated Bandwidth Allocation Problems in Data Centers Yifei Yuan, Anduo Wang, Rajeev Alur, Boon Thau Loo University of Pennsylvania.

Motivation

• Managing network resources is the key computational problem in Data Centers.

• Applying verification/synthesis tool to network resource management?– Benefits: exact solutions, correctness guarantees– Challenges: efficiency

• This work: bandwidth allocation by SAT/SMT solvers

1

Page 3: Automated Bandwidth Allocation Problems in Data Centers Yifei Yuan, Anduo Wang, Rajeev Alur, Boon Thau Loo University of Pennsylvania.

Bandwidth Allocation Problem

2

Page 4: Automated Bandwidth Allocation Problems in Data Centers Yifei Yuan, Anduo Wang, Rajeev Alur, Boon Thau Loo University of Pennsylvania.

Bandwidth Allocation Problem

1G bps 600M bps

500M bps

450M bps

X1

X2 X3

S1 S2 S3 S4

Data Center’s Network

10G bps

10G bps

2

Page 5: Automated Bandwidth Allocation Problems in Data Centers Yifei Yuan, Anduo Wang, Rajeev Alur, Boon Thau Loo University of Pennsylvania.

Bandwidth Allocation Problem

1G bps 600M bps

500M bps

450M bps

X1

X2 X3

S1 S2 S3 S4

Data Center’s Network

V1

V2 V3

400M bps

400M bps

Virtual Network

10G bps

10G bps

2

Page 6: Automated Bandwidth Allocation Problems in Data Centers Yifei Yuan, Anduo Wang, Rajeev Alur, Boon Thau Loo University of Pennsylvania.

Bandwidth Allocation Problem

1G bps 600M bps

500M bps

450M bps

X1

X2 X3

S1 S2 S3 S4

Data Center’s Network

V1

V2 V3

400M bps

400M bps

Virtual Network

10G bps

10G bps

2

Page 7: Automated Bandwidth Allocation Problems in Data Centers Yifei Yuan, Anduo Wang, Rajeev Alur, Boon Thau Loo University of Pennsylvania.

Bandwidth Allocation Problem

1G bps 600M bps

500M bps

450M bps

X1

X2 X3

S1 S2 S3 S4

Data Center’s Network

V1

V2 V3

400M bps

400M bps

Virtual Network

v1 v3 v2

10G bps

10G bps

2

Page 8: Automated Bandwidth Allocation Problems in Data Centers Yifei Yuan, Anduo Wang, Rajeev Alur, Boon Thau Loo University of Pennsylvania.

Bandwidth Allocation Problem

1G bps 600M bps

500M bps

450M bps

X1

X2 X3

S1 S2 S3 S4

Data Center’s Network

V1

V2 V3

400M bps

400M bps

Virtual Network

v1 v3 v2

10G bps

10G bps

2

Page 9: Automated Bandwidth Allocation Problems in Data Centers Yifei Yuan, Anduo Wang, Rajeev Alur, Boon Thau Loo University of Pennsylvania.

BAP: Facts

• Complexity:– NP-complete: tree for physical network & virtual

network• Existing heuristics:– Pros: efficient– Cons: no guarantee

• Alternative approach: SAT/SMT solving

3

Page 10: Automated Bandwidth Allocation Problems in Data Centers Yifei Yuan, Anduo Wang, Rajeev Alur, Boon Thau Loo University of Pennsylvania.

SAT/SMT Encoding: A Glimpse

• X(v,s): VM v is mapped to server s• Y(l,e): physical link l is reserved bandwidth virtual

link e• R(l,e,k): physical link l is the k-th edge on the

routing path for virtual link e• Server capacity:– ∑v X(v,s) < c(s), for every server s

• Link capacity:– ∑e Y(l,e) < b(l), for every physical link l

4

Page 11: Automated Bandwidth Allocation Problems in Data Centers Yifei Yuan, Anduo Wang, Rajeev Alur, Boon Thau Loo University of Pennsylvania.

Abstraction and Refinement

• Observation: Hierarchical physical network topology in data centers– Tree– Fat-tree

• Idea:– Abstract physical network: small size– Refine subgraphs

5

Page 12: Automated Bandwidth Allocation Problems in Data Centers Yifei Yuan, Anduo Wang, Rajeev Alur, Boon Thau Loo University of Pennsylvania.

Abstraction

1 2 4 2

6

Page 13: Automated Bandwidth Allocation Problems in Data Centers Yifei Yuan, Anduo Wang, Rajeev Alur, Boon Thau Loo University of Pennsylvania.

Abstraction

1 2 4 2

6

Page 14: Automated Bandwidth Allocation Problems in Data Centers Yifei Yuan, Anduo Wang, Rajeev Alur, Boon Thau Loo University of Pennsylvania.

Abstraction

1 2 4 2

3 6

6

Page 15: Automated Bandwidth Allocation Problems in Data Centers Yifei Yuan, Anduo Wang, Rajeev Alur, Boon Thau Loo University of Pennsylvania.

Abstraction

3 6

6

Page 16: Automated Bandwidth Allocation Problems in Data Centers Yifei Yuan, Anduo Wang, Rajeev Alur, Boon Thau Loo University of Pennsylvania.

Abstraction

3 6

6

Page 17: Automated Bandwidth Allocation Problems in Data Centers Yifei Yuan, Anduo Wang, Rajeev Alur, Boon Thau Loo University of Pennsylvania.

Refinement

1 2 4 2

3 6

7

Page 18: Automated Bandwidth Allocation Problems in Data Centers Yifei Yuan, Anduo Wang, Rajeev Alur, Boon Thau Loo University of Pennsylvania.

Refinement

1 2 4 2

7

Page 19: Automated Bandwidth Allocation Problems in Data Centers Yifei Yuan, Anduo Wang, Rajeev Alur, Boon Thau Loo University of Pennsylvania.

Evaluation: Set up

• Physical network topology: tree with 200 servers:

200

20

4 4 4 4

8

Page 20: Automated Bandwidth Allocation Problems in Data Centers Yifei Yuan, Anduo Wang, Rajeev Alur, Boon Thau Loo University of Pennsylvania.

Evaluation: Set up

• Virtual network topology: connected cliques

2

1 1

9

Page 21: Automated Bandwidth Allocation Problems in Data Centers Yifei Yuan, Anduo Wang, Rajeev Alur, Boon Thau Loo University of Pennsylvania.

Evaluation: Set up

• Experiment:– Run allocation algorithm– Keep mapping the VN to the PN– Stop when no more VN can be mapped

10

Page 22: Automated Bandwidth Allocation Problems in Data Centers Yifei Yuan, Anduo Wang, Rajeev Alur, Boon Thau Loo University of Pennsylvania.

Evaluation: Server Utilization

9 vms 15 vms0

0.2

0.4

0.6

0.8

1

1.2

secondnetsatsat_abs

# of VMs

Avg.

ser

ver u

litiza

-tio

n

11

Page 23: Automated Bandwidth Allocation Problems in Data Centers Yifei Yuan, Anduo Wang, Rajeev Alur, Boon Thau Loo University of Pennsylvania.

Evaluation: Running Time per VN

9 vms 15 vms0.01

0.1

1

10

100

1000

secondnetsatsat_abs

# of VMs

Runn

ing

time

per

vn (s

econ

ds)

12

Page 24: Automated Bandwidth Allocation Problems in Data Centers Yifei Yuan, Anduo Wang, Rajeev Alur, Boon Thau Loo University of Pennsylvania.

Summary

• Alternative approach solving network resource allocation problem: using SAT/SMT solvers

• Abstract&refinement for scalability• Strength: optimal solution• Weakness: efficiency– Possible scenario: Optimal reallocation

13