The Middlebox Manifesto: Enabling Innovation in Middlebox Deployment
1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox...
-
Upload
brice-kennedy -
Category
Documents
-
view
231 -
download
1
Transcript of 1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox...
![Page 1: 1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.](https://reader036.fdocuments.us/reader036/viewer/2022062300/56649e585503460f94b5213a/html5/thumbnails/1.jpg)
1
Cache Me If You Can
![Page 2: 1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.](https://reader036.fdocuments.us/reader036/viewer/2022062300/56649e585503460f94b5213a/html5/thumbnails/2.jpg)
NUS.SOC.CS5248OOI WEI TSANG
2
You Are Here
Network
Encoder
Sender
Middlebox
Receiver
Decoder
![Page 3: 1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.](https://reader036.fdocuments.us/reader036/viewer/2022062300/56649e585503460f94b5213a/html5/thumbnails/3.jpg)
NUS.SOC.CS5248OOI WEI TSANG
3
Cache Proxies for Web
A
![Page 4: 1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.](https://reader036.fdocuments.us/reader036/viewer/2022062300/56649e585503460f94b5213a/html5/thumbnails/4.jpg)
NUS.SOC.CS5248OOI WEI TSANG
4
Hierarchical Caching
A
B
![Page 5: 1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.](https://reader036.fdocuments.us/reader036/viewer/2022062300/56649e585503460f94b5213a/html5/thumbnails/5.jpg)
NUS.SOC.CS5248OOI WEI TSANG
5
Cooperative Caching
A B
![Page 6: 1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.](https://reader036.fdocuments.us/reader036/viewer/2022062300/56649e585503460f94b5213a/html5/thumbnails/6.jpg)
NUS.SOC.CS5248OOI WEI TSANG
6
Distributed Caching
A B
![Page 7: 1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.](https://reader036.fdocuments.us/reader036/viewer/2022062300/56649e585503460f94b5213a/html5/thumbnails/7.jpg)
NUS.SOC.CS5248OOI WEI TSANG
7
Streaming Media vs. Web Pages
![Page 8: 1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.](https://reader036.fdocuments.us/reader036/viewer/2022062300/56649e585503460f94b5213a/html5/thumbnails/8.jpg)
NUS.SOC.CS5248OOI WEI TSANG
8
Video Access Pattern
by S. Acharya and B. Smith
Study at Lulea University, Sweden 55% complete, 45% stop very early High temporal locality
![Page 9: 1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.](https://reader036.fdocuments.us/reader036/viewer/2022062300/56649e585503460f94b5213a/html5/thumbnails/9.jpg)
NUS.SOC.CS5248OOI WEI TSANG
9
Bimodal Distribution
10 30 50 70 90
% Played
![Page 10: 1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.](https://reader036.fdocuments.us/reader036/viewer/2022062300/56649e585503460f94b5213a/html5/thumbnails/10.jpg)
NUS.SOC.CS5248OOI WEI TSANG
10
Zipf Distribution
log (Frequency)
log (rank)
Frequency = C/rankm
![Page 11: 1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.](https://reader036.fdocuments.us/reader036/viewer/2022062300/56649e585503460f94b5213a/html5/thumbnails/11.jpg)
NUS.SOC.CS5248OOI WEI TSANG
11
Zipf Law
Frequency of English Words“the” “of” “to” “a”
City size
![Page 12: 1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.](https://reader036.fdocuments.us/reader036/viewer/2022062300/56649e585503460f94b5213a/html5/thumbnails/12.jpg)
12
Benefits of Caching
![Page 13: 1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.](https://reader036.fdocuments.us/reader036/viewer/2022062300/56649e585503460f94b5213a/html5/thumbnails/13.jpg)
NUS.SOC.CS5248OOI WEI TSANG
13
Reduce Access Latency
:) :(
![Page 14: 1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.](https://reader036.fdocuments.us/reader036/viewer/2022062300/56649e585503460f94b5213a/html5/thumbnails/14.jpg)
NUS.SOC.CS5248OOI WEI TSANG
14
Reduce Server Load
![Page 15: 1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.](https://reader036.fdocuments.us/reader036/viewer/2022062300/56649e585503460f94b5213a/html5/thumbnails/15.jpg)
NUS.SOC.CS5248OOI WEI TSANG
15
Buy Some Time
![Page 16: 1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.](https://reader036.fdocuments.us/reader036/viewer/2022062300/56649e585503460f94b5213a/html5/thumbnails/16.jpg)
NUS.SOC.CS5248OOI WEI TSANG
16
Reduce Client Buffer Size
![Page 17: 1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.](https://reader036.fdocuments.us/reader036/viewer/2022062300/56649e585503460f94b5213a/html5/thumbnails/17.jpg)
17
Type of Cache
![Page 18: 1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.](https://reader036.fdocuments.us/reader036/viewer/2022062300/56649e585503460f94b5213a/html5/thumbnails/18.jpg)
NUS.SOC.CS5248OOI WEI TSANG
18
Types of Cache
Static caching
Dynamic cachingpatching buffer
![Page 19: 1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.](https://reader036.fdocuments.us/reader036/viewer/2022062300/56649e585503460f94b5213a/html5/thumbnails/19.jpg)
NUS.SOC.CS5248OOI WEI TSANG
19
Static Caching
Cache “all or nothing” is badSplit video into segments of size
S
![Page 20: 1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.](https://reader036.fdocuments.us/reader036/viewer/2022062300/56649e585503460f94b5213a/html5/thumbnails/20.jpg)
NUS.SOC.CS5248OOI WEI TSANG
20
If I am writing a survey Introduction
Differences between web and media caching
Video access pattern Benefits of caching
Different type of cache Proxy caching architecture
![Page 21: 1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.](https://reader036.fdocuments.us/reader036/viewer/2022062300/56649e585503460f94b5213a/html5/thumbnails/21.jpg)
NUS.SOC.CS5248OOI WEI TSANG
21
Other Caching Issues
How to segment?Which segments to cache?When to fetch data?Who to fetch from?When cache is full, who to kick
out?How to measure popularity?Can cache adapt to popularity?
![Page 22: 1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.](https://reader036.fdocuments.us/reader036/viewer/2022062300/56649e585503460f94b5213a/html5/thumbnails/22.jpg)
NUS.SOC.CS5248OOI WEI TSANG
22
Rest of the Lecture
Soccer – cooperative caching proxy
Silo, rainbow and cache token – distributed caching proxy
Mocha – with congestion control
![Page 23: 1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.](https://reader036.fdocuments.us/reader036/viewer/2022062300/56649e585503460f94b5213a/html5/thumbnails/23.jpg)
23
SOCCER
Self-organizing cooperative caching architecture
![Page 24: 1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.](https://reader036.fdocuments.us/reader036/viewer/2022062300/56649e585503460f94b5213a/html5/thumbnails/24.jpg)
NUS.SOC.CS5248OOI WEI TSANG
24
How to segment?
![Page 25: 1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.](https://reader036.fdocuments.us/reader036/viewer/2022062300/56649e585503460f94b5213a/html5/thumbnails/25.jpg)
NUS.SOC.CS5248OOI WEI TSANG
25
Effects of Size S
Large S : Low utilizationSmall S : Lots of gaps
![Page 26: 1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.](https://reader036.fdocuments.us/reader036/viewer/2022062300/56649e585503460f94b5213a/html5/thumbnails/26.jpg)
NUS.SOC.CS5248OOI WEI TSANG
26
Prefix Caching Policy
1 Chunk = k segments
![Page 27: 1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.](https://reader036.fdocuments.us/reader036/viewer/2022062300/56649e585503460f94b5213a/html5/thumbnails/27.jpg)
NUS.SOC.CS5248OOI WEI TSANG
27
Fetching Cache Data
B
A
Server
Client 2Client 1
![Page 28: 1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.](https://reader036.fdocuments.us/reader036/viewer/2022062300/56649e585503460f94b5213a/html5/thumbnails/28.jpg)
NUS.SOC.CS5248OOI WEI TSANG
28
Option 2
B
A
Server
Client 2Client 1
![Page 29: 1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.](https://reader036.fdocuments.us/reader036/viewer/2022062300/56649e585503460f94b5213a/html5/thumbnails/29.jpg)
NUS.SOC.CS5248OOI WEI TSANG
29
Option 3
B
A
Server
Client 2Client 1
![Page 30: 1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.](https://reader036.fdocuments.us/reader036/viewer/2022062300/56649e585503460f94b5213a/html5/thumbnails/30.jpg)
NUS.SOC.CS5248OOI WEI TSANG
30
Issues
How to advertise?How to choose helper?
![Page 31: 1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.](https://reader036.fdocuments.us/reader036/viewer/2022062300/56649e585503460f94b5213a/html5/thumbnails/31.jpg)
NUS.SOC.CS5248OOI WEI TSANG
31
How to Advertise?
Balance betweennetwork loadfreshness of information
![Page 32: 1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.](https://reader036.fdocuments.us/reader036/viewer/2022062300/56649e585503460f94b5213a/html5/thumbnails/32.jpg)
NUS.SOC.CS5248OOI WEI TSANG
32
Scalable AdvertisementExpanding Ring Advertisement
163264128
![Page 33: 1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.](https://reader036.fdocuments.us/reader036/viewer/2022062300/56649e585503460f94b5213a/html5/thumbnails/33.jpg)
NUS.SOC.CS5248OOI WEI TSANG
33
How to Choose Helper?Consideration for Static Cache
network distance (1,2,3,4)number of streams being served
![Page 34: 1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.](https://reader036.fdocuments.us/reader036/viewer/2022062300/56649e585503460f94b5213a/html5/thumbnails/34.jpg)
NUS.SOC.CS5248OOI WEI TSANG
34
Static Cache
Cost for retrieving data from node X to node Y =
treamsCurrNumOfSreamsMaxNumOfSt
reamsMaxNumOfStYXDist
*),(
![Page 35: 1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.](https://reader036.fdocuments.us/reader036/viewer/2022062300/56649e585503460f94b5213a/html5/thumbnails/35.jpg)
NUS.SOC.CS5248OOI WEI TSANG
35
Dynamic Caching
Need to consider the size of patching buffer
S
![Page 36: 1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.](https://reader036.fdocuments.us/reader036/viewer/2022062300/56649e585503460f94b5213a/html5/thumbnails/36.jpg)
NUS.SOC.CS5248OOI WEI TSANG
36
Dynamic Caching
Nused
Nfetched = min(s, Nused + Δ)
S
![Page 37: 1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.](https://reader036.fdocuments.us/reader036/viewer/2022062300/56649e585503460f94b5213a/html5/thumbnails/37.jpg)
NUS.SOC.CS5248OOI WEI TSANG
37
Dynamic Cache
Potential Waste = Nfetched/Nused
Integrate into overall cost
![Page 38: 1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.](https://reader036.fdocuments.us/reader036/viewer/2022062300/56649e585503460f94b5213a/html5/thumbnails/38.jpg)
NUS.SOC.CS5248OOI WEI TSANG
38
Helper Selection
Helper ask other helpers to help if segments not found on local cache
Pick lowest cost helper
![Page 39: 1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.](https://reader036.fdocuments.us/reader036/viewer/2022062300/56649e585503460f94b5213a/html5/thumbnails/39.jpg)
NUS.SOC.CS5248OOI WEI TSANG
39
If Static Cache
Retrieve to fill current gapMay pick different helpers for
different gaps
Should avoid frequent switching
![Page 40: 1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.](https://reader036.fdocuments.us/reader036/viewer/2022062300/56649e585503460f94b5213a/html5/thumbnails/40.jpg)
NUS.SOC.CS5248OOI WEI TSANG
40
If Dynamic Cache
Stick to one helper
![Page 41: 1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.](https://reader036.fdocuments.us/reader036/viewer/2022062300/56649e585503460f94b5213a/html5/thumbnails/41.jpg)
NUS.SOC.CS5248OOI WEI TSANG
41
Evaluations
SOCCER
Hierarchical Proxies
Single Proxy
![Page 42: 1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.](https://reader036.fdocuments.us/reader036/viewer/2022062300/56649e585503460f94b5213a/html5/thumbnails/42.jpg)
42
Silo, Rainbow and Cache Token
![Page 43: 1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.](https://reader036.fdocuments.us/reader036/viewer/2022062300/56649e585503460f94b5213a/html5/thumbnails/43.jpg)
NUS.SOC.CS5248OOI WEI TSANG
43
Distributed Caching
B
A
Server
new clip!
![Page 44: 1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.](https://reader036.fdocuments.us/reader036/viewer/2022062300/56649e585503460f94b5213a/html5/thumbnails/44.jpg)
NUS.SOC.CS5248OOI WEI TSANG
44
Distributed Caching
B
A
Server
![Page 45: 1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.](https://reader036.fdocuments.us/reader036/viewer/2022062300/56649e585503460f94b5213a/html5/thumbnails/45.jpg)
NUS.SOC.CS5248OOI WEI TSANG
45
Distributed Caching
B
A
Server
![Page 46: 1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.](https://reader036.fdocuments.us/reader036/viewer/2022062300/56649e585503460f94b5213a/html5/thumbnails/46.jpg)
NUS.SOC.CS5248OOI WEI TSANG
46
Distributed Caching
B
A
Server
![Page 47: 1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.](https://reader036.fdocuments.us/reader036/viewer/2022062300/56649e585503460f94b5213a/html5/thumbnails/47.jpg)
NUS.SOC.CS5248OOI WEI TSANG
47
Cooperative vs DistributedCooperative caching caches
independentlyDistributed caching caches as a
team
![Page 48: 1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.](https://reader036.fdocuments.us/reader036/viewer/2022062300/56649e585503460f94b5213a/html5/thumbnails/48.jpg)
NUS.SOC.CS5248OOI WEI TSANG
48
Problems
Who should cache what?
Which segment to kick out?
How to redistribute data?
![Page 49: 1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.](https://reader036.fdocuments.us/reader036/viewer/2022062300/56649e585503460f94b5213a/html5/thumbnails/49.jpg)
NUS.SOC.CS5248OOI WEI TSANG
49
RCache
Np proxies
video of length Lv
divide into Ns equal segments
Each proxy caches each segment with a/Np probability
![Page 50: 1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.](https://reader036.fdocuments.us/reader036/viewer/2022062300/56649e585503460f94b5213a/html5/thumbnails/50.jpg)
NUS.SOC.CS5248OOI WEI TSANG
50
Analysis
Probability that whole video is cached
Storage requirement aL
1ln
11
sNa
sN
![Page 51: 1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.](https://reader036.fdocuments.us/reader036/viewer/2022062300/56649e585503460f94b5213a/html5/thumbnails/51.jpg)
NUS.SOC.CS5248OOI WEI TSANG
51
Two Parameters
How to divide video into segments?
What is the probability of storing each segment?
![Page 52: 1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.](https://reader036.fdocuments.us/reader036/viewer/2022062300/56649e585503460f94b5213a/html5/thumbnails/52.jpg)
NUS.SOC.CS5248OOI WEI TSANG
52
Silo
segment size probabilityof storage
![Page 53: 1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.](https://reader036.fdocuments.us/reader036/viewer/2022062300/56649e585503460f94b5213a/html5/thumbnails/53.jpg)
NUS.SOC.CS5248OOI WEI TSANG
53
Problems
Who should cache what?
Which segment to kick out?
How to redistribute data?
![Page 54: 1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.](https://reader036.fdocuments.us/reader036/viewer/2022062300/56649e585503460f94b5213a/html5/thumbnails/54.jpg)
NUS.SOC.CS5248OOI WEI TSANG
54
Compute Popularity
For each videoFor each segment
![Page 55: 1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.](https://reader036.fdocuments.us/reader036/viewer/2022062300/56649e585503460f94b5213a/html5/thumbnails/55.jpg)
NUS.SOC.CS5248OOI WEI TSANG
55
Rainbow Algorithm
less popular
![Page 56: 1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.](https://reader036.fdocuments.us/reader036/viewer/2022062300/56649e585503460f94b5213a/html5/thumbnails/56.jpg)
NUS.SOC.CS5248OOI WEI TSANG
56
Problems
Who should cache what?
Which segment to kick out?
How to redistribute data?
![Page 57: 1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.](https://reader036.fdocuments.us/reader036/viewer/2022062300/56649e585503460f94b5213a/html5/thumbnails/57.jpg)
NUS.SOC.CS5248OOI WEI TSANG
57
Data Redistribution
When popularity changes, need to redistribute.
Redistribute “on-demand” (lazy)
![Page 58: 1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.](https://reader036.fdocuments.us/reader036/viewer/2022062300/56649e585503460f94b5213a/html5/thumbnails/58.jpg)
NUS.SOC.CS5248OOI WEI TSANG
58
Cache Token
Each segment have two bits(T,C)
T: I am suppose to have the segment C: I have the segment
![Page 59: 1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.](https://reader036.fdocuments.us/reader036/viewer/2022062300/56649e585503460f94b5213a/html5/thumbnails/59.jpg)
NUS.SOC.CS5248OOI WEI TSANG
59
Data Redistribution
(T=1,C=1)(T=0,C=0)(T=1,C=0) (T=0,C=1)
![Page 60: 1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.](https://reader036.fdocuments.us/reader036/viewer/2022062300/56649e585503460f94b5213a/html5/thumbnails/60.jpg)
NUS.SOC.CS5248OOI WEI TSANG
60
Silo, Rainbow and TokenDistributed Caching ArchitectureFault tolerantScalable
![Page 61: 1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.](https://reader036.fdocuments.us/reader036/viewer/2022062300/56649e585503460f94b5213a/html5/thumbnails/61.jpg)
61
Proxy Cache + Congestion Control
![Page 62: 1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.](https://reader036.fdocuments.us/reader036/viewer/2022062300/56649e585503460f94b5213a/html5/thumbnails/62.jpg)
NUS.SOC.CS5248OOI WEI TSANG
62
Scenario (10am)
A
Server
Client 2
![Page 63: 1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.](https://reader036.fdocuments.us/reader036/viewer/2022062300/56649e585503460f94b5213a/html5/thumbnails/63.jpg)
NUS.SOC.CS5248OOI WEI TSANG
63
Scenario (1am)
A
Server
Client 2
![Page 64: 1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.](https://reader036.fdocuments.us/reader036/viewer/2022062300/56649e585503460f94b5213a/html5/thumbnails/64.jpg)
NUS.SOC.CS5248OOI WEI TSANG
64
Problem
Cache interfere with congestion control algorithm
Make cache adapt aware of quality adaptation
![Page 65: 1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.](https://reader036.fdocuments.us/reader036/viewer/2022062300/56649e585503460f94b5213a/html5/thumbnails/65.jpg)
NUS.SOC.CS5248OOI WEI TSANG
65
Congestion Control ProtocolRAP: AIMD + Layered Coding
“sender-driven layered unicast”
![Page 66: 1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.](https://reader036.fdocuments.us/reader036/viewer/2022062300/56649e585503460f94b5213a/html5/thumbnails/66.jpg)
NUS.SOC.CS5248OOI WEI TSANG
66
Solutions
Making cache “quality-aware”PrefetchReplacement Algorithm
![Page 67: 1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.](https://reader036.fdocuments.us/reader036/viewer/2022062300/56649e585503460f94b5213a/html5/thumbnails/67.jpg)
NUS.SOC.CS5248OOI WEI TSANG
67
Cache Miss
A
Server
Client 2
![Page 68: 1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.](https://reader036.fdocuments.us/reader036/viewer/2022062300/56649e585503460f94b5213a/html5/thumbnails/68.jpg)
NUS.SOC.CS5248OOI WEI TSANG
68
Cache Hit
A
Server
Client 2
repair +prefetch
![Page 69: 1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.](https://reader036.fdocuments.us/reader036/viewer/2022062300/56649e585503460f94b5213a/html5/thumbnails/69.jpg)
NUS.SOC.CS5248OOI WEI TSANG
69
Peeking Inside the Cache
![Page 70: 1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.](https://reader036.fdocuments.us/reader036/viewer/2022062300/56649e585503460f94b5213a/html5/thumbnails/70.jpg)
NUS.SOC.CS5248OOI WEI TSANG
70
Cache Hit: Repair
![Page 71: 1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.](https://reader036.fdocuments.us/reader036/viewer/2022062300/56649e585503460f94b5213a/html5/thumbnails/71.jpg)
NUS.SOC.CS5248OOI WEI TSANG
71
Cache Hit: Prefetch
![Page 72: 1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.](https://reader036.fdocuments.us/reader036/viewer/2022062300/56649e585503460f94b5213a/html5/thumbnails/72.jpg)
NUS.SOC.CS5248OOI WEI TSANG
72
Cache Hit: Prefetch
![Page 73: 1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.](https://reader036.fdocuments.us/reader036/viewer/2022062300/56649e585503460f94b5213a/html5/thumbnails/73.jpg)
NUS.SOC.CS5248OOI WEI TSANG
73
Prefetch Algorithm
prefetchwindow
playbackpoint
![Page 74: 1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.](https://reader036.fdocuments.us/reader036/viewer/2022062300/56649e585503460f94b5213a/html5/thumbnails/74.jpg)
NUS.SOC.CS5248OOI WEI TSANG
74
Proxy Request to ServerMultiple requests (for different
clients) are batched.
![Page 75: 1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.](https://reader036.fdocuments.us/reader036/viewer/2022062300/56649e585503460f94b5213a/html5/thumbnails/75.jpg)
NUS.SOC.CS5248OOI WEI TSANG
75
Server Response
Missing segments are sent in decreasing priority
1
2
3 4
![Page 76: 1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.](https://reader036.fdocuments.us/reader036/viewer/2022062300/56649e585503460f94b5213a/html5/thumbnails/76.jpg)
NUS.SOC.CS5248OOI WEI TSANG
76
Server Response
Send as many segments as possible until next prefetch request
![Page 77: 1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.](https://reader036.fdocuments.us/reader036/viewer/2022062300/56649e585503460f94b5213a/html5/thumbnails/77.jpg)
NUS.SOC.CS5248OOI WEI TSANG
77
Solutions
Making cache “quality-aware”PrefetchReplacement Algorithm
![Page 78: 1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.](https://reader036.fdocuments.us/reader036/viewer/2022062300/56649e585503460f94b5213a/html5/thumbnails/78.jpg)
NUS.SOC.CS5248OOI WEI TSANG
78
Goal of Replacement AlgorithmGoal: converge to efficient state
if a stream is popularaverage quality is highvariation in quality is low
![Page 79: 1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.](https://reader036.fdocuments.us/reader036/viewer/2022062300/56649e585503460f94b5213a/html5/thumbnails/79.jpg)
NUS.SOC.CS5248OOI WEI TSANG
79
The Algorithm
![Page 80: 1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.](https://reader036.fdocuments.us/reader036/viewer/2022062300/56649e585503460f94b5213a/html5/thumbnails/80.jpg)
NUS.SOC.CS5248OOI WEI TSANG
80
Trashing and Locking
![Page 81: 1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.](https://reader036.fdocuments.us/reader036/viewer/2022062300/56649e585503460f94b5213a/html5/thumbnails/81.jpg)
NUS.SOC.CS5248OOI WEI TSANG
81
Choosing Victim
whit (weighted hit) =Tplay/Ttotal
Calculate whit for each layer in a stream over a popularity window
![Page 82: 1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.](https://reader036.fdocuments.us/reader036/viewer/2022062300/56649e585503460f94b5213a/html5/thumbnails/82.jpg)
NUS.SOC.CS5248OOI WEI TSANG
82
Example
Popularity Lock? Name Layer
5.9 1 Nemo 0
4.3 1 Nemo 1
4.0 0 Matrix 2 0
3.9 0 Matrix 2 1
1.1 0 Gigli 0
![Page 83: 1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.](https://reader036.fdocuments.us/reader036/viewer/2022062300/56649e585503460f94b5213a/html5/thumbnails/83.jpg)
NUS.SOC.CS5248OOI WEI TSANG
83
Evaluations
Two CriteriaCompletenessContinuity
![Page 84: 1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.](https://reader036.fdocuments.us/reader036/viewer/2022062300/56649e585503460f94b5213a/html5/thumbnails/84.jpg)
NUS.SOC.CS5248OOI WEI TSANG
84
vs Request Number
![Page 85: 1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.](https://reader036.fdocuments.us/reader036/viewer/2022062300/56649e585503460f94b5213a/html5/thumbnails/85.jpg)
NUS.SOC.CS5248OOI WEI TSANG
85
Different Popularity
![Page 86: 1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.](https://reader036.fdocuments.us/reader036/viewer/2022062300/56649e585503460f94b5213a/html5/thumbnails/86.jpg)
NUS.SOC.CS5248OOI WEI TSANG
86
Summary
Proxy Caching for videoTechniques for segmentation,
replacement etc. Interactions with other aspect of
streaming