Toy&Exercise&=&Assignment& - TMA Conferences · Preliminary&look& 628.000000000.01300000...
Transcript of Toy&Exercise&=&Assignment& - TMA Conferences · Preliminary&look& 628.000000000.01300000...
![Page 1: Toy&Exercise&=&Assignment& - TMA Conferences · Preliminary&look& 628.000000000.01300000 628.033000000.01600000 628.069000000.01800000 628.108000000.01400000 628.143000000.01400000](https://reader034.fdocuments.us/reader034/viewer/2022042710/5f666249b859af6fee60a620/html5/thumbnails/1.jpg)
Fabio Ricciato
6th PhD School on Traffic Monitoring and Analysis TMA
2016 -‐ Louvain La Neuve, Belgium, 5-‐6 April 2016
Toy Exercise -‐ Assignment
![Page 2: Toy&Exercise&=&Assignment& - TMA Conferences · Preliminary&look& 628.000000000.01300000 628.033000000.01600000 628.069000000.01800000 628.108000000.01400000 628.143000000.01400000](https://reader034.fdocuments.us/reader034/viewer/2022042710/5f666249b859af6fee60a620/html5/thumbnails/2.jpg)
Scenario • Scenario: the Green and Blue teams have measured Round-‐
Trip Times (RTT) from their respecOve access networks via repeated request/reply to the same server!
GREEN network
BLUE network
Internet
Measurement Server
![Page 3: Toy&Exercise&=&Assignment& - TMA Conferences · Preliminary&look& 628.000000000.01300000 628.033000000.01600000 628.069000000.01800000 628.108000000.01400000 628.143000000.01400000](https://reader034.fdocuments.us/reader034/viewer/2022042710/5f666249b859af6fee60a620/html5/thumbnails/3.jpg)
Ome
Request k
Reply k
Request Ome tk
RTT rk
Measurement Client
Measurement Server
Methodology
![Page 4: Toy&Exercise&=&Assignment& - TMA Conferences · Preliminary&look& 628.000000000.01300000 628.033000000.01600000 628.069000000.01800000 628.108000000.01400000 628.143000000.01400000](https://reader034.fdocuments.us/reader034/viewer/2022042710/5f666249b859af6fee60a620/html5/thumbnails/4.jpg)
Scenario
• They provide you – A succint descripOon of their measurement methodology
– The raw measurement data • files dataB.txt, dataG.txt • two columns for Start Ome tk and RTT rk
StartTime RTT 972.00000000 0.01172138 972.02004475 0.01476894 972.04011993 0.01303928 972.06021071 0.01749107 ... ...
![Page 5: Toy&Exercise&=&Assignment& - TMA Conferences · Preliminary&look& 628.000000000.01300000 628.033000000.01600000 628.069000000.01800000 628.108000000.01400000 628.143000000.01400000](https://reader034.fdocuments.us/reader034/viewer/2022042710/5f666249b859af6fee60a620/html5/thumbnails/5.jpg)
Measurement methodology described by Blue team
“We run a series of periodic request/reply measurements towards the common measurement server. For every request packet k we record the departure <mestamp tk and start a <mer. Every request carries a unique ID in the payload that is replicated in the reply packet, in order to ensure correct associa<on between the reply and the corresponding request. When the reply packet is received, we record the value of the <mer rk. If the reply is not received within a maximum predefined <meout, we mark the request as “lost” and write “-1” in the output file. Consecu<ve measurements are spaced by 20 ms. The experiment started at 9:16 AM of 11.3.2016.”
![Page 6: Toy&Exercise&=&Assignment& - TMA Conferences · Preliminary&look& 628.000000000.01300000 628.033000000.01600000 628.069000000.01800000 628.108000000.01400000 628.143000000.01400000](https://reader034.fdocuments.us/reader034/viewer/2022042710/5f666249b859af6fee60a620/html5/thumbnails/6.jpg)
Measurement methodology described by Green Team
“We have followed the same measurement methodology described by the Blue Team, with the same spacing interval of 20 msec between consecu<ve measurements. But we started a bit later, around 9:21 AM of the same day.”
![Page 7: Toy&Exercise&=&Assignment& - TMA Conferences · Preliminary&look& 628.000000000.01300000 628.033000000.01600000 628.069000000.01800000 628.108000000.01400000 628.143000000.01400000](https://reader034.fdocuments.us/reader034/viewer/2022042710/5f666249b859af6fee60a620/html5/thumbnails/7.jpg)
Your task
• Process the data and … • … determine which network has the best performances
• moOvate your answer, provide quanOtaOve performance metric values in support of your answer.
![Page 9: Toy&Exercise&=&Assignment& - TMA Conferences · Preliminary&look& 628.000000000.01300000 628.033000000.01600000 628.069000000.01800000 628.108000000.01400000 628.143000000.01400000](https://reader034.fdocuments.us/reader034/viewer/2022042710/5f666249b859af6fee60a620/html5/thumbnails/9.jpg)
6th PhD School on Traffic Monitoring and Analysis TMA
2016 -‐ Louvain La Neuve, Belgium, 5-‐6 April 2016
Toy Exercise Sketch of SoluOon
![Page 10: Toy&Exercise&=&Assignment& - TMA Conferences · Preliminary&look& 628.000000000.01300000 628.033000000.01600000 628.069000000.01800000 628.108000000.01400000 628.143000000.01400000](https://reader034.fdocuments.us/reader034/viewer/2022042710/5f666249b859af6fee60a620/html5/thumbnails/10.jpg)
Ome
Request k
Reply k received within Tout
Request Ome tk
RTT rk
Measurement Client
Measurement Server
RTT sample
output rk
![Page 11: Toy&Exercise&=&Assignment& - TMA Conferences · Preliminary&look& 628.000000000.01300000 628.033000000.01600000 628.069000000.01800000 628.108000000.01400000 628.143000000.01400000](https://reader034.fdocuments.us/reader034/viewer/2022042710/5f666249b859af6fee60a620/html5/thumbnails/11.jpg)
Ome
Request k
Reply k was lost
Request Ome tk
Tout
Measurement Client
Measurement Server
Timeout expired
output ‘-‐1’
x
![Page 12: Toy&Exercise&=&Assignment& - TMA Conferences · Preliminary&look& 628.000000000.01300000 628.033000000.01600000 628.069000000.01800000 628.108000000.01400000 628.143000000.01400000](https://reader034.fdocuments.us/reader034/viewer/2022042710/5f666249b859af6fee60a620/html5/thumbnails/12.jpg)
Ome
Request k is lost Request Ome tk
Tout
Measurement Client
Measurement Server
Timeout expired
output ‘-‐1’
x
![Page 13: Toy&Exercise&=&Assignment& - TMA Conferences · Preliminary&look& 628.000000000.01300000 628.033000000.01600000 628.069000000.01800000 628.108000000.01400000 628.143000000.01400000](https://reader034.fdocuments.us/reader034/viewer/2022042710/5f666249b859af6fee60a620/html5/thumbnails/13.jpg)
Ome
Request k
Reply k was late
Request Ome tk
Tout
Measurement Client
Measurement Server
Timeout expired
output ‘-‐1’
![Page 14: Toy&Exercise&=&Assignment& - TMA Conferences · Preliminary&look& 628.000000000.01300000 628.033000000.01600000 628.069000000.01800000 628.108000000.01400000 628.143000000.01400000](https://reader034.fdocuments.us/reader034/viewer/2022042710/5f666249b859af6fee60a620/html5/thumbnails/14.jpg)
A First look at the two datasets
Blue dataset • N=30,000 total records • n0= 949 records w/o valid
RTT (‘-‐1’)
Green dataset • N=30,000 total records • n0= 3466 records w/o valid
RTT (‘-‐1’)
![Page 15: Toy&Exercise&=&Assignment& - TMA Conferences · Preliminary&look& 628.000000000.01300000 628.033000000.01600000 628.069000000.01800000 628.108000000.01400000 628.143000000.01400000](https://reader034.fdocuments.us/reader034/viewer/2022042710/5f666249b859af6fee60a620/html5/thumbnails/15.jpg)
A naive answer
Blue dataset • N=30,000 total records • n0= 949 records w/o valid
RTT (‘-‐1’)
• u0 = 949/30,000=0.0316
Green dataset • N=30,000 total records • n0= 3466 records w/o valid
RTT (‘-‐1’)
• u0=3466/30,000= 0.1155
u0 =# unanswered requests
# all requests=n0
N
Blue network has lower u0 à Blue network is beeer
![Page 16: Toy&Exercise&=&Assignment& - TMA Conferences · Preliminary&look& 628.000000000.01300000 628.033000000.01600000 628.069000000.01800000 628.108000000.01400000 628.143000000.01400000](https://reader034.fdocuments.us/reader034/viewer/2022042710/5f666249b859af6fee60a620/html5/thumbnails/16.jpg)
Preliminary look 628.00000000 0.01300000 628.03300000 0.01600000 628.06900000 0.01800000 628.10800000 0.01400000 628.14300000 0.01400000 628.17700000 0.01500000 628.21200000 0.01500000 628.24800000 -‐1.00000000 629.26800000 0.01400000 629.30200000 0.01800000 629.34100000 0.01500000 629.37700000 0.01600000 629.41300000 0.01500000 629.44900000 0.01800000 629.48700000 0.01700000 629.52400000 0.01600000 629.56100000 0.01800000 629.59900000 0.74200000 630.36100000 0.05700000 630.43800000 -‐1.00000000 631.45800000 0.72500000 632.20400000 0.01500000 632.24000000 0.01800000 632.27800000 0.01400000
972.02004475 0.01476894 972.04011993 0.01303928 972.06021071 0.01749107 972.08028098 0.01502918 972.10033678 0.01586265 972.12040874 0.01742269 972.14046197 0.01306065 972.16047813 0.01737577 972.18056606 0.01701450 972.20063363 0.01365929 972.22068388 0.01770575 972.24068468 0.01799749 972.26073387 0.33428613 972.28078814 0.01463612 972.30086112 0.01851273 972.32094276 0.01797620 972.34100671 0.01418419 972.36109110 0.01613566 972.38115101 0.01559531 972.40123778 0.01541753 972.42124092 0.01317477 972.44133156 0.01357658 972.46139773 0.01760751 972.48145926 0.01772676
![Page 17: Toy&Exercise&=&Assignment& - TMA Conferences · Preliminary&look& 628.000000000.01300000 628.033000000.01600000 628.069000000.01800000 628.108000000.01400000 628.143000000.01400000](https://reader034.fdocuments.us/reader034/viewer/2022042710/5f666249b859af6fee60a620/html5/thumbnails/17.jpg)
Preliminary look
Omestamps are local, not absolute
![Page 18: Toy&Exercise&=&Assignment& - TMA Conferences · Preliminary&look& 628.000000000.01300000 628.033000000.01600000 628.069000000.01800000 628.108000000.01400000 628.143000000.01400000](https://reader034.fdocuments.us/reader034/viewer/2022042710/5f666249b859af6fee60a620/html5/thumbnails/18.jpg)
A First look at the two datasets
Blue dataset • N=30,000 total records • n0= 949 records w/o valid
RTT (‘-‐1’) • max(rk) = 0.998
– Tout likely set to 1 sec
Green dataset • N=30,000 total records • n0= 3466 records w/o valid
RTT (‘-‐1’) • max(rk)=2.896
• Tout likely set to 3 sec
![Page 19: Toy&Exercise&=&Assignment& - TMA Conferences · Preliminary&look& 628.000000000.01300000 628.033000000.01600000 628.069000000.01800000 628.108000000.01400000 628.143000000.01400000](https://reader034.fdocuments.us/reader034/viewer/2022042710/5f666249b859af6fee60a620/html5/thumbnails/19.jpg)
AdjusOng Omestamps (approximately)
removing iniOal offset
rescaling to minutes
![Page 20: Toy&Exercise&=&Assignment& - TMA Conferences · Preliminary&look& 628.000000000.01300000 628.033000000.01600000 628.069000000.01800000 628.108000000.01400000 628.143000000.01400000](https://reader034.fdocuments.us/reader034/viewer/2022042710/5f666249b859af6fee60a620/html5/thumbnails/20.jpg)
A First look at the two dataset
Blue dataset • N=30,000 total records • n0= 949 records w/o valid
RTT (‘-‐1’) • max(rk) = 0.998
– Tout likely set to 1 sec • total duraOon 10 min
Green dataset • N=30,000 total records • n0= 3466 records w/o valid
RTT (‘-‐1’) • max(rk)=2.896
• Tout likely set to 3 sec
• total duraOon 38 min
![Page 21: Toy&Exercise&=&Assignment& - TMA Conferences · Preliminary&look& 628.000000000.01300000 628.033000000.01600000 628.069000000.01800000 628.108000000.01400000 628.143000000.01400000](https://reader034.fdocuments.us/reader034/viewer/2022042710/5f666249b859af6fee60a620/html5/thumbnails/21.jpg)
A First look at the two dataset
Blue dataset • N=30,000 total records • n0= 949 records w/o valid
RTT (‘-‐1’) • max(rk) = 0.998
– Tout likely set to 1 sec • total duraOon 10 min
Green dataset • N=30,000 total records • n0= 3466 records w/o valid
RTT (‘-‐1’) • max(rk)=2.896
• Tout likely set to 3 sec
• total duraOon 38 min
Same number of records (30,000), same spacing (20 ms), but different duraOon ??????
![Page 22: Toy&Exercise&=&Assignment& - TMA Conferences · Preliminary&look& 628.000000000.01300000 628.033000000.01600000 628.069000000.01800000 628.108000000.01400000 628.143000000.01400000](https://reader034.fdocuments.us/reader034/viewer/2022042710/5f666249b859af6fee60a620/html5/thumbnails/22.jpg)
outage ?
![Page 23: Toy&Exercise&=&Assignment& - TMA Conferences · Preliminary&look& 628.000000000.01300000 628.033000000.01600000 628.069000000.01800000 628.108000000.01400000 628.143000000.01400000](https://reader034.fdocuments.us/reader034/viewer/2022042710/5f666249b859af6fee60a620/html5/thumbnails/23.jpg)
zooming into outage
1.1 min c.ca outage
probably the same outage ? probably not due to causes external to the network-‐under-‐test, hence not relevant for the comparison
![Page 24: Toy&Exercise&=&Assignment& - TMA Conferences · Preliminary&look& 628.000000000.01300000 628.033000000.01600000 628.069000000.01800000 628.108000000.01400000 628.143000000.01400000](https://reader034.fdocuments.us/reader034/viewer/2022042710/5f666249b859af6fee60a620/html5/thumbnails/24.jpg)
Ambiguity
Ome
Send probe k-‐1
Ome
Send probe k
Send probe k-‐1
Send probe k
Receive reply k-‐1
D=20ms
Receive reply k-‐1
tk+1 = tk +D
tk+1 = rk +D
tk tk+1rk
tk tk+1rk
D=20ms
??
![Page 25: Toy&Exercise&=&Assignment& - TMA Conferences · Preliminary&look& 628.000000000.01300000 628.033000000.01600000 628.069000000.01800000 628.108000000.01400000 628.143000000.01400000](https://reader034.fdocuments.us/reader034/viewer/2022042710/5f666249b859af6fee60a620/html5/thumbnails/25.jpg)
Measurement process Input/Ouput
sampling Ome tk
RTT sample rk
Measurement Process
tk+1 = tk +D
INPUT OUTPUT
![Page 26: Toy&Exercise&=&Assignment& - TMA Conferences · Preliminary&look& 628.000000000.01300000 628.033000000.01600000 628.069000000.01800000 628.108000000.01400000 628.143000000.01400000](https://reader034.fdocuments.us/reader034/viewer/2022042710/5f666249b859af6fee60a620/html5/thumbnails/26.jpg)
Measurement process Input/Ouput
sampling Ome tk
RTT sample rk
tk+1 = tk + rk +D
Measurement Process
INPUT OUTPUT
![Page 27: Toy&Exercise&=&Assignment& - TMA Conferences · Preliminary&look& 628.000000000.01300000 628.033000000.01600000 628.069000000.01800000 628.108000000.01400000 628.143000000.01400000](https://reader034.fdocuments.us/reader034/viewer/2022042710/5f666249b859af6fee60a620/html5/thumbnails/27.jpg)
during the outage …
Ome
Send probe k-‐1
tk
Tout = 1 sec
Send probe k
tk+1
…
Ome
Send probe k-‐1
tk
Send probe k
tk+1
…
D=20 ms tk+1 = tk +D
tk+1 = Tout +D
![Page 28: Toy&Exercise&=&Assignment& - TMA Conferences · Preliminary&look& 628.000000000.01300000 628.033000000.01600000 628.069000000.01800000 628.108000000.01400000 628.143000000.01400000](https://reader034.fdocuments.us/reader034/viewer/2022042710/5f666249b859af6fee60a620/html5/thumbnails/28.jpg)
• (uncontrolled) correlaOons between output and input of measurement system
• Risk of distorOon (bias) – under-‐ or over-‐representaOon of certain phenomena
• other side effects
![Page 29: Toy&Exercise&=&Assignment& - TMA Conferences · Preliminary&look& 628.000000000.01300000 628.033000000.01600000 628.069000000.01800000 628.108000000.01400000 628.143000000.01400000](https://reader034.fdocuments.us/reader034/viewer/2022042710/5f666249b859af6fee60a620/html5/thumbnails/29.jpg)
discarding data during outage
Discarding data during outage
rescaling to minutes
![Page 30: Toy&Exercise&=&Assignment& - TMA Conferences · Preliminary&look& 628.000000000.01300000 628.033000000.01600000 628.069000000.01800000 628.108000000.01400000 628.143000000.01400000](https://reader034.fdocuments.us/reader034/viewer/2022042710/5f666249b859af6fee60a620/html5/thumbnails/30.jpg)
Let’s look at the RTT distribuOon
• Histograms? – How to bin ? Linearly, logaritmically … – What bin size ? – In any case you loose resoluOon (bin aggregaOon) – …
• Avoid all that by looking at CumulaOve DistribuOons!
![Page 31: Toy&Exercise&=&Assignment& - TMA Conferences · Preliminary&look& 628.000000000.01300000 628.033000000.01600000 628.069000000.01800000 628.108000000.01400000 628.143000000.01400000](https://reader034.fdocuments.us/reader034/viewer/2022042710/5f666249b859af6fee60a620/html5/thumbnails/31.jpg)
DefiniOon of ECDF, ECCDF
• CDF: CumulaOve DistribuOon FuncOon • CCDF: Complementary CDF • ECDF: Empirical CDF
• ECCDF: Empirical Complementary CDF
Fk v( ) =number of elements ≤ vtotal number of elements
=1k
1 xi ≤ v{ }i=1
k∑
Sk v( ) =1−Fk v( )
Sk v( ) =number of elements > vtotal number of elements
=1k
1 xi > v{ }i=1
k∑
![Page 32: Toy&Exercise&=&Assignment& - TMA Conferences · Preliminary&look& 628.000000000.01300000 628.033000000.01600000 628.069000000.01800000 628.108000000.01400000 628.143000000.01400000](https://reader034.fdocuments.us/reader034/viewer/2022042710/5f666249b859af6fee60a620/html5/thumbnails/32.jpg)
8 different ways of plomng a cumulaOve distribuOon
Fk v( )
v
Sk v( )
ECDF vs ECCDF
Linear vs Log x-‐axis scale
Linear vs Log y-‐axis scale
![Page 33: Toy&Exercise&=&Assignment& - TMA Conferences · Preliminary&look& 628.000000000.01300000 628.033000000.01600000 628.069000000.01800000 628.108000000.01400000 628.143000000.01400000](https://reader034.fdocuments.us/reader034/viewer/2022042710/5f666249b859af6fee60a620/html5/thumbnails/33.jpg)
ECDF Lin-‐Lin ECDF Log-‐Lin
ECDF Log-‐Log ECDF Lin-‐Log
![Page 34: Toy&Exercise&=&Assignment& - TMA Conferences · Preliminary&look& 628.000000000.01300000 628.033000000.01600000 628.069000000.01800000 628.108000000.01400000 628.143000000.01400000](https://reader034.fdocuments.us/reader034/viewer/2022042710/5f666249b859af6fee60a620/html5/thumbnails/34.jpg)
ECCDF Lin-‐Lin ECCDF Log-‐Lin
ECCDF Log-‐Log ECCDF Lin-‐Log
![Page 35: Toy&Exercise&=&Assignment& - TMA Conferences · Preliminary&look& 628.000000000.01300000 628.033000000.01600000 628.069000000.01800000 628.108000000.01400000 628.143000000.01400000](https://reader034.fdocuments.us/reader034/viewer/2022042710/5f666249b859af6fee60a620/html5/thumbnails/35.jpg)
ECCDF of valid RTT samples (loglog)
Green is above/right of Blue Green network has larger RTT ???
![Page 36: Toy&Exercise&=&Assignment& - TMA Conferences · Preliminary&look& 628.000000000.01300000 628.033000000.01600000 628.069000000.01800000 628.108000000.01400000 628.143000000.01400000](https://reader034.fdocuments.us/reader034/viewer/2022042710/5f666249b859af6fee60a620/html5/thumbnails/36.jpg)
ECCDF of valid RTT samples (loglog)
DistorOve effect due to ECCDF normalizaOon with different TimeOut value (1sec vs. 3 sec)
T=1 sec T=3 sec
![Page 37: Toy&Exercise&=&Assignment& - TMA Conferences · Preliminary&look& 628.000000000.01300000 628.033000000.01600000 628.069000000.01800000 628.108000000.01400000 628.143000000.01400000](https://reader034.fdocuments.us/reader034/viewer/2022042710/5f666249b859af6fee60a620/html5/thumbnails/37.jpg)
ECCDF of valid RTT samples (loglog)
DistorOve effect due to ECCDF normalizaOon with different TimeOut value (1sec vs. 3 sec)
Sk v( ) =number of elements > vtotal number of elements
=1k
1 xi > v{ }i=1
k∑
N-‐n0 answered probes (aner discarding n0 unanswered)
![Page 38: Toy&Exercise&=&Assignment& - TMA Conferences · Preliminary&look& 628.000000000.01300000 628.033000000.01600000 628.069000000.01800000 628.108000000.01400000 628.143000000.01400000](https://reader034.fdocuments.us/reader034/viewer/2022042710/5f666249b859af6fee60a620/html5/thumbnails/38.jpg)
ECCDF of valid RTT samples (loglog)
Sk v( ) =number of elements > vtotal number of elements
=1k
1 xi > v{ }i=1
k∑
N-‐n0 valid RTT sanples (< Tout)
N total samples
n0 invalid RTT samples Expired Timeout
N-‐n0-‐n(v) samples ≤ v n(v) samples > v
![Page 39: Toy&Exercise&=&Assignment& - TMA Conferences · Preliminary&look& 628.000000000.01300000 628.033000000.01600000 628.069000000.01800000 628.108000000.01400000 628.143000000.01400000](https://reader034.fdocuments.us/reader034/viewer/2022042710/5f666249b859af6fee60a620/html5/thumbnails/39.jpg)
ECCDF of valid RTT samples (loglog)
Sk v( ) =number of elements > vtotal number of elements
=1k
1 xi > v{ }i=1
k∑
N-‐n0 valid RTT sanples (< Tout)
N total samples
n0 invalid RTT samples Expired Timeout
n(v) samples > v N-‐n0-‐n(v) samples ≤ v
![Page 40: Toy&Exercise&=&Assignment& - TMA Conferences · Preliminary&look& 628.000000000.01300000 628.033000000.01600000 628.069000000.01800000 628.108000000.01400000 628.143000000.01400000](https://reader034.fdocuments.us/reader034/viewer/2022042710/5f666249b859af6fee60a620/html5/thumbnails/40.jpg)
ECCDF of valid RTT samples (loglog)
Sk v( ) =number of elements > vtotal number of elements
=1k
1 xi > v{ }i=1
k∑
N-‐n0 valid RTT sanples (< Tout)
N total samples
n0 invalid RTT samples Expired Timeout
n(v) samples > v N-‐n0-‐n(v) samples ≤ v
n0 samples > Tout
these are also “valid”
![Page 41: Toy&Exercise&=&Assignment& - TMA Conferences · Preliminary&look& 628.000000000.01300000 628.033000000.01600000 628.069000000.01800000 628.108000000.01400000 628.143000000.01400000](https://reader034.fdocuments.us/reader034/viewer/2022042710/5f666249b859af6fee60a620/html5/thumbnails/41.jpg)
ECCDF of valid RTT samples (loglog)
Sk v( ) =number of elements > vtotal number of elements
=1k
1 xi > v{ }i=1
k∑
N-‐n0 valid RTT sanples (< Tout)
N total samples
n0 invalid RTT samples Expired Timeout
n(v) samples > v N-‐n0-‐n(v) samples ≤ v
all
n0 samples > Tout
![Page 42: Toy&Exercise&=&Assignment& - TMA Conferences · Preliminary&look& 628.000000000.01300000 628.033000000.01600000 628.069000000.01800000 628.108000000.01400000 628.143000000.01400000](https://reader034.fdocuments.us/reader034/viewer/2022042710/5f666249b859af6fee60a620/html5/thumbnails/42.jpg)
ECCDF of all RTT samples (loglog)
T=1 sec
T=3 sec
Contrary to above, now Green is below/len of Blue à Green network has lower RTT !
![Page 43: Toy&Exercise&=&Assignment& - TMA Conferences · Preliminary&look& 628.000000000.01300000 628.033000000.01600000 628.069000000.01800000 628.108000000.01400000 628.143000000.01400000](https://reader034.fdocuments.us/reader034/viewer/2022042710/5f666249b859af6fee60a620/html5/thumbnails/43.jpg)
zooming into the mass
![Page 44: Toy&Exercise&=&Assignment& - TMA Conferences · Preliminary&look& 628.000000000.01300000 628.033000000.01600000 628.069000000.01800000 628.108000000.01400000 628.143000000.01400000](https://reader034.fdocuments.us/reader034/viewer/2022042710/5f666249b859af6fee60a620/html5/thumbnails/44.jpg)
zooming into the mass
• StartTime RTT • 628.00000000 0.01300000 • 628.03300000 0.01600000 • 628.06900000 0.01800000 • 628.10800000 0.01400000
• StartTime RTT • 972.00000000 0.01172138 • 972.02004475 0.01476894 • 972.04011993 0.01303928 • 972.06021071 0.01749107
Blue Omestamps appear to have 1 msec granularity (probably truncated)
![Page 45: Toy&Exercise&=&Assignment& - TMA Conferences · Preliminary&look& 628.000000000.01300000 628.033000000.01600000 628.069000000.01800000 628.108000000.01400000 628.143000000.01400000](https://reader034.fdocuments.us/reader034/viewer/2022042710/5f666249b859af6fee60a620/html5/thumbnails/45.jpg)
zooming into the mass
For a fair comparison, we could truncate also the Green …
• StartTime RTT • 628.00000000 0.01300000 • 628.03300000 0.01600000 • 628.06900000 0.01800000 • 628.10800000 0.01400000
• StartTime RTT • 972.00000000 0.01172138 • 972.02004475 0.01476894 • 972.04011993 0.01303928 • 972.06021071 0.01749107
• StartTime RTT • 972.00000000 0.01100000 • 972.02004475 0.01400000 • 972.04011993 0.01300000 • 972.06021071 0.01700000
![Page 46: Toy&Exercise&=&Assignment& - TMA Conferences · Preliminary&look& 628.000000000.01300000 628.033000000.01600000 628.069000000.01800000 628.108000000.01400000 628.143000000.01400000](https://reader034.fdocuments.us/reader034/viewer/2022042710/5f666249b859af6fee60a620/html5/thumbnails/46.jpg)
zooming into the mass
• StartTime RTT • 628.00000000 0.01300000 • 628.03300000 0.01600000 • 628.06900000 0.01800000 • 628.10800000 0.01400000
• StartTime RTT • 972.00000000 0.01172138 • 972.02004475 0.01476894 • 972.04011993 0.01303928 • 972.06021071 0.01749107
Blue Omestamps appear to have 1 msec granularity (probably truncated)
![Page 47: Toy&Exercise&=&Assignment& - TMA Conferences · Preliminary&look& 628.000000000.01300000 628.033000000.01600000 628.069000000.01800000 628.108000000.01400000 628.143000000.01400000](https://reader034.fdocuments.us/reader034/viewer/2022042710/5f666249b859af6fee60a620/html5/thumbnails/47.jpg)
ECCDF of all samples (loglog)
It seems the Green beats the Blue across the whole range of values (mass and tail) à Green network has best performance
![Page 48: Toy&Exercise&=&Assignment& - TMA Conferences · Preliminary&look& 628.000000000.01300000 628.033000000.01600000 628.069000000.01800000 628.108000000.01400000 628.143000000.01400000](https://reader034.fdocuments.us/reader034/viewer/2022042710/5f666249b859af6fee60a620/html5/thumbnails/48.jpg)
Take-‐away message 1
• Meta-‐informaOon = meta-‐data, parameter values, context data (outage), detailed descrip<on of measurement collec<on method …
• Meta-‐informaOon is important – meta-‐data not less important than “data”
• Meta-‐informaOon is not always available – just missing, erroneous or ambiguos
![Page 49: Toy&Exercise&=&Assignment& - TMA Conferences · Preliminary&look& 628.000000000.01300000 628.033000000.01600000 628.069000000.01800000 628.108000000.01400000 628.143000000.01400000](https://reader034.fdocuments.us/reader034/viewer/2022042710/5f666249b859af6fee60a620/html5/thumbnails/49.jpg)
Take-‐away message 2
• Try to collect and record as much meta-‐data and context-‐informaOon as possible
• SomeOmes, missing informaOon can be inferred (guessed?) from the data – in our example: outage, Omeout values – reverse engineering the collecOon method: “20 ms spacing”, 1ms truncaOon
![Page 50: Toy&Exercise&=&Assignment& - TMA Conferences · Preliminary&look& 628.000000000.01300000 628.033000000.01600000 628.069000000.01800000 628.108000000.01400000 628.143000000.01400000](https://reader034.fdocuments.us/reader034/viewer/2022042710/5f666249b859af6fee60a620/html5/thumbnails/50.jpg)
Take away message 3
• Watch against spurious correlaOons, sources of bias, distorOon, arOfacts …
• in the collec<on phase … • … and during the analysis
![Page 51: Toy&Exercise&=&Assignment& - TMA Conferences · Preliminary&look& 628.000000000.01300000 628.033000000.01600000 628.069000000.01800000 628.108000000.01400000 628.143000000.01400000](https://reader034.fdocuments.us/reader034/viewer/2022042710/5f666249b859af6fee60a620/html5/thumbnails/51.jpg)
Take away message 4
• Different problems / arOfacts might interact in subtle ways – e.g. outage + I/O feedback à over/under representaOon
![Page 52: Toy&Exercise&=&Assignment& - TMA Conferences · Preliminary&look& 628.000000000.01300000 628.033000000.01600000 628.069000000.01800000 628.108000000.01400000 628.143000000.01400000](https://reader034.fdocuments.us/reader034/viewer/2022042710/5f666249b859af6fee60a620/html5/thumbnails/52.jpg)
Final words
• Torture your data. But first caress them!
• Have fun with your future dialogues with real data J
• For quesOons & feedback email to: [email protected]‐lj.si