How to Compute Accurate Traffic Matrices for your Network in … · 2017. 9. 29. · Tomo-gravity...
Transcript of How to Compute Accurate Traffic Matrices for your Network in … · 2017. 9. 29. · Tomo-gravity...
![Page 1: How to Compute Accurate Traffic Matrices for your Network in … · 2017. 9. 29. · Tomo-gravity How to Compute Accurate Traffic Matrices for your Network in Seconds Yin Zhang, Matthew](https://reader034.fdocuments.us/reader034/viewer/2022052009/601f3bbaca7f5f02277c59ae/html5/thumbnails/1.jpg)
Tomo-gravity
How to Compute How to Compute Accurate Traffic Matrices for Accurate Traffic Matrices for your Network in Secondsyour Network in Seconds
Yin Zhang, Matthew Roughan, Carsten Lund, Yin Zhang, Matthew Roughan, Carsten Lund, Nick Duffield, Albert Greenberg, Quynh Nguyen Nick Duffield, Albert Greenberg, Quynh Nguyen
–– AT&T LabsAT&T Labs--ResearchResearch
David David DonohoDonoho –– StanfordStanford
Shannon LabShannon Lab
![Page 2: How to Compute Accurate Traffic Matrices for your Network in … · 2017. 9. 29. · Tomo-gravity How to Compute Accurate Traffic Matrices for your Network in Seconds Yin Zhang, Matthew](https://reader034.fdocuments.us/reader034/viewer/2022052009/601f3bbaca7f5f02277c59ae/html5/thumbnails/2.jpg)
Tomo-gravity
Want to know demands from source to destination
ProblemProblemHave link traffic measurements (from SNMP)
A
BC
![Page 3: How to Compute Accurate Traffic Matrices for your Network in … · 2017. 9. 29. · Tomo-gravity How to Compute Accurate Traffic Matrices for your Network in Seconds Yin Zhang, Matthew](https://reader034.fdocuments.us/reader034/viewer/2022052009/601f3bbaca7f5f02277c59ae/html5/thumbnails/3.jpg)
Tomo-gravity
Example App: reliability analysisExample App: reliability analysisUnder a link failure, routes change
want to predict new link loads
A
BC
![Page 4: How to Compute Accurate Traffic Matrices for your Network in … · 2017. 9. 29. · Tomo-gravity How to Compute Accurate Traffic Matrices for your Network in Seconds Yin Zhang, Matthew](https://reader034.fdocuments.us/reader034/viewer/2022052009/601f3bbaca7f5f02277c59ae/html5/thumbnails/4.jpg)
Tomo-gravity
Network EngineeringNetwork Engineering
What you want to doReliability analysisTraffic engineeringCapacity planning
What do you need to knowNetwork and routing Prediction and optimization techniques
? Traffic matrix
![Page 5: How to Compute Accurate Traffic Matrices for your Network in … · 2017. 9. 29. · Tomo-gravity How to Compute Accurate Traffic Matrices for your Network in Seconds Yin Zhang, Matthew](https://reader034.fdocuments.us/reader034/viewer/2022052009/601f3bbaca7f5f02277c59ae/html5/thumbnails/5.jpg)
Tomo-gravity
Solution: Solution: TomoTomo--gravitygravity
Computes traffic matricesinput: SNMP, topology, routing policies
AdvantagesToday’s data no special instrumentationFast: a few seconds Accurate: average 12% errorScales: hundreds of nodesRobust: copes easily with data glitchesFlexible: can incorporate more detailed data
![Page 6: How to Compute Accurate Traffic Matrices for your Network in … · 2017. 9. 29. · Tomo-gravity How to Compute Accurate Traffic Matrices for your Network in Seconds Yin Zhang, Matthew](https://reader034.fdocuments.us/reader034/viewer/2022052009/601f3bbaca7f5f02277c59ae/html5/thumbnails/6.jpg)
Tomo-gravity
TomographyAstronomySeismologyMedical imaging ⌧CAT in CATSCAN
TomoTomo--gravitygravity
Gravity modelingEconometricsTransportation ⌧planes, trains,
automobiles
Foundation: Information Theory
+
![Page 7: How to Compute Accurate Traffic Matrices for your Network in … · 2017. 9. 29. · Tomo-gravity How to Compute Accurate Traffic Matrices for your Network in Seconds Yin Zhang, Matthew](https://reader034.fdocuments.us/reader034/viewer/2022052009/601f3bbaca7f5f02277c59ae/html5/thumbnails/7.jpg)
Tomo-gravity
TomoTomo--gravity in a Nutshellgravity in a Nutshell
tomographic constraints(from link measurements)
1. gravity solution
2. tomo-gravity solution
![Page 8: How to Compute Accurate Traffic Matrices for your Network in … · 2017. 9. 29. · Tomo-gravity How to Compute Accurate Traffic Matrices for your Network in Seconds Yin Zhang, Matthew](https://reader034.fdocuments.us/reader034/viewer/2022052009/601f3bbaca7f5f02277c59ae/html5/thumbnails/8.jpg)
Tomo-gravity
TomoTomo--gravity in practicegravity in practice
1. Get topology & routing 2. Measure SNMP link loads 3. Derive gravity solution
Uses edge loads 4. Compute tomo-gravity solution
Use internal link dataMatches observed link loadsCan incorporate more detailed measurements to boost accuracy
![Page 9: How to Compute Accurate Traffic Matrices for your Network in … · 2017. 9. 29. · Tomo-gravity How to Compute Accurate Traffic Matrices for your Network in Seconds Yin Zhang, Matthew](https://reader034.fdocuments.us/reader034/viewer/2022052009/601f3bbaca7f5f02277c59ae/html5/thumbnails/9.jpg)
Tomo-gravity
Real exampleReal example
![Page 10: How to Compute Accurate Traffic Matrices for your Network in … · 2017. 9. 29. · Tomo-gravity How to Compute Accurate Traffic Matrices for your Network in Seconds Yin Zhang, Matthew](https://reader034.fdocuments.us/reader034/viewer/2022052009/601f3bbaca7f5f02277c59ae/html5/thumbnails/10.jpg)
Tomo-gravity
Example use: reliability analysisExample use: reliability analysis
![Page 11: How to Compute Accurate Traffic Matrices for your Network in … · 2017. 9. 29. · Tomo-gravity How to Compute Accurate Traffic Matrices for your Network in Seconds Yin Zhang, Matthew](https://reader034.fdocuments.us/reader034/viewer/2022052009/601f3bbaca7f5f02277c59ae/html5/thumbnails/11.jpg)
Tomo-gravity
ConclusionConclusion
Tomo-gravity implementedAT&T’s IP backbone (AS 7018)Hourly traffic matrices for > 1 year (in secs)
For a number of applicationsReliability analysis (killer app…)Traffic engineeringCapacity planninghttp://www.research.att.com/
~roughan/tomogravity.html
![Page 12: How to Compute Accurate Traffic Matrices for your Network in … · 2017. 9. 29. · Tomo-gravity How to Compute Accurate Traffic Matrices for your Network in Seconds Yin Zhang, Matthew](https://reader034.fdocuments.us/reader034/viewer/2022052009/601f3bbaca7f5f02277c59ae/html5/thumbnails/12.jpg)
Tomo-gravity
Key ReferencesKey References“Fast, accurate computation of large-scale IP traffic matrices from link measurements”, Y.Zhang, M.Roughan, N.Duffield and A.Greenberg, ACM SIGMETRICS 2003.“An information theoretic approach to traffic matrix estimation”, Y.Zhang, M.Roughan, C.Lund and D.Donoho, ACM SIGCOMM 2003.Both available at http://www.research.att.com/~roughan/papers.html
![Page 13: How to Compute Accurate Traffic Matrices for your Network in … · 2017. 9. 29. · Tomo-gravity How to Compute Accurate Traffic Matrices for your Network in Seconds Yin Zhang, Matthew](https://reader034.fdocuments.us/reader034/viewer/2022052009/601f3bbaca7f5f02277c59ae/html5/thumbnails/13.jpg)
Tomo-gravity
Additional Slides
![Page 14: How to Compute Accurate Traffic Matrices for your Network in … · 2017. 9. 29. · Tomo-gravity How to Compute Accurate Traffic Matrices for your Network in Seconds Yin Zhang, Matthew](https://reader034.fdocuments.us/reader034/viewer/2022052009/601f3bbaca7f5f02277c59ae/html5/thumbnails/14.jpg)
Tomo-gravity
Mathematical FormalismMathematical Formalism
1
3
2router
route 2
route 1
route 3
311 xxy +=
![Page 15: How to Compute Accurate Traffic Matrices for your Network in … · 2017. 9. 29. · Tomo-gravity How to Compute Accurate Traffic Matrices for your Network in Seconds Yin Zhang, Matthew](https://reader034.fdocuments.us/reader034/viewer/2022052009/601f3bbaca7f5f02277c59ae/html5/thumbnails/15.jpg)
Tomo-gravity
EquationsEquations
y = AxRouting matrix
Many more unknowns than measurements
Traffic matrix
Link measurements
![Page 16: How to Compute Accurate Traffic Matrices for your Network in … · 2017. 9. 29. · Tomo-gravity How to Compute Accurate Traffic Matrices for your Network in Seconds Yin Zhang, Matthew](https://reader034.fdocuments.us/reader034/viewer/2022052009/601f3bbaca7f5f02277c59ae/html5/thumbnails/16.jpg)
Tomo-gravity
Robustness (input errors)Robustness (input errors)
![Page 17: How to Compute Accurate Traffic Matrices for your Network in … · 2017. 9. 29. · Tomo-gravity How to Compute Accurate Traffic Matrices for your Network in Seconds Yin Zhang, Matthew](https://reader034.fdocuments.us/reader034/viewer/2022052009/601f3bbaca7f5f02277c59ae/html5/thumbnails/17.jpg)
Tomo-gravity
Dependence on TopologyDependence on Topology
0
5
10
15
20
25
30
0 1 2 3 4 5 6 7 8 9 10 11unknowns per measurement
relative
err
ors
(%)
randomgeographicLinear (geographic)
clique
star (20 nodes)
![Page 18: How to Compute Accurate Traffic Matrices for your Network in … · 2017. 9. 29. · Tomo-gravity How to Compute Accurate Traffic Matrices for your Network in Seconds Yin Zhang, Matthew](https://reader034.fdocuments.us/reader034/viewer/2022052009/601f3bbaca7f5f02277c59ae/html5/thumbnails/18.jpg)
Tomo-gravity
Additional information Additional information –– NetflowNetflow
![Page 19: How to Compute Accurate Traffic Matrices for your Network in … · 2017. 9. 29. · Tomo-gravity How to Compute Accurate Traffic Matrices for your Network in Seconds Yin Zhang, Matthew](https://reader034.fdocuments.us/reader034/viewer/2022052009/601f3bbaca7f5f02277c59ae/html5/thumbnails/19.jpg)
Tomo-gravity
Local traffic matrix (George Varghese)Local traffic matrix (George Varghese)
for referenceprevious case
0%1%5%10%
![Page 20: How to Compute Accurate Traffic Matrices for your Network in … · 2017. 9. 29. · Tomo-gravity How to Compute Accurate Traffic Matrices for your Network in Seconds Yin Zhang, Matthew](https://reader034.fdocuments.us/reader034/viewer/2022052009/601f3bbaca7f5f02277c59ae/html5/thumbnails/20.jpg)
Tomo-gravity
Robustness (missing data)Robustness (missing data)
![Page 21: How to Compute Accurate Traffic Matrices for your Network in … · 2017. 9. 29. · Tomo-gravity How to Compute Accurate Traffic Matrices for your Network in Seconds Yin Zhang, Matthew](https://reader034.fdocuments.us/reader034/viewer/2022052009/601f3bbaca7f5f02277c59ae/html5/thumbnails/21.jpg)
Tomo-gravity
PointPoint--toto--multipointmultipoint
We don’t see whole Internet – What if an edge link fails?Point-to-point traffic matrix isn’t invariant
![Page 22: How to Compute Accurate Traffic Matrices for your Network in … · 2017. 9. 29. · Tomo-gravity How to Compute Accurate Traffic Matrices for your Network in Seconds Yin Zhang, Matthew](https://reader034.fdocuments.us/reader034/viewer/2022052009/601f3bbaca7f5f02277c59ae/html5/thumbnails/22.jpg)
Tomo-gravity
PointPoint--toto--multipointmultipointIncluded in this approachImplicit in results aboveExplicit results worse
Ambiguity in demands in increasedMore demands use exactly the same sets of routes
use in applications is better
Point-to-point Point-to-multipoint
Link failure analysis