Measuring ISP Network Topologies with Rocketfuelnspring/talks/sigcomm-rocketfuel.pdfMeasuring ISP...
Transcript of Measuring ISP Network Topologies with Rocketfuelnspring/talks/sigcomm-rocketfuel.pdfMeasuring ISP...
![Page 1: Measuring ISP Network Topologies with Rocketfuelnspring/talks/sigcomm-rocketfuel.pdfMeasuring ISP Network Topologies with Rocketfuel Neil Spring, Ratul Mahajan, and David Wetherall](https://reader031.fdocuments.us/reader031/viewer/2022030503/5aaf9df27f8b9aa8438d8484/html5/thumbnails/1.jpg)
Measuring ISP Network Topologies withRocketfuel
Neil Spring, Ratul Mahajan, and David Wetherall
University of Washington
ACM SIGCOMM 2002
![Page 2: Measuring ISP Network Topologies with Rocketfuelnspring/talks/sigcomm-rocketfuel.pdfMeasuring ISP Network Topologies with Rocketfuel Neil Spring, Ratul Mahajan, and David Wetherall](https://reader031.fdocuments.us/reader031/viewer/2022030503/5aaf9df27f8b9aa8438d8484/html5/thumbnails/2.jpg)
Motivation
We’d like to understand Internet structure and design.
� ISP router-level topologies are designed.
We can’t get the real maps.
� Backbone maps often available in marketing form.
Severely lacking in router-level detail.
� When we asked for them, they said “no.”
2
![Page 3: Measuring ISP Network Topologies with Rocketfuelnspring/talks/sigcomm-rocketfuel.pdfMeasuring ISP Network Topologies with Rocketfuel Neil Spring, Ratul Mahajan, and David Wetherall](https://reader031.fdocuments.us/reader031/viewer/2022030503/5aaf9df27f8b9aa8438d8484/html5/thumbnails/3.jpg)
ISP topologies for research
Could extract from a Whole-Internet map:
eg. Skitter, Mercator, Lumeta.
Our philosophy:
� By focusing on an ISP, can get better precision.
� ISPs publish enough information to reconstruct maps.
� End goal is more accurate maps for research.
3
![Page 4: Measuring ISP Network Topologies with Rocketfuelnspring/talks/sigcomm-rocketfuel.pdfMeasuring ISP Network Topologies with Rocketfuel Neil Spring, Ratul Mahajan, and David Wetherall](https://reader031.fdocuments.us/reader031/viewer/2022030503/5aaf9df27f8b9aa8438d8484/html5/thumbnails/4.jpg)
Rocketfuel overviewIntegrate all information exported by an ISP:
� BGP - which prefixes are served
� Traceroute - what the paths are
� DNS - where routers are and what they do
Build detailed maps:
� Backbone
� POPs
� Peering links
4
![Page 5: Measuring ISP Network Topologies with Rocketfuelnspring/talks/sigcomm-rocketfuel.pdfMeasuring ISP Network Topologies with Rocketfuel Neil Spring, Ratul Mahajan, and David Wetherall](https://reader031.fdocuments.us/reader031/viewer/2022030503/5aaf9df27f8b9aa8438d8484/html5/thumbnails/5.jpg)
Challenges
Is it possible to collect accurate maps?
� Many public traceroute servers.
� Can’t use them all the time.
� Restricting load, it would take a year.
� Balance accuracy and speed.
Can we make any sense out of the result?
� POP / Backbone structure
� Alias resolution
5
![Page 6: Measuring ISP Network Topologies with Rocketfuelnspring/talks/sigcomm-rocketfuel.pdfMeasuring ISP Network Topologies with Rocketfuel Neil Spring, Ratul Mahajan, and David Wetherall](https://reader031.fdocuments.us/reader031/viewer/2022030503/5aaf9df27f8b9aa8438d8484/html5/thumbnails/6.jpg)
Choosing traceroutes
T
T
T
T
T
T
T
T
Autonomous System
Traceroute Server
6
![Page 7: Measuring ISP Network Topologies with Rocketfuelnspring/talks/sigcomm-rocketfuel.pdfMeasuring ISP Network Topologies with Rocketfuel Neil Spring, Ratul Mahajan, and David Wetherall](https://reader031.fdocuments.us/reader031/viewer/2022030503/5aaf9df27f8b9aa8438d8484/html5/thumbnails/7.jpg)
Choosing traceroutes
T
T
T
T
T
T
T
T
Autonomous System
Traceroute Server
7
![Page 8: Measuring ISP Network Topologies with Rocketfuelnspring/talks/sigcomm-rocketfuel.pdfMeasuring ISP Network Topologies with Rocketfuel Neil Spring, Ratul Mahajan, and David Wetherall](https://reader031.fdocuments.us/reader031/viewer/2022030503/5aaf9df27f8b9aa8438d8484/html5/thumbnails/8.jpg)
Choosing traceroutes
X
T
T
T
T
T
T
T
T
Autonomous System
Traceroute Server
8
![Page 9: Measuring ISP Network Topologies with Rocketfuelnspring/talks/sigcomm-rocketfuel.pdfMeasuring ISP Network Topologies with Rocketfuel Neil Spring, Ratul Mahajan, and David Wetherall](https://reader031.fdocuments.us/reader031/viewer/2022030503/5aaf9df27f8b9aa8438d8484/html5/thumbnails/9.jpg)
Choosing traceroutes
T
T
T
T
T
T
T
T
Autonomous System
Traceroute Server
9
![Page 10: Measuring ISP Network Topologies with Rocketfuelnspring/talks/sigcomm-rocketfuel.pdfMeasuring ISP Network Topologies with Rocketfuel Neil Spring, Ratul Mahajan, and David Wetherall](https://reader031.fdocuments.us/reader031/viewer/2022030503/5aaf9df27f8b9aa8438d8484/html5/thumbnails/10.jpg)
Choosing traceroutes
xT
T
T
T
T
T
T
T
Autonomous System
Traceroute Server
10
![Page 11: Measuring ISP Network Topologies with Rocketfuelnspring/talks/sigcomm-rocketfuel.pdfMeasuring ISP Network Topologies with Rocketfuel Neil Spring, Ratul Mahajan, and David Wetherall](https://reader031.fdocuments.us/reader031/viewer/2022030503/5aaf9df27f8b9aa8438d8484/html5/thumbnails/11.jpg)
Using BGP to choose traces
RouteViews BGP tables consist of AS-paths to destination
prefixes
Destination AS-PathCloser to destination �
10.1.0.0/16 12 20 11 6 7
Traces likely to traverse AS 6:
� From servers in ASes 12, 20, and 11 to 10.1/16.
� If all known paths to 10.1/16 include AS 6,– From anywhere to 10.1/16.
– From servers in 10.1/16 to anywhere.
11
![Page 12: Measuring ISP Network Topologies with Rocketfuelnspring/talks/sigcomm-rocketfuel.pdfMeasuring ISP Network Topologies with Rocketfuel Neil Spring, Ratul Mahajan, and David Wetherall](https://reader031.fdocuments.us/reader031/viewer/2022030503/5aaf9df27f8b9aa8438d8484/html5/thumbnails/12.jpg)
Path Reductions
Want to choose unique paths – with new information.
Skip repeated traces of the same path.
Expect the common case:
� Traceroute server has one ingress point
� Customer prefix has one egress point
� BGP peers have one early-exit per ingress. T
T
T
If we’re wrong, we might miss some paths.
New servers add paths or share load!
12
![Page 13: Measuring ISP Network Topologies with Rocketfuelnspring/talks/sigcomm-rocketfuel.pdfMeasuring ISP Network Topologies with Rocketfuel Neil Spring, Ratul Mahajan, and David Wetherall](https://reader031.fdocuments.us/reader031/viewer/2022030503/5aaf9df27f8b9aa8438d8484/html5/thumbnails/13.jpg)
Reduction Effectiveness� Brute force:
All servers to all BGP prefixes, disaggregate ISP prefixes.90-150 million traceroutes required
� BGP directed probes:All traceroutes identifiable from RouteViews.0.2-15 million traceroutes required
� Executed after path reduction:Traceroutes chosen by Rocketfuel.8-300 thousand traceroutes required
Directed probing and path reductions are effective at reducing
the number of probes required to map an ISP
13
![Page 14: Measuring ISP Network Topologies with Rocketfuelnspring/talks/sigcomm-rocketfuel.pdfMeasuring ISP Network Topologies with Rocketfuel Neil Spring, Ratul Mahajan, and David Wetherall](https://reader031.fdocuments.us/reader031/viewer/2022030503/5aaf9df27f8b9aa8438d8484/html5/thumbnails/14.jpg)
Alias resolution problem
12.123.203.177
198.32.170.30
198.107.150.52
140.142.150.19
www.cs.washington.edu
A well-known problem for Internet
mapping.
Because traceroute lists IP’s, we
might think that the path to www.cs
and ...
14
![Page 15: Measuring ISP Network Topologies with Rocketfuelnspring/talks/sigcomm-rocketfuel.pdfMeasuring ISP Network Topologies with Rocketfuel Neil Spring, Ratul Mahajan, and David Wetherall](https://reader031.fdocuments.us/reader031/viewer/2022030503/5aaf9df27f8b9aa8438d8484/html5/thumbnails/15.jpg)
Alias resolution problem
12.123.203.177
198.32.170.30
198.107.150.52
140.142.150.19
198.32.170.29
198.107.150.30
140.142.155.24
128.95.4.100
www.cs.washington.edu
A well-known problem for Internet
mapping.
Because traceroute lists IP’s, we
might think that the path to www.cs
and the path from www.cs are
different.
Alias resolution finds IP’s that belong
to the same router.
15
![Page 16: Measuring ISP Network Topologies with Rocketfuelnspring/talks/sigcomm-rocketfuel.pdfMeasuring ISP Network Topologies with Rocketfuel Neil Spring, Ratul Mahajan, and David Wetherall](https://reader031.fdocuments.us/reader031/viewer/2022030503/5aaf9df27f8b9aa8438d8484/html5/thumbnails/16.jpg)
Our alias resolution solution
Send a packet to each interface to solicit responses.
� Previous work - responses have the same source:Routers often set source address to outgoing interface
� Our approach - responses have nearby IP identifiers:IP ID is commonly set from a counter.
Identify candidate aliases
� Sort by DNS name - find aliases quickly
� Cluster by return TTL - rule out many aliases
Our tool found 2.8 times as many aliases
10% of addresses were unresponsive or unreachable.
16
![Page 17: Measuring ISP Network Topologies with Rocketfuelnspring/talks/sigcomm-rocketfuel.pdfMeasuring ISP Network Topologies with Rocketfuel Neil Spring, Ratul Mahajan, and David Wetherall](https://reader031.fdocuments.us/reader031/viewer/2022030503/5aaf9df27f8b9aa8438d8484/html5/thumbnails/17.jpg)
Backbone: Telstra
Telstra has hubs in major cities (Sydney, Melbourne, Perth) and
spokes elsewhere.
17
![Page 18: Measuring ISP Network Topologies with Rocketfuelnspring/talks/sigcomm-rocketfuel.pdfMeasuring ISP Network Topologies with Rocketfuel Neil Spring, Ratul Mahajan, and David Wetherall](https://reader031.fdocuments.us/reader031/viewer/2022030503/5aaf9df27f8b9aa8438d8484/html5/thumbnails/18.jpg)
Backbone: EBone
EBone had a highly meshed topology.
18
![Page 19: Measuring ISP Network Topologies with Rocketfuelnspring/talks/sigcomm-rocketfuel.pdfMeasuring ISP Network Topologies with Rocketfuel Neil Spring, Ratul Mahajan, and David Wetherall](https://reader031.fdocuments.us/reader031/viewer/2022030503/5aaf9df27f8b9aa8438d8484/html5/thumbnails/19.jpg)
Backbone: Level3
We see the logical topology of Level3’s MPLS-based backbone.
19
![Page 20: Measuring ISP Network Topologies with Rocketfuelnspring/talks/sigcomm-rocketfuel.pdfMeasuring ISP Network Topologies with Rocketfuel Neil Spring, Ratul Mahajan, and David Wetherall](https://reader031.fdocuments.us/reader031/viewer/2022030503/5aaf9df27f8b9aa8438d8484/html5/thumbnails/20.jpg)
Uncovering Structure: POPs
Neighbors NeighborsNeighbors
sl−bb12−spr−15−0sl−bb12−spr−14−0sl−bb12−spr−10−0
Other POPS
Other POPS
Other POPSsl−bb10−spr−10−0sl−bb10−spr−13−1sl−bb10−spr−14−0sl−bb10−spr−15−0
sl−bb11−spr−13−1sl−bb11−spr−10−0
sl−bb11−spr−14−0
sl−gw4−spr−14−0sl−gw6−spr−0−0sl−gw1−spr−0−0−0sl−gw1−spr−1−1−1−ts0sl−gw1−spr−5−0−0−ts23sl−gw1−spr−6−0−0−ts3
sl−bb11−spr−15−0
Same structure as “real” Sprint POPs, at a scale we can render.
20
![Page 21: Measuring ISP Network Topologies with Rocketfuelnspring/talks/sigcomm-rocketfuel.pdfMeasuring ISP Network Topologies with Rocketfuel Neil Spring, Ratul Mahajan, and David Wetherall](https://reader031.fdocuments.us/reader031/viewer/2022030503/5aaf9df27f8b9aa8438d8484/html5/thumbnails/21.jpg)
Map Quality� Validate with ISPs
“Good” to “excellent”
� Scan address space to estimate how much better maps
might be
No more than twice as many links.
� Compare to RouteViews
Found peerings not represented in RouteViews
� Compare to a Skitter dataset
Skitter maps the Internet, using tens of servers.
5-10 times as many IPs, links, routers, for a given ISP.
21
![Page 22: Measuring ISP Network Topologies with Rocketfuelnspring/talks/sigcomm-rocketfuel.pdfMeasuring ISP Network Topologies with Rocketfuel Neil Spring, Ratul Mahajan, and David Wetherall](https://reader031.fdocuments.us/reader031/viewer/2022030503/5aaf9df27f8b9aa8438d8484/html5/thumbnails/22.jpg)
POP Size Distribution
1 10
POP Size (total routers)
0.0
0.2
0.4
0.6
0.8
1.0
Fra
ctio
n of
Pop
s
22
![Page 23: Measuring ISP Network Topologies with Rocketfuelnspring/talks/sigcomm-rocketfuel.pdfMeasuring ISP Network Topologies with Rocketfuel Neil Spring, Ratul Mahajan, and David Wetherall](https://reader031.fdocuments.us/reader031/viewer/2022030503/5aaf9df27f8b9aa8438d8484/html5/thumbnails/23.jpg)
POP Out-Degree Distribution
0 5 10 15 20 25
POP Degree
0.0
0.2
0.4
0.6
0.8
1.0
CD
F
23
![Page 24: Measuring ISP Network Topologies with Rocketfuelnspring/talks/sigcomm-rocketfuel.pdfMeasuring ISP Network Topologies with Rocketfuel Neil Spring, Ratul Mahajan, and David Wetherall](https://reader031.fdocuments.us/reader031/viewer/2022030503/5aaf9df27f8b9aa8438d8484/html5/thumbnails/24.jpg)
Conclusion
We wanted to understand Internet structure,
We developed techniques to measure router-level maps.
� Trading accuracy for speed where needed
� New alias resolution technique
� Inferred locations and roles from DNS
We learned some things about ISPs, like
� Different backbone styles
� New data about POP size and peerings
See and download the maps at:
http://www.cs.washington.edu/research/networking/rocketfuel/
24
![Page 25: Measuring ISP Network Topologies with Rocketfuelnspring/talks/sigcomm-rocketfuel.pdfMeasuring ISP Network Topologies with Rocketfuel Neil Spring, Ratul Mahajan, and David Wetherall](https://reader031.fdocuments.us/reader031/viewer/2022030503/5aaf9df27f8b9aa8438d8484/html5/thumbnails/25.jpg)
Out-Degree distributions
1 10 100
Router outdegree
1e-04
0.001
0.01
0.1
1
P(d
egre
e >
x)
ObservedPareto: alpha = 2.61Lognormal: mu = 0.76Weibull: c = 0.42
25