M-Lab Research and Infrastructure for Interconnection ... · M-Lab Research and Infrastructure for...

39
M-Lab Research and Infrastructure for Interconnection Performance Monitoring Collin Anderson @MeasurementLab

Transcript of M-Lab Research and Infrastructure for Interconnection ... · M-Lab Research and Infrastructure for...

Page 1: M-Lab Research and Infrastructure for Interconnection ... · M-Lab Research and Infrastructure for Interconnection Performance Monitoring Collin Anderson @MeasurementLab. M-Lab: A

M-Lab Research and Infrastructure for Interconnection Performance Monitoring

Collin Anderson@MeasurementLab

Page 2: M-Lab Research and Infrastructure for Interconnection ... · M-Lab Research and Infrastructure for Interconnection Performance Monitoring Collin Anderson @MeasurementLab. M-Lab: A

M-Lab: A Collaborative and Growing Network

• Open data and open methodology

• Diversity of tests: throughput, interference, traffic shaping and path data;

• Expansion in the U.S. for Transit ISPs Zayo, Cogent, Tata, Level3 and GTT

• Expansion of M-Lab sites globally to locations in Canada, Africa and Asia

Page 3: M-Lab Research and Infrastructure for Interconnection ... · M-Lab Research and Infrastructure for Interconnection Performance Monitoring Collin Anderson @MeasurementLab. M-Lab: A

Research Update: ISP Interconnection and its Impact on Consumer Internet Performance

Page 4: M-Lab Research and Infrastructure for Interconnection ... · M-Lab Research and Infrastructure for Interconnection Performance Monitoring Collin Anderson @MeasurementLab. M-Lab: A

How Measurement Lab Collects Information Measurements From Everyone

Page 5: M-Lab Research and Infrastructure for Interconnection ... · M-Lab Research and Infrastructure for Interconnection Performance Monitoring Collin Anderson @MeasurementLab. M-Lab: A

Transit ISP X Transit ISP Y

Access ISP A Access ISP B

Network Interconnection

s

Transit ISP X Transit ISP Y

Access ISP A Access ISP B

Transit ISP X Transit ISP Y

Access ISP A Access ISP B

Transit ISP X Transit ISP Y

Access ISP A Access ISP B

Transit ISP X Transit ISP Y

Access ISP A Access ISP B

?

?

?

1 3 5

42

Methodology

Inferring the Source of Congestion

Page 6: M-Lab Research and Infrastructure for Interconnection ... · M-Lab Research and Infrastructure for Interconnection Performance Monitoring Collin Anderson @MeasurementLab. M-Lab: A

Transit ISP X Transit ISP Y

Access ISP A Access ISP B

Network Interconnection

s

Transit ISP X Transit ISP Y

Access ISP A Access ISP B

Transit ISP X Transit ISP Y

Access ISP A Access ISP B

Transit ISP X Transit ISP Y

Access ISP A Access ISP B

Transit ISP X Transit ISP Y

Access ISP A Access ISP B

?

?

?

1 3 5

42Methodology

Inferring the Source of Congestion

Page 7: M-Lab Research and Infrastructure for Interconnection ... · M-Lab Research and Infrastructure for Interconnection Performance Monitoring Collin Anderson @MeasurementLab. M-Lab: A

Transit ISP X Transit ISP Y

Access ISP A Access ISP B

Network Interconnection

s

Transit ISP X Transit ISP Y

Access ISP A Access ISP B

Transit ISP X Transit ISP Y

Access ISP A Access ISP B

Transit ISP X Transit ISP Y

Access ISP A Access ISP B

Transit ISP X Transit ISP Y

Access ISP A Access ISP B

?

?

?

1 3 5

42

Methodology

Inferring the Source of Congestion

Page 8: M-Lab Research and Infrastructure for Interconnection ... · M-Lab Research and Infrastructure for Interconnection Performance Monitoring Collin Anderson @MeasurementLab. M-Lab: A

Transit ISP X Transit ISP Y

Access ISP A Access ISP B

Network Interconnection

s

Transit ISP X Transit ISP Y

Access ISP A Access ISP B

Transit ISP X Transit ISP Y

Access ISP A Access ISP B

Transit ISP X Transit ISP Y

Access ISP A Access ISP B

Transit ISP X Transit ISP Y

Access ISP A Access ISP B

?

?

?

1 3 5

42Methodology

Inferring the Source of Congestion

Page 9: M-Lab Research and Infrastructure for Interconnection ... · M-Lab Research and Infrastructure for Interconnection Performance Monitoring Collin Anderson @MeasurementLab. M-Lab: A

Transit ISP X Transit ISP Y

Access ISP A Access ISP B

Network Interconnection

s

Transit ISP X Transit ISP Y

Access ISP A Access ISP B

Transit ISP X Transit ISP Y

Access ISP A Access ISP B

Transit ISP X Transit ISP Y

Access ISP A Access ISP B

Transit ISP X Transit ISP Y

Access ISP A Access ISP B

?

?

?

1 3 5

42Methodology

Inferring the Source of Congestion

Page 10: M-Lab Research and Infrastructure for Interconnection ... · M-Lab Research and Infrastructure for Interconnection Performance Monitoring Collin Anderson @MeasurementLab. M-Lab: A

Sufficient Sample The United States Constitutes the Largest Source of this Data

Page 11: M-Lab Research and Infrastructure for Interconnection ... · M-Lab Research and Infrastructure for Interconnection Performance Monitoring Collin Anderson @MeasurementLab. M-Lab: A

Inferring Sources of Congestion in Practice Using New York’s Comparison

Page 12: M-Lab Research and Infrastructure for Interconnection ... · M-Lab Research and Infrastructure for Interconnection Performance Monitoring Collin Anderson @MeasurementLab. M-Lab: A

Inferring Sources of Congestion in Practice Using New York’s Comparison

Page 13: M-Lab Research and Infrastructure for Interconnection ... · M-Lab Research and Infrastructure for Interconnection Performance Monitoring Collin Anderson @MeasurementLab. M-Lab: A

Inferring Sources of Congestion in Practice

US Access ISPs and Cogent (2013-2014)

Page 14: M-Lab Research and Infrastructure for Interconnection ... · M-Lab Research and Infrastructure for Interconnection Performance Monitoring Collin Anderson @MeasurementLab. M-Lab: A

Inferring Sources of Congestion in Practice

US Access ISPs and Cogent (2013-2014)

Page 15: M-Lab Research and Infrastructure for Interconnection ... · M-Lab Research and Infrastructure for Interconnection Performance Monitoring Collin Anderson @MeasurementLab. M-Lab: A

Internet Performance Varies Significantly Throughout the Day

Page 16: M-Lab Research and Infrastructure for Interconnection ... · M-Lab Research and Infrastructure for Interconnection Performance Monitoring Collin Anderson @MeasurementLab. M-Lab: A

Diurnal Patterns Are Instructive Expectations of Normal Performance

Page 17: M-Lab Research and Infrastructure for Interconnection ... · M-Lab Research and Infrastructure for Interconnection Performance Monitoring Collin Anderson @MeasurementLab. M-Lab: A

Diurnal Patterns Are Instructive Expectations of Congested Performance

Page 18: M-Lab Research and Infrastructure for Interconnection ... · M-Lab Research and Infrastructure for Interconnection Performance Monitoring Collin Anderson @MeasurementLab. M-Lab: A

Diurnal Cycles In Practice Peak Hours, Peak Disruption

Page 19: M-Lab Research and Infrastructure for Interconnection ... · M-Lab Research and Infrastructure for Interconnection Performance Monitoring Collin Anderson @MeasurementLab. M-Lab: A

Not Limited to Download Latency Sensitive Applications Affected

Page 20: M-Lab Research and Infrastructure for Interconnection ... · M-Lab Research and Infrastructure for Interconnection Performance Monitoring Collin Anderson @MeasurementLab. M-Lab: A

Congestion has not been limited to Interconnections with Cogent or Specific Services.

Page 21: M-Lab Research and Infrastructure for Interconnection ... · M-Lab Research and Infrastructure for Interconnection Performance Monitoring Collin Anderson @MeasurementLab. M-Lab: A

XO and Time Warner Cable Not Limited to Cogent

Page 22: M-Lab Research and Infrastructure for Interconnection ... · M-Lab Research and Infrastructure for Interconnection Performance Monitoring Collin Anderson @MeasurementLab. M-Lab: A

XO and Time Warner Cable Not Limited to Cogent

Page 23: M-Lab Research and Infrastructure for Interconnection ... · M-Lab Research and Infrastructure for Interconnection Performance Monitoring Collin Anderson @MeasurementLab. M-Lab: A

Level 3 and Verizon Not Limited to Cogent

Page 24: M-Lab Research and Infrastructure for Interconnection ... · M-Lab Research and Infrastructure for Interconnection Performance Monitoring Collin Anderson @MeasurementLab. M-Lab: A

Level 3 and Verizon Not Limited to Cogent

Page 25: M-Lab Research and Infrastructure for Interconnection ... · M-Lab Research and Infrastructure for Interconnection Performance Monitoring Collin Anderson @MeasurementLab. M-Lab: A

Congestion is Continuing Congestion as of Q4 2014

Page 26: M-Lab Research and Infrastructure for Interconnection ... · M-Lab Research and Infrastructure for Interconnection Performance Monitoring Collin Anderson @MeasurementLab. M-Lab: A

Comparative Performance across ISPs

No Access ISPs or Transit ISPs Universally Underperforming

Normal ISP Congested ISP

Slow Fast Slow Fast

Perc

enta

ge o

f Tes

ts

Page 27: M-Lab Research and Infrastructure for Interconnection ... · M-Lab Research and Infrastructure for Interconnection Performance Monitoring Collin Anderson @MeasurementLab. M-Lab: A

Comparative Performance across ISPs

No Access ISPs or Transit ISPs Universally Underperforming

Page 28: M-Lab Research and Infrastructure for Interconnection ... · M-Lab Research and Infrastructure for Interconnection Performance Monitoring Collin Anderson @MeasurementLab. M-Lab: A

Comparative Performance across ISPs

No Access ISPs or Transit ISPs Universally Underperforming

Page 29: M-Lab Research and Infrastructure for Interconnection ... · M-Lab Research and Infrastructure for Interconnection Performance Monitoring Collin Anderson @MeasurementLab. M-Lab: A

Comparative Performance across ISPs

No Access ISPs or Transit ISPs Universally Underperforming

Page 30: M-Lab Research and Infrastructure for Interconnection ... · M-Lab Research and Infrastructure for Interconnection Performance Monitoring Collin Anderson @MeasurementLab. M-Lab: A

Serendipitous Discovery

Page 31: M-Lab Research and Infrastructure for Interconnection ... · M-Lab Research and Infrastructure for Interconnection Performance Monitoring Collin Anderson @MeasurementLab. M-Lab: A

What Happened in Late February? Cross the Board Increases

Page 32: M-Lab Research and Infrastructure for Interconnection ... · M-Lab Research and Infrastructure for Interconnection Performance Monitoring Collin Anderson @MeasurementLab. M-Lab: A

What Happened in Late February? Cross the Board Increases

Page 33: M-Lab Research and Infrastructure for Interconnection ... · M-Lab Research and Infrastructure for Interconnection Performance Monitoring Collin Anderson @MeasurementLab. M-Lab: A

DSCP Changes! Cross the Board Increases

Page 34: M-Lab Research and Infrastructure for Interconnection ... · M-Lab Research and Infrastructure for Interconnection Performance Monitoring Collin Anderson @MeasurementLab. M-Lab: A

Research Update: Extending the Interconnection Study through Data Extraction Tools

Page 35: M-Lab Research and Infrastructure for Interconnection ... · M-Lab Research and Infrastructure for Interconnection Performance Monitoring Collin Anderson @MeasurementLab. M-Lab: A

Measurement Lab Telescope Python to extract M-Lab data

Page 36: M-Lab Research and Infrastructure for Interconnection ... · M-Lab Research and Infrastructure for Interconnection Performance Monitoring Collin Anderson @MeasurementLab. M-Lab: A

Measurement Lab Observatory Currently US Only

Page 37: M-Lab Research and Infrastructure for Interconnection ... · M-Lab Research and Infrastructure for Interconnection Performance Monitoring Collin Anderson @MeasurementLab. M-Lab: A

Measurement Lab Observatory Currently US Only

Page 38: M-Lab Research and Infrastructure for Interconnection ... · M-Lab Research and Infrastructure for Interconnection Performance Monitoring Collin Anderson @MeasurementLab. M-Lab: A

Our data shows that traffic from specific Access ISP customers across interconnections

with specific Transit ISPs experienced degraded performance and that this

degradation forms a pattern wherever specific Access ISPs and Transit ISPs exchange traffic.

Page 39: M-Lab Research and Infrastructure for Interconnection ... · M-Lab Research and Infrastructure for Interconnection Performance Monitoring Collin Anderson @MeasurementLab. M-Lab: A

measurementlab.net @MeasurementLab

There is still much more in Measurement Lab’s dataset. Please explore.