John DeHartjdd@arl.wustl.edu

http://www.arl.wustl.edu/arl

Design of aDiversified Router:

Monitoring

2 - JST/JDD/FK - 04/19/23

Revision History 5/22/06 (JDD):

»Created 5/25/06 (JDD):

»Updated LC physical interface counters»Updated LC Substrate and metalink counters.

3 - JST/JDD/FK - 04/19/23

Monitoring Being able to monitor counters, queue lengths, etc on

our running systems is an important part of what we do.»This allows us to do

compelling demonstrations Easier debugging Etc.

We need to define:»What counters and other values we want to maintain»Where to maintain them»How to retrieve them.

4 - JST/JDD/FK - 04/19/23

System View

Physical Interface 1

Physical Interface 2

MLI-11_1MLI-11_2

MLI-12_1MLI-12_2

Physical Interface 3

Physical Interface 4

MLI-31_1MLI-31_2

MLI-32_1MLI-32_2

LC-1 LC-2

SL-31

SL-32

SL-33

SL-41

SL-42

SL-43

SL-11

SL-12

SL-12

SL-21

SL-22

SL-23

Substrate Router

MR-1

MR-2

MI-1

MI-3

MI-4

MI-2

MI-1

MI-3

MI-4

MI-2

NP Blade

5 - JST/JDD/FK - 04/19/23

Monitoring Entities/statistics we might want to monitor:

»LC: Users (Meta Net Developers/Providers):

Meta Links– # receive pkts/bytes– # transmit pkts/bytes– # Ingress drop pkts: queue overflow– # Egress drop pkts: queue overflow– Ingress queue length– Egress queue length

Us (Substrate network providers): Physical Links:

– These are available via RTM counters– # receive pkts/bytes– # transmit pkts/bytes

Substrate Links: – Some per metalink counters and the rest get aggregated into a common per

substrate link counter. There is no total counter per substrate link.– # receive pkts/bytes– # transmit pkts/bytes

Total # counter touches per packet: 2 pkt cnts, 2 byte cnts, 2 queue lengths 6 atomic increment SRAM operations per packet.

– Do atomic operations take more SRAM cycles? Worst case pkt rate: 16.45 Mpkts/s 98.7 M SRAM ops/sec

Perhaps we make the Physical and Substrate Link debug only.

6 - JST/JDD/FK - 04/19/23

Monitoring»NP Blade:

Meta Interfaces # receive pkts/bytes # transmit pkts/bytes # drop pkts: queue overflow Queue length (1 on enqueue, 1 on dequeue)

Meta Routers # drop pkts: header check error Per filter/route hits (limited number supported) pkts/bytes

# mem touches per packet: 3 pkt cnts, 3 byte cnts, 2 queue length 8 atomic increment SRAM operations per packet.

Worst case pkt rate: 8.225 Mpkts/s 65.8 M SRAM ops/sec

7 - JST/JDD/FK - 04/19/23

Extra The next set of slides are for templates or extra

information if needed

8 - JST/JDD/FK - 04/19/23

Text Slide Template

9 - JST/JDD/FK - 04/19/23

Image Slide Template

10 - JST/JDD/FK - 04/19/23

OLD The rest of these are old slides that should be deleted

at some point.