Mobile Packet Core (ASR5500)d2zmdbbm9feqrf.cloudfront.net/2016/usa/pdf/BRKSPM-2130.pdfMobile Packet...

84

Transcript of Mobile Packet Core (ASR5500)d2zmdbbm9feqrf.cloudfront.net/2016/usa/pdf/BRKSPM-2130.pdfMobile Packet...

Page 1: Mobile Packet Core (ASR5500)d2zmdbbm9feqrf.cloudfront.net/2016/usa/pdf/BRKSPM-2130.pdfMobile Packet Core (ASR5500) Troubleshooting Guilherme Correia, Technical Leader, Services Rama
Page 2: Mobile Packet Core (ASR5500)d2zmdbbm9feqrf.cloudfront.net/2016/usa/pdf/BRKSPM-2130.pdfMobile Packet Core (ASR5500) Troubleshooting Guilherme Correia, Technical Leader, Services Rama

Mobile Packet Core (ASR5500) Troubleshooting

Guilherme Correia, Technical Leader, Services

Rama Ramachandran, Technical Leader, Engineering

BRKSPM-2130

Page 3: Mobile Packet Core (ASR5500)d2zmdbbm9feqrf.cloudfront.net/2016/usa/pdf/BRKSPM-2130.pdfMobile Packet Core (ASR5500) Troubleshooting Guilherme Correia, Technical Leader, Services Rama

© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public

EPC Reference Architecture 3GPP Access

E-UTRANPGWSGWeNodeB

PCRF

Operator’s

IP Services

(e.g. video, IMS)

HSS

S11

(GTP-C)

S1-U

(GTP-U)

S2b

(GTP, PMIPv6,

GRE)

MME

S5/8 (PMIPv6, GRE)

S6a

(DIAMETER)

S1-MME

(S1-AP)

GERAN

S4 (GTP-C, GTP-U)UTRAN

SGSN

Trusted

Non-3GPP

IP Access

Untrusted

Non-3GPP

IP Access

S3

(GTP-C)

S12 (GTP-U)

S10

(GTP-C)

S5/8 (GTP-C, GTP-U)

Gx (DIAMETER) Gxb

SWx (DIAMETER)

STa (RADIUS,

DIAMETER)

ePDG

AAA

SWn

S6b

(DIAMETER)

SWm

(DIAMETER

)

SGi

SWa

Gxa

Rx+ (DIAMETER)

S2c

UES2a

(GTP, PMIPv6, GRE

MIPv4 FACoA)

Gxc

UEUE

BRKSPM-2130 3

Page 4: Mobile Packet Core (ASR5500)d2zmdbbm9feqrf.cloudfront.net/2016/usa/pdf/BRKSPM-2130.pdfMobile Packet Core (ASR5500) Troubleshooting Guilherme Correia, Technical Leader, Services Rama

Agenda:

• Describe the ASR5500 hardware and software architecture.

• Describe the mapping between the Sub-system, Services and Interfaces.

• Describe the system call flow for StarOS based MPC solution.

Page 5: Mobile Packet Core (ASR5500)d2zmdbbm9feqrf.cloudfront.net/2016/usa/pdf/BRKSPM-2130.pdfMobile Packet Core (ASR5500) Troubleshooting Guilherme Correia, Technical Leader, Services Rama

Module -1

ASR5500 Hardware

Architecture Overview

Page 6: Mobile Packet Core (ASR5500)d2zmdbbm9feqrf.cloudfront.net/2016/usa/pdf/BRKSPM-2130.pdfMobile Packet Core (ASR5500) Troubleshooting Guilherme Correia, Technical Leader, Services Rama

© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public

ASR 5500 Chassis

Front Rear

Air intake

Front-to-back airflow

Front fan

tray

System

Status Card

slots (11-12)

Fabric Storage

Card slots (13-

18)

Front fan tray

Management

and I/O slots (5-

6)

Data

Processing

Card slots (1-

4, 7-10)

Power suppliesRear fan tray

Rear fan tray

BRKSPM-2130 6

Page 7: Mobile Packet Core (ASR5500)d2zmdbbm9feqrf.cloudfront.net/2016/usa/pdf/BRKSPM-2130.pdfMobile Packet Core (ASR5500) Troubleshooting Guilherme Correia, Technical Leader, Services Rama

© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public

ASR5500 – Card Positioning

S

S

C

1

S

S

C

2

F

S

C

5

F

S

C

1

F

S

C

2

F

S

C

3

F

S

C

4

F

S

C

6

R

E

S

E

R

V

E

D

1

R

E

S

E

R

V

E

D

2

Power Filter Unit Power Filter Unit

Fan Tray

Fan Tray

Air Intake

11 12 13 14 15 16 17 18 19 20

D

P

C

5

D

P

C

3

M

I

O

1

M

I

O

2

D

P

C

4

D

P

C

6

Power Connectors Power Connectors

Fan Tray

Cable Management

Fan Tray

Air Exhaust

D

P

C

1

D

P

C

7

D

P

C

8

D

P

C

2

1 2 3 4 5 6 7 8 9 10

Front View Rear View

BRKSPM-2130 7

Page 8: Mobile Packet Core (ASR5500)d2zmdbbm9feqrf.cloudfront.net/2016/usa/pdf/BRKSPM-2130.pdfMobile Packet Core (ASR5500) Troubleshooting Guilherme Correia, Technical Leader, Services Rama

© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public

ASR5500 – Chassis Mid Plane Architecture

USB and PCMCIe

BRKSPM-2130 8

Page 9: Mobile Packet Core (ASR5500)d2zmdbbm9feqrf.cloudfront.net/2016/usa/pdf/BRKSPM-2130.pdfMobile Packet Core (ASR5500) Troubleshooting Guilherme Correia, Technical Leader, Services Rama

© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public

ASR5500 Hardware Architecture – FSC Cards

• Fabric and Storage Cards (FSCs)

• 1.2Tbps Crossbar Switching Fabric

• 1:N Redundancy, slots 13 - 18

• Each FSC provides a link to all cards (Redundancy)

• Persistent Storage• 2 200GB Solid State Drives

• 2 Serial Access SCSI (SAS) controllers on MIO, one connects to top drive of each FSC and one to the bottom drive of each FSC

FSCs

BRKSPM-2130 9

Page 10: Mobile Packet Core (ASR5500)d2zmdbbm9feqrf.cloudfront.net/2016/usa/pdf/BRKSPM-2130.pdfMobile Packet Core (ASR5500) Troubleshooting Guilherme Correia, Technical Leader, Services Rama

© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public

ASR5500 Hardware Architecture – Front Cards

System Status Card

Status Monitoring Temperature, airflow, current

System LEDs

Audible Alarms

System Power

Installed in slots 11 – 12

1:1 Redundancy

SSCs

FSCs

BRKSPM-2130 10

Page 11: Mobile Packet Core (ASR5500)d2zmdbbm9feqrf.cloudfront.net/2016/usa/pdf/BRKSPM-2130.pdfMobile Packet Core (ASR5500) Troubleshooting Guilherme Correia, Technical Leader, Services Rama

© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public

ASR5500 Hardware Architecture – Rear Cards

Management Input/Output (MIO)

4 x 50Gbps Cisco Typhoon NPUs

1 x 6-core 2.0 GHz x86 processor with 96GB DRAM

Chassis Management RJ45 and 2x 1000BASE-T

Installed in slots 5 & 6

1:1 Redundancy

2 Daughter Cards

10 x 10 GbE Interfaces per daughter card

MIOs

BRKSPM-2130 11

Page 12: Mobile Packet Core (ASR5500)d2zmdbbm9feqrf.cloudfront.net/2016/usa/pdf/BRKSPM-2130.pdfMobile Packet Core (ASR5500) Troubleshooting Guilherme Correia, Technical Leader, Services Rama

© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public

MIO Architecture: ASR55-MIO-BASE-K9

BCF

Daughter Card 1 Daughter Card 21 2

IPsecMDF

US

B

US

B

D C

Typhoon

NPU 1

FAP

FAP

Typhoon

NPU 2

Typhoon

NPU 3

Typhoon

NPU 4

FAP

FAP

To Fabric ModulesTo Midplane

(SAS, USB, PCIe)

CPU

USB SL

CAF

FAPs

RS-232

Flash

BRKSPM-2130 12

Page 13: Mobile Packet Core (ASR5500)d2zmdbbm9feqrf.cloudfront.net/2016/usa/pdf/BRKSPM-2130.pdfMobile Packet Core (ASR5500) Troubleshooting Guilherme Correia, Technical Leader, Services Rama

© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public

MIO Daughter Cards

Typhoon

NPU 1

Typhoon

NPU 2

2 x 5 SFP Cage

Quad

10G

PHY

Quad

10G

PHY

Quad

10G

PHY

S

F

P

+14

S

F

P

+15

S

F

P

+12

S

F

P

+1310

S

F

P

+

S

F

P

+11

S

F

P

+16

S

F

P

+17

S

F

P

+18

S

F

P

+19

Typhoon

NPU 3

Typhoon

NPU 4

2 x 5 SFP Cage

Quad

10G

PHY

Quad

10G

PHY

Quad

10G

PHY

S

F

P

+24

S

F

P

+25

S

F

P

+22

S

F

P

+2320

S

F

P

+

S

F

P

+21

S

F

P

+26

S

F

P

+27

S

F

P

+28

S

F

P

+29

BRKSPM-2130 13

Page 14: Mobile Packet Core (ASR5500)d2zmdbbm9feqrf.cloudfront.net/2016/usa/pdf/BRKSPM-2130.pdfMobile Packet Core (ASR5500) Troubleshooting Guilherme Correia, Technical Leader, Services Rama

© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public

Data Processing Card (DPC)

Provides complex subscriber-aware traffic processing

2 subsystems, each containing: Control Plane: 2 x 6-core 2.0 GHz x86 processor with 96GB DRAM

Data Plane: 1 x 50Gbps Cisco Typhoon NPU

3 FPGAs (2 x Control, 1 x Data)

Hardware Security Processor

Installed in slots 1-4 & 7-10 1:N Redundancy Model

BRKSPM-2130 14

Page 15: Mobile Packet Core (ASR5500)d2zmdbbm9feqrf.cloudfront.net/2016/usa/pdf/BRKSPM-2130.pdfMobile Packet Core (ASR5500) Troubleshooting Guilherme Correia, Technical Leader, Services Rama

© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public

Typhoon

NPU

Security

FAP

DDF

US

B

1 1

Subsystem 1

Dual

10G

MAC

CPU0 CPU1

NAND

SPI

SPI

DPC Architecture: ASR55-DPC-K9

Typhoon

NPU

To Fabric Modules

CAFBCF

IPsec

FAP

DDF

US

B

1 1

USB to MIOs

Subsystem 0

Dual

10G

MAC

CPU0 CPU1

BRKSPM-2130 15

Page 16: Mobile Packet Core (ASR5500)d2zmdbbm9feqrf.cloudfront.net/2016/usa/pdf/BRKSPM-2130.pdfMobile Packet Core (ASR5500) Troubleshooting Guilherme Correia, Technical Leader, Services Rama

© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public

ASR5500 2nd Generation DPC2

Major Difference DPC DPC2

CPU Triple Compute Intel Westmere-EP

4 Sockets (nodes)

48 Logical Cores

192GB DDR3 RAM

96GB / Complex

Intel Haswell-EP

6 Sockets (node)

144 Logical Cores

192GB DDR4 RAM

64GB / complex

DMA FPGA (DDF) 2x 45Gb DMA FPGAs 2x 75Gb DMA FPGAs

NPU Removed (FPGA/TCAM assist)

2 50Gb NPUs

2GB Memory (ea)

No NPU**

Fabric Next-gen Fabric

Reduced from 2 to 1 chips**

200 Gb Throughput 200 Gb Throughput

Crypto Triple Crypto 2x 20Gb Engines 3x 50Gb Engines

BRKSPM-2130 16

Page 17: Mobile Packet Core (ASR5500)d2zmdbbm9feqrf.cloudfront.net/2016/usa/pdf/BRKSPM-2130.pdfMobile Packet Core (ASR5500) Troubleshooting Guilherme Correia, Technical Leader, Services Rama

© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public

ASR5500 2nd Generation Cards Compatibility

• Limited to chassis with same card configurations • i.e. Cannot mix DPC1 and DPC2

• (MIOs, DPCs, and FSCs)

• (MIOs, DPC2s and FSCs)

• Recommended configurations• Current – 2 x MIO, 8 x DPC, 4 x FSC

• New – 2 x MIO, 8 x DPC2, 4 x FSC

• ICSR Chassis Pair with different DPC types (DPC1/DPC2) configurations not supported

• Within chassis first DPC type registered are allowed others will be offline

BRKSPM-2130 17

Page 18: Mobile Packet Core (ASR5500)d2zmdbbm9feqrf.cloudfront.net/2016/usa/pdf/BRKSPM-2130.pdfMobile Packet Core (ASR5500) Troubleshooting Guilherme Correia, Technical Leader, Services Rama

End of Module 1

Questions?

Page 19: Mobile Packet Core (ASR5500)d2zmdbbm9feqrf.cloudfront.net/2016/usa/pdf/BRKSPM-2130.pdfMobile Packet Core (ASR5500) Troubleshooting Guilherme Correia, Technical Leader, Services Rama

Module 2ASR5500 Software Overview

Page 20: Mobile Packet Core (ASR5500)d2zmdbbm9feqrf.cloudfront.net/2016/usa/pdf/BRKSPM-2130.pdfMobile Packet Core (ASR5500) Troubleshooting Guilherme Correia, Technical Leader, Services Rama

© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public

Distributed ArchitectureEvery leg has its own brain and it is almost independent.

40% of the neuron cells head

60% of the neuron cells arms

BRKSPM-2130 20

Page 21: Mobile Packet Core (ASR5500)d2zmdbbm9feqrf.cloudfront.net/2016/usa/pdf/BRKSPM-2130.pdfMobile Packet Core (ASR5500) Troubleshooting Guilherme Correia, Technical Leader, Services Rama

© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public

ASR5500 Software – Distributed Architecture

MIO DPC

DPC

DPC

DPC

DPC

DPC

DPC

DPC

Distributed Software Architecture: every card runs its own instance of StarOS.

For every service, there is a corresponding signaling manager

Subscriber sessions are maintained in both the sessmgr and aaamgr tasksBRKSPM-2130 21

Page 22: Mobile Packet Core (ASR5500)d2zmdbbm9feqrf.cloudfront.net/2016/usa/pdf/BRKSPM-2130.pdfMobile Packet Core (ASR5500) Troubleshooting Guilherme Correia, Technical Leader, Services Rama

© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public

ASR5500 Software Architecture - Designed for Redundancy

Boot Configuration

High Availability Tasks

Resource Manager

Switch Fabric Control

ACTIVE MIO

DPC1

Boot Configuration

High Availability Tasks

Resource Manager

Switch Fabric Control

STANDBY MIO

HW Engines

Encrypt Comp. Filter

PSC

HW Engines

Encrypt Comp. Filter

PSC

DPCSession Manager

AAA Manager

HW Engines

Encrypt Comp. Filter

AAA Manager

Session Manager Standby

Tasks

Sync

Control

Standby Tasks

Standby Tasks

Standby Tasks

Session Manager

AAA Manager

DPC2 DPC3

BRKSPM-2130 22

Page 23: Mobile Packet Core (ASR5500)d2zmdbbm9feqrf.cloudfront.net/2016/usa/pdf/BRKSPM-2130.pdfMobile Packet Core (ASR5500) Troubleshooting Guilherme Correia, Technical Leader, Services Rama

© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public

ASR5500 Software – Sessmgr and AAAmgr

Task Name Description Function

sessmgr (SM) Session Manager • Created by Session Controller. Paired with AAA Managers.

• Provides a subscriber processing system that supports multiple session types.

• A single Session Manager can service sessions from multiple input Session

Handlers.

aaamgr (SM) Authorization, Authentication

and Accounting (AAA)

Manager

• Paired with Session Managers.

• Performs AAA protocol operations and functions for subscribers and

administrative users in the system.

• AAA operations for CLI are done through AAA Manager running on the active

management card.

BRKSPM-2130 23

Page 24: Mobile Packet Core (ASR5500)d2zmdbbm9feqrf.cloudfront.net/2016/usa/pdf/BRKSPM-2130.pdfMobile Packet Core (ASR5500) Troubleshooting Guilherme Correia, Technical Leader, Services Rama

© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public

• Download the StarOS image file from Cisco Website

• Complete the pre-checks as required

• Upload the build to the “/flash” of the chassis and verify the version

• Reconfigure the boot stack to boot from the new image and configuration file.

• Collect the support details from the chassis with the running StarOS build “show support details”

• Upgrade the chassis to the new software level using “reload”

ASR5500 Chassis Upgrade/Reload

BRKSPM-2130 24

Page 25: Mobile Packet Core (ASR5500)d2zmdbbm9feqrf.cloudfront.net/2016/usa/pdf/BRKSPM-2130.pdfMobile Packet Core (ASR5500) Troubleshooting Guilherme Correia, Technical Leader, Services Rama

© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public

Port Redundancy

1:1L2 port redundancy by default 5/* 6/*

[local]ASR5500# sho port info 5/10

Port: 5/10

Port Type : 10G Ethernet

Role : Service Port

Description : (None Set)

Redundancy Mode : Port Mode

Framing Mode : Unspecified

Redundant With : 6/10

Preferred Port : Non-Revertive

Physical ifIndex : 84541440

Administrative State : Enabled

Configured Duplex : Auto

Configured Speed : Auto

Configured Flow Control : Enabled

Interface MAC Address : 00-05-47-FE-18-E9

Fixed MAC Address : 00-05-47-FE-18-C9

< … >

[local]ASR5500#

BRKSPM-2130 25

Page 26: Mobile Packet Core (ASR5500)d2zmdbbm9feqrf.cloudfront.net/2016/usa/pdf/BRKSPM-2130.pdfMobile Packet Core (ASR5500) Troubleshooting Guilherme Correia, Technical Leader, Services Rama

© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public

StarOS Logging

MIO

MIO and DPC/DPC2

Runtime

Inactive

Log BufferRuntime

Active Log

Buffer

Evlogd

Managers(VPNMgr, SessMgr,

NPUMgr, GTPcMgr

etc)

Controllers(VPNCtrl, SessCtrl,

NPUCtrl, rmctrl etc)

Console

Terminal

Syslog

Servers

System Messenger

CLI

Log Sources

BRKSPM-2130 26

Page 27: Mobile Packet Core (ASR5500)d2zmdbbm9feqrf.cloudfront.net/2016/usa/pdf/BRKSPM-2130.pdfMobile Packet Core (ASR5500) Troubleshooting Guilherme Correia, Technical Leader, Services Rama

© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public

ASR5500 Call Distribution

[local]ASR5500# show task resources | grep sessmgr

Thursday February 18 15:19:49 AST 2016

task cputime memory files sessions

cpu facility inst used allc used alloc used allc used allc S status

----------------------- --------- ------------- --------- ------------- ------

3/0 sessmgr 4 23% 100% 844.2M 1.86G 95 500 11440 28160 I good

3/0 sessmgr 7 23% 100% 840.7M 1.86G 95 500 11420 28160 I good

3/0 sessmgr 11 22% 100% 839.7M 1.86G 95 500 11430 28160 I good

3/0 sessmgr 16 26% 100% 841.2M 1.86G 92 500 11435 28160 I good

3/0 sessmgr 23 22% 100% 835.5M 1.86G 95 500 11443 28160 I good

3/0 sessmgr 26 26% 100% 841.0M 1.86G 94 500 11436 28160 I good

Active calls

BRKSPM-2130 27

Page 28: Mobile Packet Core (ASR5500)d2zmdbbm9feqrf.cloudfront.net/2016/usa/pdf/BRKSPM-2130.pdfMobile Packet Core (ASR5500) Troubleshooting Guilherme Correia, Technical Leader, Services Rama

© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public

• Require session recovery configuration:

default require session recovery

• (SIT), (HAT), and (CSP) are responsible for detecting both SW and HW faults.

• RCT initiates the appropriate corrective action(s).

BRKSPM-2130 28

Page 29: Mobile Packet Core (ASR5500)d2zmdbbm9feqrf.cloudfront.net/2016/usa/pdf/BRKSPM-2130.pdfMobile Packet Core (ASR5500) Troubleshooting Guilherme Correia, Technical Leader, Services Rama

© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public

ASR5500 Software Architecture – Session Recovery

• Sessmgr/AAAmgr pairs are split among DPCs.

Active DPC 1 Active DPC 2 Standby DPC 3

BRKSPM-2130 29

Page 30: Mobile Packet Core (ASR5500)d2zmdbbm9feqrf.cloudfront.net/2016/usa/pdf/BRKSPM-2130.pdfMobile Packet Core (ASR5500) Troubleshooting Guilherme Correia, Technical Leader, Services Rama

© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public

ASR5500 Software Architecture – Session Recovery

Active DPC 1 Active DPC 2 Standby DPC 3

Task

Failure

Re

co

ve

ry

BRKSPM-2130 30

Page 31: Mobile Packet Core (ASR5500)d2zmdbbm9feqrf.cloudfront.net/2016/usa/pdf/BRKSPM-2130.pdfMobile Packet Core (ASR5500) Troubleshooting Guilherme Correia, Technical Leader, Services Rama

© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public

ASR5500 Session Recovery – Full Recovery Mode

DPC

Failure Recovery

Active DPC 1 Active DPC 2 Standby DPC 3

Becomes Active

BRKSPM-2130 31

Page 32: Mobile Packet Core (ASR5500)d2zmdbbm9feqrf.cloudfront.net/2016/usa/pdf/BRKSPM-2130.pdfMobile Packet Core (ASR5500) Troubleshooting Guilherme Correia, Technical Leader, Services Rama

End of Module 2Questions?

Page 33: Mobile Packet Core (ASR5500)d2zmdbbm9feqrf.cloudfront.net/2016/usa/pdf/BRKSPM-2130.pdfMobile Packet Core (ASR5500) Troubleshooting Guilherme Correia, Technical Leader, Services Rama

Module - 3Subsystem, Services and Interfaces

Page 34: Mobile Packet Core (ASR5500)d2zmdbbm9feqrf.cloudfront.net/2016/usa/pdf/BRKSPM-2130.pdfMobile Packet Core (ASR5500) Troubleshooting Guilherme Correia, Technical Leader, Services Rama

© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public

Interfaces and Services – MME

mme-service

Hss-peer-service

Diamter

endpoint sgs-service

Context diameter

MME

Global config

mode

Subscriber-map

HSS EIR MSS

DNS

S1-MME

S6a S13 Sgs

Gn

SGSN

eNodeB

Sctp-param-template Tai-mgmt-db

Diamter

endpoint

sgtpc-service

Egtp-service

Dns-client

Context dns

Context

gtp

Context

mme

SGW/MMES11/S10

BRKSPM-2130 34

Page 35: Mobile Packet Core (ASR5500)d2zmdbbm9feqrf.cloudfront.net/2016/usa/pdf/BRKSPM-2130.pdfMobile Packet Core (ASR5500) Troubleshooting Guilherme Correia, Technical Leader, Services Rama

© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public

Is the MME service up?******** show mme-service all *******

Thursday February 18 15:20:20 AST 2016

Service name : mme

Context : s1mmes11

Status : STARTED

Bind : Done

S1-MME IP Address : 10.231.0.20

10.231.0.21

<snip>

PLMN Id : MCC: 250, MNC: 01

Network-Global-MME-ID-Mgmt-DB : Associated

Foreign-PLMN-GUTI-Mgmt-DB : Not Associated

EGTP Context : s1mmes11

EGTP Service : egtp_s11

EGTP Sv Context : Not defined

EGTP Sv Service : Not defined

SGTPC Context : gns4

SGTPC Service : sgtpmme

MME HSS Context : s6a

MME HSS Service : hss

<snip>

S1AP SCTP Parameters:

SCTP Param Template Associated : S1-template

SCTP Param Timestamp : Wed Jan 13 04:34:18 2016

SCTP Alpha : 5

SCTP Beta : 10

SCTP Checksum Type : CRC32

SCTP Valid Cookie Lifetime : 60000ms

SCTP Max Assoc Retrans : 10

SCTP Max Number of In Streams : 16

SCTP Init Retransmissions : 5

SCTP Max MTU : 1500bytes

SCTP Max Number of Out Streams : 16

SCTP Path Retransmissions : 5

SCTP Min MTU : 508bytes

SCTP RTO Initial : 3000ms

SCTP RTO Max : 60000ms

SCTP RTO Min : 1000ms

SCTP Sack Frequency : 2

SCTP Sack Period : 200ms

SCTP Start MTU : 1500bytes

SCTP Heartbeat Status : Enabled

SCTP HeartBeat Timer : 10s

SCTP Bundle Status : Disabled

SCTP Bundle Timer : 0msBRKSPM-2130 35

Page 36: Mobile Packet Core (ASR5500)d2zmdbbm9feqrf.cloudfront.net/2016/usa/pdf/BRKSPM-2130.pdfMobile Packet Core (ASR5500) Troubleshooting Guilherme Correia, Technical Leader, Services Rama

© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public

Interfaces and Services – SGW

sgw-service

Gtpu-service Egtp-service

Context s1u_s11 SGW

Global config mode

Subscriber-map

S1-U

eNodeB

Qci-qos-mapping

Egtp-service

gtpp-group

Context gtpp

Context S5_s8

Context

sgw

PGW

S11

MME

CGF

Gz

S5/S8

BRKSPM-2130 36

Page 37: Mobile Packet Core (ASR5500)d2zmdbbm9feqrf.cloudfront.net/2016/usa/pdf/BRKSPM-2130.pdfMobile Packet Core (ASR5500) Troubleshooting Guilherme Correia, Technical Leader, Services Rama

© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public

Is the SGW service up?******** show sgw-service all *******

Wednesday January 27 17:27:00 CET 2016

Service name :sgw-svc

Service-Id :9

Context :saegw

Accounting context :saegw

Accounting gtpp group :default

Accounting mode :Gtpp

Accounting stop-trigger :Default

Status :STARTED

Egress protocol :gtp

Ingress EGTP service :sgw-svc-s11-ingress

Egress context :pgw

Egress EGTP service :sgw-svc-s5-egress

Egress MAG service :n/a

IMS auth. service :n/a

Peer Map :n/a

Access Peer Map :n/a

Accounting policy :sgw

Newcall policy :n/a

QCI-QOS mapping table :pgw-qci-qos

Event Reporting :Disabled

DDN Throttling :Disabled

Page UE for PGW initiated proc :Disabled

Temp-Failure Handling for DBR proc :Disabled

PGW Ctrl FTEID in Relocation Create Session Response :Disabled

GTPC Path Failure Handling:

S11-Interface: local-purge

S5-Interface : local-purge

S1U-Interface: local-purge

S5U-Interface: local-purge

S4U-Interface: local-purge

S4-Interface: local-purge

S12-Interface: local-purge

GTPU Error Indication Handling:

S1U-Interface: page-ue

S5U-Interface: local-purge

S12-Interface: page-ue

S4U-Interface: local-purge

ddn success-action no-user-connect ddn-retry-timer: 60

ddn failure-action pkt-drop-time: 300

ddn isr-sequential-paging delay-time: 10

Idle timeout : n/a

PLMN ID List : MCC: 555, MNC: 55 [Primary]

Subscriber Map Name: smap_map

SAEGW service : n/a

EGTP NTSR: Disabled

Session Hold Timer: n/a

Timeout: n/a

GTP-C Load Control Profile : Not Defined

GTP-C Overload Control Profile : Not Defined

BRKSPM-2130 37

Page 38: Mobile Packet Core (ASR5500)d2zmdbbm9feqrf.cloudfront.net/2016/usa/pdf/BRKSPM-2130.pdfMobile Packet Core (ASR5500) Troubleshooting Guilherme Correia, Technical Leader, Services Rama

© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public

Interfaces and Services – PGW

Diameter

endpointDiameter

endpoint

AAA

group

Gtpp-group

Context diameter

Context ISP

Context Ga

Context s5s8

PGW

APN

Context GiIp-ppol

pgw-service

PCRF OCS

Gx GyAAA

S5

/

S8

SGW

CGF

Gz

gtpu-service

AAA

Ims-auth-service

Global mode

Enhanced-charging-service

Credit-control-group

PDN

SGi

BRKSPM-2130 38

Page 39: Mobile Packet Core (ASR5500)d2zmdbbm9feqrf.cloudfront.net/2016/usa/pdf/BRKSPM-2130.pdfMobile Packet Core (ASR5500) Troubleshooting Guilherme Correia, Technical Leader, Services Rama

© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public

Is the PGW service up?

******** show pgw-service all *******

Wednesday January 27 17:27:00 CET 2016

Service name : pgw-svc

Service-Id : 8

Context : saegw

Status : STARTED

EGTP Service : pgw-svc-s5-ingress

LMA Service : Not defined

GGSN Service : ggsn-svc

IPNE Service : Not defined

Peer Map : Not defined

Session-Delete-Delay Timer : Disabled

Session-Delete-Delay Timeout : n/a

PLMN ID List : MCC: 555, MNC: 555

Newcall Policy : None

dns-client Context Name : pgw

gx-li context : li

gx-li transport : udp

QCI-QOS Mapping Table Name : pgw-qci-qos

Authorize : Disabled

Setup Timeout : 60(secs)

Message Timestamp Drift : 180(secs)

S6b IPv6 Reporting : Disabled

Duplicate Subscriber Addr Request : Reject

Qos Negotiation Profile Rel8 for Gy interface : Disabled

Fqdn-name : Disabled

EGTP SGW Restoration Handling :Disabled

Session Hold Timer: n/a

Timeout: n/a

EGTP Modify bearer cmd negotiate qos :Disabled

EGTP GnGp Modify bearer res with APN-AMBR :Disabled

EGTP Bit Rate in Rounded Down Kbps :Disabled

GTP-C Load Control Profile : Not Defined

GTP-C Overload Control Profile : Not Defined

P-CSCF Restoration solution : HSS-based (Private Extn)

GTPC Outgoing Throttling :Disabled

RLF Template Name :N/A

Throttling override :Disabled

Throttling override Policy :N/A

GTPC Incoming Throttling Params: Configured (Default)

Message Rate (per sec) : 20000

Delay Tolerance (secs) : 5

Queue Size : 10000

BRKSPM-2130 39

Page 40: Mobile Packet Core (ASR5500)d2zmdbbm9feqrf.cloudfront.net/2016/usa/pdf/BRKSPM-2130.pdfMobile Packet Core (ASR5500) Troubleshooting Guilherme Correia, Technical Leader, Services Rama

End of Module 3

Questions?

Page 41: Mobile Packet Core (ASR5500)d2zmdbbm9feqrf.cloudfront.net/2016/usa/pdf/BRKSPM-2130.pdfMobile Packet Core (ASR5500) Troubleshooting Guilherme Correia, Technical Leader, Services Rama

Module 4:Troubleshooting ASR5500

Page 42: Mobile Packet Core (ASR5500)d2zmdbbm9feqrf.cloudfront.net/2016/usa/pdf/BRKSPM-2130.pdfMobile Packet Core (ASR5500) Troubleshooting Guilherme Correia, Technical Leader, Services Rama

© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public

Incident Reporting

• Incident: Issues that are ongoing

• Detailed Problem Description

• Two to three “show support details” (SSDs) output, 5 – 10 minutes a part during the problem

• Multiple monitor subscriber output, if user is unknown, do “monitor subscriber next-call“

• Pcap is also good to have

BRKSPM-2130 42

Page 43: Mobile Packet Core (ASR5500)d2zmdbbm9feqrf.cloudfront.net/2016/usa/pdf/BRKSPM-2130.pdfMobile Packet Core (ASR5500) Troubleshooting Guilherme Correia, Technical Leader, Services Rama

© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public

Introduction to the SSD: show support-details

Can contain more than 4000 commands – equivalent to “show tech”

Allows the CSE to understand the current status of the chassis

Hardware

Resources (CPU/Memory)

Service Statistics

Configuration

When opening a Service Request with HTTS/TAC, it is mandatory to attach the SSD to the case.

BRKSPM-2130 43

Page 44: Mobile Packet Core (ASR5500)d2zmdbbm9feqrf.cloudfront.net/2016/usa/pdf/BRKSPM-2130.pdfMobile Packet Core (ASR5500) Troubleshooting Guilherme Correia, Technical Leader, Services Rama

ASR5500 Overview

LAB DEMO:

• Hardware and Software Checks

• Monitor subscriber

Page 45: Mobile Packet Core (ASR5500)d2zmdbbm9feqrf.cloudfront.net/2016/usa/pdf/BRKSPM-2130.pdfMobile Packet Core (ASR5500) Troubleshooting Guilherme Correia, Technical Leader, Services Rama

© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public

Health Checks - Hardware

show card table • Cards states (Active/Standby/Booting)

• SPOF

show card diag <card num> • Card Diagnostics (Good/Fail)

• Last Failure (Time/Cause)

show card info <card number> • Current State/Desired State

• Session Busy/Out

show cpu errors card <card number> Control Plane Network Errors/Drops (Back Pressure)

show cpu table CPU/Memory Utilization (Current/5 Minutes/15

minutes)

show rct stats show recovery task history for card failures

BRKSPM-2130 45

Page 46: Mobile Packet Core (ASR5500)d2zmdbbm9feqrf.cloudfront.net/2016/usa/pdf/BRKSPM-2130.pdfMobile Packet Core (ASR5500) Troubleshooting Guilherme Correia, Technical Leader, Services Rama

© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public

Health Checks - Hardware

show port table • Port states (Active/Standby)

• Admin/Oper State (Enabled/Disabled)/(Up/Down)

(Hardware/VLAN Only)

• LAG Status

show port utilization table • Average Port Utilization (mbps)

show port datalink counters • Physical port counters (Tx/Rx)

show port npu counters • NPU processed port counters (Tx/Rx)

• Can specify vlan for specific counters

show port info Port details: MAC, LAG, VLANS, Duplex/Speed settings

etc…

show ip interface summary Context level; shows ip interface status

BRKSPM-2130 46

Page 47: Mobile Packet Core (ASR5500)d2zmdbbm9feqrf.cloudfront.net/2016/usa/pdf/BRKSPM-2130.pdfMobile Packet Core (ASR5500) Troubleshooting Guilherme Correia, Technical Leader, Services Rama

© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public

Health Checks - Software

show task resources

show task resources | grep –v good

show task resources max

• Task memory and CPU utilization, Look for any

task in over or warn state

• The “max” option shows the maximum resources

used since boot

show task table Lists all tasks and their parent tasks

show resources • High level overview of chassis utilization and

capacity, tracks max utilization per service with

timestamp

show crash list • List of crashes with timestamp and related task

BRKSPM-2130 47

Page 48: Mobile Packet Core (ASR5500)d2zmdbbm9feqrf.cloudfront.net/2016/usa/pdf/BRKSPM-2130.pdfMobile Packet Core (ASR5500) Troubleshooting Guilherme Correia, Technical Leader, Services Rama

© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public

Health Checks - Software[pgw]ASR5500-1# show pgw-service statistics all

VPN Name: pgw

Subscribers Total:

Active: 60

S6b Assume Positive: 0

Current PDNs By RAT-Type:

EUTRAN: 120 UTRAN: 0

GERAN: 0 WLAN: 0

OTHER: 0

PDNs Rejected By Reason:

No Resource: 0 Missing or unknown APN: 0

APN sel-Mode mismatch: 0 PDN-Type not supported: 0

APN restr violation: 0 Subs auth failed: 0

static addr not allow: 0 static addr not alloc: 0

Dynamic addr not alloc: 0 static addr not present: 0

Invalid QCI Value: 0

BRKSPM-2130 48

Page 49: Mobile Packet Core (ASR5500)d2zmdbbm9feqrf.cloudfront.net/2016/usa/pdf/BRKSPM-2130.pdfMobile Packet Core (ASR5500) Troubleshooting Guilherme Correia, Technical Leader, Services Rama

© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public

Health Checks - Software

• Many protocol level statistics available, normally found with “show <protocol> statistics

[local]ASR5500-1# show egtpc statistics

Tunnel Management Messages:

Create Session Request:

Total TX: 0 Total RX: 0

Initial TX: 0 Initial RX: 0

Retrans TX: 0 Retrans RX: 0

Discarded: 0

No Rsp RX: 0

Create Session Response:

Total TX: 0 Total RX: 0

Initial TX: 0 Initial RX: 0

Accepted: 0 Accepted: 0

Denied: 0 Denied: 0

Retrans TX: 0 Discarded: 0

Modify Bearer Request:

Total TX: 0 Total RX: 0

BRKSPM-2130 49

Page 50: Mobile Packet Core (ASR5500)d2zmdbbm9feqrf.cloudfront.net/2016/usa/pdf/BRKSPM-2130.pdfMobile Packet Core (ASR5500) Troubleshooting Guilherme Correia, Technical Leader, Services Rama

© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public

Health Checks - Software

show subscriber summary • Overall summary stats on all subscribers

show sub full <options> • Detailed information about subscriber

• Data/Policies/AAA/Nodes/IP Data

show subscriber data-rate • Subscriber data rates per sub/apn etc…

show active-charging sessions full <options> • Subscriber related active charging data per sub

show active-charging flows <options> • Flows per subscriber

show session disconnect-reasons • Summarizes total number of disconnect types

show subscriber debug-info <options> • Displays internal call troubleshooting information for

subscriber sessions

BRKSPM-2130 50

Page 51: Mobile Packet Core (ASR5500)d2zmdbbm9feqrf.cloudfront.net/2016/usa/pdf/BRKSPM-2130.pdfMobile Packet Core (ASR5500) Troubleshooting Guilherme Correia, Technical Leader, Services Rama

© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public

Health Checks - Software[pgw]ASR5500-1# show sub debug-info username 22331010101018@cisco

username: 22331010101018@cisco callid: 2ffba180 msid: 311481170000008

Card/Cpu: 1/0

Sessmgr Instance: 162

Primary callline:

Redundancy Status: Original Session

Checkpoints Attempts Success Last-Attempt Last-Success

Full: 1 0 26400ms 0ms

Micro: 1 1 26400ms 26400ms

GR Checkpoints Sent

0 Full Checkpoints

0 Micro Checkpoints

Current number of NAT flows checkpointed: 0

Current state: SMGR_STATE_CONNECTED

FSM Event trace:

State Event Num Occurances Time

SMGR_STATE_OPEN SMGR_EVT_NEWCALL (1) 2014-09-14:16:17:35

SMGR_STATE_NEWCALL_ARRIVED SMGR_EVT_IPADDR_ALLOC_SUCCESS (1) 2014-09-14:16:17:35

SMGR_STATE_NEWCALL_ARRIVED SMGR_EVT_ANSWER_CALL (1) 2014-09-14:16:17:35

SMGR_STATE_NEWCALL_ANSWERED SMGR_EVT_LINE_CONNECTED (1) 2014-09-14:16:17:35

SMGR_STATE_LINE_CONNECTED SMGR_EVT_LOWER_LAYER_UP (1) 2014-09-14:16:17:35

CLP State Trace:

State EBI's Associated Time

SMGR_CLP_EVT_PGW_CREATE_SESSION_REQ 5 - - - - - - - - - - 2014-09-14:16:17:35

CLI_MAPPED_SMGR_SEF_BIND - - - - - - - - - - - 2014-09-14:16:17:35

Card/CPU and Sessmgr UE is

attached to

Event trace

BRKSPM-2130 51

Page 52: Mobile Packet Core (ASR5500)d2zmdbbm9feqrf.cloudfront.net/2016/usa/pdf/BRKSPM-2130.pdfMobile Packet Core (ASR5500) Troubleshooting Guilherme Correia, Technical Leader, Services Rama

© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public

Health Checks – Software

show snmp trap history verbose • Displays last

• SNMP traps generated

show logs • Long log buffer of latest events on the chassis

show alarm outstanding • Lists output of ongoing chassis issues

show configuration errors • Lists incomplete or missing configuration

BRKSPM-2130 52

Page 53: Mobile Packet Core (ASR5500)d2zmdbbm9feqrf.cloudfront.net/2016/usa/pdf/BRKSPM-2130.pdfMobile Packet Core (ASR5500) Troubleshooting Guilherme Correia, Technical Leader, Services Rama

© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public

Monitor Subscriber

Detailed information on subscriber related messaging

Capture by Username/IMSI/MSISDN/MSID/Call ID etc…

Good to have both bad and good examples during issue

Always gather a mon sub of verbosity 3

[local]MAG-MME-1# monitor subscriber imsi 25001638855553…

Monday June 23 2014

INBOUND>>>>> 09:49:41:766 Eventid:88112(0)

===>GPRS Mobility/Session Management Message (3 Bytes)

Protocol Discriminator : GMM message

0000 .... : Skip Indicator : (0)

.... 1000 : Protocol Discriminator : (8)

Message Type: 0x13 (19)

Message : Authentication and ciphering Response

Spare Nibble

A&C Reference Number : 0x0 (0)

0x0000 0813 00 ...

Monday June 23 2014

<<<<OUTBOUND 09:49:41:766 Eventid:88113(0)

===>GPRS Mobility/Session Management Message (30 Bytes)

Protocol Discriminator : GMM message

0000 .... : Skip Indicator : (0)

.... 1000 : Protocol Discriminator : (8)

Message Type: 0x9 (9)

Message : Routing Area Update Accept

BRKSPM-2130 53

Page 54: Mobile Packet Core (ASR5500)d2zmdbbm9feqrf.cloudfront.net/2016/usa/pdf/BRKSPM-2130.pdfMobile Packet Core (ASR5500) Troubleshooting Guilherme Correia, Technical Leader, Services Rama

© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public

Monitor Subscriber (some options)

The following options are often useful

19, A, X – Enabled User L3 traffic with Hex/ASCII Output of packet

Y Multi-Call trace for multiple APNs

S – Sender info, the sessmgr managing the call

L – Limit the context for call capturing

BRKSPM-2130 54

Page 55: Mobile Packet Core (ASR5500)d2zmdbbm9feqrf.cloudfront.net/2016/usa/pdf/BRKSPM-2130.pdfMobile Packet Core (ASR5500) Troubleshooting Guilherme Correia, Technical Leader, Services Rama

© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public

Trace Logging (connected calls only)

[local]ASR5500-1# logging trace msid 355551191000002

Added tracing to 4 calls

2014-Sep-10+00:09:02.845 [sessmgr 11285 debug] [9/0/5864 <sessmgr:144> smgr_pcc_intf.c:1894]

[callid 2a9e56f1] [software internal user syslog] PCC received SEF_EVT_DATA_PACKET_IND

completed For Transaction id: 0 Event SEF_EVT_DATA_PACKET_IND from <SEf>

2014-Sep-10+00:09:02.845 [css 77202 debug] [9/0/5864 <sessmgr:144> acsmgr_rules.c:20926]

[callid 2a9e56f1] [software internal user protocol-log syslog] Rule matched : corporate for uplink

packet of subscriber MSID : 35555551191000002

2014-Sep-10+00:09:02.845 [acsmgr 91025 trace] [9/0/5864 <sessmgr:144> acsmgr_rules.c:20792]

[callid 2a9e56f1] [context: billing, contextID: 5] [software internal user syslog] ruledef: corporate

matches for service pgw-ecs

BRKSPM-2130 55

Page 56: Mobile Packet Core (ASR5500)d2zmdbbm9feqrf.cloudfront.net/2016/usa/pdf/BRKSPM-2130.pdfMobile Packet Core (ASR5500) Troubleshooting Guilherme Correia, Technical Leader, Services Rama

Cisco ASR5000/ASR5500 Troubleshooting Guide

Page 57: Mobile Packet Core (ASR5500)d2zmdbbm9feqrf.cloudfront.net/2016/usa/pdf/BRKSPM-2130.pdfMobile Packet Core (ASR5500) Troubleshooting Guilherme Correia, Technical Leader, Services Rama

© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public

Cisco ASR5000/ASR5500 Troubleshooting Guide

Free for download from cisco.com

https://supportforums.cisco.com/sites/default/files/cisco_asr5000_asr5500_troubleshooting_guide.pdf

BRKSPM-2130 57

Page 58: Mobile Packet Core (ASR5500)d2zmdbbm9feqrf.cloudfront.net/2016/usa/pdf/BRKSPM-2130.pdfMobile Packet Core (ASR5500) Troubleshooting Guilherme Correia, Technical Leader, Services Rama

© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public

Continue Your Education

• Demos in the Cisco campus

• Walk-in Self-Paced Labs

• Table Topics

• Meet the Engineer 1:1 meetings

• Related sessions

BRKSPM-2130 58

Page 59: Mobile Packet Core (ASR5500)d2zmdbbm9feqrf.cloudfront.net/2016/usa/pdf/BRKSPM-2130.pdfMobile Packet Core (ASR5500) Troubleshooting Guilherme Correia, Technical Leader, Services Rama

© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public

Session ID Time Session Title Speakers

Sunday (10 July 2016)

LTRSPM-2022 01:00 – 05:00 PM Virtual Packet Core Orchestration: Spring to Life Gateways and Services Julie Ann Connary, Amir Ahmadi

Monday (11 July 2016)

BRKSPM-2125 08:00 - 10:00 AM Virtualizing Cisco Mobile Packet Core Aeneas Dodd-Noble, Vivek Agarwal

BRKSPM-2071 01:00 - 03:00 PM 5G Technology Updates Paul Polakos, Prakash Suthar

BRKSPM-2029 04:00 – 05:30 PM Optimizing NFV Performance Ali Bokhari

BRKSPM-2022 04:00 – 05:30 PM Using Telco NFV to Deploy Mobility Networks Dave Clough

BRKSPM-2130 04:00 – 05:30 PM Mobile Packet Core (ASR5500) Troubleshooting Guilherme Correia, Rama Ramachandran

Tuesday (12 July 2016)

BRKSPM-2128 08:00 - 10:00 AM Radio Access Network Virtualization Mark Grayson, Oliver Bull

BRKSPM-2026 01:30 - 03:00 PM AT&T Case study for Managing Customer Experience in Mobile Networks Jeronimo Diez De Sollano, Anwin Kallumpurath

BRKSPM-2065 04:00 – 05:30 PM Mobile and Enterprise Security for the Age of Ubiquitous Encryption Humberto La Roche, Christopher ORourke

BRKSPM-2127 04:00 – 05:30 PM Design & Deploying Trusted and Un-Trusted VoWiFi Venkata Reddy Kasu, Arun Gunasekaran

Wednesday (13 July 2016)

BRKSPM-2129 08:00 - 10:00 AM Deploying 4G/LTE branch routers for IOT solutions Vivek Datar, David Mindel

PLNSPM-2021 01:30 – 03:00 PM Network Infrastructure and Operation Transformation Anand Malani, Scott Clark, Vilma Stoss, Rich Plane, Mark Ghattas (Moderator)

BRKSPM-2028 04:00 – 05:30 PM Design and Deployment of Overlay Services on LTE Network Tom Redman

BRKSPM-2122 04:00 – 05:30 PM Virtualizing Mobile Service Providers Transport Network Ravi Narahari, Abbas Abidi

Thursday (14 July 2016)

BRKSPM-2121 08:00 - 10:00 AM Cisco SON and Advanced Analytics Oliver Bull, Ashish Bansal

BRKSPM-2126 04:00 – 05:30 PM Analytics for Large Connected Venues: App Integration with Wi-Fi Infrastructure Matt Swartz, Joshua Suhr

PSOSPM-2505 01:00 – 02:00 PM Cisco Hosted Mobility (Mobility as a Service) Mike Shomaker

WISP Lab (11-14 July)

LABSPM-2011 10:00 - 6:00 PM Cisco Virtualized Packet Core Installation on VMware Amir Ahmadi, William Pedraza

LABSPM-2012 10:00 - 6:00 PM Cisco Virtualized Packet Core Installation on Openstack Christopher Ove, Guilherme Correia

BRKSPM-2130 59

Page 60: Mobile Packet Core (ASR5500)d2zmdbbm9feqrf.cloudfront.net/2016/usa/pdf/BRKSPM-2130.pdfMobile Packet Core (ASR5500) Troubleshooting Guilherme Correia, Technical Leader, Services Rama

Please join us for the Service Provider Innovation Talk featuring:

Yvette Kanouff | Senior Vice President and General Manager, SP Business

Joe Cozzolino | Senior Vice President, Cisco Services

Thursday, July 14th, 2016

11:30 am - 12:30pm, In the Oceanside A room

What to expect from this innovation talk

• Insights on market trends and forecasts

• Preview of key technologies and capabilities

• Innovative demonstrations of the latest and greatest products

• Better understanding of how Cisco can help you succeed

Register to attend the session live now or

watch the broadcast on cisco.com

Page 61: Mobile Packet Core (ASR5500)d2zmdbbm9feqrf.cloudfront.net/2016/usa/pdf/BRKSPM-2130.pdfMobile Packet Core (ASR5500) Troubleshooting Guilherme Correia, Technical Leader, Services Rama

© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public

Complete Your Online Session Evaluation

Don’t forget: Cisco Live sessions will be available for viewing on-demand after the event at CiscoLive.com/Online

• Give us your feedback to be entered into a Daily Survey Drawing. A daily winner will receive a $750 Amazon gift card.

• Complete your session surveys through the Cisco Live mobile app or from the Session Catalog on CiscoLive.com/us.

BRKSPM-2130 61

Page 62: Mobile Packet Core (ASR5500)d2zmdbbm9feqrf.cloudfront.net/2016/usa/pdf/BRKSPM-2130.pdfMobile Packet Core (ASR5500) Troubleshooting Guilherme Correia, Technical Leader, Services Rama

© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public

Continue Your Education

• Demos in the Cisco campus

• Walk-in Self-Paced Labs

• Lunch & Learn

• Meet the Engineer 1:1 meetings

• Related sessions

BRKSPM-2130 62

Page 63: Mobile Packet Core (ASR5500)d2zmdbbm9feqrf.cloudfront.net/2016/usa/pdf/BRKSPM-2130.pdfMobile Packet Core (ASR5500) Troubleshooting Guilherme Correia, Technical Leader, Services Rama

Thank you

Page 64: Mobile Packet Core (ASR5500)d2zmdbbm9feqrf.cloudfront.net/2016/usa/pdf/BRKSPM-2130.pdfMobile Packet Core (ASR5500) Troubleshooting Guilherme Correia, Technical Leader, Services Rama

© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public

Session ID Time Session Title Speakers

Sunday (10 July 2016)

LTRSPM-2022 01:00 – 05:00 PM Virtual Packet Core Orchestration: Spring to Life Gateways and Services Julie Ann Connary, Amir Ahmadi

Monday (11 July 2016)

BRKSPM-2125 08:00 - 10:00 AM Virtualizing Cisco Mobile Packet Core Aeneas Dodd-Noble, Vivek Agarwal

BRKSPM-2071 01:00 - 03:00 PM 5G Technology Updates and ICN Demonstration Paul Polakos, Prakash Suthar, Giovanna Carofiglio

BRKSPM-2029 04:00 – 05:30 PM Optimizing NFV Performance Ali Bokhari, Sean Merrow

BRKSPM-2022 04:00 – 05:30 PM Using Telco NFV to Deploy Mobility Networks Dave Clough

Tuesday (12 July 2016)

BRKSPM-2128 08:00 - 10:00 AM Radio Access Network Virtualization Mark Grayson, Oliver Bull

BRKSPM-2026 01:00 - 03:00 PM Managing Customer Experience for Mobile Networks Jeronimo Diez De Sollano, Daryl Huynh

BRKSPM-2065 04:00 – 05:30 PM Mobile and Enterprise Security for the Age of Ubiquitous Encryption Humberto La Roche, Christopher ORourke

BRKSPM-2127 04:00 – 05:30 PM Design & Deploying Trusted and Un-Trusted VoWiFi Venkata Reddy Kasu, Arun Gunasekaran

Wednesday (13 July 2016)

BRKSPM-2129 08:00 - 10:00 AM Deploying 4G/LTE branch routers for IOT solutions Anand Jayaraman, Vivek Datar

PLNSPM-2021 01:30 – 03:00 PM SP Infrastructure and Operation Transformation

Anand Malani, Scott Clark, Sunil Kripalani, Vilma Stoss, Mark Ghattas

(Moderator)

BRKSPM-2028 04:00 – 05:30 PM Design and Deployment of Overlay Services on LTE Network Tom Redman

BRKSPM-2122 04:00 – 05:30 PM Virtualizing Mobile Service Providers Transport Network Ravi Narahari, Abbas Abidi

Thursday (14 July 2016)

BRKSPM-2121 08:00 - 10:00 AM Cisco SON and Advanced Analytics Oliver Bull, Ashish Bansal

BRKSPM-2126 04:00 – 05:30 PM

Analytics for Large Connected Venues: App Integration with Wi-Fi

Infrastructure Matt Swartz, Joshua Suhr

WISP Lab (11-14 July)

LABSPM-2011 8:00 - 5:00 PM Cisco Virtualized Packet Core Installation on VMware Amir Ahmadi, William Pedraza

LABSPM-2012 8:00 - 5:00 PM Cisco Virtualized Packet Core Installation on Openstack Christopher Ove, Guilherme Correia

BRKSPM-2130 64

Page 65: Mobile Packet Core (ASR5500)d2zmdbbm9feqrf.cloudfront.net/2016/usa/pdf/BRKSPM-2130.pdfMobile Packet Core (ASR5500) Troubleshooting Guilherme Correia, Technical Leader, Services Rama
Page 66: Mobile Packet Core (ASR5500)d2zmdbbm9feqrf.cloudfront.net/2016/usa/pdf/BRKSPM-2130.pdfMobile Packet Core (ASR5500) Troubleshooting Guilherme Correia, Technical Leader, Services Rama

© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public

Acronyms• RAR – Re-Authorization Request

• RAA - Re-Authorization Answer

• AAR - Authorization Authentication Request

• AAA – Authorization Authentication Answer

• STR – Session Termination Request

• STA – Session Termination Answer

• ASR – Abort Session Request

• ASA – Aborst Session Answer

• CER/CEA – Capabilities Exchange Request/Capabilities Exchange Answer

• PBU – Proxy Binding Update

BRKSPM-2130 66

Page 67: Mobile Packet Core (ASR5500)d2zmdbbm9feqrf.cloudfront.net/2016/usa/pdf/BRKSPM-2130.pdfMobile Packet Core (ASR5500) Troubleshooting Guilherme Correia, Technical Leader, Services Rama

© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public

Acronyms• SaMOG – S2a Mobility over GTPv2

• MRME – Multi-Radio Management Entity

• CGW – Converged Access Gateway

• TWAN – Trusted WLAN Access Network

• TWAP – Trusted WLAN AAA Proxy

• TWAG – Trusted WLAN Acess Gateway

• LBO – Local Breakout

• LEMF – Law Enforcement Monitoring Facility

• EPC – Evolved Packet Core

• AAA - Authentication, Authorization, and Accounting

BRKSPM-2130 67

Page 68: Mobile Packet Core (ASR5500)d2zmdbbm9feqrf.cloudfront.net/2016/usa/pdf/BRKSPM-2130.pdfMobile Packet Core (ASR5500) Troubleshooting Guilherme Correia, Technical Leader, Services Rama

© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public

Acronyms (Continue…)• PGW - PDN Gateway

• PMIPv6 - Proxy Mobile IP version 6

• GTP – GPRS Tunneling Protocol

• EAP – Extensible Authentication Protocol

• NAI – Network Access Identifier

• DNS – Domain Name Service

• PDN – Packet Data Network

• DER – Diameter EAP Request

• DEA – Diameter EAP Answer

• MD – Mediation Device

BRKSPM-2130 68

Page 69: Mobile Packet Core (ASR5500)d2zmdbbm9feqrf.cloudfront.net/2016/usa/pdf/BRKSPM-2130.pdfMobile Packet Core (ASR5500) Troubleshooting Guilherme Correia, Technical Leader, Services Rama

© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public

Tasks and FunctionsTask Name Description Function

Sitmain (SIT) System Initiation Task - Main • Initiated at system startup.

• Provides startup configuration to other SIT components.

• Starts SITREAP sub-function.

• Maintains CPU state information.

sitparent (SIT) SIT Parent sub-function • Starts management cards in active/standby mode.

• Registers tasks with HAT task.

• Notifies CSP task of CPU startup configuration.

• Brings up DPCs in standby mode.

sitreap (SIT) SIT Reap sub-function • Shuts down tasks as required.

hatcpu (HAT) High Availability Task CPU • Device initialization and control functions.

• Reports loss of any task on its CPU to hatsystem sub-function.

• Controls LEDs on the DPCs.

• Initializes and monitors hardware on DPC.

• Collects CPU monitoring information and reports to hatsystem.

hatsystem (HAT) High Availability Task System Controller • Controls all the HAT sub-function in the system. Initialized on startup.

• Initializes Switch Fabric and Internal Ethernet switch.

• Monitors system components such as fans for state changes.

• Triggers action for redundancy in the event of fault detection.

• The HAT subsystem on the redundant management card mirrors the HAT subsystem on the active

management card.

rmctrl (RM) Resource Manager Controller • Started by the sitparent task on startup and monitored by HAT for a failure.

• Initializes resources such as CPUs and memory.

• Requests updated card status from the CSP subsystem and updates the system card table.

• Communicates with all rmctrls and requests their latest set of resource data.

BRKSPM-2130 69

Page 70: Mobile Packet Core (ASR5500)d2zmdbbm9feqrf.cloudfront.net/2016/usa/pdf/BRKSPM-2130.pdfMobile Packet Core (ASR5500) Troubleshooting Guilherme Correia, Technical Leader, Services Rama

© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public

Tasks and FunctionsTask Name Description Function

rmmgr (RM) Resource Manager Managers • Started by the sitparent task and monitored by HAT for a failure

• Initializes the local resource data and scratch space.

• Communicates with SIT task on the local CPY to get its entire task table and associated resources.

• Gathers current resource utilization for each task.

• Sends the resource data to the rmctrl task.

vpnctrl (VPN) VPN Controller • Created at system start-up.

• Initiates the VPN Manager for each context.

• Informs the Session Controller task when there are additions or changes to contexts. One VPN Controller

operates at any one time.

• Routes context specific operation information to the appropriate VPN Manager.

• Performs VPN Manager recover and saves all VPN-related configuration in SCT.

vpnmgr (VPN) VPN Manager • Started by the VPN controller for each configured context – one exists for local context always.

• Performs IP address pool and subscriber IP address Management.

• Performs all context specific operations including but not limited to: IP interfaces, ARP, IP address pool

management, slow path forwarding, NPU flows, port Access Control Lists (ACLs), and logging.

• Provides IP interface address information for each context to the Session Controller.

bgp (VPN) Border Gateway Protocol • Created by VPN Manager for each context that has BGP routing configured.

• Responsible for learning and redistributing routing information via BGP protocol.

• Maintains BGP peer connections and Applies any defined BGP routing policy.

ospf (VPN) Open Shortest Path First • Created by VPN Manager for each context that has OSPF routing configured.

• Responsible for learning and redistributing routing information via OSPF protocol.

• Maintains OSPF neighbor relationships and LSA database.

• Perform SPF calculations.

• Applies any defined OSPF routing policy.

BRKSPM-2130 70

Page 71: Mobile Packet Core (ASR5500)d2zmdbbm9feqrf.cloudfront.net/2016/usa/pdf/BRKSPM-2130.pdfMobile Packet Core (ASR5500) Troubleshooting Guilherme Correia, Technical Leader, Services Rama

© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public

Tasks and FunctionsTask Name Description Function

ospfv3 (VPN) Open Shortest Path First • Created by VPN Manager for each context that has OSPFv3 routing configured.

• Responsible for learning and redistributing routing information via OSPFv3 protocol.

• Maintains OSPFv3 neighbor relationships and LSA database.

• Perform OSPFv3 SPF calculations.

• Applies any defined OSPFv3 routing policy.

rip (VPN) Routing Information Protocol • Created by VPN Manager for each context that has RIP routing configured.

• Responsible for learning and redistributing routing information via RIP protocol.

• Maintains RIP database.

• Sends periodic RIP update messages.

• Applies any defined RIP routing policy.

zebos (VPN) L2 and L3 Switching • Created by VPN Manager for each context .

• Maintains RIB and FIB for the context. Performs static routing.

• Interfaces to the kernel or routing and interface updates.

• Redistributes routing information to dynamic routing protocols

• Calculates next-hop reachability.

knpusim (NPU) Kernel-based NPU Simulator [VPC-DI,

VPC-SI]

• Created at OS Startup. Provides port configuration services to the CSP task.

• Provides interface binding and forwarding services to the VPN Manager.

• Provides flow insertion and removal services to Session Manager and AAA Manager tasks.

• Provides recovery services to the NPU Controller.

npuctrl (NPU) NPU Controller • Created at OS Startup. One NPU Controller in the system at any time.

• Monitors the NPU Manager state.

• Registers to receive notification of NPU Manager crashes.

• Controls recovery operation.

• Provides a central location for CLI commands related to NPU Manager state.

BRKSPM-2130 71

Page 72: Mobile Packet Core (ASR5500)d2zmdbbm9feqrf.cloudfront.net/2016/usa/pdf/BRKSPM-2130.pdfMobile Packet Core (ASR5500) Troubleshooting Guilherme Correia, Technical Leader, Services Rama

© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public

Tasks and FunctionsTask Name Description Function

npusim (NPU) NPU Simulator [ASR 5500] • Created for every DPC installed and started.

• Provides port configuration services to the CSP Task.

• Provides interface binding and forwarding services to the VPN Manager..

• Provides flow insertion and removal services to Session Manager and AAA Manager tasks.

• Provides recovery services to the NPU Controller.

sessctrl (SM) Session Controller • Created at OS Startup. Session Controller maintained in the system at any point of time.

• Primary contact point for the Session subsystem and acts as a proxy for the subsystem.

• Starts, configures and coordinates the Session Processing subsystem – sub-managers.

• Works with Resource Manager to start new Session Managers instances when limits are reached.

• Receives context Information from VPN Managers.

• Distributes IP interface address information to other Session Processing Subsystem

• Manages Enhanced Charging Services (ECS), Content Filtering and URL Blacklisting services.

sessmgr (SM) Session Manager • Created by Session Controller. Paired with AAA Managers.

• Provides a subscriber processing system that supports multiple session types.

• Multiple Session Managers per CPU. Operates in a distributed processing system.

• Processes protocols for A10/A11, GRE, GTPu/GTPc, PPP and Mobile IP.

• A single Session Manager can service sessions from multiple input Session Handlers.

aaamgr (SM) Authorization, Authentication and

Accounting (AAA) Manager

• Paired with Session Managers.

• Performs AAA protocol operations and functions for subscribers and administrative users in the system.

• Acts as AAA client to AAA servers.

• Managers GTP Prime messaging with Charging Gateway functions (CGFs).

• Multiple AAA Managers can run on a single CPU and can be distributed throughout any CPU in the

system.

• AAA operations for CLI are done through AAA Manager running on the active management card.

BRKSPM-2130 72

Page 73: Mobile Packet Core (ASR5500)d2zmdbbm9feqrf.cloudfront.net/2016/usa/pdf/BRKSPM-2130.pdfMobile Packet Core (ASR5500) Troubleshooting Guilherme Correia, Technical Leader, Services Rama

© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public

Tasks and FunctionsTask Name Description Function

aaaproxy (SM) Authorization, Authentication and

Accounting (AAA) Proxy Manager

• Starts when Global Config gtpp single-source is configured. Uses single UDP source port instead of one

port for each AAA Manager with a unique source port.

• Runs on demux card when session recovery is enabled or when require demux card is configured.

• Writes CDRs to a file in VRAM-disk. The enqueued CDRs are then periodically transferred to disk.

acsctrl (SM) Active Charging System (ACS)

Controller

• Starts when active-charging service CLI command is configured.

• Runs on the primary DPC and manages ACS service – reads/writes ACS config into SCT.

• Monitors recovery process and cleanup.

acsmgr (SM) Active Charging System (ACS) Manager • Created by ACS Controller for IP Session processing.

• Sends and receives data through Session Managers.

• Active/Standby tasks created only when session recovery is enabled.

cdrmod (SM) Charging Detail Record Module • Responsible for receiving EDR/UDR records from different ACSMGR instances in the system.

• Responsible for writing records in files using file naming conventions and formats.

diamproxy (SM) Diameter Proxy • Created by diactrl (which runs as part of vpnctrl). Number of tasks depends on configuration of single or

multiple proxies. If it is diamproxy single – one diamproxy task created and runs in demux card. Multiple

proxies will spawn one diamproxy per active DPC card that is not demux.

• Maintains diameter base connections to all peers configured in the system.

• Informs applications on connection states.

• Acts as a pass-through for messages from the application to server- acts as a forwarding agent.

• A single Diameter proxy is used to service multiple diameter applications.

egtpemgr (SM) Enhanced GPRS Tunneling Protocol

Egress Manager

• Created by session controller for each context in which an egtp-service interface-type sgw-egress or

MME is configured. Handles certain EGTP messages from SGW, PGW.

• Maintains a list current EGTP sessions.

• Maintains list of current Session Manager tasks which aids in session recovery.

• Handles GTP Echo messaging.

BRKSPM-2130 73

Page 74: Mobile Packet Core (ASR5500)d2zmdbbm9feqrf.cloudfront.net/2016/usa/pdf/BRKSPM-2130.pdfMobile Packet Core (ASR5500) Troubleshooting Guilherme Correia, Technical Leader, Services Rama

© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public

Tasks and FunctionsTask Name Description Function

egtpimgr (SM) Enhanced GPRS Tunneling Protocol

Ingress Manager

• Created by session controller for each context in which an egtp-service interface-type sgw-ingress or

pgw-ingress is configured.

• Receives EGTP sessions from MME/S4 SGSN/SGW and distributes them to different Session Manager

Tasks for load balancing.

• Maintains a list current EGTP sessions. Handles GTP Echo messaging.

• Maintains list of current Session Manager tasks which aids in session recovery

imsimgr (SM) International Mobile Subscriber Identity

Manager for MME

• Starts when MME service is configured. One instance per system.

• Selects sessmgr to use for new subscriber session.

• Maintains and reports MME-related demux statistics such as Attach by IMSI and Attach by GUTI.

• Interacts with sessctrl, mmemgr and sessmgr tasks.

l2tpdemux (SM) L2TP Demux Task • Created by Session Controller when LNS service is created. One task per system.

• De-mux and forwards new tunnel create requests to L2TPmgrs

• Load balance requests among multiple L2TPmgrs.

l2tpmgr (SM) Layer 2 Tunneling Protocol Manager • Created by Session Controller for each context in which LAC or LNS is configured.

• Responsible for all L2TP processing. Maintains protocol state machine for L2TP sessions and tunnels.

• Triggers IPSec encryption for new L2TP tunnels as needed.

mmedemux (SM) Mobility Management Entity Demux

Manager.

• Started as part of MME service creation procedure. One mmedemux task per chassis.

• Distributes incoming S1-MME SCTP connections to mmemgr tasks in the system.

• Remains aware of all MME services in the system.

mmemgr (SM) Mobility Management Entity Manager • Starts when MME service configuration is detected. There can be multiple instances to load balance

sessions. Contains identical configuration in each instance.

• Runs SCTP stack. Handles SCTP associations.

• Maintains TA list. Manages eNodeB database. Provides S1-MME protocol nodal functions.

BRKSPM-2130 74

Page 75: Mobile Packet Core (ASR5500)d2zmdbbm9feqrf.cloudfront.net/2016/usa/pdf/BRKSPM-2130.pdfMobile Packet Core (ASR5500) Troubleshooting Guilherme Correia, Technical Leader, Services Rama

© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public

Tasks and FunctionsTask Name Description Function

afctrl (Platform) ASR5500 Fabric Controller • Responsible for the overall management of the system fabric.

• Manages the pool of Rendezvous Destinations and coordinates fabric recovery by the afmgr proclets

after a fault

• A single afctrl instance runs on the active MIO/UMIO only.

afmgr (Platform) ASR5500 Fabric Manager • Responsible for the management of fabric resources on a particular card.

• There is one afmgr on every CPU that is responsible for one or more fabric access processors (FAPs) or

fabric elements (FEs).

• afmgr supports recovery but not migration.

afio (Platform) ASR5500 Fabric driver • Responsible for the direct configuration of the fabric chipset. afio supports non-messenger inter-process

communication (IPC) with the local afmgr and with other local afio instances

connproxy

(Platform)

TCP/SCTP connection proxy • Allows applications on any card to share the same TCP/SCTP connection to the same remote endpoint

instead of opening a new connection for each application on the card.

cspctrl (Platform) Card-Slot-Port Controller. • Manages physical chassis components.

dhmgr (Platform) Distributed Host Manager • Started automatically by SITPARENT.

• Coordinates establishment of locally terminated TCP, SCTP, and UDP connections on behalf of multi-

instanced tasks such as Diameter endpoints among sessmgr tasks..

hdctrl (Platform) Hard Drive Controller • Controls and manages the drive array spanning the management cards.

hwctrl (Platform) Hardware Controller • The hwctrl task has several timers that manage polling loops for hardware sensor readings, sensor

threshold monitoring, and fan tray monitoring.

hwmgr (Platform) Hardware Manager • The hwmgr task runs on all cards to read local hardware sensors and report them back to the hwctrl.

BRKSPM-2130 75

Page 76: Mobile Packet Core (ASR5500)d2zmdbbm9feqrf.cloudfront.net/2016/usa/pdf/BRKSPM-2130.pdfMobile Packet Core (ASR5500) Troubleshooting Guilherme Correia, Technical Leader, Services Rama

© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public

Tasks and FunctionsTask Name Description Function

ipsecctrl (Platform) IPSec Controller • Started by SIT regardless of configuration.

• Started ipsecmgr tasks based on configuration and maintains its list for task recovery.

• Receives and maintains user configuration for IPSec/

• Manages the configured IPSec crypto maps and its assignment to ipsecmgrs.

• Interfaces with vpnmgr task for required IPSec configuration parameters such as IP Access Lists, IP

Pools, interface address and interface state notifications.

ipsecmgr (Platform) IPSec Manager • Created by ipsecctrl. Establishes and manages secure IKEv1, IKEv2 and IPSec data tunnels.

lagmgr (Platform) Link Aggregation Group Manager • Started by npuctrl on MIO with a facility level between CSP and npumgr to receive configuration/status

notification and build global LAG database.

• Exchanges control packets (LACP and Marker) over configured physical ports with peers to reach

agreement on aggregation of links.

msgd (Platform) Messenger Daemon • Implements the Name Service and related functions for the internal message passing system.

msgproxy (Platform) Message Proxy. • The Messenger Proxy process handles broadcast messages send from any single application (referred to

as a client) to any facility which has one instance per thread (referred to as the Target Facility).

• One msgproxy task runs on each CPU on DPCs and SF Virtual Machine (VPC-DI).

• Processes incoming broadcast messages from the Client processes, such as sessctrl, distributes them to

the correct Target Facility, such as sessmgr, creates the correct responses and sends them back to the

correct Client.

nscontrol (Platform) Name Service Controller • Provides a reliable channel for tasks to send control messages to the Messenger Daemon.

rct (Platform) Recovery Control Task • Monitors tasks/managers/facilities across the system and performs recovery in the event of a failure.

sct (Platform) Shared Configuration Task • Performs the redundant storage of configuration information and state information in memory database.

Sft (Platform) Switch Fabric Task • Monitors the switch fabric and the gigabit Ethernet control plane.

BRKSPM-2130 76

Page 77: Mobile Packet Core (ASR5500)d2zmdbbm9feqrf.cloudfront.net/2016/usa/pdf/BRKSPM-2130.pdfMobile Packet Core (ASR5500) Troubleshooting Guilherme Correia, Technical Leader, Services Rama

© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public

Tasks and FunctionsTask Name Description Function

bulkstat

(Management)

Bulk Statistics Manager • Periodically polls and gathers bulk statistics and transfers this data to external management

systems.

evlogd

(Management)

Event Log Daemon • Handles event logging functions including the interface to external syslogd servers and

internal event logs.

orbs (Management) ORBEM Service • The orbs task is also known as the ORB Element Manager (ORBEM).

• An Element Management System (EMS) requests orbs to perform Element Management

Functions on the system using secure IIOP. ORBS then interacts with concerned Controller

Tasks to execute the function.

• The response/errors from the execution are interpreted, formulated into an EMF response,

and handed off to EMS servers.

orbns

(Management)

Messenger Daemon • Notifies EMS Servers of event occurrences.

• Registers EMS Servers and subscribes them to associated event types.

sesstrc

(Management)

Session Trace collection task • Implements the standards-based session trace functionality.

• Manages both CLI and signaling-based subscriber traces. It collects messages to be traced

and generates trace files as needed. It uploads trace files to the Trace Collection Entity as

needed.

snmp

(Management)

Simple Network Management

Protocol

• Handles inboard SNMP operations if configured, and sends SNMP notifications (traps) if

enabled.

threshold

(Management)

Threshold Server • Handles monitoring of threshold crossing alerts, if configured. Polls statistics/variables,

maintains state, and generates log messages/SNMP notification of threshold crossings.

BRKSPM-2130 77

Page 78: Mobile Packet Core (ASR5500)d2zmdbbm9feqrf.cloudfront.net/2016/usa/pdf/BRKSPM-2130.pdfMobile Packet Core (ASR5500) Troubleshooting Guilherme Correia, Technical Leader, Services Rama

© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public

ASR5500 System Initiation Task (SIT)

• sitmain task initializes the system.

• sitparent starts cards in Active/Standby &registers with HAT

• sitreap shuts down the card & harvests resources

• cspctrl – manages physical components

• afctrl & afmgr manages switch fabric

BRKSPM-2130 78

Page 79: Mobile Packet Core (ASR5500)d2zmdbbm9feqrf.cloudfront.net/2016/usa/pdf/BRKSPM-2130.pdfMobile Packet Core (ASR5500) Troubleshooting Guilherme Correia, Technical Leader, Services Rama

© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public

ASR5500 High AvailabilityTask (HAT)

Monitors operation state – responsible for minimizing service impacts.

Handles unexpected events with RCT tasks.

hatcpu – controls LEDs & monitors hardware on DPC

hatsystem controls all hat functions at startup including Fabric & Ethernet.

BRKSPM-2130 79

Page 80: Mobile Packet Core (ASR5500)d2zmdbbm9feqrf.cloudfront.net/2016/usa/pdf/BRKSPM-2130.pdfMobile Packet Core (ASR5500) Troubleshooting Guilherme Correia, Technical Leader, Services Rama

© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public

ASR5500 Resource Management Task (RM)

rmctrl task started by sitparent task

rmctrl is monitored by HAT for failure.

rmmgr – manages local resources & scratch space

BRKSPM-2130 80

Page 81: Mobile Packet Core (ASR5500)d2zmdbbm9feqrf.cloudfront.net/2016/usa/pdf/BRKSPM-2130.pdfMobile Packet Core (ASR5500) Troubleshooting Guilherme Correia, Technical Leader, Services Rama

© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public

ASR5500 Other Platform Tasks

HAT detects any failure

Recovery Control Task

Shared configuration task

Other common system-wide tasks such as Event Logger & SNMP Daemons

BRKSPM-2130 81

Page 82: Mobile Packet Core (ASR5500)d2zmdbbm9feqrf.cloudfront.net/2016/usa/pdf/BRKSPM-2130.pdfMobile Packet Core (ASR5500) Troubleshooting Guilherme Correia, Technical Leader, Services Rama

© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public

ASR5500 VPN Tasks

vpnctrl started by SIT spawns vpnmgr for each context

Communicates with session controller for starting new contexts

Maintains administrative & operational aspects of VPN subsystem

BRKSPM-2130 82

Page 83: Mobile Packet Core (ASR5500)d2zmdbbm9feqrf.cloudfront.net/2016/usa/pdf/BRKSPM-2130.pdfMobile Packet Core (ASR5500) Troubleshooting Guilherme Correia, Technical Leader, Services Rama

© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public

ASR5500 NPU Tasks

npuctrl started by SIT – one system-wide task

Registers & monitors npumgr & performs any recovery action

Provides single location for CLI interaction with NPU

NPUSIM task in every DPC card

BRKSPM-2130 83

Page 84: Mobile Packet Core (ASR5500)d2zmdbbm9feqrf.cloudfront.net/2016/usa/pdf/BRKSPM-2130.pdfMobile Packet Core (ASR5500) Troubleshooting Guilherme Correia, Technical Leader, Services Rama

© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public

ASR5500 SM Tasks

High touch processing of mobile subscribers including

payload transformations, filtering & scheduling, policing

& maintaining statistics.

• For every service, there is a corresponding signaling

manager

• Subscriber sessions are maintained in both the sessmgr &

aaamgr tasks

BRKSPM-2130 84