Mobile Packet Core (ASR5500)d2zmdbbm9feqrf.cloudfront.net/2016/usa/pdf/BRKSPM-2130.pdfMobile Packet...
Transcript of Mobile Packet Core (ASR5500)d2zmdbbm9feqrf.cloudfront.net/2016/usa/pdf/BRKSPM-2130.pdfMobile Packet...
Mobile Packet Core (ASR5500) Troubleshooting
Guilherme Correia, Technical Leader, Services
Rama Ramachandran, Technical Leader, Engineering
BRKSPM-2130
© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public
EPC Reference Architecture 3GPP Access
E-UTRANPGWSGWeNodeB
PCRF
Operator’s
IP Services
(e.g. video, IMS)
HSS
S11
(GTP-C)
S1-U
(GTP-U)
S2b
(GTP, PMIPv6,
GRE)
MME
S5/8 (PMIPv6, GRE)
S6a
(DIAMETER)
S1-MME
(S1-AP)
GERAN
S4 (GTP-C, GTP-U)UTRAN
SGSN
Trusted
Non-3GPP
IP Access
Untrusted
Non-3GPP
IP Access
S3
(GTP-C)
S12 (GTP-U)
S10
(GTP-C)
S5/8 (GTP-C, GTP-U)
Gx (DIAMETER) Gxb
SWx (DIAMETER)
STa (RADIUS,
DIAMETER)
ePDG
AAA
SWn
S6b
(DIAMETER)
SWm
(DIAMETER
)
SGi
SWa
Gxa
Rx+ (DIAMETER)
S2c
UES2a
(GTP, PMIPv6, GRE
MIPv4 FACoA)
Gxc
UEUE
BRKSPM-2130 3
Agenda:
• Describe the ASR5500 hardware and software architecture.
• Describe the mapping between the Sub-system, Services and Interfaces.
• Describe the system call flow for StarOS based MPC solution.
Module -1
ASR5500 Hardware
Architecture Overview
© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public
ASR 5500 Chassis
Front Rear
Air intake
Front-to-back airflow
Front fan
tray
System
Status Card
slots (11-12)
Fabric Storage
Card slots (13-
18)
Front fan tray
Management
and I/O slots (5-
6)
Data
Processing
Card slots (1-
4, 7-10)
Power suppliesRear fan tray
Rear fan tray
BRKSPM-2130 6
© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public
ASR5500 – Card Positioning
S
S
C
1
S
S
C
2
F
S
C
5
F
S
C
1
F
S
C
2
F
S
C
3
F
S
C
4
F
S
C
6
R
E
S
E
R
V
E
D
1
R
E
S
E
R
V
E
D
2
Power Filter Unit Power Filter Unit
Fan Tray
Fan Tray
Air Intake
11 12 13 14 15 16 17 18 19 20
D
P
C
5
D
P
C
3
M
I
O
1
M
I
O
2
D
P
C
4
D
P
C
6
Power Connectors Power Connectors
Fan Tray
Cable Management
Fan Tray
Air Exhaust
D
P
C
1
D
P
C
7
D
P
C
8
D
P
C
2
1 2 3 4 5 6 7 8 9 10
Front View Rear View
BRKSPM-2130 7
© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public
ASR5500 – Chassis Mid Plane Architecture
USB and PCMCIe
BRKSPM-2130 8
© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public
ASR5500 Hardware Architecture – FSC Cards
• Fabric and Storage Cards (FSCs)
• 1.2Tbps Crossbar Switching Fabric
• 1:N Redundancy, slots 13 - 18
• Each FSC provides a link to all cards (Redundancy)
• Persistent Storage• 2 200GB Solid State Drives
• 2 Serial Access SCSI (SAS) controllers on MIO, one connects to top drive of each FSC and one to the bottom drive of each FSC
FSCs
BRKSPM-2130 9
© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public
ASR5500 Hardware Architecture – Front Cards
System Status Card
Status Monitoring Temperature, airflow, current
System LEDs
Audible Alarms
System Power
Installed in slots 11 – 12
1:1 Redundancy
SSCs
FSCs
BRKSPM-2130 10
© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public
ASR5500 Hardware Architecture – Rear Cards
Management Input/Output (MIO)
4 x 50Gbps Cisco Typhoon NPUs
1 x 6-core 2.0 GHz x86 processor with 96GB DRAM
Chassis Management RJ45 and 2x 1000BASE-T
Installed in slots 5 & 6
1:1 Redundancy
2 Daughter Cards
10 x 10 GbE Interfaces per daughter card
MIOs
BRKSPM-2130 11
© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public
MIO Architecture: ASR55-MIO-BASE-K9
BCF
Daughter Card 1 Daughter Card 21 2
IPsecMDF
US
B
US
B
D C
Typhoon
NPU 1
FAP
FAP
Typhoon
NPU 2
Typhoon
NPU 3
Typhoon
NPU 4
FAP
FAP
To Fabric ModulesTo Midplane
(SAS, USB, PCIe)
CPU
USB SL
CAF
FAPs
RS-232
Flash
BRKSPM-2130 12
© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public
MIO Daughter Cards
Typhoon
NPU 1
Typhoon
NPU 2
2 x 5 SFP Cage
Quad
10G
PHY
Quad
10G
PHY
Quad
10G
PHY
S
F
P
+14
S
F
P
+15
S
F
P
+12
S
F
P
+1310
S
F
P
+
S
F
P
+11
S
F
P
+16
S
F
P
+17
S
F
P
+18
S
F
P
+19
Typhoon
NPU 3
Typhoon
NPU 4
2 x 5 SFP Cage
Quad
10G
PHY
Quad
10G
PHY
Quad
10G
PHY
S
F
P
+24
S
F
P
+25
S
F
P
+22
S
F
P
+2320
S
F
P
+
S
F
P
+21
S
F
P
+26
S
F
P
+27
S
F
P
+28
S
F
P
+29
BRKSPM-2130 13
© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public
Data Processing Card (DPC)
Provides complex subscriber-aware traffic processing
2 subsystems, each containing: Control Plane: 2 x 6-core 2.0 GHz x86 processor with 96GB DRAM
Data Plane: 1 x 50Gbps Cisco Typhoon NPU
3 FPGAs (2 x Control, 1 x Data)
Hardware Security Processor
Installed in slots 1-4 & 7-10 1:N Redundancy Model
BRKSPM-2130 14
© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public
Typhoon
NPU
Security
FAP
DDF
US
B
1 1
Subsystem 1
Dual
10G
MAC
CPU0 CPU1
NAND
SPI
SPI
DPC Architecture: ASR55-DPC-K9
Typhoon
NPU
To Fabric Modules
CAFBCF
IPsec
FAP
DDF
US
B
1 1
USB to MIOs
Subsystem 0
Dual
10G
MAC
CPU0 CPU1
BRKSPM-2130 15
© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public
ASR5500 2nd Generation DPC2
Major Difference DPC DPC2
CPU Triple Compute Intel Westmere-EP
4 Sockets (nodes)
48 Logical Cores
192GB DDR3 RAM
96GB / Complex
Intel Haswell-EP
6 Sockets (node)
144 Logical Cores
192GB DDR4 RAM
64GB / complex
DMA FPGA (DDF) 2x 45Gb DMA FPGAs 2x 75Gb DMA FPGAs
NPU Removed (FPGA/TCAM assist)
2 50Gb NPUs
2GB Memory (ea)
No NPU**
Fabric Next-gen Fabric
Reduced from 2 to 1 chips**
200 Gb Throughput 200 Gb Throughput
Crypto Triple Crypto 2x 20Gb Engines 3x 50Gb Engines
BRKSPM-2130 16
© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public
ASR5500 2nd Generation Cards Compatibility
• Limited to chassis with same card configurations • i.e. Cannot mix DPC1 and DPC2
• (MIOs, DPCs, and FSCs)
• (MIOs, DPC2s and FSCs)
• Recommended configurations• Current – 2 x MIO, 8 x DPC, 4 x FSC
• New – 2 x MIO, 8 x DPC2, 4 x FSC
• ICSR Chassis Pair with different DPC types (DPC1/DPC2) configurations not supported
• Within chassis first DPC type registered are allowed others will be offline
BRKSPM-2130 17
End of Module 1
Questions?
Module 2ASR5500 Software Overview
© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public
Distributed ArchitectureEvery leg has its own brain and it is almost independent.
40% of the neuron cells head
60% of the neuron cells arms
BRKSPM-2130 20
© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public
ASR5500 Software – Distributed Architecture
MIO DPC
DPC
DPC
DPC
DPC
DPC
DPC
DPC
Distributed Software Architecture: every card runs its own instance of StarOS.
For every service, there is a corresponding signaling manager
Subscriber sessions are maintained in both the sessmgr and aaamgr tasksBRKSPM-2130 21
© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public
ASR5500 Software Architecture - Designed for Redundancy
Boot Configuration
High Availability Tasks
Resource Manager
Switch Fabric Control
ACTIVE MIO
DPC1
Boot Configuration
High Availability Tasks
Resource Manager
Switch Fabric Control
STANDBY MIO
HW Engines
Encrypt Comp. Filter
PSC
HW Engines
Encrypt Comp. Filter
PSC
DPCSession Manager
AAA Manager
HW Engines
Encrypt Comp. Filter
AAA Manager
Session Manager Standby
Tasks
…
Sync
Control
Standby Tasks
Standby Tasks
Standby Tasks
Session Manager
AAA Manager
DPC2 DPC3
BRKSPM-2130 22
© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public
ASR5500 Software – Sessmgr and AAAmgr
Task Name Description Function
sessmgr (SM) Session Manager • Created by Session Controller. Paired with AAA Managers.
• Provides a subscriber processing system that supports multiple session types.
• A single Session Manager can service sessions from multiple input Session
Handlers.
aaamgr (SM) Authorization, Authentication
and Accounting (AAA)
Manager
• Paired with Session Managers.
• Performs AAA protocol operations and functions for subscribers and
administrative users in the system.
• AAA operations for CLI are done through AAA Manager running on the active
management card.
BRKSPM-2130 23
© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public
• Download the StarOS image file from Cisco Website
• Complete the pre-checks as required
• Upload the build to the “/flash” of the chassis and verify the version
• Reconfigure the boot stack to boot from the new image and configuration file.
• Collect the support details from the chassis with the running StarOS build “show support details”
• Upgrade the chassis to the new software level using “reload”
ASR5500 Chassis Upgrade/Reload
BRKSPM-2130 24
© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public
Port Redundancy
1:1L2 port redundancy by default 5/* 6/*
[local]ASR5500# sho port info 5/10
Port: 5/10
Port Type : 10G Ethernet
Role : Service Port
Description : (None Set)
Redundancy Mode : Port Mode
Framing Mode : Unspecified
Redundant With : 6/10
Preferred Port : Non-Revertive
Physical ifIndex : 84541440
Administrative State : Enabled
Configured Duplex : Auto
Configured Speed : Auto
Configured Flow Control : Enabled
Interface MAC Address : 00-05-47-FE-18-E9
Fixed MAC Address : 00-05-47-FE-18-C9
< … >
[local]ASR5500#
BRKSPM-2130 25
© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public
StarOS Logging
MIO
MIO and DPC/DPC2
Runtime
Inactive
Log BufferRuntime
Active Log
Buffer
Evlogd
Managers(VPNMgr, SessMgr,
NPUMgr, GTPcMgr
etc)
Controllers(VPNCtrl, SessCtrl,
NPUCtrl, rmctrl etc)
Console
Terminal
Syslog
Servers
System Messenger
CLI
Log Sources
BRKSPM-2130 26
© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public
ASR5500 Call Distribution
[local]ASR5500# show task resources | grep sessmgr
Thursday February 18 15:19:49 AST 2016
task cputime memory files sessions
cpu facility inst used allc used alloc used allc used allc S status
----------------------- --------- ------------- --------- ------------- ------
3/0 sessmgr 4 23% 100% 844.2M 1.86G 95 500 11440 28160 I good
3/0 sessmgr 7 23% 100% 840.7M 1.86G 95 500 11420 28160 I good
3/0 sessmgr 11 22% 100% 839.7M 1.86G 95 500 11430 28160 I good
3/0 sessmgr 16 26% 100% 841.2M 1.86G 92 500 11435 28160 I good
3/0 sessmgr 23 22% 100% 835.5M 1.86G 95 500 11443 28160 I good
3/0 sessmgr 26 26% 100% 841.0M 1.86G 94 500 11436 28160 I good
Active calls
BRKSPM-2130 27
© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public
• Require session recovery configuration:
default require session recovery
• (SIT), (HAT), and (CSP) are responsible for detecting both SW and HW faults.
• RCT initiates the appropriate corrective action(s).
BRKSPM-2130 28
© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public
ASR5500 Software Architecture – Session Recovery
• Sessmgr/AAAmgr pairs are split among DPCs.
Active DPC 1 Active DPC 2 Standby DPC 3
BRKSPM-2130 29
© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public
ASR5500 Software Architecture – Session Recovery
Active DPC 1 Active DPC 2 Standby DPC 3
Task
Failure
Re
co
ve
ry
BRKSPM-2130 30
© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public
ASR5500 Session Recovery – Full Recovery Mode
DPC
Failure Recovery
Active DPC 1 Active DPC 2 Standby DPC 3
Becomes Active
BRKSPM-2130 31
End of Module 2Questions?
Module - 3Subsystem, Services and Interfaces
© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public
Interfaces and Services – MME
mme-service
Hss-peer-service
Diamter
endpoint sgs-service
Context diameter
MME
Global config
mode
Subscriber-map
HSS EIR MSS
DNS
S1-MME
S6a S13 Sgs
Gn
SGSN
eNodeB
Sctp-param-template Tai-mgmt-db
Diamter
endpoint
sgtpc-service
Egtp-service
Dns-client
Context dns
Context
gtp
Context
mme
SGW/MMES11/S10
BRKSPM-2130 34
© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public
Is the MME service up?******** show mme-service all *******
Thursday February 18 15:20:20 AST 2016
Service name : mme
Context : s1mmes11
Status : STARTED
Bind : Done
S1-MME IP Address : 10.231.0.20
10.231.0.21
<snip>
PLMN Id : MCC: 250, MNC: 01
Network-Global-MME-ID-Mgmt-DB : Associated
Foreign-PLMN-GUTI-Mgmt-DB : Not Associated
EGTP Context : s1mmes11
EGTP Service : egtp_s11
EGTP Sv Context : Not defined
EGTP Sv Service : Not defined
SGTPC Context : gns4
SGTPC Service : sgtpmme
MME HSS Context : s6a
MME HSS Service : hss
<snip>
S1AP SCTP Parameters:
SCTP Param Template Associated : S1-template
SCTP Param Timestamp : Wed Jan 13 04:34:18 2016
SCTP Alpha : 5
SCTP Beta : 10
SCTP Checksum Type : CRC32
SCTP Valid Cookie Lifetime : 60000ms
SCTP Max Assoc Retrans : 10
SCTP Max Number of In Streams : 16
SCTP Init Retransmissions : 5
SCTP Max MTU : 1500bytes
SCTP Max Number of Out Streams : 16
SCTP Path Retransmissions : 5
SCTP Min MTU : 508bytes
SCTP RTO Initial : 3000ms
SCTP RTO Max : 60000ms
SCTP RTO Min : 1000ms
SCTP Sack Frequency : 2
SCTP Sack Period : 200ms
SCTP Start MTU : 1500bytes
SCTP Heartbeat Status : Enabled
SCTP HeartBeat Timer : 10s
SCTP Bundle Status : Disabled
SCTP Bundle Timer : 0msBRKSPM-2130 35
© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public
Interfaces and Services – SGW
sgw-service
Gtpu-service Egtp-service
Context s1u_s11 SGW
Global config mode
Subscriber-map
S1-U
eNodeB
Qci-qos-mapping
Egtp-service
gtpp-group
Context gtpp
Context S5_s8
Context
sgw
PGW
S11
MME
CGF
Gz
S5/S8
BRKSPM-2130 36
© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public
Is the SGW service up?******** show sgw-service all *******
Wednesday January 27 17:27:00 CET 2016
Service name :sgw-svc
Service-Id :9
Context :saegw
Accounting context :saegw
Accounting gtpp group :default
Accounting mode :Gtpp
Accounting stop-trigger :Default
Status :STARTED
Egress protocol :gtp
Ingress EGTP service :sgw-svc-s11-ingress
Egress context :pgw
Egress EGTP service :sgw-svc-s5-egress
Egress MAG service :n/a
IMS auth. service :n/a
Peer Map :n/a
Access Peer Map :n/a
Accounting policy :sgw
Newcall policy :n/a
QCI-QOS mapping table :pgw-qci-qos
Event Reporting :Disabled
DDN Throttling :Disabled
Page UE for PGW initiated proc :Disabled
Temp-Failure Handling for DBR proc :Disabled
PGW Ctrl FTEID in Relocation Create Session Response :Disabled
GTPC Path Failure Handling:
S11-Interface: local-purge
S5-Interface : local-purge
S1U-Interface: local-purge
S5U-Interface: local-purge
S4U-Interface: local-purge
S4-Interface: local-purge
S12-Interface: local-purge
GTPU Error Indication Handling:
S1U-Interface: page-ue
S5U-Interface: local-purge
S12-Interface: page-ue
S4U-Interface: local-purge
ddn success-action no-user-connect ddn-retry-timer: 60
ddn failure-action pkt-drop-time: 300
ddn isr-sequential-paging delay-time: 10
Idle timeout : n/a
PLMN ID List : MCC: 555, MNC: 55 [Primary]
Subscriber Map Name: smap_map
SAEGW service : n/a
EGTP NTSR: Disabled
Session Hold Timer: n/a
Timeout: n/a
GTP-C Load Control Profile : Not Defined
GTP-C Overload Control Profile : Not Defined
BRKSPM-2130 37
© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public
Interfaces and Services – PGW
Diameter
endpointDiameter
endpoint
AAA
group
Gtpp-group
Context diameter
Context ISP
Context Ga
Context s5s8
PGW
APN
Context GiIp-ppol
pgw-service
PCRF OCS
Gx GyAAA
S5
/
S8
SGW
CGF
Gz
gtpu-service
AAA
Ims-auth-service
Global mode
Enhanced-charging-service
Credit-control-group
PDN
SGi
BRKSPM-2130 38
© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public
Is the PGW service up?
******** show pgw-service all *******
Wednesday January 27 17:27:00 CET 2016
Service name : pgw-svc
Service-Id : 8
Context : saegw
Status : STARTED
EGTP Service : pgw-svc-s5-ingress
LMA Service : Not defined
GGSN Service : ggsn-svc
IPNE Service : Not defined
Peer Map : Not defined
Session-Delete-Delay Timer : Disabled
Session-Delete-Delay Timeout : n/a
PLMN ID List : MCC: 555, MNC: 555
Newcall Policy : None
dns-client Context Name : pgw
gx-li context : li
gx-li transport : udp
QCI-QOS Mapping Table Name : pgw-qci-qos
Authorize : Disabled
Setup Timeout : 60(secs)
Message Timestamp Drift : 180(secs)
S6b IPv6 Reporting : Disabled
Duplicate Subscriber Addr Request : Reject
Qos Negotiation Profile Rel8 for Gy interface : Disabled
Fqdn-name : Disabled
EGTP SGW Restoration Handling :Disabled
Session Hold Timer: n/a
Timeout: n/a
EGTP Modify bearer cmd negotiate qos :Disabled
EGTP GnGp Modify bearer res with APN-AMBR :Disabled
EGTP Bit Rate in Rounded Down Kbps :Disabled
GTP-C Load Control Profile : Not Defined
GTP-C Overload Control Profile : Not Defined
P-CSCF Restoration solution : HSS-based (Private Extn)
GTPC Outgoing Throttling :Disabled
RLF Template Name :N/A
Throttling override :Disabled
Throttling override Policy :N/A
GTPC Incoming Throttling Params: Configured (Default)
Message Rate (per sec) : 20000
Delay Tolerance (secs) : 5
Queue Size : 10000
BRKSPM-2130 39
End of Module 3
Questions?
Module 4:Troubleshooting ASR5500
© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public
Incident Reporting
• Incident: Issues that are ongoing
• Detailed Problem Description
• Two to three “show support details” (SSDs) output, 5 – 10 minutes a part during the problem
• Multiple monitor subscriber output, if user is unknown, do “monitor subscriber next-call“
• Pcap is also good to have
BRKSPM-2130 42
© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public
Introduction to the SSD: show support-details
Can contain more than 4000 commands – equivalent to “show tech”
Allows the CSE to understand the current status of the chassis
Hardware
Resources (CPU/Memory)
Service Statistics
Configuration
When opening a Service Request with HTTS/TAC, it is mandatory to attach the SSD to the case.
BRKSPM-2130 43
ASR5500 Overview
LAB DEMO:
• Hardware and Software Checks
• Monitor subscriber
© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public
Health Checks - Hardware
show card table • Cards states (Active/Standby/Booting)
• SPOF
show card diag <card num> • Card Diagnostics (Good/Fail)
• Last Failure (Time/Cause)
show card info <card number> • Current State/Desired State
• Session Busy/Out
show cpu errors card <card number> Control Plane Network Errors/Drops (Back Pressure)
show cpu table CPU/Memory Utilization (Current/5 Minutes/15
minutes)
show rct stats show recovery task history for card failures
BRKSPM-2130 45
© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public
Health Checks - Hardware
show port table • Port states (Active/Standby)
• Admin/Oper State (Enabled/Disabled)/(Up/Down)
(Hardware/VLAN Only)
• LAG Status
show port utilization table • Average Port Utilization (mbps)
show port datalink counters • Physical port counters (Tx/Rx)
show port npu counters • NPU processed port counters (Tx/Rx)
• Can specify vlan for specific counters
show port info Port details: MAC, LAG, VLANS, Duplex/Speed settings
etc…
show ip interface summary Context level; shows ip interface status
BRKSPM-2130 46
© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public
Health Checks - Software
show task resources
show task resources | grep –v good
show task resources max
• Task memory and CPU utilization, Look for any
task in over or warn state
• The “max” option shows the maximum resources
used since boot
show task table Lists all tasks and their parent tasks
show resources • High level overview of chassis utilization and
capacity, tracks max utilization per service with
timestamp
show crash list • List of crashes with timestamp and related task
BRKSPM-2130 47
© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public
Health Checks - Software[pgw]ASR5500-1# show pgw-service statistics all
VPN Name: pgw
Subscribers Total:
Active: 60
S6b Assume Positive: 0
…
Current PDNs By RAT-Type:
EUTRAN: 120 UTRAN: 0
GERAN: 0 WLAN: 0
OTHER: 0
…
PDNs Rejected By Reason:
No Resource: 0 Missing or unknown APN: 0
APN sel-Mode mismatch: 0 PDN-Type not supported: 0
APN restr violation: 0 Subs auth failed: 0
static addr not allow: 0 static addr not alloc: 0
Dynamic addr not alloc: 0 static addr not present: 0
Invalid QCI Value: 0
BRKSPM-2130 48
© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public
Health Checks - Software
• Many protocol level statistics available, normally found with “show <protocol> statistics
[local]ASR5500-1# show egtpc statistics
Tunnel Management Messages:
Create Session Request:
Total TX: 0 Total RX: 0
Initial TX: 0 Initial RX: 0
Retrans TX: 0 Retrans RX: 0
Discarded: 0
No Rsp RX: 0
Create Session Response:
Total TX: 0 Total RX: 0
Initial TX: 0 Initial RX: 0
Accepted: 0 Accepted: 0
Denied: 0 Denied: 0
Retrans TX: 0 Discarded: 0
Modify Bearer Request:
Total TX: 0 Total RX: 0
BRKSPM-2130 49
© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public
Health Checks - Software
show subscriber summary • Overall summary stats on all subscribers
show sub full <options> • Detailed information about subscriber
• Data/Policies/AAA/Nodes/IP Data
show subscriber data-rate • Subscriber data rates per sub/apn etc…
show active-charging sessions full <options> • Subscriber related active charging data per sub
show active-charging flows <options> • Flows per subscriber
show session disconnect-reasons • Summarizes total number of disconnect types
show subscriber debug-info <options> • Displays internal call troubleshooting information for
subscriber sessions
BRKSPM-2130 50
© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public
Health Checks - Software[pgw]ASR5500-1# show sub debug-info username 22331010101018@cisco
username: 22331010101018@cisco callid: 2ffba180 msid: 311481170000008
Card/Cpu: 1/0
Sessmgr Instance: 162
Primary callline:
Redundancy Status: Original Session
Checkpoints Attempts Success Last-Attempt Last-Success
Full: 1 0 26400ms 0ms
Micro: 1 1 26400ms 26400ms
GR Checkpoints Sent
0 Full Checkpoints
0 Micro Checkpoints
Current number of NAT flows checkpointed: 0
Current state: SMGR_STATE_CONNECTED
FSM Event trace:
State Event Num Occurances Time
SMGR_STATE_OPEN SMGR_EVT_NEWCALL (1) 2014-09-14:16:17:35
SMGR_STATE_NEWCALL_ARRIVED SMGR_EVT_IPADDR_ALLOC_SUCCESS (1) 2014-09-14:16:17:35
SMGR_STATE_NEWCALL_ARRIVED SMGR_EVT_ANSWER_CALL (1) 2014-09-14:16:17:35
SMGR_STATE_NEWCALL_ANSWERED SMGR_EVT_LINE_CONNECTED (1) 2014-09-14:16:17:35
SMGR_STATE_LINE_CONNECTED SMGR_EVT_LOWER_LAYER_UP (1) 2014-09-14:16:17:35
CLP State Trace:
State EBI's Associated Time
SMGR_CLP_EVT_PGW_CREATE_SESSION_REQ 5 - - - - - - - - - - 2014-09-14:16:17:35
CLI_MAPPED_SMGR_SEF_BIND - - - - - - - - - - - 2014-09-14:16:17:35
Card/CPU and Sessmgr UE is
attached to
Event trace
BRKSPM-2130 51
© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public
Health Checks – Software
show snmp trap history verbose • Displays last
• SNMP traps generated
show logs • Long log buffer of latest events on the chassis
show alarm outstanding • Lists output of ongoing chassis issues
show configuration errors • Lists incomplete or missing configuration
BRKSPM-2130 52
© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public
Monitor Subscriber
Detailed information on subscriber related messaging
Capture by Username/IMSI/MSISDN/MSID/Call ID etc…
Good to have both bad and good examples during issue
Always gather a mon sub of verbosity 3
[local]MAG-MME-1# monitor subscriber imsi 25001638855553…
Monday June 23 2014
INBOUND>>>>> 09:49:41:766 Eventid:88112(0)
===>GPRS Mobility/Session Management Message (3 Bytes)
Protocol Discriminator : GMM message
0000 .... : Skip Indicator : (0)
.... 1000 : Protocol Discriminator : (8)
Message Type: 0x13 (19)
Message : Authentication and ciphering Response
Spare Nibble
A&C Reference Number : 0x0 (0)
0x0000 0813 00 ...
Monday June 23 2014
<<<<OUTBOUND 09:49:41:766 Eventid:88113(0)
===>GPRS Mobility/Session Management Message (30 Bytes)
Protocol Discriminator : GMM message
0000 .... : Skip Indicator : (0)
.... 1000 : Protocol Discriminator : (8)
Message Type: 0x9 (9)
Message : Routing Area Update Accept
BRKSPM-2130 53
© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public
Monitor Subscriber (some options)
The following options are often useful
19, A, X – Enabled User L3 traffic with Hex/ASCII Output of packet
Y Multi-Call trace for multiple APNs
S – Sender info, the sessmgr managing the call
L – Limit the context for call capturing
BRKSPM-2130 54
© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public
Trace Logging (connected calls only)
[local]ASR5500-1# logging trace msid 355551191000002
Added tracing to 4 calls
2014-Sep-10+00:09:02.845 [sessmgr 11285 debug] [9/0/5864 <sessmgr:144> smgr_pcc_intf.c:1894]
[callid 2a9e56f1] [software internal user syslog] PCC received SEF_EVT_DATA_PACKET_IND
completed For Transaction id: 0 Event SEF_EVT_DATA_PACKET_IND from <SEf>
2014-Sep-10+00:09:02.845 [css 77202 debug] [9/0/5864 <sessmgr:144> acsmgr_rules.c:20926]
[callid 2a9e56f1] [software internal user protocol-log syslog] Rule matched : corporate for uplink
packet of subscriber MSID : 35555551191000002
2014-Sep-10+00:09:02.845 [acsmgr 91025 trace] [9/0/5864 <sessmgr:144> acsmgr_rules.c:20792]
[callid 2a9e56f1] [context: billing, contextID: 5] [software internal user syslog] ruledef: corporate
matches for service pgw-ecs
BRKSPM-2130 55
Cisco ASR5000/ASR5500 Troubleshooting Guide
© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public
Cisco ASR5000/ASR5500 Troubleshooting Guide
Free for download from cisco.com
https://supportforums.cisco.com/sites/default/files/cisco_asr5000_asr5500_troubleshooting_guide.pdf
BRKSPM-2130 57
© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public
Continue Your Education
• Demos in the Cisco campus
• Walk-in Self-Paced Labs
• Table Topics
• Meet the Engineer 1:1 meetings
• Related sessions
BRKSPM-2130 58
© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public
Session ID Time Session Title Speakers
Sunday (10 July 2016)
LTRSPM-2022 01:00 – 05:00 PM Virtual Packet Core Orchestration: Spring to Life Gateways and Services Julie Ann Connary, Amir Ahmadi
Monday (11 July 2016)
BRKSPM-2125 08:00 - 10:00 AM Virtualizing Cisco Mobile Packet Core Aeneas Dodd-Noble, Vivek Agarwal
BRKSPM-2071 01:00 - 03:00 PM 5G Technology Updates Paul Polakos, Prakash Suthar
BRKSPM-2029 04:00 – 05:30 PM Optimizing NFV Performance Ali Bokhari
BRKSPM-2022 04:00 – 05:30 PM Using Telco NFV to Deploy Mobility Networks Dave Clough
BRKSPM-2130 04:00 – 05:30 PM Mobile Packet Core (ASR5500) Troubleshooting Guilherme Correia, Rama Ramachandran
Tuesday (12 July 2016)
BRKSPM-2128 08:00 - 10:00 AM Radio Access Network Virtualization Mark Grayson, Oliver Bull
BRKSPM-2026 01:30 - 03:00 PM AT&T Case study for Managing Customer Experience in Mobile Networks Jeronimo Diez De Sollano, Anwin Kallumpurath
BRKSPM-2065 04:00 – 05:30 PM Mobile and Enterprise Security for the Age of Ubiquitous Encryption Humberto La Roche, Christopher ORourke
BRKSPM-2127 04:00 – 05:30 PM Design & Deploying Trusted and Un-Trusted VoWiFi Venkata Reddy Kasu, Arun Gunasekaran
Wednesday (13 July 2016)
BRKSPM-2129 08:00 - 10:00 AM Deploying 4G/LTE branch routers for IOT solutions Vivek Datar, David Mindel
PLNSPM-2021 01:30 – 03:00 PM Network Infrastructure and Operation Transformation Anand Malani, Scott Clark, Vilma Stoss, Rich Plane, Mark Ghattas (Moderator)
BRKSPM-2028 04:00 – 05:30 PM Design and Deployment of Overlay Services on LTE Network Tom Redman
BRKSPM-2122 04:00 – 05:30 PM Virtualizing Mobile Service Providers Transport Network Ravi Narahari, Abbas Abidi
Thursday (14 July 2016)
BRKSPM-2121 08:00 - 10:00 AM Cisco SON and Advanced Analytics Oliver Bull, Ashish Bansal
BRKSPM-2126 04:00 – 05:30 PM Analytics for Large Connected Venues: App Integration with Wi-Fi Infrastructure Matt Swartz, Joshua Suhr
PSOSPM-2505 01:00 – 02:00 PM Cisco Hosted Mobility (Mobility as a Service) Mike Shomaker
WISP Lab (11-14 July)
LABSPM-2011 10:00 - 6:00 PM Cisco Virtualized Packet Core Installation on VMware Amir Ahmadi, William Pedraza
LABSPM-2012 10:00 - 6:00 PM Cisco Virtualized Packet Core Installation on Openstack Christopher Ove, Guilherme Correia
BRKSPM-2130 59
Please join us for the Service Provider Innovation Talk featuring:
Yvette Kanouff | Senior Vice President and General Manager, SP Business
Joe Cozzolino | Senior Vice President, Cisco Services
Thursday, July 14th, 2016
11:30 am - 12:30pm, In the Oceanside A room
What to expect from this innovation talk
• Insights on market trends and forecasts
• Preview of key technologies and capabilities
• Innovative demonstrations of the latest and greatest products
• Better understanding of how Cisco can help you succeed
Register to attend the session live now or
watch the broadcast on cisco.com
© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public
Complete Your Online Session Evaluation
Don’t forget: Cisco Live sessions will be available for viewing on-demand after the event at CiscoLive.com/Online
• Give us your feedback to be entered into a Daily Survey Drawing. A daily winner will receive a $750 Amazon gift card.
• Complete your session surveys through the Cisco Live mobile app or from the Session Catalog on CiscoLive.com/us.
BRKSPM-2130 61
© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public
Continue Your Education
• Demos in the Cisco campus
• Walk-in Self-Paced Labs
• Lunch & Learn
• Meet the Engineer 1:1 meetings
• Related sessions
BRKSPM-2130 62
Thank you
© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public
Session ID Time Session Title Speakers
Sunday (10 July 2016)
LTRSPM-2022 01:00 – 05:00 PM Virtual Packet Core Orchestration: Spring to Life Gateways and Services Julie Ann Connary, Amir Ahmadi
Monday (11 July 2016)
BRKSPM-2125 08:00 - 10:00 AM Virtualizing Cisco Mobile Packet Core Aeneas Dodd-Noble, Vivek Agarwal
BRKSPM-2071 01:00 - 03:00 PM 5G Technology Updates and ICN Demonstration Paul Polakos, Prakash Suthar, Giovanna Carofiglio
BRKSPM-2029 04:00 – 05:30 PM Optimizing NFV Performance Ali Bokhari, Sean Merrow
BRKSPM-2022 04:00 – 05:30 PM Using Telco NFV to Deploy Mobility Networks Dave Clough
Tuesday (12 July 2016)
BRKSPM-2128 08:00 - 10:00 AM Radio Access Network Virtualization Mark Grayson, Oliver Bull
BRKSPM-2026 01:00 - 03:00 PM Managing Customer Experience for Mobile Networks Jeronimo Diez De Sollano, Daryl Huynh
BRKSPM-2065 04:00 – 05:30 PM Mobile and Enterprise Security for the Age of Ubiquitous Encryption Humberto La Roche, Christopher ORourke
BRKSPM-2127 04:00 – 05:30 PM Design & Deploying Trusted and Un-Trusted VoWiFi Venkata Reddy Kasu, Arun Gunasekaran
Wednesday (13 July 2016)
BRKSPM-2129 08:00 - 10:00 AM Deploying 4G/LTE branch routers for IOT solutions Anand Jayaraman, Vivek Datar
PLNSPM-2021 01:30 – 03:00 PM SP Infrastructure and Operation Transformation
Anand Malani, Scott Clark, Sunil Kripalani, Vilma Stoss, Mark Ghattas
(Moderator)
BRKSPM-2028 04:00 – 05:30 PM Design and Deployment of Overlay Services on LTE Network Tom Redman
BRKSPM-2122 04:00 – 05:30 PM Virtualizing Mobile Service Providers Transport Network Ravi Narahari, Abbas Abidi
Thursday (14 July 2016)
BRKSPM-2121 08:00 - 10:00 AM Cisco SON and Advanced Analytics Oliver Bull, Ashish Bansal
BRKSPM-2126 04:00 – 05:30 PM
Analytics for Large Connected Venues: App Integration with Wi-Fi
Infrastructure Matt Swartz, Joshua Suhr
WISP Lab (11-14 July)
LABSPM-2011 8:00 - 5:00 PM Cisco Virtualized Packet Core Installation on VMware Amir Ahmadi, William Pedraza
LABSPM-2012 8:00 - 5:00 PM Cisco Virtualized Packet Core Installation on Openstack Christopher Ove, Guilherme Correia
BRKSPM-2130 64
© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public
Acronyms• RAR – Re-Authorization Request
• RAA - Re-Authorization Answer
• AAR - Authorization Authentication Request
• AAA – Authorization Authentication Answer
• STR – Session Termination Request
• STA – Session Termination Answer
• ASR – Abort Session Request
• ASA – Aborst Session Answer
• CER/CEA – Capabilities Exchange Request/Capabilities Exchange Answer
• PBU – Proxy Binding Update
BRKSPM-2130 66
© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public
Acronyms• SaMOG – S2a Mobility over GTPv2
• MRME – Multi-Radio Management Entity
• CGW – Converged Access Gateway
• TWAN – Trusted WLAN Access Network
• TWAP – Trusted WLAN AAA Proxy
• TWAG – Trusted WLAN Acess Gateway
• LBO – Local Breakout
• LEMF – Law Enforcement Monitoring Facility
• EPC – Evolved Packet Core
• AAA - Authentication, Authorization, and Accounting
BRKSPM-2130 67
© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public
Acronyms (Continue…)• PGW - PDN Gateway
• PMIPv6 - Proxy Mobile IP version 6
• GTP – GPRS Tunneling Protocol
• EAP – Extensible Authentication Protocol
• NAI – Network Access Identifier
• DNS – Domain Name Service
• PDN – Packet Data Network
• DER – Diameter EAP Request
• DEA – Diameter EAP Answer
• MD – Mediation Device
BRKSPM-2130 68
© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public
Tasks and FunctionsTask Name Description Function
Sitmain (SIT) System Initiation Task - Main • Initiated at system startup.
• Provides startup configuration to other SIT components.
• Starts SITREAP sub-function.
• Maintains CPU state information.
sitparent (SIT) SIT Parent sub-function • Starts management cards in active/standby mode.
• Registers tasks with HAT task.
• Notifies CSP task of CPU startup configuration.
• Brings up DPCs in standby mode.
sitreap (SIT) SIT Reap sub-function • Shuts down tasks as required.
hatcpu (HAT) High Availability Task CPU • Device initialization and control functions.
• Reports loss of any task on its CPU to hatsystem sub-function.
• Controls LEDs on the DPCs.
• Initializes and monitors hardware on DPC.
• Collects CPU monitoring information and reports to hatsystem.
hatsystem (HAT) High Availability Task System Controller • Controls all the HAT sub-function in the system. Initialized on startup.
• Initializes Switch Fabric and Internal Ethernet switch.
• Monitors system components such as fans for state changes.
• Triggers action for redundancy in the event of fault detection.
• The HAT subsystem on the redundant management card mirrors the HAT subsystem on the active
management card.
rmctrl (RM) Resource Manager Controller • Started by the sitparent task on startup and monitored by HAT for a failure.
• Initializes resources such as CPUs and memory.
• Requests updated card status from the CSP subsystem and updates the system card table.
• Communicates with all rmctrls and requests their latest set of resource data.
BRKSPM-2130 69
© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public
Tasks and FunctionsTask Name Description Function
rmmgr (RM) Resource Manager Managers • Started by the sitparent task and monitored by HAT for a failure
• Initializes the local resource data and scratch space.
• Communicates with SIT task on the local CPY to get its entire task table and associated resources.
• Gathers current resource utilization for each task.
• Sends the resource data to the rmctrl task.
vpnctrl (VPN) VPN Controller • Created at system start-up.
• Initiates the VPN Manager for each context.
• Informs the Session Controller task when there are additions or changes to contexts. One VPN Controller
operates at any one time.
• Routes context specific operation information to the appropriate VPN Manager.
• Performs VPN Manager recover and saves all VPN-related configuration in SCT.
vpnmgr (VPN) VPN Manager • Started by the VPN controller for each configured context – one exists for local context always.
• Performs IP address pool and subscriber IP address Management.
• Performs all context specific operations including but not limited to: IP interfaces, ARP, IP address pool
management, slow path forwarding, NPU flows, port Access Control Lists (ACLs), and logging.
• Provides IP interface address information for each context to the Session Controller.
bgp (VPN) Border Gateway Protocol • Created by VPN Manager for each context that has BGP routing configured.
• Responsible for learning and redistributing routing information via BGP protocol.
• Maintains BGP peer connections and Applies any defined BGP routing policy.
ospf (VPN) Open Shortest Path First • Created by VPN Manager for each context that has OSPF routing configured.
• Responsible for learning and redistributing routing information via OSPF protocol.
• Maintains OSPF neighbor relationships and LSA database.
• Perform SPF calculations.
• Applies any defined OSPF routing policy.
BRKSPM-2130 70
© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public
Tasks and FunctionsTask Name Description Function
ospfv3 (VPN) Open Shortest Path First • Created by VPN Manager for each context that has OSPFv3 routing configured.
• Responsible for learning and redistributing routing information via OSPFv3 protocol.
• Maintains OSPFv3 neighbor relationships and LSA database.
• Perform OSPFv3 SPF calculations.
• Applies any defined OSPFv3 routing policy.
rip (VPN) Routing Information Protocol • Created by VPN Manager for each context that has RIP routing configured.
• Responsible for learning and redistributing routing information via RIP protocol.
• Maintains RIP database.
• Sends periodic RIP update messages.
• Applies any defined RIP routing policy.
zebos (VPN) L2 and L3 Switching • Created by VPN Manager for each context .
• Maintains RIB and FIB for the context. Performs static routing.
• Interfaces to the kernel or routing and interface updates.
• Redistributes routing information to dynamic routing protocols
• Calculates next-hop reachability.
knpusim (NPU) Kernel-based NPU Simulator [VPC-DI,
VPC-SI]
• Created at OS Startup. Provides port configuration services to the CSP task.
• Provides interface binding and forwarding services to the VPN Manager.
• Provides flow insertion and removal services to Session Manager and AAA Manager tasks.
• Provides recovery services to the NPU Controller.
npuctrl (NPU) NPU Controller • Created at OS Startup. One NPU Controller in the system at any time.
• Monitors the NPU Manager state.
• Registers to receive notification of NPU Manager crashes.
• Controls recovery operation.
• Provides a central location for CLI commands related to NPU Manager state.
BRKSPM-2130 71
© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public
Tasks and FunctionsTask Name Description Function
npusim (NPU) NPU Simulator [ASR 5500] • Created for every DPC installed and started.
• Provides port configuration services to the CSP Task.
• Provides interface binding and forwarding services to the VPN Manager..
• Provides flow insertion and removal services to Session Manager and AAA Manager tasks.
• Provides recovery services to the NPU Controller.
sessctrl (SM) Session Controller • Created at OS Startup. Session Controller maintained in the system at any point of time.
• Primary contact point for the Session subsystem and acts as a proxy for the subsystem.
• Starts, configures and coordinates the Session Processing subsystem – sub-managers.
• Works with Resource Manager to start new Session Managers instances when limits are reached.
• Receives context Information from VPN Managers.
• Distributes IP interface address information to other Session Processing Subsystem
• Manages Enhanced Charging Services (ECS), Content Filtering and URL Blacklisting services.
sessmgr (SM) Session Manager • Created by Session Controller. Paired with AAA Managers.
• Provides a subscriber processing system that supports multiple session types.
• Multiple Session Managers per CPU. Operates in a distributed processing system.
• Processes protocols for A10/A11, GRE, GTPu/GTPc, PPP and Mobile IP.
• A single Session Manager can service sessions from multiple input Session Handlers.
aaamgr (SM) Authorization, Authentication and
Accounting (AAA) Manager
• Paired with Session Managers.
• Performs AAA protocol operations and functions for subscribers and administrative users in the system.
• Acts as AAA client to AAA servers.
• Managers GTP Prime messaging with Charging Gateway functions (CGFs).
• Multiple AAA Managers can run on a single CPU and can be distributed throughout any CPU in the
system.
• AAA operations for CLI are done through AAA Manager running on the active management card.
BRKSPM-2130 72
© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public
Tasks and FunctionsTask Name Description Function
aaaproxy (SM) Authorization, Authentication and
Accounting (AAA) Proxy Manager
• Starts when Global Config gtpp single-source is configured. Uses single UDP source port instead of one
port for each AAA Manager with a unique source port.
• Runs on demux card when session recovery is enabled or when require demux card is configured.
• Writes CDRs to a file in VRAM-disk. The enqueued CDRs are then periodically transferred to disk.
acsctrl (SM) Active Charging System (ACS)
Controller
• Starts when active-charging service CLI command is configured.
• Runs on the primary DPC and manages ACS service – reads/writes ACS config into SCT.
• Monitors recovery process and cleanup.
acsmgr (SM) Active Charging System (ACS) Manager • Created by ACS Controller for IP Session processing.
• Sends and receives data through Session Managers.
• Active/Standby tasks created only when session recovery is enabled.
cdrmod (SM) Charging Detail Record Module • Responsible for receiving EDR/UDR records from different ACSMGR instances in the system.
• Responsible for writing records in files using file naming conventions and formats.
diamproxy (SM) Diameter Proxy • Created by diactrl (which runs as part of vpnctrl). Number of tasks depends on configuration of single or
multiple proxies. If it is diamproxy single – one diamproxy task created and runs in demux card. Multiple
proxies will spawn one diamproxy per active DPC card that is not demux.
• Maintains diameter base connections to all peers configured in the system.
• Informs applications on connection states.
• Acts as a pass-through for messages from the application to server- acts as a forwarding agent.
• A single Diameter proxy is used to service multiple diameter applications.
egtpemgr (SM) Enhanced GPRS Tunneling Protocol
Egress Manager
• Created by session controller for each context in which an egtp-service interface-type sgw-egress or
MME is configured. Handles certain EGTP messages from SGW, PGW.
• Maintains a list current EGTP sessions.
• Maintains list of current Session Manager tasks which aids in session recovery.
• Handles GTP Echo messaging.
BRKSPM-2130 73
© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public
Tasks and FunctionsTask Name Description Function
egtpimgr (SM) Enhanced GPRS Tunneling Protocol
Ingress Manager
• Created by session controller for each context in which an egtp-service interface-type sgw-ingress or
pgw-ingress is configured.
• Receives EGTP sessions from MME/S4 SGSN/SGW and distributes them to different Session Manager
Tasks for load balancing.
• Maintains a list current EGTP sessions. Handles GTP Echo messaging.
• Maintains list of current Session Manager tasks which aids in session recovery
imsimgr (SM) International Mobile Subscriber Identity
Manager for MME
• Starts when MME service is configured. One instance per system.
• Selects sessmgr to use for new subscriber session.
• Maintains and reports MME-related demux statistics such as Attach by IMSI and Attach by GUTI.
• Interacts with sessctrl, mmemgr and sessmgr tasks.
l2tpdemux (SM) L2TP Demux Task • Created by Session Controller when LNS service is created. One task per system.
• De-mux and forwards new tunnel create requests to L2TPmgrs
• Load balance requests among multiple L2TPmgrs.
l2tpmgr (SM) Layer 2 Tunneling Protocol Manager • Created by Session Controller for each context in which LAC or LNS is configured.
• Responsible for all L2TP processing. Maintains protocol state machine for L2TP sessions and tunnels.
• Triggers IPSec encryption for new L2TP tunnels as needed.
mmedemux (SM) Mobility Management Entity Demux
Manager.
• Started as part of MME service creation procedure. One mmedemux task per chassis.
• Distributes incoming S1-MME SCTP connections to mmemgr tasks in the system.
• Remains aware of all MME services in the system.
mmemgr (SM) Mobility Management Entity Manager • Starts when MME service configuration is detected. There can be multiple instances to load balance
sessions. Contains identical configuration in each instance.
• Runs SCTP stack. Handles SCTP associations.
• Maintains TA list. Manages eNodeB database. Provides S1-MME protocol nodal functions.
BRKSPM-2130 74
© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public
Tasks and FunctionsTask Name Description Function
afctrl (Platform) ASR5500 Fabric Controller • Responsible for the overall management of the system fabric.
• Manages the pool of Rendezvous Destinations and coordinates fabric recovery by the afmgr proclets
after a fault
• A single afctrl instance runs on the active MIO/UMIO only.
afmgr (Platform) ASR5500 Fabric Manager • Responsible for the management of fabric resources on a particular card.
• There is one afmgr on every CPU that is responsible for one or more fabric access processors (FAPs) or
fabric elements (FEs).
• afmgr supports recovery but not migration.
afio (Platform) ASR5500 Fabric driver • Responsible for the direct configuration of the fabric chipset. afio supports non-messenger inter-process
communication (IPC) with the local afmgr and with other local afio instances
connproxy
(Platform)
TCP/SCTP connection proxy • Allows applications on any card to share the same TCP/SCTP connection to the same remote endpoint
instead of opening a new connection for each application on the card.
cspctrl (Platform) Card-Slot-Port Controller. • Manages physical chassis components.
dhmgr (Platform) Distributed Host Manager • Started automatically by SITPARENT.
• Coordinates establishment of locally terminated TCP, SCTP, and UDP connections on behalf of multi-
instanced tasks such as Diameter endpoints among sessmgr tasks..
hdctrl (Platform) Hard Drive Controller • Controls and manages the drive array spanning the management cards.
hwctrl (Platform) Hardware Controller • The hwctrl task has several timers that manage polling loops for hardware sensor readings, sensor
threshold monitoring, and fan tray monitoring.
hwmgr (Platform) Hardware Manager • The hwmgr task runs on all cards to read local hardware sensors and report them back to the hwctrl.
BRKSPM-2130 75
© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public
Tasks and FunctionsTask Name Description Function
ipsecctrl (Platform) IPSec Controller • Started by SIT regardless of configuration.
• Started ipsecmgr tasks based on configuration and maintains its list for task recovery.
• Receives and maintains user configuration for IPSec/
• Manages the configured IPSec crypto maps and its assignment to ipsecmgrs.
• Interfaces with vpnmgr task for required IPSec configuration parameters such as IP Access Lists, IP
Pools, interface address and interface state notifications.
ipsecmgr (Platform) IPSec Manager • Created by ipsecctrl. Establishes and manages secure IKEv1, IKEv2 and IPSec data tunnels.
lagmgr (Platform) Link Aggregation Group Manager • Started by npuctrl on MIO with a facility level between CSP and npumgr to receive configuration/status
notification and build global LAG database.
• Exchanges control packets (LACP and Marker) over configured physical ports with peers to reach
agreement on aggregation of links.
msgd (Platform) Messenger Daemon • Implements the Name Service and related functions for the internal message passing system.
msgproxy (Platform) Message Proxy. • The Messenger Proxy process handles broadcast messages send from any single application (referred to
as a client) to any facility which has one instance per thread (referred to as the Target Facility).
• One msgproxy task runs on each CPU on DPCs and SF Virtual Machine (VPC-DI).
• Processes incoming broadcast messages from the Client processes, such as sessctrl, distributes them to
the correct Target Facility, such as sessmgr, creates the correct responses and sends them back to the
correct Client.
nscontrol (Platform) Name Service Controller • Provides a reliable channel for tasks to send control messages to the Messenger Daemon.
rct (Platform) Recovery Control Task • Monitors tasks/managers/facilities across the system and performs recovery in the event of a failure.
sct (Platform) Shared Configuration Task • Performs the redundant storage of configuration information and state information in memory database.
Sft (Platform) Switch Fabric Task • Monitors the switch fabric and the gigabit Ethernet control plane.
BRKSPM-2130 76
© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public
Tasks and FunctionsTask Name Description Function
bulkstat
(Management)
Bulk Statistics Manager • Periodically polls and gathers bulk statistics and transfers this data to external management
systems.
evlogd
(Management)
Event Log Daemon • Handles event logging functions including the interface to external syslogd servers and
internal event logs.
orbs (Management) ORBEM Service • The orbs task is also known as the ORB Element Manager (ORBEM).
• An Element Management System (EMS) requests orbs to perform Element Management
Functions on the system using secure IIOP. ORBS then interacts with concerned Controller
Tasks to execute the function.
• The response/errors from the execution are interpreted, formulated into an EMF response,
and handed off to EMS servers.
orbns
(Management)
Messenger Daemon • Notifies EMS Servers of event occurrences.
• Registers EMS Servers and subscribes them to associated event types.
sesstrc
(Management)
Session Trace collection task • Implements the standards-based session trace functionality.
• Manages both CLI and signaling-based subscriber traces. It collects messages to be traced
and generates trace files as needed. It uploads trace files to the Trace Collection Entity as
needed.
snmp
(Management)
Simple Network Management
Protocol
• Handles inboard SNMP operations if configured, and sends SNMP notifications (traps) if
enabled.
threshold
(Management)
Threshold Server • Handles monitoring of threshold crossing alerts, if configured. Polls statistics/variables,
maintains state, and generates log messages/SNMP notification of threshold crossings.
BRKSPM-2130 77
© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public
ASR5500 System Initiation Task (SIT)
• sitmain task initializes the system.
• sitparent starts cards in Active/Standby ®isters with HAT
• sitreap shuts down the card & harvests resources
• cspctrl – manages physical components
• afctrl & afmgr manages switch fabric
BRKSPM-2130 78
© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public
ASR5500 High AvailabilityTask (HAT)
Monitors operation state – responsible for minimizing service impacts.
Handles unexpected events with RCT tasks.
hatcpu – controls LEDs & monitors hardware on DPC
hatsystem controls all hat functions at startup including Fabric & Ethernet.
BRKSPM-2130 79
© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public
ASR5500 Resource Management Task (RM)
rmctrl task started by sitparent task
rmctrl is monitored by HAT for failure.
rmmgr – manages local resources & scratch space
BRKSPM-2130 80
© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public
ASR5500 Other Platform Tasks
HAT detects any failure
Recovery Control Task
Shared configuration task
Other common system-wide tasks such as Event Logger & SNMP Daemons
BRKSPM-2130 81
© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public
ASR5500 VPN Tasks
vpnctrl started by SIT spawns vpnmgr for each context
Communicates with session controller for starting new contexts
Maintains administrative & operational aspects of VPN subsystem
BRKSPM-2130 82
© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public
ASR5500 NPU Tasks
npuctrl started by SIT – one system-wide task
Registers & monitors npumgr & performs any recovery action
Provides single location for CLI interaction with NPU
NPUSIM task in every DPC card
BRKSPM-2130 83
© 2016 Cisco and/or its affiliates. All rights reserved. Cisco Public
ASR5500 SM Tasks
High touch processing of mobile subscribers including
payload transformations, filtering & scheduling, policing
& maintaining statistics.
• For every service, there is a corresponding signaling
manager
• Subscriber sessions are maintained in both the sessmgr &
aaamgr tasks
BRKSPM-2130 84