Warid Alarms Sheet (CS SMSScr MS)

WARID CALL/SMS

SCREENING AND MY

STATUS ALARMS SHEET

Warid Call/SMS Screening & MyStatus Alarms Sheet

1

TECHNICAL SUPPORT GUIDE The software described in this book is furnished under a license agreement and may be used

only in accordance with the terms of the agreement.

COPYRIGHT NOTICE Copyright 2014 Globitel. All rights reserved.

No part of this publication may be reproduced, transmitted, transcribed, stored in a retrieval

system, or translated into any language or computer language, in any form or by any means,

electronic mechanical, magnetic, optical, chemical, manual, or otherwise, without the prior

written permission of Globitel.

LEGAL DISCLAIMER No part of this publication may be reproduced, adapted, or translated in any form or by any

means without prior written authorization of Globitel.

Information published here is current or planned as of the date of publication of this

document. Because we are improving and adding features to our products continuously, the

information in this publication is subject to change without notice.

TECHNICAL SUPPORT For technical support, call 962797279900 or email us @: [email protected]


2

CONTENTS

Revision History ............................................................................................................................. 3

Abstract ........................................................................................................................................... 4

SYSTEM Alarms ............................................................................................................................ 5

How to monitor the system? ...................................................................................................... 5

Whom shall I contact in case of an issue? ............................................................................... 23


3

REVISION HISTORY

Revisio

n

1.0 Author Omar Al-

Madanat

File

Name

Warid CS, SMSScr & MS Alarms Sheet

Date May

.6, 2014

Editor Remark

s

1st revision of the Warid CS, SMSScr & MS Alarms

Sheet


4

ABSTRACT This document lists the alarms configured for Call/SMS Screening and My Status Systems

on Host monitor tool along with their description, severity and the actions need to be done if

the alarm occurs.


5

SYSTEM ALARMS

How to monitor the system? Host Monitor covers a lot of areas that need to be checked continuously in order to make sure

that the system is functioning properly. The host monitor tool can send a notification (in the

form of SMS, Email ...) once any of the configured alarms goes bad. The host monitor which

is installed for Call/SMS Screening and MyStatus systems is installed on Database server 2

(10.3.122.39).

The following alarms are defined on the system:

Tab Alarm Title Alarm Description Severity

IVR Server

IVR Server Aculab Control Object Check Aculab Control

Object Service whether it is

running or not

Critical

IVR Server Aculab DSP Channel Object Check Aculab DSP Channel

Object whether it is running

or not

Critical

IVR Server Aculab Line Object Check Aculab Line Object

Service whether it is

running or not

Critical

IVR Server Aculab Prosody Object Check Aculab Prosody

Object whether it is running

or not

Critical

IVR Server Aculab startup service Check Aculab startup

service whether it is

running or not

Critical

IVR Server HLR Provisioning Manager Check HLR Provisioning

Manager Process whether it

is running or not

Critical

IVR Server IN Charging Manager Check IN Charging


is running or not

Critical

IVR Server Java Process Check Java Process whether

it is running or not

Critical

IVR Server Process Charging Connector

on IVR server

Check Charging Connector

on IVR server Process

whether it is running or not

Critical


6

IVR Server SMS Manager Check SMS Manager

Process whether it is

running or not

Major

IVR Server SMS Provisioning Manager Check SMS Provisioning


is running or not

Critical

IVR Server Subscription Life Cycle Check Subscription Life

Cycle Process whether it is

running or not

Major

IVR Server Warid IVR Check Warid IVR Process


Critical

IVR Server Free Space for Drive C in

IVR server

Check if Free Space for

Drive C is below 3 GB.

Major

IVR Server Free Space for Drive E in

IVR server


Drive D is below 5 GB.

Major

IVR Server Check Oracle Server Check if Oracle Server is up

or not

Critical

IVR Server Connectivity between IVR

Server and IN Interface

Check the connectivity

between IVR server and IN

Interface (Ping

10.11.28.120)

Critical


Server and SMSC Interface

one


between IVR server and

SMSC Interface (Ping

10.4.12.6)

Major


Server and TABS DB


between IVR server and

TABS DB from the result of

Run the Command to check TABS DB

Critical

IVR Server Run the Command to check

TABS DB

Run the command

TNSPing 172.21.5.8 and write the result into a file.

Minor

IVR Server Virtual IP address

reachability

Check the Virtual IP

address reachability (Ping

10.3.122.41)

Major

IVR Server CPU Usage in IVR server Check the CPU usage on

IVR server (threshold 75%)

Major (if it

last for two

consequential

checks)

IVR Server Checking IVR Links Run the Command to write

Links status into a file

Minor

IVR Server First IVR Link is down Check the status of the first

Link (SLC 0)

Critical


7

IVR Server Second IVR Link is down Check the status of the

second Link (SLC 1)

Critical

IVR Server Call Screening Web

Application availability

Check the availability of CS

web interface

Minor

IVR Server Copy Last Modified Trace

for HLR Provisioning

Manager

Copy the last trace for HLR

Provisioning Manager to

E:\Maintenance

Minor


for IN Charging Manager

Copy the last trace for IN

Charging Manager to

E:\Maintenance

Minor


for SMS Manager

Copy the last trace for SMS

Manager to E:\Maintenance

Minor


for Subscription Life Cycle

Copy the last trace for

Subscription Life Cycle to

E:\Maintenance

Minor

IVR Server Get Last 100 Lines from

HLR Provisioning Trace

Copy the last 100 lines in

the last HLR Provisioning

Trace into another file

Minor

IVR Server Get Last 100 Lines from IN

Charging Manager Trace

Copy the last 100 lines in

the last IN Charging

Manager Trace into another

file (HLR_Prov2.txt)

Minor

IVR Server HLR Provisioning Manager

Activity

Check the behavior of HLR

Provisioning Manager from

HLR_Prov2.txt

Major

IVR Server IN Charging Manager

Activity: Returned Value

from IN Interface: Test 1

Check if the returned value

from IN (-1/False) exists in

IN Charging Manager

traces. This value indicates

an error.

Critical





from IN (2001/True) exists

in IN Charging Manager


successful action.

Critical (if

the alarms

not cleared

automatically

after 1 hour)





from IN (4241/False) exists

in IN Charging Manager


failed action due to

insufficient balance.

Minor


8

IVR Server SLC: Convert to PostPaid

Process

Check if the SLC Convert to

PostPaid Process has been

finished or not.

Major

IVR Server SLC: Convert to PrePaid

Process

Check if the SLC Convert to

PrePaid Process has been

finished or not.

Major

IVR Server SLC: Deleted Subscribers

Process

Check if the SLC Deleted

Subscribers Process has

been finished or not.

Major

IVR Server SLC: Oracle Errors Check if there are any

Oracle Errors in SLC trace

Critical

IVR Server SLC: Portout Process Check if the SLC Portout

Process has been finished or

not.

Major

IVR Server SLC: Purge Process Check if the SLC Renewal


not.

Major

IVR Server SLC: Renewal Process Check if the SLC Renewal


not.

Major

IVR Server SLC: Send Expiry Warning

SMS

Check if the SLC Expiry

Warning Process has been

finished or not.

Major

Call Screening Database Server 1

CS_DB1 C Drive Free Space in DB1 Check if Free Space for


Major

CS_DB1 Cluster Svc Check the service ClusSvc whether it is running or not

Critical

CS_DB1 E Drive Free Space in DB1 Check if Free Space for

Drive E is below 5 GB.

Major

CS_DB1 Java Process Check Java Process whether


Critical

CS_DB1 Shared Storage Space Drive

Q


Drive Q is below 2 GB.

Major

Call Screening Database Server 2

CS_DB2 C Drive Free Space in DB2 Check if Free Space for


Major

CS_DB2 Cluster Svc Check the service ClusSvc whether it is running or not

Critical

CS_DB2 E Drive Free Space in DB2 Check if Free Space for


Major


9

CS_DB2 Java Process Check Java Process whether


Critical

CS_DB2 Shared Storage Space Drive

K


Drive K is below 5 GB.

Major

Call Screening Application Server 1

Call

Screening

Application

One

Call Screening Process Check Call Screening


running or not

Critical

Call

Screening

Application

One

Gctload process Check Gctload Process


Critical

Call

Screening

Application

One

Java Process Check Java Process whether


Critical

Call

Screening

Application

One

RoamGateService Process Check Roam Gate Service


running or not

Critical

Call

Screening

Application

One

Check the file size for

gctload t1 results

congestion.txt

Check congestion.txt size and alert if its size is

smaller than 16 b

Minor

Call

Screening

Application

One

Congestion status Check the congestion status Major

Call

Screening

Application

One

First SCTP Association

Status

Check the status of the first

association

Critical

Call

Screening

Application

One

Generate a test file for

gctload t1 results

Copy the result of the

command gctload t1 into the file congestion.txt

Minor


10

Call

Screening

Application

One

Generate Routestatus File Generate Route Status file

RouteStatus.txt Minor

Call

Screening

Application

One

Messages Free count in the

buffer

This will check the free

messages in Signaling layer

buffers

Critical

Call

Screening

Application

One

RouteStatus Size Check RouteStatus.txt size and alert if its size is

smaller than 16 b

Minor

Call

Screening

Application

One

Second SCTP association

status


association

Critical

Call

Screening

Application

One

Connection to oracle server Check the availability of

Oracle server

Major

Call

Screening

Application

One

Database Server

Reachability

Check the availability of the

DB server

Major

Call

Screening

Application

One

CPU Usage in application

server one

Check the CPU usage on


Major (if it

last for two

consequential

checks)

Call

Screening

Application

One

Free Space for Drive C in

Application one



Major

Call

Screening

Application

One

Free Space for Drive E in

Application one



Major

Call

Screening

Application

One

Check CSApp1 trace

(Exception)

Check CS traces for

Exceptions

Major


11

Call

Screening

Application

One

Check Expired Messages in

RGS Trace-CS1

Check RGS traces for

Expired Messages

Major

Call Screening Application Server 2

Call

Screening

Application

Two

Call Screening Process Check Call Screening


running or not

Critical

Call

Screening

Application

Two



Critical

Call

Screening

Application

Two

Java Process Check Java Process whether


Critical

Call

Screening

Application

Two



running or not

Critical

Call

Screening

Application

Two

Check the file size for

gctload t1 results

congestion.txt


smaller than 16 b

Minor

Call

Screening

Application

Two


Call

Screening

Application

Two


Status


association

Critical

Call

Screening

Application

Two


gctload t1 results



Minor


12

Call

Screening

Application

Two



Call

Screening

Application

Two


buffer



buffers

Critical

Call

Screening

Application

Two


smaller than 16 b

Minor

Call

Screening

Application

Two


status

Check the status of the

second association

Critical

Call

Screening

Application

Two


Oracle server

Major

Call

Screening

Application

Two

Database Server

Reachability


DB server

Major

Call

Screening

Application

Two


server one



Major (if it

last for two

consequential

checks)

Call

Screening

Application

Two


Application one



Major

Call

Screening

Application

Two


Application one



Major

Call

Screening

Application

Two

Check CSApp1 trace

(Exception)

Check CS traces for

Exceptions

Major


13

Call

Screening

Application

Two


RGS Trace-CS1


Expired Messages

Major

Call

Screening

Application

Two

System insertion for IVR

DRs into database

Check whether records are

being inserted into

IVR_DRs table

Major

Call

Screening

Application

Two

System insertion for net

active subscribers count


being inserted into

net_active_subscribers table

Major

Call

Screening

Application

Two

System insertion into Action

Log Table


being inserted into

action_log table

Minor

Call

Screening

Application

Two

System insertion into Calls

Per Hour Table


being inserted into

callsperhour table

Major

Call

Screening

Application

Two

System insertion into

service subscriber action log

table


being inserted into

service_sub_action_log table

Major

My Status Specific Alarms

My_Status System Insertion into

TDR_Profile


being inserted into

TDR_Profile table

Critical

My_Status System Insertion into

TDR_Service


being inserted into

TDR_service table

Critical

SMS Screening Application Server 1

SMS

Screening

Application

One

Number of

sms_hlr_requests where

transaction_Status = 0

Check the number of

pending requests towards

HLR (threshold: 150)

Major

SMS

Screening

Application

One

The Traffic is Exceeding the

License (480 K/H)

This alarm will monitor the

traffic and give an

indication in case the traffic

exceeds the agreed license

Major


14

SMS

Screening

Application

One



Critical

SMS

Screening

Application

One



running or not

Critical

SMS

Screening

Application

One

SMS Screening Process Check SMS Screening


running or not

Critical

SMS

Screening

Application

One

Check file size for gctload

t1 results congestion.txt


smaller than 16 b

Minor

SMS

Screening

Application

One


SMS

Screening

Application

One


Status


association

Critical

SMS

Screening

Application

One


gctload t1 results



Minor

SMS

Screening

Application

One



SMS

Screening

Application

One


buffer



buffers

Critical

SMS

Screening

Application

One


smaller than 16 b

Minor


15

SMS

Screening

Application

One


status


second association

Critical

SMS

Screening

Application

One


Oracle server.

Major

SMS

Screening

Application

One

Database Server

Reachability


DB server

Major

SMS

Screening

Application

One


server one



Major (if it

last for two

consequential

checks)

SMS

Screening

Application

One


Application One



Major

SMS

Screening

Application

One


Application One



Major

SMS

Screening

Application

One

System Insertion for SMS

DRs into the database


being inserted into

SMS_TDR table

Critical

SMS

Screening

Application

One


RGS Trace


Expired Messages

Critical

SMS

Screening

Application

One

Check Expired Redirect

Messages in RGS Trace


Expired Redirect Messages

Critical


16


SMS

Screening

Application

two



Critical

SMS

Screening

Application

two



running or not

Critical

SMS

Screening

Application

two



running or not

Critical

SMS

Screening

Application

two


Oracle server

Major

SMS

Screening

Application

two

Database Server

Reachability


DB server

Major

SMS

Screening

Application

two


server one



Major (if it

last for two

consequential

checks)

SMS

Screening

Application

two


Application Two



Major

SMS

Screening

Application

two


Application Two



Major


SMS

Screening

Application

three



Critical (if

the node get

active)


17

SMS

Screening

Application

three

MyStatus SMS Manager

Process

Check My Status SMS


is running or not

Critical

SMS

Screening

Application

three




smaller than 16 b

Minor

SMS

Screening

Application

three

Congestion status Check the congestion status Major (if the

node get

active)

SMS

Screening

Application

three


Status


association

Critical (if

the node get

active)

SMS

Screening

Application

three


gctload t1 results



Minor

SMS

Screening

Application

three



SMS

Screening

Application

three


buffer



buffers

Critical (if

the node get

active)

SMS

Screening

Application

three


smaller than 16 b

Minor

SMS

Screening

Application

three


status


second association

Critical (if

the node get

active)

SMS

Screening

Application

three


Oracle server

Major


18

SMS

Screening

Application

three

Database Server

Reachability


DB server

Major

SMS

Screening

Application

three


server one



Major (if it

last for two

consequential

checks and (if

the node get

active)

SMS

Screening

Application

three


Application Three



Major

SMS

Screening

Application

three


Application Three



Major

SMS

Screening

Application

three

Check MS SMSManager

Trace (DB Error)

Check the SMS Manager

traces for Errors in Data

Store

Critical


SMS

Screening

Application

four



Critical (if

the node get

active)

SMS

Screening

Application

four




smaller than 16 b

Minor

SMS

Screening

Application

four

Congestion status Check the congestion status Major (if the

node get

active)

SMS

Screening

Application

four


Status


association

Critical (if

the node get

active)


19

SMS

Screening

Application

four


gctload t1 results



Minor

SMS

Screening

Application

four



SMS

Screening

Application

four


buffer



buffers

Critical (if

the node get

active)

SMS

Screening

Application

four


smaller than 16 b

Minor

SMS

Screening

Application

four


status


second association

Critical (if

the node get

active)

SMS

Screening

Application

four


Oracle server

Major (if the

node get

active)

SMS

Screening

Application

four

Database Server

Reachability


DB server

Major (if the

node get

active)

SMS

Screening

Application

four


server one



Major (if it

last for two

consequential

checks and if

the node get

active)

SMS

Screening

Application

four


Application Four



Major (if the

node get

active)


20

SMS

Screening

Application

four


Application Four



Major (if the

node get

active)


SMS

Screening

Application

Five



Critical

SMS

Screening

Application

Five



running or not

Critical

SMS

Screening

Application

Five



running or not

Critical

SMS

Screening

Application

Five




smaller than 16 b

Minor

SMS

Screening

Application

Five


SMS

Screening

Application

Five


Status


association

Critical

SMS

Screening

Application

Five


gctload t1 results



Minor

SMS

Screening

Application

Five




21

SMS

Screening

Application

Five


buffer



buffers

Critical

SMS

Screening

Application

Five


smaller than 16 b

Minor

SMS

Screening

Application

Five


status


second association

Critical

SMS

Screening

Application

Five


Oracle server

Major

SMS

Screening

Application

Five

Database Server

Reachability


DB server

Major

SMS

Screening

Application

Five


server one



Major (if it

last for two

consequential

checks)

SMS

Screening

Application

Five


Application Five



Major

SMS

Screening

Application

Five


Application Five



Major

SMS

Screening

Application

Five


RGS Trace


Expired Messages

Critical

SMS

Screening

Application

Five

Check Expired Redirect

Messages in RGS Trace


Expired Redirect Messages

Critical


22


SMS

Screening

Application

Six



Critical

SMS

Screening

Application

Six



running or not

Critical

SMS

Screening

Application

Six



running or not

Critical

SMS

Screening

Application

Six




smaller than 16 b

Minor

SMS

Screening

Application

Six


SMS

Screening

Application

Six


Status


association

Critical

SMS

Screening

Application

Six


gctload t1 results



Minor

SMS

Screening

Application

Six



SMS

Screening

Application

Six


buffer



buffers

Critical


23

SMS

Screening

Application

Six


smaller than 16 b

Minor

SMS

Screening

Application

Six


status


second association

Critical

SMS

Screening

Application

Six


Oracle server

Major

SMS

Screening

Application

Six

Database Server

Reachability


DB server

Major

SMS

Screening

Application

Six


server one



Major (if it

last for two

consequential

checks)

SMS

Screening

Application

Six


Application Six



Major

SMS

Screening

Application

Six


Application Six



Major

Whom shall I contact in case of an issue? Please follow the following escalation sequence:

- Globitel hot line: 962797279900, [email protected]

- Support Engineer: Omar Al-Madanat 962 79 7444563

- Support team leader: Mohammad Faraj 962 79 7066685 (in case of middle

management escalation only)

- Operations director: Wisam Ammori 962 79 6565101 (in case of top management escalation only)

Warid Alarms Sheet (CS SMSScr MS)

Documents

Transcript of Warid Alarms Sheet (CS SMSScr MS)