QoS in Mobile Networks of Rwanda - rura.r · PDF file1 PREAMBLE The Regulatory Board of RURA;...

REGULATIONS FOR QUALITY OF

SERVICE OF CELLULAR MOBILE

NETWORKS SERVICES

DOCUMENT CONTROL

Reference Number 00.............../RURA/2018

Originator Rwanda Utilities Regulatory Authority

Print Version

Date of Issue

Website: http://www.rura.rw

Phone: (250) 252 58 45 63

E-mail: [email protected]

P.O Box: 7289 Kigali – Rwanda

TABLE OF CONTENTS

PREAMBLE................................................................................................. 1

ARTICLE 1: PURPOSE OF THESE REGULATIONS ............................................. 2

ARTICLE 2: DEFINITIONS OF TERMS ............................................................ 3

ARTICLE 3: SCOPE OF THESE REGULATIONS ................................................. 4

ARTICLE 4: OBJECTIVES OF THESE REGULATIONS ......................................... 5

ARTICLE 5: MEASUREMENTS ....................................................................... 6

ARTICLE 6: REPORTING AND RECORDING .................................................... 8

ARTICLE 7: PUBLICATION OF MEASUREMENT RESULTS .................................. 9

ARTICLE 8: AUDIT ................................................................................... 10

ARTICLE 9: INVESTIGATION OF THE QUALITY OF SERVICE ............................ 11

ARTICLE 10: REPEALING PROVISIONS ......................................................... 12

ARTICLE 11: COMMENCEMENT ................................................................... 13

APPENDIX 1- KEY PERFORMANCE INDICATORS............................................. 14

APPENDIX 2- MEASUREMENT METHODS ...................................................... 17

1

PREAMBLE

The Regulatory Board of RURA;

Pursuant to Law N°24/2016 of 18/06/2016 governing information and communication

technologies especially in its article 30;

Pursuant to Law Nº09/2013 of 01/03/2013 establishing the Rwanda Utilities Regulatory Authority;

Given the Presidential Order No 04/01 of 15/03/2004 determining specific duties of the Regulatory

Board in Telecommunications matters, especially in Article 3;

Having reviewed the current Quality of service of cellular mobile networks services in Rwanda;

Recognizing the importance of improving the Quality of service in cellular mobile networks services

and the potential impact of these services on internal and international market access for all users;

AFTER its deliberations in its meeting of ...........................................................................

HEREBY issues the following regulations for “Quality of Service of Cellular Mobile Networks

Services”.

2

ARTICLE 1: PURPOSE OF THESE REGULATIONS

These regulations determine the quality of service of cellular mobile networks services in Rwanda.

3

ARTICLE 2: DEFINITIONS OF TERMS

In these regulations, unless the context otherwise requires, the following terms shall be defined as

follows:

a) CELL: is the radio frequency coverage area of a site in radio access network which is part of

a cellular mobile telephone network and in case it is an Omni-site, it is synonymous with the

site; and at a sectored site, it is synonymous with the sector;

b) KPI: Key Performance Indicator;

c) LATENCY: a measure of the time delay experienced by a system;

d) LTE: Long Term Evolution; LTE is commonly marketed as 4G;

e) MNO: are all licensees holding the “cellular mobile” licenses and are under the regulation of

the Regulatory Authority in the Republic of Rwanda;

f) MO: Mobile Originated;

g) MT: Mobile Terminated;

h) OSS: Operations support systems (OSS), or operational support systems;

i) POLQA: Perceptual Objective Listening Quality Assessment;

j) QOS: Quality of Service;

k) QUALITY OF SERVICE: is the main indicator of the performance of a telecommunication

network and of the degree to which such network conforms to the standards of such quality of

service as specified in these regulations for specified parameters;

l) REGULATORY AUTHORITY: is the Rwanda Utilities Regulatory Authority for the

regulation of certain public utilities including Telecommunications networks and /or

telecommunications services;

m) SMS: Short Message Service;

n) SMSC: Short Message Service Centre;

4

ARTICLE 3: SCOPE OF THESE REGULATIONS

These regulations shall apply to any licensed MNO within Rwanda.

All licensed MNOs shall be bound by the provisions of these regulations in so far as their

business activities are intended to provide cellular mobile network services.

5

ARTICLE 4: OBJECTIVES OF THESE REGULATIONS

These regulations shall have the following objectives:

i. To enforce service quality delivery by MNOs

ii. To maintain service quality, while recognizing environmental and operating

conditions;

iii. To make QoS information available to Customers;

iv. To assist the development of related telecommunications markets.

6

ARTICLE 5: MEASUREMENTS

(a) MNO shall monitor performance of the network it administers and quality of service it

provides. MNO shall have appropriate tools, mechanisms and processes in place to facilitate

the measurements and to have ability to take corrective actions when necessary. MNO shall

document its approach to meet this requirement.

(b) MNO shall make three kinds of measurements:

i. Drive Test (DT) measurements of network KPIs as specified in Table 1 of Appendix

1. MNOs should make complete DT activity twice a year and provide the report of

the test results as requested in point (d) of this article;

ii. OSS KPIs that are following MNOs own OSS counters and calculation methods. The

Report should consist of KPIs presented at point (c), 24 hours/7 days a week. OSS

KPIs are requested to enable Regulatory Authority to follow networks performance.

OSS KPIs methodology is not defined on this document. KPIs will follow MNO’s

own performance KPI definition and counters. Calculation methodology and

counters to be shared between MNOs and the Regulatory Authority. 1

iii. Coverage prediction for all mobile technologies provided by the licensee. MNOs

should submit coverage prediction information for both geographic and population

coverage every quarter; the coverage information and related statistics shall be

submitted respectively by 31st March, 30th June, 30th September and 31st December,

and in no case not later than 15 working days counting from the specified dates.

(b) Unless otherwise stated in these regulations, the reports on measurements taken and recorded

from OSS shall be submitted to the Regulatory Authority on monthly basis. The monthly

OSS reports shall be delivered on the last day of each month, and in no case not later than 5

working days counting from the said day. OSS KPI report shall be presented in graphs

including data from past 3 months (on daily basis). OSS KPI graphs:

i. Call Setup Success Rate CSSR % (all available technology)

ii. Call Drop Rate CDR % (all available technology)

iii. Handover Success Rate % (all available technology)

iv. Service Availability % (all available technology)

v. Data Throughput Mbit/s (2G/3G & 4G)

(c) MNOs shall present the DT results by every half year; the reports shall be delivered

respectively by 30th June and 31st December, and in no case not later than 15 working days

counting from the specified dates. The Regulatory Authority shall specify the routes to be

used for DT measurements within the first month of each 6-month reporting period. Each

operator must provide editable electronic (MS Word / Excel) versions of the reports.

1 OSS KPIs are used for information purposes only

7

(d) For measurements and verification functions, the Regulatory Authority shall use the

following methods to audit MNOs networks: Drive test, Consumer survey, Data acquired

from OSS and submitted by Licensees. OSS data will be delivered by using MNOs own

counters and reporting from OSS. The Regulatory Authority is not limited to the methods

mentioned above.

8

ARTICLE 6: REPORTING AND RECORDING

(a) The reporting areas, which are the geographic areas for which measurements are taken and

recorded shall be reported on both National- and Province-specific basis. The Provinces

(reporting areas) are as follows:

i. City of Kigali

ii. Northern Province

iii. Southern Province

iv. Western Province

v. Eastern Province

However, the Regulatory Authority may extend reporting areas up to the District Level.

(b) Unless the Regulatory Authority permits in writing, two or more reporting areas shall not be

combined into one reporting area for particular Licensees, parameters, services and reporting

periods.

(c) For each parameter which is reportable for a service, for each reporting area and for each

reporting period, a Licensee shall perform the following tasks during measurement, reporting

and recording:

i. Taking the measurements according to the measurement methods defined in

the APPENDIX 2: Measurement Methods.

ii. Submitting the measurement reports to the Regulatory Authority as specified

in Article 5.

iii. Identifying all material deviations from the KPI targets and drafting an action

plan to fix the deviations.

iv. Submitting any additional information requested by the Regulatory

Authority, including details of the times, places and other details of the

measurements, within one (1) month after the end of the reporting period or

as may be otherwise directed by the Regulatory Authority;

v. Retaining quality of service data, including all measurements and related

records (log files), for a minimum of twelve (12) months after the end of

reporting period or as may be otherwise directed by the Regulatory Authority.

9

ARTICLE 7: PUBLICATION OF MEASUREMENT RESULTS

(a) The Regulatory Authority may publish the measurement results within two (2) months after

the end of the reporting period to which the measurements apply.

(b) For each parameter which is reportable for a service, for each reporting area and for each

reporting period, measurement results to be published by the Regulatory Authority shall be

set out in tables that contain, for each Licensee:

i. The name for the service used by the Licensee;

ii. An identification of the reporting area for which the measurements were

taken;

iii. An indication of any target for the parameter and the service that has not

been reached by the Licensee;

iv. Any other information or comparison of service quality that the

Regulatory Authority determines to be appropriate, possibly including

information to help customers to assess the performance of competing

Licensees.

10

ARTICLE 8: AUDIT

(a) The Regulatory Authority shall conduct quality of service audit of mobile networks of

Licensees. In doing so, the Regulatory Authority may vary the regularity and frequency of

the audits, as well as the Licensees, services, parameters, reporting areas and reporting

periods that require audits.

11

ARTICLE 9: INVESTIGATION OF THE QUALITY OF

SERVICE

(a) The Regulatory Authority may investigate at any time the quality of service measurement

methodologies, reporting and recording procedures of a Licensee. In doing so, the Regulatory

Authority may exercise its powers of monitoring and enforcement of obligations.

(b) The KPIs set in Appendix 1 represent minimum acceptable levels of QoS in MNOs

networks. Thus it is of utmost importance that the KPIs are achieved and maintained. In case

an MNO fails to meet one or more of the KPIs, the Regulatory Authority exercises all the

necessary enforcement powers provided in the ICT law and other relevant legislation to

ensure that the MNOs fulfil their KPI commitments.

12

ARTICLE 10: REPEALING PROVISIONS

All prior provisions contrary to these regulations are hereby repealed.

13

ARTICLE 11: COMMENCEMENT

These regulations shall come into force on the date of its signature.

KIGALI, ON

……………………

Eng Coletha RUHAMYA

CHAIRPERSON OF THE REGULATORY BOARD

APPENDIX 1- KEY PERFORMANCE INDICATORS

TABLE 1: CELLULAR MOBILE NETWORKS VOICE, SMS AND DATA SERVICES → CALLED

DRIVE TEST KPIS

S/N PERFORMANCE

INDICATORS THRESHOLD

2G VOICE SERVICE:

1. Call set up time (CST) ≤ 9 sec in ≥ 98% of the cases.

2. Call Setup Success Rate (CSSR) ≥ 95 %

3. Call Drop Rate (CDR)

≤ 2%

4. Voice Quality (MOS) For ≥ 75% of samples ≥ 3 using MOS, POLQA WB algorithms.

2G& 3G VOICE SERVICE (Dual Mode)




≤ 2%

8. Voice Quality (MOS) For ≥ 80% of samples ≥ 3 using MOS, POLQA WB algorithms.

2G SMS SERVICE

9. SMS Send Success Rate ≥ 96%

10. SMS e2e Delivery Success Rate ≥ 95%

11. SMS Send time 3,5 seconds, (Median)

12. SMS e2e Delivery Time 6 seconds, (Median)

3G SMS SERVICE

13. SMS Send Success Rate ≥ 96%

14. SMS e2e Delivery Success Rate ≥ 95%

15. SMS Send time 3 seconds, (Median)

15

16. SMS e2e Delivery Time 6 seconds, (Median)

CS FALL BACK LTE (Mobile to Mobile)




≤ 2%

2G/3G PS DATA SERVICES

20. Application Throughput 80 % of Download ≥ 2,5 Mbit/s

21. Round Trip Time RTT (Latency) Median value ≤ 300ms

4G PS DATA SERVICES

22. Application Throughput 80 % of Download ≥ 10 Mbit/s

23. Round Trip Time RTT (Latency) Median value ≤ 50ms

NETWORK COVERAGE AND QUALITY

24. 2G Signal Strength RxLev ≥ -95 dBm (98% area)

25. 3G Signal Strength RSCP ≥ -105 dBm (98% area)

26. 3G Signal Quality Ec/No ≥ -14 dBm (90% area)

27. 4G Signal Strength RSRP ≥ -115 dBm (98% area)

28. 4G Signal Quality RSRQ ≥ -15 dBm (90% area)

TABLE 2: END USER HOTSPOT TEST

END USER TEST CASES

S/N PERFORMANCE


1. Web Page Access Success Rate ≥ 99 %

2. Web Page Completion Success

Rate

≥ 98 %

16

3. Web page Download time (s)

4. Video streaming set up Success

rate

≥ 99 %

5. Video streaming Completion

Success Rate

≥ 98 %

TABLE 3: COVERAGE ESTIMATION BASED ON PLANNING TOOL PREDICTION

PLANNING TOOL BASED COVERAGE PLOTS

S/N PERFORMANCE


1. 2G coverage, Relevant of service

provider

≥ -95 dBm (96% of country area)


provider



provider


17

APPENDIX 2- MEASUREMENT METHODS

TABLE 2: MEASUREMENT METHODS OF CELLULAR MOBILE (VOICE, 3G DATA AND SMS

SERVICES)

Parameter Name Measurement Method

MOBILE NETWORKS

Voice Service

Call Setup Time

(CST)

Definition: according to ETSI TS 102 250-2: Telephony Setup Time [s]. Time between

sending of complete address information and receipt of call set-up notification.

Equation:

Call Setup Time = t2 – t1

Where: t1: point of time where the customer presses the send button on mobile equipment

(command for call establishment is sent from test SW). t2: point of time where connect is

established (Called party answered).

Refer to ETSI TS 102 250-2

Call Setup Success

Rate (CSSR)

Definition: applying ETSI TS 102 250-2: Mobile Service Non-Accessibility: Probability

that the end-user can access the Mobile Service when requested if it is offered by display of

the network indicator on the Mobile Equipment. Stop triggering point: Called party

answered.

Equation:

Call Setup Success Rate [%] = 100 * (Number of call attempts - Number of

unsuccessful call attempts) / Number of call attempts.


Call Drop Rate

(CDR)

Definition: according to ETSI TS 102 250-2: Call Drop Rate: Probability that a successful

call attempt is ended by a cause other than the intentional termination by A- or B-party.

Equation:

Call Drop Rate [%] = 100 * Number of unintentionally terminated telephony calls /

Number of successful telephony call attempts.


18

Speech Quality

(MOS)

Definition: according to ETSI TS 102 250-2: Speech Quality on Call basis (SpQ-C).

Indicator representing the quantification of the end-to-end speech transmission quality of

the Mobile Telephony Service. This parameter computes the speech quality on the basis of

completed calls. That is, for each completed call, average downlink MOS scale speech

quality value is calculated.

Equation: POLQA Algorithm ITU P.863

Listening-quality scale

Quality of the speech Score

Excellent 5

Good 4

Fair 3

Poor 2

Bad 1

The quantity evaluated from the scores (mean listening-quality opinion score, or simply

mean pinion score) is represented by the symbol MOS.

Note: PESQ (ITU-T Rec. P.862). is not recommender to use with HD-Voice in wideband

and super-wideband speech signals

SMS Service

SMS Send

Success Rate

Definition: applying ETSI TS 102 250-2: SMS Service Non-Accessibility MO: Probability

that the end-customer can access the Short Message Service when requested while it is offered

by display of the network indicator on the Mobile Equipment.

Equation:

SMS Send Success Rate [%] = 100 * Successful SMS service attempts/ Number of SMS

attempts.


SMS End-to-End

Delivery Success

Rate

Definition: applying ETSI TS 102 250-2: SMS Completion Failure Ratio: Ratio of received

and sent test SMS from one mobile to another mobile part, excluding duplicate received and

corrupted test SMS.

Equation:

SMS End-to-end Delivery Success Rate [%] = 100 * (received test SMS - duplicate

received test SMS - corrupted test SMS) / Number of SMS attempts.


19

SMS Send Time Definition: according to ETSI TS 102 250-2: SMS Access Delay MO [s]: Time between

sending a Short Message to a Short Message Centre (SMSC) and receiving the notification

from the Short Message Centre.

Equation:

SMS Send Time [s] = t2-t1. t1: time when "send" button is pushed in terminal (MO)

Where: t2: point of time when the terminal (MO) receives confirmation from the SMS center.


SMS End-to-End

Delivery Time [s]

Definition: according to ETSI TS 102 250-2: SMS End-to-End Delivery Time (MO/MT) [s].

Time between sending a Short Message to a Short Message Centre and receiving the very

same Short Message on another mobile equipment.

Equation:

SMS End-to-End Delivery Time [s] = t2-t1. t1: time when "send" button is pushed in terminal

(MO).

Where: t2: Time when the mobile equipment 2 receives the Short Message from mobile

equipment 1.


DATA SERVICE

Application

Throughput

Definition: according to ETSI TS 102 250-2: FTP Download Mean Data Rate [Mbit/s]. After

a data link has been successfully established, this parameter describes the average data transfer

rate measured throughout the entire connect time to the service. The data transfer shall be

successfully terminated. The prerequisite for this parameter is network and service access.

Equation:

Application Layer Throughput [Mbit/s] = user data transferred [Mbit] / (t2-t1).

Where: t1: time data transfer started. t2: time data transfer completed

Note: FTP server must be located within third party company premises where verification test

can be repeated. Location to be in Rwanda and Regulatory Authority to have access on it.

Round Trip Time Definition: According to ETSI TS 102 250-2: Ping Round Trip Time [ms]. The round trip

time is the time required for a packet to travel from a source to a destination and back. It is

used to measure the delay on a network at a given time. For this measurement the service must

already be established.

Equation:

Round Trip Time [msec] = t2-t1

Where: t1: time packet sent. t2: packet received

Note: FTP server must be located within third party company premises where verification test

20

can be repeated. Location to be in Rwanda and Regulatory Authority to have access on it.

Coverage; RX-

Level (2G)

Description: Average GSM signal level (dBm) for best Measured GSM channel

Measurement:

Coverage availability (GSM)=

Coverage; RSCP

(3G)

Description: Average UMTS signal level (dBm) for best Measured UMTS carrier

Measurement:

Coverage; RSRP

(LTE)

Description: Average LTE signal level (dBm) for best Measured LTE carrier

Measurement:

Coverage availability (LTE)=

HOTSPOT MEASUREMENT PROPOSAL

Web Page Access

Success Rate (%)

Definition: Percentage of times that the subscriber is able to access web browsing service

over the total number of attempts

Condition: PDP context is activated

Trigger Points:

Start: user initiates the web page request

Stop: first content is received

Computation:

(1-(Unsuccessful Attempts to Retrieve Web page Content/Total Number of Web page

Retrieve Attempts))*100

Web Page

Completion

Success Rate (%)

Definition: Proportion of times that the web page is successfully retrieved ones the download

has already started over the total number of times that the service is accessible

Condition: The web browsing service is accessible and the first data content has already

arrived to the UE

Trigger Points:

Start: first content arrives to the UE

Stop: the whole web page is retrieved

Computation:

(1-(Number of incomplete HTTP data retrievals/Total number of successfully started HTTP

retrievals))*100

Coverage availability (UMTS

21

Web page

Download time

(s)

Definition: Time needed to successfully retrieve the content of a web page

Condition: The web page retrieval has been successful

Trigger Points:

Start: user request the web page content

Stop: all the web page content has been retrieved

Computation:

t web page contents retrieved - t user requests web page

Video streaming

set up Success

rate (%)

Definition: Ratio of successful stream reproduction starts user request the stream

Condition: PDP context is activated

Trigger Points:

Start: user initiates the video request

Stop: the video streaming starts

Computation:

(1-(Number of reproductions NOT started/Total number of streaming Attempts))*100

Video streaming

Completion

Success Rate (%)

Definition: Proportion of the times that the video is reproduced until the end and the number

of times that the reproduction is started

Condition: Streaming reproduction has started successfully

Trigger Points:

Start: streaming reproduction starts

Stop: reproduction reaches the end of the stream

Computation:

(1-(Number of reproduction drops /Total number of streaming started))*100

22

KIGALI, ON

……………………

Dr Ignace GATARE

CHAIRPERSON OF THE REGULATORY BOARD

QoS in Mobile Networks of Rwanda - rura.r · PDF file1 PREAMBLE The Regulatory Board of RURA;...

Documents

Transcript of QoS in Mobile Networks of Rwanda - rura.r · PDF file1 PREAMBLE The Regulatory Board of RURA;...