OFTA Metering and Billing Standardstel_archives.ofca.gov.hk/en/b_m_issues/210602_4.pdf · Systems -...

HKTA 3104

Issue 2

December 2005

Quality Assurance Manual for

Billing and Metering Integrity Scheme

TELECOMMUNICATIONS AUTHORITY

HONG KONG

___________________________________________________________________________________ HKTA 3104 Issue 2

FOREWORD

1. On 30 May 2000, the Office of the Telecommunications Authority (OFTA) issued

a Consultation Paper on “Billing and Metering Accuracy of Public Telecommunications

Services in Hong Kong” proposing to implement a scheme that would best suit the need

of customers and the industry and at the same time be economically and technically

feasible for implementation in Hong Kong’s environment.

2. Having considered the submissions from the industry on the above Consultation

Paper, the Telecommunications Authority (TA) issued a Statement on 4 August 2000 to

set out his considered views and intention that there is a genuine need to introduce and

implement such a scheme in Hong Kong for enhancement of the confidence of the

customers on billing and metering accuracy of the industry. In order to ensure early

implementation of the proposed scheme, OFTA set up an industry forum on 15

September 2000 with participation of representatives from the concerned

telecommunications operators and their associations, the Consumer Council and user

groups to devise the details of the proposed scheme called “Billing and Metering

Integrity Scheme” (BMIS) which includes the billing and metering integrity standards,

self-appraisal system, assurance system, reporting system, monitoring system and

implementation plan.

3. The Quality Assurance Manual has been developed to specify the required

metering and billing integrity standards as well as the self-appraisal requirements and

procedures to be followed and complied by the industry. Apart from this document,

another major document called HKTA 3105, “Requirements on the Assurance,

Reporting and Monitoring Procedures for the Billing and Metering Integrity Scheme”

listing the general requirements and procedures on the assurance, reporting and

monitoring has also been developed in order that the industry could follow and observe

these requirements and procedures closely in compliance with BMIS.

4. All the HKTA specifications, consultation papers, statements and information

notes issued by the Telecommunications Authority related to the BMIS can be obtained

by downloading them from the OFTA's Internet website: http://www.ofta.gov.hk.

___________________________________________________________________________________ HKTA 3104 Issue 2

5. Any enquiry or request for further information regarding this manual can be

addressed to :-

Senior Telecommunications Engineer (Regulatory Section 11)

Office of the Telecommunications Authority

29/F, Wu Chung House,

213 Queen's Road East,

Wanchai, Hong Kong.

Fax: +852 2803 5112

E-mail: [email protected]

___________________________________________________________________________________ HKTA 3104 Issue 2

AMENDMENT TABLE

Item Issue No. Paragraph Descriptions

1 2 Foreword Update the contact point.

2 2 9.1.1 The interval of submission of self-declaration forms is revised from “quarterly” to “half-yearly”.

3 2 9.2.1 Ditto

4 2 9.2.4 Ditto

5 2 9.2.5 Ditto

6 2 Section 10 Update the reference documents

___________________________________________________________________________________ HKTA 3104 Issue 2

Table of Contents

Page

1. Introduction 6

2. Glossary 7

3. Scope of the Manual 9

4. Billing and Metering Integrity Standards 9

5. Telecommunications Acceptance Models 10

5.1 Telecommunications Metering Acceptance Model 10

5.2 Telecommunications Billing Acceptance Model 14

6. Testing Tolerance Levels 17

6.1 Metering Tolerance 17

6.2 Billing Tolerance 17

6.3 Rounding Treatments 18

7. Verification of Metering and Billing System 20

7.1 Metering Test 20

7.2 Billing Test 30

7.3 Pre-paid Services 32

8. Guidelines to Design Operator’s Detailed Operation Manual 39

8.1 Introduction 39

8.2 Details of Each Section 39

9. Monthly Test Report 44

9.1 Introduction 44

9.2 Self-Declaration Procedures 44

9.3 Format of Test Report 45

10. Reference Documents 49

___________________________________________________________________________________ HKTA 3104 Issue 2

Annex 1 Switching Rules and Procedures 50

Annex 2 Self-Declaration Form for Compliance Status 51

Annex 3 Self-Declaration Form for the Metering Test 52

Annex 4 Self-Declaration Form for the Billing Test 53

Annex 5 Format of Metering and Billing Test Report 54

Annex 6 Inspection Status 62

Annex 7 Format of Test Report for Rounding Treatment Test 63

___________________________________________________________________________________ HKTA 3104 Issue 2

1. Introduction

1.1 The main purpose of this Quality Assurance Manual (QAM) is to provide a quality

assurance framework such that the operators can implement their self-appraisal systems

in a timely and responsive manner in compliance with the BMIS. It is hoped that this

manual would also facilitate the understanding of the general public on what controls

and measures are to be implemented by operators to assure the accuracy and integrity of

their bills issued to customers.

1.2 This manual is published, distributed and maintained by OFTA. Apart from this

manual, the operators are required to develop their own Detailed Operation Manual

(DOM) and perform measurements or generate Test Calls in accordance with the

requirements and procedures stipulated in this manual.

1.3 If necessary, OFTA or OFTA’s appointed agent will perform an on-site audit on

operators’ Billing and Metering Systems.

1.4 Operators are encouraged to implement ISO 9001: 2000 “Quality Management

Systems - Requirements” in their Billing and Metering Systems so that a

well-established process control mechanism can be developed. However, the

compliance or adoption of this ISO requirement by operators is voluntary and up to

operators’ individual commercial decision and operational requirements. If necessary,

OFTA may conduct a review and consultation with operators on whether there is a

genuine need for operators to strengthen the process control of billing and metering

systems by generally adopting this and/or other related ISO requirements.

___________________________________________________________________________________ HKTA 3104 Issue 2

2. Glossary

Acceptance Number The number that is used for determining monthly test acceptability, i.e. the number of failed samples allowable in a test.

Acceptance Quality Limit (AQL)

Quality level that is the worst tolerable process average when a continuing series of lots is submitted for acceptance sampling. In BMIS, AQL refers to the quality level to show the likely percentage of failed items in a monthly Metering/Billing Test.

Billing Billing means the function of public telecommunications operators or service providers in: - assembling the charges incurred by a customer during the billing period;

- applying any debts or credits outstanding or discounts due and calculating the net amount to be paid by the customer; and - issuing the bill.

Billing Tolerance The maximum deviation allowed in each call charge of Billing Test.

Call Detail Records (CDR)

Records of detailed information such as call type, call start time, call duration, calling party, called party etc captured by the switches.

Call Duration The interval between the call is actually established that begins when the call is answered and ends when the call is terminated.

Called Party A called party is the person who receives the call.

Calling Party A calling party is the person who originates the call.

Certified Public Accountant (CPA)

Certified Public Accountant means a professional accountant registered as such by virtue of section 24 of the Professional Accountants Ordinance (Chapter 50) and holding a valid and current practising certificate.

Charged Party A charged party is the person registered with the telecommunications operator or service provider concerned responsible for the payment or settlement of a specific or group of bills.

Charging Time Stamp

Charging time stamp is the time recorded in a CDR used for calculating the charge amount for the services provided or consumed and the applicable tariff thereto.

Delay The time required for a signal to transit from the sending point to the receiving metering point.

___________________________________________________________________________________ HKTA 3104 Issue 2

Metering

The process of capturing and recording call details such as calling number, time of day, call duration etc. for billing purpose.

Metering Tolerance The maximum deviation allowed for call duration in the Metering Test.

Per Call Test A two-part Metering Test: Part 1 to reconcile Test Call log records with call details from a metering point and Part 2 to reconcile call details from that metering point with call details from Billing System.

Switching Rules A set of rules to control the switching of status between Normal, Reduced, Tightened and Discontinue Inspection.

Test Call A call generated manually or automatically to verify the functioning and accuracy of a Metering System.

___________________________________________________________________________________ HKTA 3104 Issue 2

3. Scope of the Manual

This manual describes the billing and metering integrity standards, the sampling models,

metering / billing tolerance levels, the verification procedures and the format of the test

report as required by the BMIS. It also provides guidance for operators to design their

own DOM.

4. Billing and Metering Integrity Standards

The billing and metering integrity standards of public telecommunications services are

described as below:-

Metering Integrity Standard

Number of inaccurately metered calls shall not exceed 1 in 10,000 of total calls.

Billing Integrity Standard

Absolute summation error value of the inaccurately billed calls in a bill shall not

exceed 1 in 10,000 of the value of total billed sum in that bill.

___________________________________________________________________________________ HKTA 3104 Issue 2

5. Telecommunications Acceptance Models

5.1 Telecommunications Metering Acceptance Model (the Metering Model)

Introduction

5.1.1 The sampling model for Metering System is developed in accordance with ISO

2859-1: 1999(E) “Sampling Procedures for Inspection by Attributes – Part 1: Sampling

Schemes Indexed by Acceptance Quality Limit (AQL) for Lot-by-Lot Inspection” on the

condition that live traffic should be used in the first place. AQL is a quality level to show

the likely percentage of failed items in a monthly Metering Test. This manual has made

use of the same or similar terms given in the above ISO document. If there were practical

and technical limitations such that live traffic could not be used, operators could use Test

Calls that should be conducted in the same environment and conditions of live traffic

within the concerned operators’ networks.

5.1.2 The purpose of the monthly Metering Test is to examine whether the metering

integrity standard of 1:10,000 given in Section 4 is met and to ensure an acceptable

quality level in metering accuracy for a specific traffic in a month. Operators shall start

from the normal inspection. Normal, tightened or reduced inspection shall continue to be

unchanged on successive monthly Metering Tests, except where the Switching Rules

require changes. The Switching Rules shall be applied to each class of non-conformities

or nonconforming units independently.

Number of Test Calls for Metering Test

5.1.3 The Telecommunications Metering Acceptance Model (the Metering Model)

governs the acceptance criteria and the amount of Test Calls to be conducted by

operators of Fixed Telecommunications Network Services (FTNS), mobile network

services (including services provided by Public Mobile Radiotelephone Services

Licensees, Personal Communications Services Licensees and Mobile Carrier Licensees),

Public Non-exclusive Telecommunications Services (PNETS) (for example, External

Telecommunications Services (ETS), International Calling Card Services, Virtual

Private Network Services, International Simple Resale (ISR) for Facsimile and Data

(ISR fax and data), International Value-Added Network Services and Internet Services

Providers (ISP), Mobile Virtual Network Operators (MVNO) etc.). The Metering Model

follows some of the requirements in ISO 2859-1:1999(E) with the details given in the

___________________________________________________________________________________ HKTA 3104 Issue 2

following table:

Number of Test Calls Per Month Per Licence (Note 1)

Reduced Inspection

Normal Inspection

Tightened Inspection

Acceptance No / Rejection No

AQL

FTNS/Mobile/PNETS 500 1250 2000 0, 1 0.01%

Table 1 : Telecommunications Metering Acceptance Model

Note 1 : Each mobile network operator is required to conduct a number of Test Calls

stated in Table 1 irrespective of number of licences issued to that particular operator for

operation of second generation mobile services (i.e. GSM 900/1800, TDMA and CDMA

technology).

Switching Rules

5.1.4 The diagram showing details of the Switching Rules is attached in Annex 1.

Normal to Tightened

5.1.5 Under the normal inspection, operators are required to sample or generate a

specific number of live or Test Calls every month in accordance with the requirements in

Table 1. When two monthly Metering Tests out of five consecutive monthly Metering

Tests (or fewer than five consecutive monthly Metering Tests) have been non-acceptable

on original inspection, operators are required to implement the requirements of the

tightened inspection.

Tightened to Normal

5.1.6 Under the tightened inspection, operators are required to sample or generate a


Table 1. When five consecutive monthly Metering Tests that have been considered

acceptable on original inspection, operators are allowed to switch to the normal

inspection.

Normal to Reduced

5.1.7 Under the normal inspection, operators are required to sample or generate a


Table 1. Operators can switch to the reduced inspection provided that all of the following

___________________________________________________________________________________ HKTA 3104 Issue 2

conditions are satisfied:

a) the current value of the switching score (see Section 5.1.8) is at least 30; and

b) reduced inspection is considered desirable by the operator.

Remark: the ISO 2859-1’s criterion of “production is at a steady rate ” is not applied to

the Metering Model when switching from the normal inspection to the reduced

inspection.

Switching Score

5.1.8 The calculation of the switching score shall be initiated at the start of normal

inspection. The switching score shall be set at the zero value at the start and updated

following the inspection of each subsequent monthly Metering Test on original normal

inspection. When the acceptance number is 0, add 2 to the switching score if a specific

monthly Metering Test is accepted; otherwise reset the switching score to zero. For

example, the switching score is 2 when the monthly Metering Test in, say, May 2002 is

passed. The switching score is 4 when monthly Metering Tests in May 2002 and June

2002 are passed. The switching score is reset to zero if the monthly Metering Test in July

2002 failed.

Reduced to Normal

5.1.9 Under the reduced inspection, operators can switch to the normal inspection if

any of the following conditions occur on original inspection:

a) a monthly Metering Test is not accepted; or

b) instructions given by the TA that normal inspection shall be re-instated.

Remark: ISO 2859-1’s criterion of “production becomes irregular or delayed” is not

applied to the Metering Model when switching from the reduced inspection to the

normal inspection.

Discontinuation of Inspection

5.1.10 If the cumulative number of monthly Metering Tests not accepted in a sequence

of consecutive monthly Metering Tests on original tightened inspection reaches 5, the

acceptance procedures from Section 5.1.4 to Section 5.1.9 shall not be resumed until the

___________________________________________________________________________________ HKTA 3104 Issue 2

operator concerned has already improved its quality assurance system in a manner to the

satisfaction of the TA. Tightened inspection shall then be used as if Section 5.1.5 had

been invoked.

___________________________________________________________________________________ HKTA 3104 Issue 2

5.2 Telecommunications Billing Acceptance Model (the Billing Model)

5.2.1 The Billing Model is also based on ISO 2859-1:1999(E). Operators are required

to perform a Billing Test each month by sampling a number of bills specified with

respect to the applicable status in Table 2 below. The purpose of the monthly Billing Test

is to examine whether the billing integrity standard of 1:10,000 given in Section 4 is met

and to ensure an acceptable quality level of billing accuracy for the bills issued in a

month.

Number of Bills to be Sampled Each Month

Acceptance No /

Rejection No

AQL

Sample 32 bills in the reduced inspection Sample 50 bills in the normal inspection Sample 80 bills in the tightened inspection

0, 1 0.25%

Table 2 : Telecommunications Billing Acceptance Model

5.2.2 A specific monthly Billing Test is considered to be not acceptable if the individual

total error sum over the total billed sum of any sampled telephone bill is greater than

1/10,000.

Normal to Tightened

5.2.3 The Switching Rules as specified in Annex 1 are also applicable to the Billing

Model. Under the normal inspection, operators are required to sample a specific number

of bills every month in accordance with the requirements in Table 2. When two monthly

Billing Tests out of five consecutive monthly Billing Tests (or fewer than five

consecutive monthly Billing Tests) have been non-acceptable on original inspection,

operators are required to implement the requirements of the tightened inspection.

Tightened to Normal

5.2.4 Under the tightened inspection, operators are required to sample a specific number

of bills every month in accordance with the requirements in Table 2. When five

consecutive monthly Billing Tests which have been considered acceptable on original

inspection, operators are allowed to switch to the normal inspection.

Normal to Reduced

___________________________________________________________________________________ HKTA 3104 Issue 2

5.2.5 Under the normal inspection, operators are required to sample a specific number

of bills every month in accordance with the requirements in Table 2. Operators can

switch to the reduced inspection provided that all of the following conditions are

satisfied:

a) the current value of the switching score (see Section 5.2.6) is at least 30; and

b) reduced inspection is considered desirable by the operator.

Remark: the ISO 2859-1’s criterion of “production is at a steady rate” is not applied to

the Billing Model when switching from the normal inspection to the reduced inspection.

Switching Score

5.2.6 The calculation of the switching score shall be initiated at the start of the normal

inspection. The switching score shall be set at the zero value at the start and updated

following the inspection of each subsequent monthly Billing Test on original normal

inspection. When the acceptance number is 0, add 2 to the switching score if a specific

monthly Billing Test is accepted; otherwise reset the switching score to zero. For

example, the switching score is 2 when the monthly Billing Test in, say, May 2002 is

passed. The switching score is 4 when monthly Billing Tests in May 2002 and June 2002

also passed. The switching score is reset to zero if the monthly Billing Test in July 2002

failed.

Reduced to Normal

5.2.7 Under the reduced inspection, operators can switch to the normal inspection if

any of the following conditions occur on original inspection:

a) a monthly Billing Test is not accepted; or

b) instructions given by the TA that normal inspection shall be re-instated.

Remark: the ISO 2859-1’s criterion of “production becomes irregular or delayed” is not

applied to the Billing Model when switching from the reduced inspection to the normal

inspection.

Discontinuation of Inspection

5.2.8 If the cumulative number of monthly Billing Tests not accepted in a sequence of

___________________________________________________________________________________ HKTA 3104 Issue 2

consecutive monthly Billing Tests on original tightened inspection reaches 5, the

acceptance procedures from Section 5.2.3 to Section 5.2.7 shall not be resumed until the

operator concerned has improved its quality assurance system in a manner to the

satisfaction of the TA. Tightened inspection shall then be used as if Section 5.2.3 had

been invoked.

___________________________________________________________________________________ HKTA 3104 Issue 2

6. Testing Tolerance Levels

6.1 Metering Tolerance

6.1.1 Since the metering device of a network is usually not located at the customer end,

the measured duration will have a small difference from that perceived by the customer.

Therefore, it is necessary to introduce a term known as Metering Tolerance. Delay is the

main cause of the Metering Tolerance.

6.1.2 The following are the Metering Tolerance for different services:

Type of Services Tolerance

IDD on Fixed Network Service

Mobile Service (Note 2)

Mobile Prepaid Service

ETS Service

ETS Calling Card Service

Fixed Network Calling Card Service

Modem Dial-up Internet Service/IVANS

+/- 5100 ms

+/- 6980 ms

+/- 7640 ms

+/- 4200 ms

+ 7150 ms

+ 6550 ms

+ 54.5 seconds

Table 6.1 Metering Tolerance for Different Services

Note 2: Mobile Service is applicable to mobile local calls, mobile IDD calls and mobile

ETS calls.

6.1.3 Apart from Metering Tolerance for call duration, four more parameters need to be

tested in the Metering Test. These parameters are Calling Party, Called Party, Charged

Party and Charging Time Stamp.

6.1.4 No tolerance or error is allowed for recording of the Calling Party, the Called

Party and the Charged Party. These parameters must be checked if they are relevant to

the charging accuracy. Tolerance for the charging time stamp is +8.5 seconds and -5.5

seconds and this parameter needs to be checked if it is relevant to the charging accuracy.

6.2 Billing Tolerance

6.2.1 During the Billing Test, call records from Billing System would be rerated by

operators in accordance with the billing logic/tariff plan. This rerated per call charge will

be compared with the per call charge appeared on the bill issued to the customer. No

___________________________________________________________________________________ HKTA 3104 Issue 2

tolerance will be given to the difference between the rerated per call charge and also the

per call charge appeared on the bill issued to the customer. In other words, the billing

tolerance of each billed call for different type of services is:

IDD Service : +/- 0 cent

Mobile Service : +/- 0 cent

Modem Dial-up Internet Service : +/- 0 cent

6.3 Rounding Treatments

6.3.1 All operators concerned are requested to declare their rounding treatments used in

DOM and perform a rounding treatment test on all sampled bills in the Billing Test in

the first twelve months after the implementation of the BMIS and report same in the

manner specified herein. OFTA will conduct a review on whether there is a need to

impose suitable accuracy requirements, integrity standards or restrictions on the

rounding treatments or steps of individual operators.

6.3.2 The per call charge appearing in a bill will be subtracted from the actual per call

charge calculated by using 4 decimal places in dollar value at each rating or mediation

step. This difference is known as per call discrepancy (Eij). All Eij will be summed up

and reported to OFTA.

Eij = ABij - A’Bij

where i refers to i-th bill and j refers to j-th call of the i-th bill

Eij refers to per call discrepancy

ABij refers to operator billed per call charge, calculated from operator’s billing

logic (usually with 2 decimal places in dollar value)

A’Bij refers to actual per call charge (with 4 decimal places in dollar value)

6.3.3 When Eij is positive, it implies that it is to the benefits of the operator. When Eij is

negative, it implies that it is to the benefits of the consumer. Operators shall specify the

signs of Eij clearly in the results. For example, a telephone per call discrepancy is

Eij = ABij - A’Bij = $0.01- $0.0074

= + $0.0026

6.3.4 Operators shall submit the results of the rounding treatment test to OFTA in both

hardcopy and softcopy not later than 14 months and two weeks after the implementation

___________________________________________________________________________________ HKTA 3104 Issue 2

of the BMIS. The submitted test results would be studied by OFTA. The results of this

rounding treatment test should be duly signed by the operator’s responsible person,

dated and chopped with the company chop. Operator’s submissions of the test results

should use the format/template given in Annex 7.

6.3.5 All submissions of hard copies of the rounding treatment test reports shall be

addressed to:

Senior Telecommunications Engineer (Technical Regulation 1)

Office of the Telecommunications Authority

29/F, Wu Chung House,

213 Queen's Road East,

Wanchai, Hong Kong.

6.3.6 At the same time, submissions of soft copies of the rounding treatment test reports

shall be addressed to:

[email protected]

___________________________________________________________________________________ HKTA 3104 Issue 2

7. Verification of Metering and Billing System

7.1 Metering Test

7.1.1 Operators are allowed to use automatic call generators to generate Test Calls from

switches to test the metering accuracy. This section describes the two methods to

perform the Metering Test. The operator may reconcile test log records from call

generators with the corresponding records in the Billing System. The alternative method

is to reconcile test log records from call generators with the records extracted from a

metering point, followed by another reconcilation with the metering point and the

corresponding records in the Billing System. In such case, the operator has to specify the

metering point, say at the mediation device, in the DOM.

7.1.2 Nevertheless, manual Test Calls such as calling card services are acceptable if

there is no appropriate test equipment for the operator. In this case, the operator may also

reconcile manual test log records with the corresponding records in the Billing System.

Methodology to Verify Metering System Using Test Calls

The Metering Test

7.1.3 The Metering Test is performed once every month and outlined in the diagram

below:

7.1.4 The test should involve the following steps:

i) Generation of Test Calls

ii) Collection of Test Call log

iii) Collection of call details from the Billing System

iv) Producing test result by comparing the Test Call log from call generator

with the call details from the Billing System. Test Calls are accepted or

rejected in accordance to the tolerance levels described in Section 6.1

Test

Calls

Metering

point

Billing

System

Bills

Comparison

Test Call

Log

Call Details

___________________________________________________________________________________ HKTA 3104 Issue 2

Number of Test Calls and Acceptance Level

7.1.5 The number of Test Calls required in each test and the acceptance level are

specified in Table 1. The distribution of numbers of Test Calls stated in Table 1 will be

determined by applying either traffic ratio, revenue or number of customers of the

operators concerned. In general, the operator must use the same consistent basis of either

traffic ratio, revenue or number of customers in all pro-rata calculations for the numbers

of Test Calls and Test Bills among relevant prepaid and postpaid services, and the use of

pro-rata basis must be declared in DOM.

Test Call Pattern

7.1.6 In each Metering Test, operators should change test patterns quarterly in order to

satisfy the randomness requirements on calling Directory Numbers (DNs), called DNs,

charging DNs and call types.

Directory Numbers Selection

7.1.7 The operators should reserve a certain directory numbers (DN)s for the Metering

Test. These DNs can be discrete spare numbers or belong to a specific number block.

Operators can even use the internal network routing and testing numbers (i.e. numbers

with the leading digits of ‘19’) at their own convenience.

7.1.8 The operators have to use a pseudo random /ballot method to draw a calling DN

and a called DN for the Metering Test. However, the calling DN and the called DN must

be changed periodically so as to satisfy the randomness requirement. In case of dial-up

Internet, the operators have to use a pseudo-random / ballot method to draw 2 log-in ID

numbers from the reserved number list. 8 access numbers should be randomly selected

from the available access number pool. If the pool is smaller than 8, all access numbers

should be tested. In case of calling card calls, operators can select 2 cards from a

reserved pool of 100 cards.

Test Call Types

7.1.9 The Test Call types are shown in the configuration diagrams at the end of this

section. During the IDD test for ETS, mobile and fixed network services, operators are

allowed to set up a loop back route to simulate the international call path. Operators may

determine their own numbering scheme for performing this loop back test according to

___________________________________________________________________________________ HKTA 3104 Issue 2

their operational needs.

7.1.10 Regarding the indirect calls involved in fixed and mobile networks, there may be

technical difficulties in setting up a test configuration across networks for indirect calls.

Therefore, operators are allowed not to test indirect calls provided that they have tested

the direct calls and could explicitly state and confirm that the call paths of indirect calls

are having no significant difference to those of direct calls.

Call Duration

7.1.11 The call duration to be used in the Metering Test is:

Call Type Test Call Duration

(Minutes)

IDD Calls 1.5

Mobile Calls 1.5

Dial-up Internet Calls 10

Tolerance of Measurement Equipment

7.1.12 Operators may either use measurement equipment produced by equipment

manufacturers in the market or tailor-made ones for their own use. However, they need

to enclose the relevant certificate(s) by the equipment manufacturers or recognized

laboratories or self-declaration on the accuracy/tolerance of such measurement

equipment in use in the DOM in order that these certificates and self-declaration

information will be audited by OFTA on need basis. The tolerance for measurement

equipment is +/- 1 second. Maximum tolerance for measurement equipment for call

duration is +/- 1 second. In case of manual call, the tolerance of manual calls is the same

as Section 7.3.6.

7.1.13 The total tolerance for accepting the Test Calls is the tolerance of measurement

equipment plus the Metering Tolerance mentioned in Section 6.1.

Requirements on Test Execution

7.1.14 Operators should follow the following requirements during the test execution:

i) Operators need to check the integrity of the time stamps of the calls if the call

types of those calls selected are in time zone tariff plans. Operators should

ensure to continually align and adjust the time stamp of the Test Call logs

______________________HKTA 3104 Issue 2

recorded by the call generators/receivers with the clock reference of the

Hong Kong Observatory (time server “stdtime.gov.hk”);

ii) Operators should produce test reports and self-declaration forms according to

the requirements described in Section 9 of this Manual;

iii) Metering tolerances for these three parameters, that is, start time, end time

and call duration, strictly follow Section 6.1 regardless of whether the

parameters are directly obtained or indirectly derived from other parameters

on the call record in the Billing System;

iv) Total number of successful calls to be counted shall be no less than 99.9% of

total Test Calls as specified in Table 1; and

v) Operators may test more than the number of calls as specified in Table 1, but

they shall use the valid calls (i.e. successful calls and those unsuccessful calls

as specified in (iv) in sequence for checking and reporting purpose).

Alternative Method by Per Call Test

7.1.15 Operators have an option to perform the Metering Test in two steps according to

their operational needs. However, the Metering Test is considered to have failed if either

Part 1 test or Part 2 test failed. The details of the Part 1 test and Part 2 test are described

in Section 7.1.16 and 7.1.18 respectively. Both tests are performed once every month.

Part 1 Test

7.1.16 The following diagram illustrates Part 1 of the test.

7.1.17 This part is the

Test Calls Metering

Point

Billing

System

Bills

Test Call

Log

Comparison

Call Detailed Records

Part 1

_____________________________________________________________

same as that described in the “Methodology to Verify Metering

____________________________________________________HKTA 3104 Issue 2

System Using Test Calls” of this section, except that the call details for comparison with

the Test Call log are collected from the metering point output instead of the Billing

System. The requirements specified in Section 7.1.3 “The Metering Test” to Section

7.1.14 “Requirements on Test Execution” are applicable to this part of the test.

Part 2 Test

Test Outline

7.1.18 The objective of the test is to compare the call information of the CDR at the

metering point output with the call details from the Billing System. Live calls are taken

as samples for comparison. The details of the Part 2 test are illustrated in the following

diagram.

7.1.19 The test should involve the following steps:

(i) Collection of CDR samples of live calls from meter

(ii) Collection of call details from the Billing System;

(iii) Producing test result by comparing the CDRs f

details from the Billing System. Test Calls are acce

Section 6.1 are exactly matched.

Number of Test Calls and Acceptance Number

7.1.20 The number of Test Calls required in each

specified in Table 1.

Call Sampling

7.1.21 The calls are sampled according to a rando

during a randomly selected period in the month when

Live

Calls

Metering

point

Billing

System Bills

CDR

Comp

Call Details

Part 2

ariso

_______________________________

ing point output on random basis;

and

rom the metering point and call

pted if the parameters set out in

test and the acceptance level are

m selection of a calling number

the Part 1 test is taken place.

___________________________________________________________________________________ HKTA 3104 Issue 2

7.1.22 Metering Test is not required for incoming toll free call, collect call and global

conference call, etc if the Metering Systems are operated by other carriers or if the

Metering System are manual. If necessary, OFTA may conduct a review in future for the

inclusion of incoming toll free call, collect call and global conference call in the

metering requirements.

___________________________________________________________________________________________________________________

________________________________________________________________________________________________________________________________________ HKTA 3104 Issue 1

Test Configurations (1/4)

Call

Generator

CDR

Local

Switch

Toll

Switch

Billing

SystemFixed Network IDD Service

Fixed

Network

loop

back

Call

Receiver

___________________________________________________________________________________________________________________

________________________________________________________________________________________________________________________________________ HKTA 3104 Issue 1


Call

Generator

Base

Station

Controller

Base

Station

Mobile Network

Mobile

Network

MSC

Base

Station

Controller

Base

StationCall

Receiver

loop

back

(for IDD

test only)

___________________________________________________________________________________________________________________

________________________________________________________________________________________________________________________________________ HKTA 3104 Issue 1


Call

Generator ETS

Platform

loop

back

ETS

Call

Receiver

ETS platform with direct interface with Call

Generator and Call ReceiverOption 1

Call

Generator ETS

Platformloop

backCall

Receiver

ETS platform cannot directly interface with

Call Generator and Call Receiver. Test calls

are passed to ETS platform via PSTN

PSTN

Option 2

___________________________________________________________________________________________________________________

________________________________________________________________________________________________________________________________________ HKTA 3104 Issue 1

Mobile N etw ork

Call

G enerator

Call

R eceiver

ETS

platfo rm loopback

Option 3


Test C onfigurations (4/4)

Call G enerator

e .g . com puterPSTN ISP P la tform

Rem ote A ccess Server

Radius Server

ISP

______________________________________________________________________

_________________________________________________________________________________ HKTA 3104 Issue 1

7.2 Billing Test

7.2.1 Based on the sampled bills as mentioned in Section 5.2.1, operators are required to perform a Billing Test on a monthly basis by sampling 32, 50, 80 bills in the reduced, normal and tightened inspection respectively. The purpose of the Billing Test is to verify the billing accuracy of all sampled bills. 7.2.2 Operators will calculate the billing charges of calls by applying their own billing logic and using the call detail records information stored in their Billing Systems (ABij) which is exactly the same point of the Billing System used for Metering Test under Section 7.1.4 (iii) or Section 7.1.19 (iii). Afterwards, operators will compare the charges calculated from their billing logic (ABij) with the charges actually billed to customers (A’’Bij ). The absolute differences between these two charges in a bill will be added and regarded as total error in a bill (Σ Dij). 7.2.3 The actual bill amount is the summation of all chargeable values that the customer needs to pay to the operator concerned. For convenience purpose, the charge that the customer needs to pay to the operator is regarded as positive value, otherwise it will be regarded as negative value. Examples of negative value are free minutes, free call charges, balance brought forward in credit, odd cents carried forward etc. 7.2.4 Therefore, all the billing charges of positive value in a sampled bill will be added up and regarded as the actual bill amount (Ti) in a bill. All other negative values such as monetary rebates, free minutes, volume discount etc will not be counted in this amount. These billing charges include all timed/usage charges and non-timed/usage charges in that bill. Any billing charge of negative value will be checked arithmetically but will not be counted in the actual bill amount. When operators provide rebates in terms of time to their customers, the input information (time rebated from previous months or free minutes carried forward) can be assumed to be correct. Operators only need to perform the checking on the arithmetic calculation. When a sampled bill consists of negative chargeable values only, this sampled bill will be discarded and substituted by another sampled bill. 7.2.5 The passing criteria of an individual bill i is: ΣDij / Ti <= $1 / $10000 where

� i refers to a bill and j refers to a call

� Ti refers the actual bill amount in a bill (down to cents place)

� Dij refers to per call error in a specific bill i and it equals to the absolute difference of

ABij and A’’Bij (Dij = ׀ABij - A’’Bij׀)

� ABij refers to operator billed per call charge calculated from operator’s billing logic

(down to cents place)

� A’’Bij refers to per call charge appeared on customer’s bill (down to cents place) � Arithmetic check based on charges actually billed to customers is counted as one of

the passing criteria in a bill check

______________________________________________________________________

_________________________________________________________________________________ HKTA 3104 Issue 1

7.2.6 The monthly Billing Test is considered as failed if any individual sampled

telephone bill is failed. The following table illustrates the number of bills to be sampled

by operators each month and the acceptance/rejection criteria.

Number of Bills to be Sampled

Each Month

Acceptance No / Rejection No

Sample 32 bills in the reduced inspection Sample 50 bills in the normal inspection Sample 80 bills in the tightened inspection

0,1

7.2.7 However, operators shall ensure a random or pseudo-random selection of

samples and also declare the selection process in the DOM. Operators should use one of

the following parameters which would cover all their customers to randomize the

selection of the samples. Random selection parameters are account number, directory

number or invoice number.

7.2.8 Operators can use electronic records of the bills in the Billing System instead of

hardcopy bills, provided that they are consistent with the bills actually issued to

customers. Operators should have measures to ensure the consistency of the two records.

7.2.9 No Billing Test is required if the values of bills are calculated and checked by the

other carriers. However, it is still necessary for operators to conduct an arithmetic check

of these billing data to verify the correctness of the final bill value. If only raw data (e.g.

call duration) is provided by other carriers, operators are still required to perform the

associated Billing Test based on these raw data.

Maximum Calls Per Bill

7.2.10 “Maximum calls per bill” is a selection criteria in the Billing Test. If the number

of calls of a sampled bill is greater than the maximum calls per bill, then this bill can be

discarded. The maximum calls per bill for the Billing Test is defined as:

IDD 35 calls per bill

Mobile 191 calls per bill

Dial-up Internet 34 calls per bill

Minimum Call Per Bill

7.2.11 The minimum call per bill in Billing Test is defined as 1.

______________________________________________________________________

_________________________________________________________________________________ HKTA 3104 Issue 1

7.3 Pre-paid Services

7.3.1 Pre-paid services refer to the services provided by operators in the form of

pre-paid calling cards and pre-paid SIM cards.

Number of Test Calls

7.3.2 Operators can use either traffic ratio, revenue or number of customers to

determine the number of Test Calls (X) for the pre-paid services in the Metering Test

whereas X is a portion of Test Calls in Table 1. For example, a FTNS operator is offering

both post paid and pre-paid services and it decides to use traffic ratio to work out the

number of Test Calls for post paid and pre-paid services. Assume its traffic ratio for post

paid and pre-paid is 90% and 10% of total traffic respectively. Hence the number of Test

Calls for post paid services are 1125 (1250 x 90%) and the number of Test Calls for the

pre-paid services are 125 Test Calls (1250 x 10%).

Number of Pre-paid Cards

7.3.3 Similarly, operators can use either traffic ratio, revenue or number of customers to

determine the number of pre-paid calling cards/pre-paid SIM cards (Y) for the Billing

Test whereas Y is a portion of telephone bills in Table 2. For example, a FTNS operator

is offering both post paid and pre-paid services and it decides to use traffic ratio to work

out the number of pre-paid calling cards. Assume its traffic ratio for post paid and

pre-paid services is 90% and 10% of total traffic respectively. Hence, the number of

telephone bills for post-paid services are 45 (50 x 90%) and the number of pre-paid

calling cards/telephone bills for the test are 5. In addition, half-adjustment rounding to

the nearest integer must be applied in these pro-rata calculations, except that if the

number for a prepaid service is smaller than 1, it must be rounded up to 1.

Billing Integrity Standard

7.3.4 As far as the Billing Test is concerned, the absolute summation error value of the

inaccurately billed calls in a pre-paid calling card/pre-paid SIM card shall not exceed 1

in 10,000 of the value of total billed sum in that pre-paid calling card/pre-paid SIM card.

Test Method

______________________________________________________________________

_________________________________________________________________________________ HKTA 3104 Issue 1

7.3.5 Automatic test for the pre-paid services is highly recommended and shall be

adopted at a first place. However, if automatic generation of pre-paid calls is not feasible,

then manual generation of Test Calls for pre-paid services is also acceptable.

Tolerance of Call Start Time and Call Stop Time

7.3.6 In case the call generation and call recording have to be undertaken manually, the

tolerance of call start time or call end time is +/- 2 seconds.

Accuracy of IVRS Voice Prompt

7.3.7 Operators shall self-declare in DOM that the accuracy of the pre-paid calling card

or pre-paid SIM card system in the conversion of electronic record to voice message.

Scenario of Pre-paid Services Platforms

7.3.8 In general, there are 2 scenarios for the pre-paid services systems. Scenario 1

refers to the pre-paid services system possessing a database in which the required call

detailed information and the charge of each call have been recorded. Scenario 2 refers to

the pre-paid services systems that do not have a database storing call detailed

information and the charge of each call. Operators can select either separate or integrate

test for the pre-paid service test.

Separate Test

7.3.9 The Metering Test is similar to Section 7.1. The following parameters should be

checked, wherever applicable, such as calling party, called party, call duration, charged

party (e.g. account number) and charging time stamp etc. The method of selecting

Directory Numbers is set out in Section 7.1.7. The number of pre-paid cards required for

Metering Test is at least 2.

7.3.10 The Billing Test is similar to Section 7.2. All in-service pre-paid SIM/calling

cards should be sampled for the Billing Test. In particular, procedures should be derived

in such a way to ensure samples are chosen randomly or pseudo-randomly.

7.3.11 Sampling of calls/cards/bills can be made in either automatic way or manual

ballot way. All the sampled records (calls, bills or cards etc.) must be listed out clearly

irrespective of whether the calls/bills/cards were used, discarded or any other possible

______________________________________________________________________

_________________________________________________________________________________ HKTA 3104 Issue 1

uses.

7.3.12 However, if sampling of cards is a manual process, then all the cards drawn

including filtered cards and selected cards must be recorded.

7.3.13 Only the calls made in previous month of the reporting period shall be included

for the test. The maximum and minimum numbers of calls per card for the pre-paid

system are the same as those per bill for post paid system.

Integrated Test

7.3.14 The charged party shall be verified when the Metering System is tested. Call

charge should be calculated by applying the billing logic of the billing/pre-paid system.

This call charge is verified against the actual call charge deducted by the prepaid system.

The actual call charge deducted by the prepaid system can be checked and recorded by

listening to the IVRS voice or other methods whereas appropriate.

7.3.15 In case the test is failed, operators shall conduct investigations, report the

sources of faults (Metering System, Billing System, or both) and specify the remedy

actions taken to rectify the faults to OFTA. In case call duration record is not retrievable

from the Prepaid Service Platform, the operator must submit sufficient supporting

information for its investigation and argument to declare that the fault is due to Metering

System alone, Billing System alone, or both of them.

7.3.16 The passing criteria for pre-paid services using integrated platforms are

similar to Section 7.2.5. In case of pre-paid SIM cards offered by mobile operators which

can make both IDD calls and mobile calls, the number of pre-paid IDD calls and

pre-paid mobile calls are derived from the total number of pre-paid calls of that mobile

operator using either traffic ratio, revenue or number of customers. The number of

pre-paid cards required for integrated test is at least 2.

General Procedure

7.3.17 The general procedures for testing the prepaid systems are to:

a) Check the prepaid cards for sufficient monetary value for making the Test Calls;

b) Synchronize the clock with Hong Kong Observatory, if necessary;

c) Record the balance at the beginning of the tests;

d) Check the charged party (or card identifier) and duration during the Metering Test

______________________________________________________________________

_________________________________________________________________________________ HKTA 3104 Issue 1

whereas calling party, called party and time stamp would be checked if necessary;

e) Record the remaining balance at the end of the tests;

f) Record the before-call and after-call balances to obtain the per-call charge amount

in case the per-call charge amount is not available from the prepaid system;

g) Record the deviation of the charging amount calculated manually and the amount

recorded by the prepaid system for each call;

h) Add the absolute differences between manually calculated charge and the actual

deducted amount for each call to be regarded as total error for the prepaid service;

i) Sum all calculated chargeable values to become the actual bill amount;

j) Check whether the passing criteria for the prepaid card is fulfilled that the ratio of

the total error and the actual bill amount does not exceed 1: 10000 and that the

arithmetic check set out in Section 7.2.4 is passed. and

k) Observe that the previous agreed procedures for handling rounding treatment for

post paid service were applicable to prepaid service.

________________________________________________________________________________________________________________

_____________________________________________________________________________________________________________________________________ HKTA 3104 Issue 1

Template for Pre-paid Services

Separate Test

Metering Test

Call type: _________________

[Optional Table]

Account No. / Card Identifier

Initial Card Value

Derived Records from Test Calls

Call Number Test Date Account No. /

Card

Identifier

Called Number Answered Start

Time

Duration

1

2

3

Derived from Prepay Service Platform

Call

Number

Test Date Account No.

/ Card

Identifier

Called

Number

Answered

Start Time

Duration Test Result

1

2

3

________________________________________________________________________________________________________________

_____________________________________________________________________________________________________________________________________ HKTA 3104 Issue 1

Billing Test


Initial Card Value

Call

No.

Test

Date

Called

DN

Start / End**

Time

(if

applicable)

Recorded

Duration

Rerated

Call

Charges

Call Charges

Recorded by

the Billing

System

Card

Balance*

Absolute

Error

1

2

3

4

5

X

Total

Note: * Card Balance, except the balance at the end of the test, is an optional item.

** Deleted if appropriate.

________________________________________________________________________________________________________________

_____________________________________________________________________________________________________________________________________ HKTA 3104 Issue 1

Integrated Test

Call type : ___________________


Initial Card Value

Call No*

Test Date

Called DN

Card Balance Before Making the Test Call

Start / End** Time (answered) [if applicable]

Recorded Duration of Test Call

Charging Unit *

No of Units (roundup) *

Unit Charge / Tariff

Manually Rated call Charges (X)

Minimum Acceptable Duration *

MaximumAcceptable Duration *

Possible Call Charges (lower) *

Possible Call Charges (upper) *

Card Balance After Making the Test Call

Call Charges Deducted by the Billing System

Absolute Error (Y) (note)

Test Results (metering)

(1) (2) (3) (4) (5) (6) (7) (8) (9) (10) (11) (12) (13) (14) (15) (16) (17)

1 $100 58 6 10 $0.20 $2.00 49 67 $1.80 $2.40 $97.80 $2.20 $0.00

2 $97.80 58 6 10 $0.20 $2.00 49 67 $1.80 $2.40 $96.10 $1.70 $0.10

3 $96.10 58 6 10 $0.20 $2.00 49 67 $1.80 $2.40 $93.50 $2.60 $0.20

4

5

X

Passing criteria for Billing Test Result is : summation of Y ÷ summation of X ≤ 1: 10,000

Billing Test Result : summation of y ÷ summation of x ≤ 1: 10,000 (pass criteria)

Note: * Optional items ** Deleted if appropriate.

(note) : If (12) <= (15) <= (13), the absolute error is 0. (i.e. Call No. 1 case)

If (15) < (12), the absolute error is (12) - (15). (i.e. Call No. 2 case)

If (15) > (13), the absolute error is (15) - (13). (i.e. Call No. 3 case)

_____________________________________________________________________

___________________________________________________________________________________ HKTA 3104 Issue 1

8. Guidelines to Design Operator’s Detailed Operation Manual

8.1 Introduction

8.1.1 This section illustrates the guidelines to operators on how to design and compile

their DOM. The DOM integrates the operator’s all aspects of the Metering and Billing

Tests from network operating system to back-office Billing Systems. It provides the

information on the operator’s internal testing and coordination procedures and system or

equipment setup in meeting the requirements of this manual or the BMIS as a whole.

8.1.2 There are several guidelines to help operators to prepare the DOM such as:

• The purpose of the DOM is to give and explain the operation of operator’s billing

and metering processes, man machine interfaces, testing procedures and system or

equipment setup. It could also serve to assist the CPA in understanding the detailed

information before conducting the required assurance exercise;

• Apart from giving the operation of billing and metering processes, testing

procedures and system/equipment setup, the DOM should also illustrate the details

about the reporting channel and mechanism to OFTA; and

• DOM should also specify when and how the details given therein would be revised

and updated.

8.1.3 The DOM should therefore include the following major headings:

• The description of the system/equipment setup to meet the requirements of the

Metering Model and standards;

• The description of the system equipment setup to meet the requirements of the

Billing Model and standards;

• The Metering Tests and yardsticks;

• The Billing Tests and yardsticks;

• Self appraisal procedures;

• Self declaration;

• Monthly Report; and

• Procedures for revision.

8.2 Details of Each Section

8.2.1 Contents of DOM should include the details given in the following table:

_____________________________________________________________________

___________________________________________________________________________________ HKTA 3104 Issue 1

Item

No.

Headings Contents

1. Introduction Describe the meaning of DOM

2. Scope Describe the scope of DOM

3. Description of the telecommunications networks and systems involved in the Metering and Billing operation

Describe the functions and operations of various components of the operator’s telecommunications networks and systems involved in the processes of Metering and Billing. For details, refer to the relevant documents.

4. Description of the Metering System

Describe the setup and operation of the Metering System. For details, refer to the relevant documents.

5. Description of the rating, mediation and Billing Systems

Describe the setup and operation of the rating, mediation and Billing Systems. For details, refer to the relevant documents.

6. Description of the setup and internal procedures for carrying out the Metering Tests

Describe the procedures and methods in undertaking the Metering Test, such as: � Yardsticks of the test; � who is responsible for the Metering Test � when should the Metering Test be performed

(date of a specific month) � how many Test Calls should be made � under what conditions should the test be

re-performed � what are the reasons causing the failure of a

particular Metering Test (also give the reasons and causes behind the possible failure)

� what are the precautions or remedial actions to minimise the occurrence of failed Test Calls

� when and who should submit the quarterly test results and self declaration forms (Metering Test part) by the operator’s responsible directorate officer/ authorised staff; and

� when and who should submit the completed signed self-declaration forms (Metering Test part) to OFTA/CPA

7. Description of the setup and internal procedures for carrying out the Billing Tests

Describe the procedures and methods in undertaking the Billing Tests, such as: � yardsticks of the test; � who is responsible for the Billing Test � when should the Billing Test be performed (date

of a specific month) � how many bills should be re-rated � under what conditions should the test be

re-performed � what are the reasons behind causing failure of a

particular Billing Test � what are the precautions or remedial actions to

minimise the failed bill

_____________________________________________________________________

___________________________________________________________________________________ HKTA 3104 Issue 1

� when and who should submit the quarterly test results and self declaration forms (Billing Test part) by the operator’s responsible directorate officer/ authorised staff; and

� when and who should submit the completed and signed self-declaration forms (Billing Test part) to OFTA/CPA

�

8. Self declaration procedures Describe the internal procedures for self-declaration and submission of the completed and signed self-declaration forms or monthly reports to OFTA by the Submission Date set out in Section 9.2.4. State the name, post title of the operator’s directorate level or authorised staff responsible for making a self-declaration to OFTA on both Metering Test and Billing Test.

9. Monthly test results

Describe the procedures and details on how a Metering and Billing System be sub-divided for appraisal, such as: • who should be responsible to carry out the

Metering and Billing Tests and analysis of the collected test data

• under what conditions will the monthly test results be submitted to OFTA

• when should the monthly test results be submitted to OFTA; and

• who should countersign the monthly test results

10. The procedure of changing this Manual (change of staff, yardsticks etc)

State under what conditions for which the DOM would be revised or changed and who is the responsible person for making the required amendments . All amendments must be documented and duly authorised by the operator’s responsible person.

11. Related documents If there are any related documents to the DOM, it is necessary to specify the name of these documents.

12. The format of monthly report Same format as given in Section 9.3 of QAM

8.2.2 Yardsticks for Metering Test

1. Testing equipment tolerance

Testing equipment tolerance should be the tolerance as defined in the technical specification of equipment vendor or the tolerance as measured by the operator supported by a detailed test report to be included in the DOM.

2. Metering Tolerance (delay) in operator’s network

• Metering Tolerance (delay) in operator’s network is to be declared by operators and/or

• Metering Tolerance as defined in this manual or as approved by the TA

3. Randomness of sampling

• To ensure randomness of sampling, the operator may use ballot or pseudo-random method to draw the test pattern;

_____________________________________________________________________

___________________________________________________________________________________ HKTA 3104 Issue 1

• For calling number, 2 testing numbers are to be drawn from a pool of 100 directory numbers or internal network routing and testing numbers for use in the test;

• For called number, testing numbers are to be drawn from a pool of 100 directory numbers or internal network routing and testing numbers for use in the test.

4. System Clock Accuracy

� Operators are required to declare the system clock accuracy in DOM by referencing to the relevant technical specifications supplied by their equipment vendors/self declaration

� Operators are required to declare the routine procedures to calibrate the system clock and synchronize with Hong Kong Observatory’s clock.

5. Any other yardsticks where necessary

8.2.3 Yardsticks for Billing Test

1. Charging unit

State at least the reference showing the operator’s existing charging unit such as 6 seconds basis.

2. Unit rate

State at least the reference showing the unit rate for each charging unit such as $0.2 per 6 seconds.

3. Call charge per minute in operator’s Billing System

Operator’s call charge published in the tariff plans such as $2 per minute.

4. Rounding treatments • Rounding treatments that have been used in the Billing System.

• Billing methodology especially those steps involve rounding treatment (e.g. all the steps in generating a charged IDD telephone call in the telephone bill). A sample telephone bill is necessary to illustrate the situations.

5. Name of your Billing System, version and vendors, if any, for developing the Billing Systems

6. Accuracy on the conversion of electronic record to voice by IVRS equipment

Operators shall self-declare the accuracy on the conversion of electronic record to voice by IVRS equipment. A typical voice prompt is to read out the remaining pre-paid card values.

7. Any other yardsticks where necessary

8.2.4 Operators can determine to use only one of the sampling parameters which will

cover all their customers to randomize the selection of their samples for the Billing

Tests.

(i) Account Number;

(ii) Directory Number; or

_____________________________________________________________________

___________________________________________________________________________________ HKTA 3104 Issue 1

(iii) Invoice Number.

8.2.5 Operators are required to specify the sampling parameters of the Billing Test in

the “Yardsticks for Billing Test” of the DOM. Operators should apply the market

exchange rate fairly in their billing procedures.

8.2.6 The operators should endeavour that charging information can be made available upon request by customers including but not limited to the following items whichever applicable: � call duration/usage (in calling units or seconds); � unit charge tariff (to the nearest cent); � the exchange rate applied if necessary (in 4 significant figures); � the discount plan applied; and � call bill amount (to the nearest cent).

_____________________________________________________________________

___________________________________________________________________________________ HKTA 3104 Issue 1

9. Monthly Test Report

9.1 Introduction

9.1.1 Operators should prepare the testing report on monthly basis and submit the

self-declaration forms for the compliance status, Metering Test and Billing Test to OFTA

half-yearly using the format attached in Annex 2, Annex 3 and Annex 4 respectively.

This section describes the self-declaration procedure and the format of the test report

that is to be submitted by operators after conducting the Metering and Billing Tests.

9.1.2 All the measurements or test results generated and collected during the Metering

Tests and Billing Tests must be properly recorded and documented in the Monthly Test

Report. Operators should not selectively submit test data collected from the test for test

report preparation purpose.

9.2 Self-Declaration Procedures

9.2.1 Operators are required to make self-declarations half-yearly to OFTA on its

monthly test results of the Metering and Billing Systems. Operators can make their own

arrangement for the Metering and Billing Test. However, some general guidelines are

suggested as follows:

Guidelines

9.2.2 At the beginning of each month, operators prepare, set up and perform the Billing

and Metering Tests in accordance with the DOM. In case of any unsuccessful test results

due to abnormal circumstances of the testing environment, the operators shall

re-perform some of the tests if necessary*. Operators are required to prepare the test

reports and self-declaration forms according to the test results.

* The condition for re-test can be:

a. system outage – e.g. the communication link is out of order;

b. unforeseen disaster – e.g. red rain / black rain storm, typhoon that causes heavy load

of communication link; and/or

c. test equipment failure.

Mandatory Requirements

_____________________________________________________________________

___________________________________________________________________________________ HKTA 3104 Issue 1

9.2.3 Apart from the general guidelines outlined above, operators must fulfill some

mandatory requirements as mentioned in the following paragraphs.

9.2.4 Operators must submit the self-declaration forms to OFTA by the twenty-fifth of

the month immediately following the sixth month in which the tests are conducted (“the

Submission Date”). If any test results done within the six months are failed, operators

should also submit the monthly test reports together with the self-declaration forms to

OFTA by the Submission Date. Allowable extension to the end of the calendar month of

the Submission Date can be given if request is made in advance to OFTA before the

Submission Date through email at [email protected].

9.2.5 For instance, if the tests are conducted in January, February, March, April, May

and June, the self-declaration forms and also any failed test reports for these six months

should reach OFTA at [email protected] via e-Cert by 25th July. If the monthly test

results have passed, operators only need to submit the self-declaration forms to OFTA in

the same manner by the Submission Date. Meanwhile, operators should keep the

monthly test reports to be checked by the CPA. The operators should complete the

monthly test results by the Submission Date.

9.2.6 The one who signs and submits the self-declaration forms to OFTA should be at

the operator’s directorate level or authorized staff. Operator’s submissions of

self-declaration forms and test reports should use the format/template as defined and

given in this manual.

9.2.7 It is the responsibility of individual operators to submit the self-declaration forms

and test reports to OFTA on time. OFTA will not be held responsible for chasing any

operators for the required submissions.

9.3 Format of Test Report

9.3.1 Operators are required to prepare the test report about the Metering Test and

Billing Test performed. In general, the test reports should be sufficient to derive the

results of the test for inspection purpose. Therefore, the test report should at least keep

the records of the checked test data.

Format of Metering Test Report Using the Metering Test

9.3.2 For operators employing the Metering Test in Section 7.1.3, it should include a

_____________________________________________________________________

___________________________________________________________________________________ HKTA 3104 Issue 1

test report showing the matching results between the following derived data from the

Billing System and call generator:

• Directory number (i.e. calling party/charged party);

• Dialled number (i.e. called party information sufficient for billing purpose);

• Charging Time Stamp;

• Duration/Usage; and

• Call Date.

9.3.3 In order to allow easy reference of each record, the following additional fields are

recommended also:

• Test sequence number (for cross reference of matched records);

• Service type (“Mobile/Mobile IDD”, “IDD/ETS”, “ISP”);

• Metering Tolerance (as specified for different service type in this Manual);

• Test equipment tolerance;

• Charging Time Stamp tolerance;

• Difference of Charging Time Stamp;

• Difference of duration/usage;

• Result (result of individual record checked, either “P” = Pass or “F”=Fail”); and

• Total number of failed calls in the test at the end of the report.

Format of Metering Test Report Using Per Call Test

9.3.4 For operators employing Per Call Test in Section 7.1.15, the test report should

include two parts. Part I of the test report include the matching results between the

following derived data from the CDR and Test Call generator and Part II of the test

report includes the matching results between the following derived data from the Billing

System and the CDR:

• Directory number (i.e. calling party/charged party);

• Dialled number (i.e. called party information sufficient for billing purpose);

• Charging Time Stamp;

• Duration/Usage; and

• Call Date.

9.3.5 In order to allow easy reference of each record, the following additional fields are

recommended also:

• Test sequence number (for cross reference of matched records);


• Metering Tolerance (as specified for different service type in this Manual, not

_____________________________________________________________________

___________________________________________________________________________________ HKTA 3104 Issue 1

applicable to Part II);

• Test equipment tolerance;

• Charging Time Stamp tolerance;

• Difference of Charging Time Stamp;

• Difference of duration/usage;

• Result (result of individual record checked, either “P” = Pass or “F”=Fail”); and

• Total number of failed calls in the test at the end of the report.

Format of Billing Test Report

9.3.6 For Billing Test report, it should include detailed bills, worksheet of checking

detail bills and summary of the results of checking detailed bills.

9.3.7 The detailed bills should include all charging information as follows:-


• Sampling identification, i.e. Directory Number, Account Number, or Invoice

Number;

• Call date;

• Charging time stamp (for item associated with time and usage charge);

• Dialled number (for item associated with time and usage charge);

• Duration/ Usage (for item associated with time and usage charge);

• Charging description (for item not associated with time and usage charge);

• Billed amount; and

• Calling party or charged party.

9.3.8 The worksheet of checking detailed bills should include charging information on

the bills and the actual calculated amount as follows:-

• Bill number (identification of the bill sampled for cross reference of checking

result);


• Sampling identification, i.e. Directory Number, Account Number, or Invoice

Number;

• Item reference (reference for the items on bill);

• Call date;

• Charging time stamp (for item associated with time and usage charge);

• Charging description (for item not associated with time and usage charge);

• Duration;

• Number of units (calculate from duration/ usage);

_____________________________________________________________________

___________________________________________________________________________________ HKTA 3104 Issue 1

• Unit charge;

• Discount;

• Actual calculated amount (amount calculated manually);

• Billed amount (amount shown on bill);

• Difference of charging amount (i.e. absolute value of difference of Actual Calculated

Amount and Billed Amount);

• Total actual calculated amount of the bill (sum of all Actual Calculated Amount);

• Total difference of charging amount of the bill (sum of all Difference of Charging

Amount); and

• Calling party or charged party.

9.3.9 The summary of the results of checking detailed bills should include the results of

the bills being checked as follows:-

• Bill number (identification of the bill sampled for cross reference of checking

result);

• Total difference of charging amount of the bill (sum of all Difference of Charging

Amount);

• Total actual bill amount of the bill (sum of all Actual Bill Amount);

• Ratio of difference of the bill (calculated by Total Difference of Charging Amount of

the bill / Total Actual Calculated Amount of the bill);

• Result (result of individual bill checked, either “P” = Pass or “F” = Fail);

• Threshold per bill (for reference only);

• Total number of bills failed (number of bills with ratio of difference greater than

threshold); and

• Result of Billing Test (Passed or failed).

9.3.10 A sample of all test reports is attached in Annex 5 for reference. Although there

is no need for operators to provide the passed test reports regularly to OFTA, operators

should keep them for at least 3 years in case there is a need for OFTA or CPA to make

reference to them.

_____________________________________________________________________

___________________________________________________________________________________ HKTA 3104 Issue 1

10. Reference Documents

“Code of Practice Related to the Implementation and Compliance of Billing and

Metering Integrity Scheme” issued by OFTA

“Implementation Plan of Billing and Metering Integrity Scheme” issued by OFTA

HKTA 3105 “Requirements on the Assurance, Reporting and Monitoring Procedures for

the Billing and Metering Integrity Scheme” issued by OFTA

ISO 2859-1: 1999 (E) “Sampling Procedures for Inspection by Attributes – Part 1:

Sampling Plans Indexed by Acceptable Quality Level (AQL) for Lot-by-Lot Inspection”

Office of Telecommunications (Oftel, UK) : Standard for Telecommunications Metering

Systems and Billing Systems OTR003 : 2001

Australian Communications Industry Forum : Industry Code on Call Charging and

Billing Accuracy ACIF C518 : 2000

Statement of the Telecommunications Authority on “Billing and Metering Integrity

Scheme” issued on 23 November 2005

_____________________________________________________________________

___________________________________________________________________________________ HKTA 3104 Issue 1

Annex 1 Switching Rules and Procedures

Reduced

Inspection

Normal

Inspection

Tightened

Inspection

Discontinue

Inspection

Monthly test not

accepted or Note 4 Switching Score ≥ 30 and Note 3

5 consecutive monthly tests

accepted

2 of 5 or fewer consecutive

monthly tests not accepted

TA approval of reversion to

Tightened Inspection

5 monthly tests not accepted while

on Tightened Inspection

Start

Note 3: reduced inspection is considered desirable by the operator.

Note 4: instructions given by the TA that normal inspection shall be re-instated.

____________________________________________________________________

___________________________________________________________________________________ HKTA 3104 Issue 1

Annex 2 Self-Declaration Form for Compliance Status

Billing and Metering Integrity Scheme (BMIS)

Self-Declaration Form

Compliance Status on [Date]

I declare that our company has followed the requirements in accordance with the HKTA

3104 “Quality Assurance Manual for Billing and Metering Integrity Scheme” to carry

out metering and billing integrity tests and is in compliance with / not in compliance

with the BMIS on [Date].

Company name: ___________________________________

Licence type:____________________________(e.g. FTNS, PMRS, PNETS etc.)

Licence number:____________________________

Name of responsible person: ________________________

Position: ______________________

Telephone: ____________________________

Fax:___________________________________

Email address: _________________________

Date: _________________________

Signature: _____________________

____________________________________________________________________

___________________________________________________________________________________ HKTA 3104 Issue 1

Annex 3 Self-Declaration Form for the Metering Test


Self-Declaration Form of the Metering Test on [Date]



out metering and billing integrity tests and the results are as follows:

Metering Test

Testing period: _____________ (e.g. August 2001)

Number of Test Calls made: __________ (e.g. 1250)

Number of failed calls: ___________ (e.g. 1)

Test result: ________ (e.g. Pass with 10 switching score)

Inspection status before this test: ________ (refer to Annex 6 of QAM)

Inspection status after this test: __________ (refer to Annex 6 of QAM)

Metering Test / Per Call Test (Please specify) (Note 5):________ (e.g. Metering Test)

Number of calls sampled in Per Call Test Part 2: _____________(e.g. 1250)

Number of failed calls in Per Call Test Part 2: _______________(e.g. 1)

Company name: ___________________________________

Licence type: ____________________________ (e.g. FTNS, PMRS, PNETS etc.)

Licence number: ____________________________

Name of authorised person: ________________________

Position: _______________________

Telephone: ___________________________ Fax:________________________

Email address: _________________________ Date: _________________________

Signed with company chop: ___________________________

Note 5:

The Metering Test: test from call generator to Billing System.

Per Call Test: A two-part Metering Test: Part 1 to reconcile Test Call log records with

call details from a metering point and Part 2 to reconcile call details from that metering

point with call details from Billing System.

____________________________________________________________________

___________________________________________________________________________________ HKTA 3104 Issue 1

Annex 4 Self-Declaration Form for the Billing Test


Self-Declaration Form of the Billing Test on [Date]



out metering and billing integrity tests and the results are as follows:

Billing Test

Testing period: _____________ (e.g. August 2001)

Number of telephone bills checked: __________ (e.g. 50)

Number of failed telephone bills: ___________ (e.g. 0)

Test result: ________ (e.g. Pass with 10 switching score)

Inspection status before this test: ________ (refer to Annex 6 of QAM)

Inspection status after this test: __________ (refer to Annex 6 of QAM)

Company name: ___________________________________

Licence type:____________________________(e.g. FTNS, PMRS, PNETS etc.)

Licence number:____________________________


Position: ______________________

Telephone: ___________________________ Fax:___________________________

Email address: ________________________ Date: _________________________


_______________________________________________________________________________________________________________

_________________________________________________________________________________________________________________________________________ HKTA 3104 Issue 1

Annex 5 Format of Metering and Billing Test Report

Example of a Monthly Metering Test Report Using Metering Test Method Specified in “Methodology to Verify Metering System Using Test Calls”

in Section 7.1.3

Derived Records from Call Generator

Test Sequence Directory

Number

Dialled Number Call Date Charging Time Stamp

(start/end* time)

(A1)

Duration

/Usage

(A2)

Service

Type

Test Equipment

Tolerance

(second)

e.g. 1 2123 1234 00x 1 212 xxxxxxx 1 Dec 2001 9:05:00 p.m. 2 min 30 sec IDD 2

2

3

5000

*: delete whereas appropriate.

Derived Records form Billing System


Number

Dialled Number Charging Time Stamp

(start/end* time)

(B1)

Duration/

Usage

(B2)

Service

Type

Metering Tolerance

(second)

e.g. 1 2123 4567 00x 1 212 xxxxxxx 9:05:03 p.m. 2 min 33 sec IDD 1

2

3

5000

_______________________________________________________________________________________________________________

_________________________________________________________________________________________________________________________________________ HKTA 3104 Issue 1

Results of Difference between Call Generator and Billing System

Test Sequence Difference of

Charging Time Stamp

(start/end* time)

(B1-A1)

Difference of

Duration/Usage (B2-A2)

Result Difference of

Caller ID

Difference of

Calling ID

e.g. 1 0 0 F – mismatch

2

3

5000

*: delete whereas appropriate

Report prepared by

Company: _____________________

Name: ___________________

Position: __________________

Telephone: __________________

Fax: _______________________

Email:______________________

Date: _____________________

_______________________________________________________________________________________________________________

_________________________________________________________________________________________________________________________________________ HKTA 3104 Issue 1

Example of a Monthly Metering Test Report Using Metering Test Method Specified in “Alternative Method by Per Call Test”

in Section 7.1.15

Part I

Derived Records from Call Generator

Test

Sequence

Directory

Number


(start/end* time)

(A1)

Duration

/Usage

(A2)

Service

Type

Test Equipment

Tolerance

(second)

e.g. 1 2123 1234 00x 1 212 xxxxxxx 1 Dec 2001 9:05:00 p.m. 2 min 30 sec IDD 2

2

3

5000


Derived Records form CDR


Number


(start/end* time)

(B1)

Duration/

Usage

(B2)

Service

Type

Metering

Tolerance

(second)

e.g. 1 2123 4567 00x 1 212 xxxxxxx 9:05:03 p.m. 2 min 33 sec IDD 1

2

3

5000

_______________________________________________________________________________________________________________

_________________________________________________________________________________________________________________________________________ HKTA 3104 Issue 1

Results of Difference between Call Generator and CDR

Test Sequence Difference of Charging

Time Stamp

(start/end* time)

(B1-A1)

Difference of

Duration/Usage

(B2-A2)

Result


2

3

5000


Report prepared by

Company: _____________________

Name: ___________________

Position: __________________

Telephone: __________________

Fax: _______________________

Email:______________________

Date: _____________________

_______________________________________________________________________________________________________________

_________________________________________________________________________________________________________________________________________ HKTA 3104 Issue 1

Part II

Derived Records from CDR


Number


(start/end* time)

(A1)

Duration

/Usage

(A2)

Service

Type

e.g. 1 2123 1234 00x 1 212 xxxxxxx 1 Dec 2001 9:05:00 p.m. 2 min 30 sec IDD

2

3

5000


Derived Records from Billing System


Number


(start/end* time)

(B1)

Duration/

Usage

(B2)

Service

Type

e.g. 1 2123 4567 00x 1 212 xxxxxxx 9:05:03 p.m. 2 min 33 sec IDD

2

3

5000

_______________________________________________________________________________________________________________

_________________________________________________________________________________________________________________________________________ HKTA 3104 Issue 1

Results of Difference CDR and Billing System

Test Sequence Difference of

Charging Time Stamp

(start/end* time)

(B1-A1)

Difference of

Duration/Usage (B2-A2)

Result


2

3

5000


Report prepared by

Company: _____________________

Name: ___________________

Position: __________________

Telephone: __________________

Fax: _______________________

Email:______________________

Date: _____________________

_______________________________________________________________________________________________________________

_________________________________________________________________________________________________________________________________________ HKTA 3104 Issue 1

An Example of a Monthly Billing Test Report

Worksheet of Checking Detail Bills

Bill Number : 1

Service Type : IDD

Sample Identification (Directory No./Account No./Invoice No.) : XXXXXXXXXXXXX

Charging Items

Item Sequence

Call Date

Calling Party/Charged

Party

Charging Time Stamp

(start/end* time)

Charging Description

Duration No. of Units

Unit Charge Discount Actual Calculated Amount (A)

Billed Amount (B)

Difference of Charging Amount

(ABS(A – B))

e.g. 1 DD-MMM-YY HH:MM XXX XXX $X.XXXX XX% $XX.XX $2.80 0.00

2

3

30 XXXXXX $XX.XX $30.00 0.00

Total Per Bill

$XXXXX.XX $X.XX


_______________________________________________________________________________________________________________

_________________________________________________________________________________________________________________________________________ HKTA 3104 Issue 1

Result Summary of Checking Detail Bills

Bill Number

Total Difference of Charging Amount (C)

Total Actual Calculated Amount (D)

Ratio of Difference

(C/D)

Threshold Per Bill (E)

Result

(P if C/D <= E;

F if C/D > E)

Arithmetic Check

Overall Result (Note 6)

1 $X.XXXX $XXXXX.XX X.XXXX X.XXXX P F F

2 $X.XXXX $XXXXX.XX X.XXXX X.XXXX P P

3 $X.XXXX $XXXXX.XX X.XXXX X.XXXX F P F

4 $X.XXXX $XXXXX.XX X.XXXX X.XXXX F F F

50 $X.XXXX $XXXXX.XX X.XXXX X.XXXX P P P

Note 6: Overall result = threshold result logical AND arithmetic result.

Total Number of Bills Failed: X

Billing Test Result: (Passed or Failed)

Report prepared by

Company: _____________________

Name: ___________________

Position: __________________

Telephone: __________________

Fax: _______________________

Email:______________________

Date: ___________

_____________________________________________________________________

_________________________________________________________________________________ HKTA 3104 Issue 1

Annex 6 Inspection Status

1 Normal Inspection Switching Score = X 1 of Y consecutive monthly tests not accepted

Note: X=0,2,4,..,28 Note: Y=1,2,3,4 (this clause needed only when in jeopardy)

2 Reduced Inspection

3 Tightened Inspection

X consecutive monthly tests accepted

Y cumulative monthly tests not accepted

Note: X=0,1,2,3,4 Note: Y=0,1,2,3,4

4 Discontinue Inspection

_____________________________________________________________________

_________________________________________________________________________________ HKTA 3104 Issue 1

Annex 7 Format of Test Report for Rounding Treatment Test


Rounding Treatment Test

I report our company’s results of rounding treatment test as follows:

Testing period: _____________ (e.g. September 2001 to September 2002)

Number of bills used: __________ (e.g. 600)

Discrepancies: ____________ (e.g. + $1.3)

Total Billed Amount: ____________ (e.g. $60000)

I have attached a soft copy using a format/template defined by OFTA for all details of the

test. In this soft copy, it shall include, but not limited to, per call discrepancy (Eij), actual

per call charge up to 4 decimal places (A’Bij), operator billed per call charge calculated

according to operator’s billing logic (ABij).

Bill No.

Item Sequence

ABij Operator Billed Per Call Charge (calculated from operator’s billing logic usually with 2 decimal places in dollar terms)

A’Bij Actual Per Call Charge (with 4 decimal places in dollar terms)

Per Call Discrepancy, (Eij)

e.g. 1 1 $4.80 $4.7850 $0.015

$4.7 $4.7350 $-0.035

Company name: ___________________________________

Licence type: __________________________(e.g. FTNS, PMRS, PNETS etc.)

Licence number: ____________________________


Position: ______________________

Date: _________________________

Email address : _________________________

Telephone: ____________________________

Fax: __________________________________


OFTA Metering and Billing Standardstel_archives.ofca.gov.hk/en/b_m_issues/210602_4.pdf · Systems -...

Documents

Transcript of OFTA Metering and Billing Standardstel_archives.ofca.gov.hk/en/b_m_issues/210602_4.pdf · Systems -...