Independent Drive Test Report IDT Report... · • Most of the calls are blocked due to SDCCH...

Independent Drive Test Report

- September’16

PATNA

Key performance indicators for most of the operators: Most of the operators met the Call Setup

Success Rate (CSSR), where as most of the operators fall below the 2% CDR threshold

Methodology:

Independent Drive test was conducted in Patna from 9:00 AM to 9:PM from 5th to 6th of September 2016. The total drive test covered in Patna

area was approximately 200 km over a period of 2 days. A total of ~3438 calls were made for six 2G networks and four 3G networks covering

seven operators.

1 2 3 4

City-Level

Performance

Area-Level

Performance Analysis Summary

and

Highlights

Date: 3 November 2016

5

Appendix I. Benchmarking KPIs

II. Coverage

III. Receive (Rx) Quality

IV. City-Level Ranking

V. City-Level KPI

The independent drive test has been carried out by M/s IMRB International on behalf of TRAI

City-Level

Performance

Introduction

Ancillary Details

Overview

TRAI is regularly monitoring the performance of Telecom Service Providers (TSP) against the benchmarks for the various Quality of

Service (QoS) parameters laid down by the Authority. TSPs submit Performance Monitoring Reports to TRAI every quarter. TRAI also

undertakes audit and assessment of Quality of Service through independent agencies to verify the Quality of Service claimed. The Audit

agencies conduct sample ‘Drive tests’ across various cities all over the country as part of audit and assessment of the TSPs’

performance.

In view of complaints on call drops and other network issues, on behalf of TRAI, an Independent Drive Test (IDT) was conducted from 5th

September 2016 to 6th September 2016 covering various locations in Patna . The performance of Aircel, Airtel, BSNL, Idea, Vodafone,

Reliance, Telenor was monitored across various technologies (2G, 3G and CDMA). The drive test route was defined on the basis of

several factors that include - areas from where call drop complaints are commonly received; areas of heavy usage; residential areas

away from arterial roads; office areas; areas where previous Drive tests showed network issues; etc.

For the purpose of these tests, 2G + 3G Mode (Auto) was used. The test results obtained from these drive tests were conducted to

assess the network condition more specifically in terms of Radio Frequency (RF) Coverage; Rx Quality; Call Setup Success Rate; Call

Drop Rate; Blocked Calls and Carrier to Interference ratio.

Drive Route Details For Goa Area:

Independent Drive test was conducted in Mumbai to Goa area from 9:00 AM to 9:PM from 5th to 6th of September 2016. The total drive

test covered in Patna area was approximately 180 km over a period of 2 days. Total of ~3438 calls were made for six 2G networks and

four 3G networks, covering seven operators.

Roads and Areas covered in Patna is shown in the below map.

Below is the List of Areas Covered and Drive Routes

1

Danapur cantt Sabajpur Indira Nagar Karam Uchak Village

Jalalpur Saket Vihar Shivaji Path Begampur

Mansarovar nagar Shivaji Nagar Patna Internationl Airport Bajrang Puri

Sadikpur Bituara Anisabad Golakpur

HMRI Hospital Neora Road Sipara Mangal Chowk

Nandgaon Mahua Bagh Lohia Nagar Choti Pahadi

Indrapuri Dhulwari Buddha Colony Patrakar Nagar

Central Revenue Colony Varundavan Colony Nageshwar Colony Janki Nagar

XTTI Colony Yakubpur Nagwan Gandhi Maidan Quasim Colony

Taklapur Isha Nagar Patna Medical College & University Sultan Ganj

Drive test route

1. City-Level Performance

City-Level Details Operator Performance against Key Performance Indicators :

1. Call Setup Success Rate, 2. Blocked Call Rate, 3. Call Drop Rate, 4. Rx Quality

Legends

Threshold for each KPI are considered as per TRAI guidelines Abbreviation / Definition: CSSR (benchmark > =95%) : Call Setup Success Rate

BCR (benchmark <=3%): Blocked Call Rate

CDR (benchmark <=2%): Call Drop Rate

Good RxQuality (benchmark >=95%): 2G (RxQual <=5), 3G (EcNo >=-15dBm), CDMA (FER <=4%)

Most of the operators have met the

Call Setup Success Rate benchmark

of >=95%, except Airtel 3G. Refer. Fig 1

Most of the operators have met the

Blocked Call Rate benchmark of

<=3%, except Aircel 2G, Airtel 2G

&3G. Refer. Fig 2

Most of the operators failed to meet

the Call Drop Rate benchmark of

<=2%, except Airtel 2G, Idea 2G,

Reliance 3G and Vodafone 2G.

Refer. Fig 3

Half of the operators failed to meet

the Rx Quality Rate benchmark of

>=95%, except Aircel 3G, Airtel 3G,

Idea 2G, Reliance 3G and Vodafone

2G.

Refer. Fig 4

Operator meeting the benchmark Operator not meeting the benchmark

2

Current Drive: September 2016

96.41% 97.39% 96.96% 94.23%

97.02% 98.10% 99.73%

98.04% 98.36% 98.64%

Air

cel 2

G

Air

cel 3

G

Air

tel 2

G

Air

tel 3

G

Bsn

l 2G

Bsn

l 3G

Idea

2G

Re

lian

ce 3

G

Tele

no

r 2

G

Vo

da

fon

e 2

G

Fig 1. Call Setup Success Rate (%)

95%

3.59% 2.61% 3.04%

5.77%

2.98% 1.90% 0.27% 1.96% 1.64% 1.36%

Air

cel 2

G

Air

cel 3

G

Air

tel 2

G

Air

tel 3

G

Bsn

l 2G

Bsn

l 3G

Idea

2G

Re

lian

ce 3

G

Tele

no

r 2

G

Vo

da

fon

e 2

G

Fig 2. Block Call Rate (%)

3%

2.58% 3.36%

0.28% 2.04%

3.35%

12.58%

0.27% 2.00% 2.22% 1.10%

Air

cel 2

G

Air

cel 3

G

Air

tel 2

G

Air

tel 3

G

Bsn

l 2G

Bsn

l 3G

Idea

2G

Rel

ian

ce 3

G

Tele

no

r 2

G

Vo

da

fon

e 2

G

Fig 3. Call Drop Rate (%)

2%

86.49%

96.88% 93.63%

98.78%

92.78% 93.25% 95.04% 95.44%

91.32%

96.93%

Air

cel 2

G

Air

cel 3

G

Air

tel 2

G

Air

tel 3

G

Bsn

l 2G

Bsn

l 3G

Idea

2G

Rel

ian

ce 3

G

Tele

no

r 2

G

Vo

da

fon

e

2G

Fig 4. Rx Quality (%)

95%

2. Area-Level Performance

Area-Level Details

Legends

Drive test route covered in Patna city

Fig 5. Area Level route map

Areas meeting the benchmark Areas not meeting the benchmark

Abbreviation / Definition: CSSR (benchmark > =95%) : Call Setup Success Rate




3

Threshold for each KPI are considered as per TRAI guidelines

Current Drive: September 2016

2. Area-Level Performance

Area-Level Details

Legends

Area Level KPI performance ( all operators inclusive)





4

Areas meeting the benchmark Areas not meeting the benchmark

Threshold for each KPI are considered as per TRAI guidelines Current Drive: September 2016

Blocked Call Rate Aircel Airtel BSNL Idea Reliance Telenor Vodafone

DANAPUR CANTT 2.63% 5.41% 1.85% 0.00% 0.00% 0.00% 3.28%

KHAGAUL 8.22% 0.00% 0.00% 0.00% 0.00% 0.00% 0.00%

PATNA CENTRAL 2.21% 5.60% 3.83% 0.79% 0.96% 2.42% 0.00%

KUMHRAR 2.75% 3.92% 2.26% 0.00% 4.17% 2.11% 2.11%

Call Drop Rate Aircel Airtel BSNL Idea Reliance Telenor Vodafone

DANAPUR CANTT 2.70% 0.00% 10.38% 1.64% 3.92% 1.64% 1.69%

KHAGAUL 4.48% 0.00% 2.60% 0.00% 3.23% 5.13% 0.00%

PATNA CENTRAL 3.17% 0.91% 7.96% 0.00% 1.94% 2.48% 1.59%

KUMHRAR 2.42% 2.04% 7.72% 0.00% 0.87% 1.44% 0.72%

Rx Quality Aircel Airtel BSNL Idea Reliance Telenor Vodafone

DANAPUR CANTT 90.43% 96.06% 91.19% 95.43% 92.01% 90.51% 95.22%

KHAGAUL 84.56% 95.58% 94.62% 97.58% 89.69% 92.20% 98.97%

PATNA CENTRAL 91.67% 94.60% 89.89% 94.61% 96.82% 87.86% 95.58%

KUMHRAR 91.16% 96.52% 95.27% 94.51% 97.40% 94.12% 98.28%

Call Setup Success Rate Aircel Airtel BSNL Idea Reliance Telenor Vodafone

DANAPUR CANTT 97.37% 94.59% 98.15% 100.00% 100.00% 100.00% 96.72%

KHAGAUL 91.78% 100.00% 100.00% 100.00% 100.00% 100.00% 100.00%

PATNA CENTRAL 97.79% 94.40% 96.17% 99.21% 99.04% 97.58% 100.00%

KUMHRAR 97.25% 96.08% 97.74% 100.00% 95.83% 97.89% 97.89%

Detailed Analysis of Operators

High RLT

• Radio Link Timeout (RLT indicates how long the call can

sustain during poor quality – Higher the value the

longer it will sustain the call).

• If Radio Link Timeout of > 40 is considered in RLT <=40

for Aircel 2G, the Call Drop Rate would be higher than

the current call drop rate(2.58%).

3. Analysis

Legends Current Drive: September 2016

Operator meeting the set CDR threshold Operator not meeting the set CDR threshold

Abbreviation / Definition: CSSR (benchmark >=95%) : Call Setup Success Rate





Operators No. of Cells

with RLT <= 40

No. of Cells

with RLT > 40 Current CDR

CDR, If all

Cells assume

RLT <= 40

Airtel 100.00% 0.00% 0.28% 0.28%

Aircel 90.16% 9.84% 2.58% 2.87%

Vodafone 100.00% 0.00% 1.10% 1.10%

Idea 100.00% 0.00% 0.27% 0.27%

BSNL 100.00% 0.00% 3.35% 3.35%

Telenor 100.00% 0.00% 2.22% 2.22%

5

3. Analysis


Aircel 2G (CDR : 2.58%, BCR : 3.59%, Rx Quality : 86.49%, )

• Poor quality of network is clear indication of high call block rate.

Khagaul, Patna Central, Kumhrar are the key contributed areas of

high block rate

• Most of the calls are blocked due to SDCCH access failure,

SDCCH drop and TCH access failure .

• Aircel 2G having poor HOSR as well.

Airtel 3G (CDR : 2.04%, BCR : 5.77%)

• Danapur Cantt, Patna Central and Kumhrar are the key contributed

area of blocked calls.

• Most of the calls are blocked in 2G mode due to SDCCH access

failure and SDCCH drop.







6

Parameter

Highlighted areas(Danapur

Cantt , Patna Central ,

Kumhrar)

Rest of

Patna

# call blocks 18 0


Parameter Whole Patna

# call blocks 13

# call drops 9

3. Analysis


BSNL 3G (CDR : 12.58%, Coverage : 47.01%)

• Patna Central and Kumhrar are the key contributed areas of dropped

calls. Dropped Calls in these areas are 79.49% of total dropped calls in

all areas.

• Poor coverage of network is clear indication of high call drop rate.

• Due to poor coverage of BSNL 3G network, 62.32% calls are in 2G

mode.







7


Parameter

Highlighted

areas( Patna

Central ,

Kumhrar)

Rest of Patna

# call drops 31 8

BSNL 2G (CDR : 3.35%, Rx Quality : 92.78%, HOSR : 78.17%)

• Danapur Cantt and Patna Central are the key contributed areas of

dropped calls. Dropped Calls in these areas are 83.33% of total

dropped calls in all areas.

• Patna central and Kumhrar are key contributed areas of high block rate.

• Most of the calls are blocked due to SDCCH access failure, SDCCH drop

and TCH access failure.

Parameter

Highlighted

areas( Danapur

Cantt & Patna

Central)

Rest of Patna

# call drops 10 2

Parameter

Highlighted

areas( Kumhrar &

Patna Central)

Rest of Patna

# call blocks 10 1

4. Summary & Highlights

Summary & Highlights

Most of the operators failed to meet the Call Drop Rate benchmark of <=2%, except Airtel 2G, Idea

2G, Reliance 3G and Vodafone 2G.

Key Highlights

• Most of the operators failed to meet the Call Drop rate benchmark of <=2%, except Airtel 2G, Idea 2G, Reliance 3G

and Vodafone 2G.

• 3G network of BSNL have Call Drop Rates in the range of above 10%. The high drop rate for operator is clear

indication of urgent need of improvement in order to deliver a reasonable levels of services.

• All area in Patna City lagging in call drop benchmark with a small margin, so the operators need to focus on their

quality of services than currently is being provided.

Fig 6. Call Drop Rate

8

2.58% 3.36%

0.28% 2.04%

3.35%

12.58%

0.27% 2.00% 2.22%

1.10%

Air

cel 2

G

Air

cel 3

G

Air

tel 2

G

Air

tel 3

G

Bsn

l 2G

Bsn

l 3G

Idea

2G

Re

lian

ce 3

G

Tele

no

r 2

G

Vo

da

fon

e 2

G

Fig 6. Call Drop Rate (%)

5. Appendix

Ancillary Details

I. Benchmarking KPI Details

II. Coverage Details

III. Receive (Rx) Quality Details

IV. City-Level Ranking and KPI details

V. City-Level KPI details

Table of Contents in Appendix

9

Appendix

Ancillary Details

2. Benchmarking KPI Details

RF Coverage

RF Coverage relates to the geographical footprint within the system that has sufficient RF signal strength to provide for a call/data

session. Coverage rate of an operator is calculated basis of % of samples in which the Rx level is better than -85 dBm

Accessibility

Accessibility is the ability of a service to be obtained within specific tolerances and other given conditions, when requested by the user.

In other words, the ability of a user to obtain the requested service from the system. Accessibility is monitored by measuring Call Setup

Success Rate (CSSR) which is defined as the ratio of Established Calls to Call Attempts

Retainability

Retainability is “The ability of a service, once obtained, to continue to be provided under given conditions for a requested duration.” For

determining the Retainability the regulation prescribes three important parameters namely Call Drop Rate (CDR), Worst affected Cells

having more than 3% TCH drop and Connection with good voice quality. Drop Call and Connection with good voice quality were

monitored by the drive test

Mobility

In a cellular system a base station has only a limited coverage area. Hence it is possible for a moving subscriber to be out of range of a

base station while making a call. The process by which a mobile telephone call is transferred from one base station to another as the

subscriber passes the boundary of a cell is called a handover. The Handover success rate (HOSR) more than 95% is considered to be

good

Rx Quality

For measuring voice quality, RxQual samples on a scale from 0 to 7 for GSM operators, EcNo from 0 to -30 dBm and Frame Error Rate

(FERs) for CDMA service providers are measured. As per the QoS norms, RxQual between 0- 5 for GSM operators, EcNo >= -15 dBm and

between 0-4% FER value for CDMA operators FERs is considered to be good, where as RxQual beyond this benchmark is considered to

be bad

10

Coverage % Accessibility % Retainability % Mobility % Rx Quality %

Aircel 2G 89.87% 96.41% 97.42% 94.65% 86.49%

Aircel 3G 76.79% 97.39% 96.64% 99.14% 96.88%

Airtel 2G 97.63% 96.96% 99.72% 97.73% 93.63%

Airtel 3G 90.44% 94.23% 97.96% 99.78% 98.78%

Bsnl 2G 98.35% 97.02% 96.65% 78.17% 92.78%

Bsnl 3G 47.01% 98.10% 87.42% 97.78% 93.25%

Idea 2G 94.35% 99.73% 99.73% 98.41% 95.04%

Reliance 3G 53.82% 98.04% 98.00% 99.94% 95.44%

Telenor 2G 89.28% 98.36% 97.78% 95.42% 91.32%

Vodafone 2G 87.41% 98.64% 98.90% 98.89% 96.93%

0.00%

25.00%

50.00%

75.00%

100.00%

KPI Distribution

Appendix

Ancillary Details

3. Coverage Details

RF Coverage relates to the geographical footprint within the system that has sufficient RF signal strength to provide for a call/data

session. The Coverage rate of an operator is calculated basis of % of samples in which the Rx level is better than -85 dBm. The details

are as follows.

Operators not meeting benchmark

11

Aircel 2G Aircel 3G Airtel 2G

Airtel 3G BSNL 2G BSNL 3G

0.00%

25.00%

50.00%

75.00%

100.00%

Air

cel 2

G

Air

cel 3

G

Air

tel 2

G

Air

tel 3

G

Bsn

l 2G

Bsn

l 3G

Idea

2G

Re

lian

ce 3

G

Tele

no

r 2

G

Vo

da

fon

e 2

G

Coverage Distribution

-95 to -120 dBm -85 to -95 dBm -75 to -85 dBm 0 to -75 dBm

Operators Coverage Rate

Aircel 2G 89.87%

Aircel 3G 76.79%

Airtel 2G 97.63%

Airtel 3G 90.44%

Bsnl 2G 98.35%

Bsnl 3G 47.01%

Idea 2G 94.35%

Reliance 3G 53.82%

Telenor 2G 89.28%

Vodafone 2G 87.41%

Appendix

Ancillary Details

3. Coverage Details

12

IDEA 2G RELIANCE 3G Telenor 2G

Vodafone 2G

Appendix

Ancillary Details

4. Receive (Rx) Quality Details

For measuring voice quality, RxQual samples on a scale from 0 to 7 for GSM operators, EcNo for 3G operators on a scale of 0 to -30

dBm and Frame Error Rate (FERs) for CDMA service providers are measured. As per the QoS norms, Rx Quality between 0- 5 for GSM

operators, EcNo >= -15 dBm and between 0-4% FER value for CDMA operators FERs is considered to be good, where as quality beyond

this benchmark is considered to be bad. The benchmark should usually be > =95%.


13

Aircel 2G Aircel 3G Airtel 2G

Airtel 3G BSNL 2G BSNL 3G

0.00%

25.00%

50.00%

75.00%

100.00%

Air

cel 2

G

Air

cel 3

G

Air

tel 2

G

Air

tel 3

G

Bsn

l 2G

Bsn

l 3G

Idea

2G

Re

lian

ce 3

G

Tele

no

r 2

G

Vo

da

fon

e 2

G

Rx Quality Distribution

RxQual 6 to 7, EcNo <-15 dBm, FER <= 4% RxQual 0 to 5, EcNo >=-15 dBm, FER > 4%

Operator Rx Quality

Aircel 2G 86.49%

Aircel 3G 96.88%

Airtel 2G 93.63%

Airtel 3G 98.78%

Bsnl 2G 92.78%

Bsnl 3G 93.25%

Idea 2G 95.04%

Reliance 3G 95.44%

Telenor 2G 91.32%

Vodafone 2G 96.93%

Appendix

Ancillary Details

4. Receive (Rx) Quality Details

14

IDEA 2G RELIANCE 3G Telenor 2G

Vodafone 2G

Appendix

Ancillary Details

5. City-Level Ranking and KPI details

Accessibility is the ability of a service to be obtained within specific tolerances and other given conditions, when requested by the user.

In other words, the ability of a user to obtain the requested service from the system. Accessibility is monitored by measuring Call Setup

Success Rate (CSSR) which is defined as the ratio of Established Calls to Call Attempts. The benchmark is >=95%. The details are as

follows:

Retainability is “the ability of a service, once obtained, to continue to be provided under given conditions for a requested duration.” For

determining the Retainability, the regulation prescribes three important parameters namely Call drop rate (CDR), Worst affected Cells

having more than 3% TCH drop and Connection with good voice quality. The call drop and connection with good voice quality were

monitored by the drive test

Call Drop Rate (CDR): The parameter gives a reliable measurement of the mobile network used by the service provider for maintaining a

call once it has been correctly established

Mobility: In a cellular system a base station has only a limited coverage area. Hence it is possible for a moving subscriber to get out of

reach of a base station while making a call. The process by which a mobile telephone call is transferred from one base station to

another as the subscriber passes the boundary of a cell is called a handover. The Handover Ssuccess Rate (HOSR) more than 95% is

considered to be good

*In case of multiple call failure in similar geo location in given period of 60sec has been counted as one call failure


15

Operators Total HO Attempt HO Failure HO Success HO Failure Rate HO Success Rate

Aircel 2G 579 31 548 5.35% 94.65%

Aircel 3G 3601 31 3570 0.86% 99.14%

Airtel 2G 970 22 948 2.27% 97.73%

Airtel 3G 5569 12 5557 0.22% 99.78%

Bsnl 2G 655 143 512 21.83% 78.17%

Bsnl 3G 2070 46 2024 2.22% 97.78%

Idea 2G 628 10 618 1.59% 98.41%

Reliance 3G 5098 3 5095 0.06% 99.94%

Telenor 2G 502 23 479 4.58% 95.42%

Vodafone 2G 720 8 712 1.11% 98.89%

Operators Total Call Established Total Call Drop CDR CCSR

Aircel 2G 349 9 2.58% 97.42%

Aircel 3G 298 10 3.36% 96.64%

Airtel 2G 351 1 0.28% 99.72%

Airtel 3G 294 6 2.04% 97.96%

Bsnl 2G 358 12 3.35% 96.65%

Bsnl 3G 310 39 12.58% 87.42%

Idea 2G 370 1 0.27% 99.73%

Reliance 3G 300 6 2.00% 98.00%

Telenor 2G 360 8 2.22% 97.78%

Vodafone 2G 363 4 1.10% 98.90%

Operators Total Call Attempt Blocked Calls Blocked Call Rate* CSSR

Aircel 2G 362 13 3.59% 96.41%

Aircel 3G 306 8 2.61% 97.39%

Airtel 2G 362 11 3.04% 96.96%

Airtel 3G 312 18 5.77% 94.23%

Bsnl 2G 369 11 2.98% 97.02%

Bsnl 3G 316 6 1.90% 98.10%

Idea 2G 371 1 0.27% 99.73%

Reliance 3G 306 6 1.96% 98.04%

Telenor 2G 366 6 1.64% 98.36%

Vodafone 2G 368 5 1.36% 98.64%

Appendix

Ancillary Details

6. City-Level KPI details

16

Call Events

Operators (Summary)

Aircel Airtel BSNL IDEA Reliance Telenor Vodafone

2G 3G 2G 3G 2G 3G 2G 3G 2G 2G

Call Attempt (September-16)

362 306 362 312 369 316 371 306 366 368

Blocked Call Rate (September-16)

3.59% 2.61% 3.04% 5.77% 2.98% 1.90% 0.27% 1.96% 1.64% 1.36%

CSSR (Accessibility) (September-16)

96.41% 97.39% 96.96% 94.23% 97.02% 98.10% 99.73% 98.04% 98.36% 98.64%

Dropped Call Rate (September-16)

2.58% 3.36% 0.28% 2.04% 3.35% 12.58% 0.27% 2.00% 2.22% 1.10%

Mobility HOSR (September-16)

94.65% 99.14% 97.73% 99.78% 78.17% 97.78% 98.41% 99.94% 95.42% 98.89%

Rx Quality (September-16)

86.49% 96.88% 93.63% 98.78% 92.78% 93.25% 95.04% 95.44% 91.32% 96.93%

Operators are meeting benchmark Operators not meeting benchmark

Independent Drive Test Report IDT Report... · • Most of the calls are blocked due to SDCCH...

Documents

Transcript of Independent Drive Test Report IDT Report... · • Most of the calls are blocked due to SDCCH...