Independent Drive Test Report Report for Surat_Final.pdf · Good RxQuality (benchmark >=95%): 2G...

18
Independent Drive Test Report - September’16 Surat Key performance indicators for most of the operators: Most of the operators met the Call Setup Success Rate (CSSR), where as half of the operators fall below the 2% Call Drop Rate (CDR) threshold Methodology: Independent Drive test was conducted in Surat from 9:00 AM to 9:PM from 19 th to 20 th of September 2016. The total drive test covered in Surat area was approximately 250 km over a period of 2 days. A total of ~3282 calls were made for seven 2G networks, five 3G networks and two CDMA networks covering eight operators. 1 2 3 4 City-Level Performance Area-Level Performance Analysis Summary and Highlights Date: 3 November 2016 5 Appendix I. Benchmarking KPIs II. Coverage III. Receive (Rx) Quality IV. City-Level Ranking V. City-Level KPI The independent drive test has been carried out by M/s IMRB International on behalf of TRAI Introduction

Transcript of Independent Drive Test Report Report for Surat_Final.pdf · Good RxQuality (benchmark >=95%): 2G...

Page 1: Independent Drive Test Report Report for Surat_Final.pdf · Good RxQuality (benchmark >=95%): 2G (RxQual =-15dBm), CDMA (FER

Independent Drive Test Report

- September’16

Surat

Key performance indicators for most of the operators: Most of the operators met the Call Setup

Success Rate (CSSR), where as half of the operators fall below the 2% Call Drop Rate (CDR)

threshold

Methodology:

Independent Drive test was conducted in Surat from 9:00 AM to 9:PM from 19th to 20th of September 2016. The total drive test covered in Surat

area was approximately 250 km over a period of 2 days. A total of ~3282 calls were made for seven 2G networks, five 3G networks and two

CDMA networks covering eight operators.

1 2 3 4

City-Level

Performance

Area-Level

Performance Analysis Summary

and

Highlights

Date: 3 November 2016

5

Appendix I. Benchmarking KPIs

II. Coverage

III. Receive (Rx) Quality

IV. City-Level Ranking

V. City-Level KPI

The independent drive test has been carried out by M/s IMRB International on behalf of TRAI

Introduction

Page 2: Independent Drive Test Report Report for Surat_Final.pdf · Good RxQuality (benchmark >=95%): 2G (RxQual =-15dBm), CDMA (FER

Introduction

Ancillary Details Overview

TRAI is regularly monitoring the performance of Telecom Service Providers (TSP) against the benchmarks for the various Quality of

Service (QoS) parameters laid down by the Authority. TSPs submit Performance Monitoring Reports to TRAI every quarter. TRAI also

undertakes audit and assessment of Quality of Service through independent agencies to verify the Quality of Service claimed. The Audit

agencies conduct sample ‘Drive tests’ across various cities all over the country as part of audit and assessment of the TSPs’

performance.

In view of complaints on call drops and other network issues, on behalf of TRAI, an Independent Drive Test (IDT) was conducted from

19th September 2016 to 20th September 2016 covering various locations in Surat . The performance of Airtel, BSNL, Idea, MTS, Tata,

Vodafone, Reliance, Telenor was monitored across various technologies (2G, 3G and CDMA). The drive test route was defined on the

basis of several factors that include - areas from where call drop complaints are commonly received; areas of heavy usage; residential

areas away from arterial roads; office areas; areas where previous Drive tests showed network issues; etc.

For the purpose of these tests, 2G + 3G Mode (Auto) was used. The test results obtained from these drive tests were conducted to

assess the network condition more specifically in terms of Radio Frequency (RF) Coverage; Rx Quality; Call Setup Success Rate; Call

Drop Rate; Blocked Calls and Carrier to Interference ratio.

Drive Route Details For Goa Area:

Independent Drive test was conducted in Mumbai to Goa area from 9:00 AM to 9:PM from 19th to 20th of September 2016. The total

drive test covered in Surat area was approximately 250 km over a period of 2 days. Total of ~282 calls were made for seven 2G

networks, five 3G networks & 2 CDMA networks covering eight operators.

Roads and Areas covered in Surat is shown in the below map.

Below is the List of Areas Covered and Drive Routes

1

Kosad navivasahat Gopipura

Parth society Rustampura

Amroli Maktampur

Abhishek twp Bhatar char rasta

Dilip nagar Piplod

Mota varachha Athwa

Khodiyar nagar Vishnu nagar

Punitdham society Pandesara

Patel faliya Hari nagar

Amidhara society Govind nagar

Yamuna nagar Chopati

Jai bhavani society Nanpura

Yogi nagar Adajan

Chikuwadi Jogani nagar

Nilkamal park Pankaj nagar

Samrat Society Mahadev nagar

Sita nagar Palanpur patiya

Sidhdheswar society Sima nagar

Ambavadi Khidmat nagar

Laxmi nagar Gorat

Jt nagar Rehmat nagar

Heera nagar Katargam

Patel nagar Raman nagar

Mira nagar Nagina wadi

Drive test route

Page 3: Independent Drive Test Report Report for Surat_Final.pdf · Good RxQuality (benchmark >=95%): 2G (RxQual =-15dBm), CDMA (FER

1. City-Level Performance

City-Level Details Operator Performance against Key Performance Indicators :

1. Call Setup Success Rate, 2. Blocked Call Rate, 3. Call Drop Rate, 4. Rx Quality

Legends

Threshold for each KPI are considered as per TRAI guidelines Abbreviation / Definition: CSSR (benchmark > =95%) : Call Setup Success Rate

BCR (benchmark <=3%): Blocked Call Rate

CDR (benchmark <=2%): Call Drop Rate

Good RxQuality (benchmark >=95%): 2G (RxQual <=5), 3G (EcNo >=-15dBm), CDMA (FER <=4%)

All the operators have met the Call

Setup Success Rate benchmark of

>=95%, except Reliance 2G and

Telenor 2G. Refer. Fig 1

Half of the operators have met the

Blocked Call Rate benchmark of

<=3%, except BSNL 3G, Idea 3G,

Reliance 2G, Tata 2G, Tata CDMA,

Telenor 2G and Vodafone 3G. Refer. Fig 2

Half of the operators have met the

Call Drop Rate benchmark of

<=2%, except BSNL 3G, Idea 3G,

Reliance 2G, Tata 2G, Tata 3G,

Tata CDMA and Telenor 2G.

Refer. Fig 3

Most of the operators have met the

Rx Quality Rate benchmark of

>=95%, except Idea 3G, Reliance

2G, Tata 2G and Telenor 2G.

Refer. Fig 4

Operator meeting the benchmark Operator not meeting the benchmark

2

Current Drive: September 2016

97.01% 99.16% 97.37% 96.54% 98.58% 96.76% 100.00%

93.00% 95.97% 98.03% 96.37%

90.87%

97.04% 96.46%

AIR

TEL

2G

AIR

TEL

3G

BS

NL

2G

BS

NL

3G

IDE

A 2

G

IDE

A 3

G

MTS

CD

MA

Re

lian

ce 2

G

TATA

2G

TATA

3G

TATA

CD

MA

TELE

NO

R 2

G

VO

DA

FON

E 2

G

VO

DA

FON

E 3

G

Fig 1. Call Setup Success Rate (%)

95%

2.99% 0.84%

2.63% 3.46% 1.42%

3.24%

0.00%

7.00%

4.03% 1.97%

3.63%

9.13%

2.96% 3.54%

AIR

TEL

2G

AIR

TEL

3G

BS

NL

2G

BS

NL

3G

IDE

A 2

G

IDE

A 3

G

MTS

CD

MA

Re

lian

ce 2

G

TATA

2G

TATA

3G

TATA

CD

MA

TELE

NO

R 2

G

VO

DA

FON

E 2

G

VO

DA

FON

E 3

G

Fig 2. Block Call Rate (%)

3%

0.77% 1.70% 1.16%

6.73%

0.48%

3.91%

0.75%

6.28%

2.10%

4.42% 3.35%

6.35%

1.02% 1.57%

AIR

TEL

2G

AIR

TEL

3G

BS

NL

2G

BS

NL

3G

IDE

A 2

G

IDE

A 3

G

MTS

CD

MA

Re

lian

ce 2

G

TATA

2G

TATA

3G

TATA

CD

MA

TELE

NO

R 2

G

VO

DA

FON

E 2

G

VO

DA

FON

E 3

G

Fig 3. Call Drop Rate (%)

2%

96.16% 98.51% 98.24% 97.97% 97.02%

93.76% 96.72%

92.25% 93.97%

98.30% 96.94%

89.77%

95.51% 96.68%

AIR

TEL

2G

AIR

TEL

3G

BS

NL

2G

BS

NL

3G

IDE

A 2

G

IDE

A 3

G

MTS

CD

MA

Re

lian

ce 2

G

TATA

2G

TATA

3G

TATA

CD

MA

TELE

NO

R 2

G

VO

DA

FON

E 2

G

VO

DA

FON

E 3

G

Fig 4. Rx Quality (%)

95%

Page 4: Independent Drive Test Report Report for Surat_Final.pdf · Good RxQuality (benchmark >=95%): 2G (RxQual =-15dBm), CDMA (FER

1. City-Level Performance Comparison from Previous Comparison against previous drive test (May’16) – Most of the operators have shown

improvement in CSSR, CDR and Rx Quality.

Legends Current Drive: September 2016

Previous Drive: December 2015

Improvement from previous drive Degradation from previous drive

All operators have shown improvement

in CSSR from pervious drive test

except Tata CDMA and Telenor.

Refer Fig 5

All operators have shown improvement

in CDR from pervious drive test except

Tata CDMA . Refer Fig 6

All operators have shown improvement

in their Quality in compare to the

previous drive test. Refer. Fig 7

Abbreviation / Definition: CSSR (benchmark > =95%) : Call Setup Success Rate

BCR (benchmark <=3%): Blocked Call Rate

CDR (benchmark <=2%): Call Drop Rate

Good Rx Quality (benchmark >=95%): 2G (RxQual <=5), 3G (EcNo >=-15dBm), CDMA (FER <=4%)

3

2.01%

5.86% 4.09%

5.33%

1.04%

5.60% 6.66%

8.29%

-0.86% -0.07%

5.63% 4.83% A

irte

l 2G

BS

NL

3G

Idea

2G

Idea

3G

MTS

CD

MA

Re

lian

ce 2

G

Tata

2G

Tata

3G

Tata

CD

MA

Tele

no

r 2

G

Vo

da

fon

e 2

G

Vo

da

fon

e 3

G

Fig 5. CSSR difference from previous drive (%)

3.4% 2.8%

7.9% 7.0% 4.8%

0.2%

4.9% 2.7%

-2.5% 0.0%

6.1%

2.8%

Air

tel 2

G

BS

NL

3G

Idea

2G

Idea

3G

MTS

CD

MA

Re

lian

ce 2

G

Tata

2G

Tata

3G

Tata

CD

MA

Tele

no

r 2

G

Vo

da

fon

e 2

G

Vo

da

fon

e 3

G

Fig 6. CDR difference from previous drive (%)

9.1%

32.3%

12.4%

34.8%

6.1% 8.6% 3.7%

73.2%

3.0% 9.3%

43.7%

28.2%

Air

tel 2

G

BS

NL

3G

Idea

2G

Idea

3G

MTS

CD

MA

Re

lian

ce 2

G

Tata

2G

Tata

3G

Tata

CD

MA

Tele

no

r 2

G

Vo

da

fon

e 2

G

Vo

da

fon

e 3

G

Fig 7. Rx Quality difference from previous drive (%)

Page 5: Independent Drive Test Report Report for Surat_Final.pdf · Good RxQuality (benchmark >=95%): 2G (RxQual =-15dBm), CDMA (FER

2. Area-Level Performance

Area-Level Details

Legends

Drive test route covered in Surat city

Fig 8. Area Level route map)

Areas meeting the benchmark Areas not meeting the benchmark

Abbreviation / Definition: CSSR (benchmark > =95%) : Call Setup Success Rate

BCR (benchmark <=3%): Blocked Call Rate

CDR (benchmark <=2%): Call Drop Rate

Good RxQuality (benchmark >=95%): 2G (RxQual <=5), 3G (EcNo >=-15dBm), CDMA (FER <=4%)

4

Threshold for each KPI are considered as per TRAI guidelines

Current Drive: September 2016

Page 6: Independent Drive Test Report Report for Surat_Final.pdf · Good RxQuality (benchmark >=95%): 2G (RxQual =-15dBm), CDMA (FER

2. Area-Level Performance

Area-Level Details

Legends

Area Level KPI performance ( all operators inclusive)

Abbreviation / Definition: CSSR (benchmark > =95%) : Call Setup Success Rate

BCR (benchmark <=3%): Blocked Call Rate

CDR (benchmark <=2%): Call Drop Rate

Good RxQuality (benchmark >=95%): 2G (RxQual <=5), 3G (EcNo >=-15dBm), CDMA (FER <=4%)

5

Areas meeting the benchmark Areas not meeting the benchmark

Threshold for each KPI are considered as per TRAI guidelines Current Drive: September 2016

Block Call Rate Airtel BSNL Idea MTS RCOM TATA Telenor Vodafone

Varachha 5.17% 4.67% 2.27% 0.00% 5.36% 3.73% 6.38% 4.55%

Katagram+ Amroli 0.88% 1.79% 4.76% 0.00% 7.14% 2.94% 4.55% 0.00%

Adajan 1.28% 0.00% 3.80% 0.00% 15.00% 2.70% 2.44% 6.82%

Piplod 0.93% 4.55% 0.99% 0.00% 5.17% 2.26% 9.26% 2.88%

Pandesara + Udhna 1.11% 3.37% 1.15% 0.00% 4.26% 4.58% 20.45% 0.00%

Call Setup Success Rate Airtel BSNL Idea MTS RCOM TATA Telenor Vodafone

Varachha 94.83% 95.33% 97.73% 100.00% 94.64% 96.27% 93.62% 95.45%

Katagram+ Amroli 99.12% 98.21% 95.24% 100.00% 92.86% 97.06% 95.45% 100.00%

Adajan 98.72% 100.00% 96.20% 100.00% 85.00% 97.30% 97.56% 93.18%

Piplod 99.07% 95.45% 99.01% 100.00% 94.83% 97.74% 90.74% 97.12%

Pandesara + Udhna 98.89% 96.63% 98.85% 100.00% 95.74% 95.42% 79.55% 100.00%

Call Drop Rate Airtel BSNL Idea MTS RCOM TATA Telenor Vodafone

Varachha 1.82% 1.96% 1.16% 1.75% 1.89% 1.29% 9.09% 1.19%

Katagram+ Amroli 0.00% 3.64% 0.00% 1.61% 9.62% 3.03% 4.76% 0.00%

Adajan 0.00% 5.06% 1.32% 0.00% 5.88% 2.78% 0.00% 0.00%

Piplod 2.80% 3.81% 1.00% 0.00% 5.45% 8.09% 6.12% 0.00%

Pandesara + Udhna 1.12% 4.65% 5.81% 0.00% 8.89% 0.00% 11.43% 5.33%

Rx Quality Airtel BSNL Idea MTS RCOM TATA Telenor Vodafone

Varachha 96.19% 97.16% 95.03% 97.08% 94.34% 96.26% 88.48% 94.88%

Katagram+ Amroli 98.25% 99.07% 96.84% 96.17% 91.00% 96.27% 89.01% 95.58%

Adajan 97.15% 97.35% 95.96% 94.09% 92.54% 97.05% 91.05% 96.27%

Piplod 97.46% 98.96% 96.93% 96.76% 93.01% 95.16% 91.49% 96.53%

Pandesara + Udhna 96.98% 97.83% 95.39% 99.53% 90.01% 95.26% 88.72% 96.93%

Page 7: Independent Drive Test Report Report for Surat_Final.pdf · Good RxQuality (benchmark >=95%): 2G (RxQual =-15dBm), CDMA (FER

Detailed Analysis of Operators

High RLT

• Radio Link Timeout (RLT indicates how long the call can

sustain during poor quality – Higher the value the longer

it will sustain the call).

3. Analysis

Legends Current Drive: September 2016

Operator meeting the set CDR threshold Operator not meeting the set CDR threshold

Abbreviation / Definition: CSSR (benchmark >=95%) : Call Setup Success Rate

BCR (benchmark <=3%): Blocked Call Rate

CDR (benchmark <=2%): Call Drop Rate

Good RxQuality (benchmark >=95%): 2G (RxQual <=5), 3G (EcNo >=-15dBm), CDMA (FER <=4%)

Threshold for each KPI are considered as per TRAI guidelines

Operators

No. of Cells

with RLT <=

40

No. of Cells

with RLT > 40 Current CDR

CDR, If all

Cells assume

RLT <= 40

Airtel 100.00% 0.00% 0.77% 0.77%

BSNL 98.56% 1.44% 1.16% 1.16%

Idea 100.00% 0.00% 0.48% 0.48%

Reliance 87.45% 12.55% 6.28% 6.28%

Tata 100.00% 0.00% 2.10% 2.10%

Telenor 91.23% 8.77% 6.35% 6.35%

Vodafone 100.00% 0.00% 1.02% 1.02%

6

Page 8: Independent Drive Test Report Report for Surat_Final.pdf · Good RxQuality (benchmark >=95%): 2G (RxQual =-15dBm), CDMA (FER

3. Analysis

Detailed Analysis of Operators

BSNL 3G (CDR : 6.73%, Coverage: 63.56%)

• Poor coverage of network is clear indication of high call block rate.

• All call drops are equally distributed over the whole network.

IDEA 3G (CDR : 3.91%, Rx Quality : 93.76%)

• (Pandesara + Udhana) is the key contributed area of dropped calls. This

area has 57% of total drop calls of whole areas.

• Poor network quality is clear indication of high call drop rate.

Legends Current Drive: September 2016

Operator meeting the set CDR threshold Operator not meeting the set CDR threshold

Abbreviation / Definition: CSSR (benchmark > =95%) : Call Setup Success Rate

BCR (benchmark <=3%): Blocked Call Rate

CDR (benchmark <=2%): Call Drop Rate

Good RxQuality (benchmark >=95%): 2G (RxQual <=5), 3G (EcNo >=-15dBm), CDMA (FER <=4%)

7

Parameter Highlighted areas

(Pandesara +Udhana)

Rest of

Surat

# call drops 4 3

Threshold for each KPI are considered as per TRAI guidelines

Parameter Whole Surat

# call drops 15

Reliance 2G (CDR : 6.28%, BCR : 7.00% Coverage : 69.85%, Quality : 92.25%)

Parameter

Highlighted areas

(Katagram + Amroli and

Pandesara +Uthana)

Rest of

Surat

# call Drops 9 6 • (Katagram + Amroli) and (Pandesara + Uthana) are the key contributed

area of dropped calls. These areas have 60% of total dropped calls of

whole areas.

• Most of the calls are blocked due to poor network and poor coverage.

• (Katagram + Amroli) and Adajan are the key contributed area of

blocked calls. These areas have 56% of total blocked calls of whole

areas.

Parameter

Highlighted areas

(Katagram + Amroli &

Adajan)

Rest of

Surat

# call Blocks 10 8

Page 9: Independent Drive Test Report Report for Surat_Final.pdf · Good RxQuality (benchmark >=95%): 2G (RxQual =-15dBm), CDMA (FER

3. Analysis

Detailed Analysis of Operators

TATA 3G (CDR : 4.42%)

• Piplod is the key contributed area of dropped calls. Dropped calls in this

area has 55% of total dropped calls of whole area.

Legends Current Drive: September 2016

Operator meeting the set CDR threshold Operator not meeting the set CDR threshold

Abbreviation / Definition: CSSR (benchmark > =95%) : Call Setup Success Rate

BCR (benchmark <=3%): Blocked Call Rate

CDR (benchmark <=2%): Call Drop Rate

Good RxQuality (benchmark >=95%): 2G (RxQual <=5), 3G (EcNo >=-15dBm), CDMA (FER <=4%)

8

Threshold for each KPI are considered as per TRAI guidelines

Parameter Highlighted areas (

Piplod ) Rest of Surat

# call drops 6 5

TATA CDMA (CDR : 3.35)

• Piplod is the key contributed area of dropped calls. Dropped calls in this

area has 62% of total dropped calls of whole area.

Parameter Highlighted areas (

Piplod ) Rest of Surat

# call drops 5 3

Telenor 2G (CDR : 6.35%, BCR : 9.13%, Coverage : 81.35% , Rx Quality : 89.77%)

• Varachha and (Pandesara + Uthana) are the key contributed area

of dropped calls. These areas have 67% of total dropped calls of

whole areas.

• Most of the calls are dropped due to poor coverage and poor

quality of network.

• Piplod and (Pandesara + Uthana) are the key contributed area of

dropped calls. These areas have 74% of total dropped calls of

whole areas.

Parameter

Highlighted areas

( Varachha &

Pandesara + Uthna)

Rest of Surat

# call drops 8 4

Parameter

Highlighted areas

( Piplod &

Pandesara + Uthna)

Rest of Surat

# call drops 14 5

Page 10: Independent Drive Test Report Report for Surat_Final.pdf · Good RxQuality (benchmark >=95%): 2G (RxQual =-15dBm), CDMA (FER

4. Summary & Highlights

Summary & Highlights

Half of the operators failed to meet the call drop rate benchmark of <=2%, except Airtel 2G, Airtel 3G,

BSNL 2G, Idea 2G, MTS CDMA, Vodafone 2G and Vodafone 3G.

Key Highlights

• All of the operators have shown improvement in their performance, compare to the pervious drive except Tata CDMA .

• Half of the operators failed to meet the call drop rate benchmark of <=2%, except Airtel 2G, Airtel 3G, BSNL 2G, Idea

2G, MTS CDMA, Vodafone 2G and Vodafone 3G.

• BSNL 3G, Reliance 2G and Telenor 2G operators have call drop rate of >5%.

• The gap between the performances of Airtel 2G, Airtel 3G, BSNL 2G, Idea 2G, MTS CDMA, Vodafone 2G and

Vodafone 3G compared to the poor performances of other operators are clearly showing in the areas driven, there are

possibilities for other operators to offer a better Quality of service than is currently being provided.

Fig 9. Call Drop Rate

9

0.77% 1.70% 1.16%

6.73%

0.48%

3.91%

0.75%

6.28%

2.10%

4.42% 3.35%

6.35%

1.02% 1.57%

AIR

TEL

2G

AIR

TEL

3G

BS

NL

2G

BS

NL

3G

IDE

A 2

G

IDE

A 3

G

MTS

CD

MA

Re

lian

ce 2

G

TATA

2G

TATA

3G

TATA

CD

MA

TELE

NO

R 2

G

VO

DA

FON

E 2

G

VO

DA

FON

E 3

G

Fig 9. Call Drop Rate (%)

Page 11: Independent Drive Test Report Report for Surat_Final.pdf · Good RxQuality (benchmark >=95%): 2G (RxQual =-15dBm), CDMA (FER

5. Appendix

Ancillary Details

I. Benchmarking KPI Details

II. Coverage Details

III. Receive (Rx) Quality Details

IV. City-Level Ranking and KPI details

V. City-Level KPI details

Table of Contents in Appendix

10

Page 12: Independent Drive Test Report Report for Surat_Final.pdf · Good RxQuality (benchmark >=95%): 2G (RxQual =-15dBm), CDMA (FER

Appendix

Ancillary Details

2. Benchmarking KPI Details

RF Coverage

RF Coverage relates to the geographical footprint within the system that has sufficient RF signal strength to provide for a call/data

session. Coverage rate of an operator is calculated basis of % of samples in which the Rx level is better than -85 dBm

Accessibility

Accessibility is the ability of a service to be obtained within specific tolerances and other given conditions, when requested by the user.

In other words, the ability of a user to obtain the requested service from the system. Accessibility is monitored by measuring Call Setup

Success Rate (CSSR) which is defined as the ratio of Established Calls to Call Attempts

Retainability

Retainability is “The ability of a service, once obtained, to continue to be provided under given conditions for a requested duration.” For

determining the Retainability the regulation prescribes three important parameters namely Call Drop Rate (CDR), Worst affected Cells

having more than 3% TCH drop and Connection with good voice quality. Drop Call and Connection with good voice quality were

monitored by the drive test

Mobility

In a cellular system a base station has only a limited coverage area. Hence it is possible for a moving subscriber to be out of range of a

base station while making a call. The process by which a mobile telephone call is transferred from one base station to another as the

subscriber passes the boundary of a cell is called a handover. The Handover success rate (HOSR) more than 95% is considered to be

good

Rx Quality

For measuring voice quality, RxQual samples on a scale from 0 to 7 for GSM operators, EcNo from 0 to -30 dBm and Frame Error Rate

(FERs) for CDMA service providers are measured. As per the QoS norms, RxQual between 0- 5 for GSM operators, EcNo >= -15 dBm and

between 0-4% FER value for CDMA operators FERs is considered to be good, where as RxQual beyond this benchmark is considered to

be bad

11

Coverage % Accessibility % Retainability % Mobility % Rx Quality %

AIRTEL 2G 98.42% 97.01% 99.23% 99.56% 96.16%

AIRTEL 3G 94.30% 99.16% 98.30% 100.00% 98.51%

BSNL 2G 97.59% 97.37% 98.84% 97.90% 98.24%

BSNL 3G 63.56% 96.54% 93.27% 98.97% 97.97%

IDEA 2G 99.76% 98.58% 99.52% 98.34% 97.02%

IDEA 3G 93.87% 96.76% 96.09% 99.74% 93.76%

MTS CDMA 99.50% 100.00% 99.25% 100.00% 96.72%

Reliance 2G 69.85% 93.00% 93.72% 99.47% 92.25%

TATA 2G 83.70% 95.97% 97.90% 94.47% 93.97%

TATA 3G 85.33% 98.03% 95.58% 99.14% 98.30%

TATA CDMA 99.87% 96.37% 96.65% 99.41% 96.94%

TELENOR 2G 81.35% 90.87% 93.65% 95.79% 89.77%

VODAFONE 2G 92.63% 97.04% 98.98% 92.97% 95.51%

VODAFONE 3G 94.16% 96.46% 98.43% 98.76% 96.68%

0.00%

25.00%

50.00%

75.00%

100.00%

KPI Distribution

Page 13: Independent Drive Test Report Report for Surat_Final.pdf · Good RxQuality (benchmark >=95%): 2G (RxQual =-15dBm), CDMA (FER

Appendix

Ancillary Details

3. Coverage Details

RF Coverage relates to the geographical footprint within the system that has sufficient RF signal strength to provide for a call/data

session. The Coverage rate of an operator is calculated basis of % of samples in which the Rx level is better than -85 dBm. The details

are as follows.

Operators not meeting benchmark

12

Airtel 2G Airtel 3G BSNL 2G

BSNL 3G IDEA 2G IDEA 3G

Operators Coverage Rate

Airtel 2G 98.42%

Airtel 3G 94.30%

BSNL 2G 97.59%

BSNL 3G 63.56%

IDEA 2G 99.76%

IDEA 3G 93.87%

MTS CDMA 99.50%

Reliance 2G 69.85%

TATA 2G 83.70%

TATA 3G 85.33%

TATA CDMA 99.87%

Telenor 2G 81.35%

Vodafone 2G 92.63%

Vodafone 3G 94.16%

0.00%

25.00%

50.00%

75.00%

100.00%

Air

tel 2

G

Air

tel 3

G

BS

NL

2G

BS

NL

3G

IDE

A 2

G

IDE

A 3

G

MTS

CD

MA

Re

lian

ce 2

G

TATA

2G

TATA

3G

TATA

CD

MA

Tele

no

r 2

G

Vo

da

fon

e 2

G

Vo

da

fon

e 3

G

Coverage Distribution

-95 to -120 dBm -85 to -95 dBm -75 to -85 dBm 0 to -75 dBm

Page 14: Independent Drive Test Report Report for Surat_Final.pdf · Good RxQuality (benchmark >=95%): 2G (RxQual =-15dBm), CDMA (FER

Appendix

Ancillary Details

3. Coverage Details

13

RELIANCE 2G MTS CDMA TATA 2G

TATA 3G TATA CDMA TELENOR 2G

VODAFONE 2G VODAFONE 3G

Page 15: Independent Drive Test Report Report for Surat_Final.pdf · Good RxQuality (benchmark >=95%): 2G (RxQual =-15dBm), CDMA (FER

Appendix

Ancillary Details

4. Receive (Rx) Quality Details

For measuring voice quality, RxQual samples on a scale from 0 to 7 for GSM operators, EcNo for 3G operators on a scale of 0 to -30

dBm and Frame Error Rate (FERs) for CDMA service providers are measured. As per the QoS norms, Rx Quality between 0- 5 for GSM

operators, EcNo >= -15 dBm and between 0-4% FER value for CDMA operators FERs is considered to be good, where as quality beyond

this benchmark is considered to be bad. The benchmark should usually be > =95%.

Operators not meeting benchmark

14

Airtel 2G Airtel 3G

BSNL 3G

Airtel 3G BSNL 2G

IDEA 2G IDEA 3G

0.00%

25.00%

50.00%

75.00%

100.00%

Air

tel 2

G

Air

tel 3

G

BS

NL

2G

BS

NL

3G

IDE

A 2

G

IDE

A 3

G

MTS

CD

MA

Re

lian

ce 2

G

TATA

2G

TATA

3G

TATA

CD

MA

Tele

no

r 2

G

Vo

da

fon

e 2

G

Vo

da

fon

e 3

G

Rx Quality Distribution

RxQual 6 to 7, EcNo <-15 dBm, FER <= 4% RxQual 0 to 5, EcNo >=-15 dBm, FER > 4%

Operators Rx Quality

Airtel 2G 96.16%

Airtel 3G 98.51%

BSNL 2G 98.24%

BSNL 3G 97.97%

IDEA 2G 97.02%

IDEA 3G 93.76%

MTS CDMA 96.72%

Reliance 2G 92.25%

TATA 2G 93.97%

TATA 3G 98.30%

TATA CDMA 96.94%

Telenor 2G 89.77%

Vodafone 2G 95.51%

Vodafone 3G 96.68%

Page 16: Independent Drive Test Report Report for Surat_Final.pdf · Good RxQuality (benchmark >=95%): 2G (RxQual =-15dBm), CDMA (FER

Appendix

Ancillary Details

4. Receive (Rx) Quality Details

15

MTS CDMA RELIANCE 2G TATA 2G

TATA 3G TATA CDMA TELENOR 2G

VODAFONE 2G VODAFONE 3G

Page 17: Independent Drive Test Report Report for Surat_Final.pdf · Good RxQuality (benchmark >=95%): 2G (RxQual =-15dBm), CDMA (FER

Appendix

Ancillary Details

5. City-Level Ranking and KPI details

Accessibility is the ability of a service to be obtained within specific tolerances and other given conditions, when requested by the user.

In other words, the ability of a user to obtain the requested service from the system. Accessibility is monitored by measuring Call Setup

Success Rate (CSSR) which is defined as the ratio of Established Calls to Call Attempts. The benchmark is >=95%. The details are as

follows:

Retainability is “the ability of a service, once obtained, to continue to be provided under given conditions for a requested duration.” For

determining the Retainability, the regulation prescribes three important parameters namely Call drop rate (CDR), Worst affected Cells

having more than 3% TCH drop and Connection with good voice quality. The call drop and connection with good voice quality were

monitored by the drive test

Call Drop Rate (CDR): The parameter gives a reliable measurement of the mobile network used by the service provider for maintaining a

call once it has been correctly established

Mobility: In a cellular system a base station has only a limited coverage area. Hence it is possible for a moving subscriber to get out of

reach of a base station while making a call. The process by which a mobile telephone call is transferred from one base station to

another as the subscriber passes the boundary of a cell is called a handover. The Handover Ssuccess Rate (HOSR) more than 95% is

considered to be good

*In case of multiple call failure in similar geo location in given period of 60sec has been counted as one call failure

Operators not meeting benchmark

16

Operators Total HO Attempt HO Failure HO Success HO Failure Rate HO Success Rate

AIRTEL 2G 902 4 898 0.44% 99.56%

AIRTEL 3G 4171 0 4171 0.00% 100.00%

BSNL 2G 810 17 793 2.10% 97.90%

BSNL 3G 2132 22 2110 1.03% 98.97%

IDEA 2G 724 12 712 1.66% 98.34%

IDEA 3G 1893 5 1888 0.26% 99.74%

MTS CDMA 2263 0 2263 0.00% 100.00%

Reliance 2G 567 3 564 0.53% 99.47%

TATA 2G 796 44 752 5.53% 94.47%

TATA 3G 2780 24 2756 0.86% 99.14%

TATA CDMA 7452 44 7408 0.59% 99.41%

TELENOR 2G 380 16 364 4.21% 95.79%

VODAFONE 2G 725 51 674 7.03% 92.97%

VODAFONE 3G 4524 56 4468 1.24% 98.76%

Operators Total Call Established Total Call Drop CDR CCSR

AIRTEL 2G 260 2 0.77% 99.23%

AIRTEL 3G 235 4 1.70% 98.30%

BSNL 2G 259 3 1.16% 98.84%

BSNL 3G 223 15 6.73% 93.27%

IDEA 2G 209 1 0.48% 99.52%

IDEA 3G 179 7 3.91% 96.09%

MTS CDMA 267 2 0.75% 99.25%

Reliance 2G 239 15 6.28% 93.72%

TATA 2G 238 5 2.10% 97.90%

TATA 3G 249 11 4.42% 95.58%

TATA CDMA 239 8 3.35% 96.65%

TELENOR 2G 189 12 6.35% 93.65%

VODAFONE 2G 197 2 1.02% 98.98%

VODAFONE 3G 191 3 1.57% 98.43%

Operators Total Call Attempt Blocked Calls Blocked Call Rate* CSSR

AIRTEL 2G 268 8 2.99% 97.01%

AIRTEL 3G 237 2 0.84% 99.16%

BSNL 2G 266 7 2.63% 97.37%

BSNL 3G 231 8 3.46% 96.54%

IDEA 2G 212 3 1.42% 98.58%

IDEA 3G 185 6 3.24% 96.76%

MTS CDMA 267 0 0.00% 100.00%

Reliance 2G 257 18 7.00% 93.00%

TATA 2G 248 10 4.03% 95.97%

TATA 3G 254 5 1.97% 98.03%

TATA CDMA 248 9 3.63% 96.37%

TELENOR 2G 208 19 9.13% 90.87%

VODAFONE 2G 203 6 2.96% 97.04%

VODAFONE 3G 198 7 3.54% 96.46%

Page 18: Independent Drive Test Report Report for Surat_Final.pdf · Good RxQuality (benchmark >=95%): 2G (RxQual =-15dBm), CDMA (FER

Appendix

Ancillary Details

6. City-Level KPI details

17

Operators are meeting benchmark Operators not meeting benchmark

Call Events

Operators (Summary)

Airtel BSNL Idea MTS

CDMA Reliance TATA Telenor Vodafone

2G 3G 2G 3G 2G 3G 2G 2G CDMA 2G 3G CDMA 2G 2G 3G

Call Attempt

Sep' 16 268 237 266 231 212 185 267 257 N/A 248 254 248 208 203 198

Dec' 15 280 N/A N/A 279 254 210 289 246 279 290 234 253 276 291 251

Sep' 15 263 N/A N/A NA 343 NA NA 261 NA 337 NA NA NA 253 NA

Blocked Call Rate

Sep' 16 2.99% 0.84% 2.63% 3.46% 1.42% 3.24% 0.00% 7.00% N/A 4.03% 1.97% 3.63% 9.13% 2.96% 3.54%

Dec' 15 5.00% N/A N/A 9.32% 5.51% 8.57% 1.04% 12.60% 1.79% 10.69% 10.26% 2.77% 9.06% 8.59% 8.37%

Sep' 15 22.43% N/A N/A N/A 21.28% N/A N/A 18.39% N/A 27.00% N/A N/A N/A 2.37% N/A

CSSR(Accessibility)

Sep' 16 97.01% 99.16% 97.37% 96.54% 98.58% 96.76% 100.00% 93.00% N/A 95.97% 98.03% 96.37% 90.87% 97.04% 96.46%

Dec' 15 95.00% N/A N/A 90.68% 94.49% 91.43% 98.96% 87.40% 98.21% 89.31% 89.74% 97.23% 90.94% 91.41% 91.63%

Sep' 15 77.57% N/A N/A N/A 78.72% N/A N/A 81.61% N/A 73.00% N/A N/A N/A 97.63% NA

Dropped Call Rate

Sep' 16 0.77% 1.70% 1.16% 6.73% 0.48% 3.91% 0.75% 6.28% N/A 2.10% 4.42% 3.35% 6.35% 1.02% 1.57%

Dec' 15 4.14% N/A N/A 9.49% 8.33% 10.94% 5.59% 6.51% 4.38% 6.95% 7.14% 0.81% 6.37% 7.14% 4.35%

Sep' 15 2.03% N/A N/A N/A 0.74% N/A N/A 38.97% N/A 2.85% N/A N/A N/A 1.62% N/A

HOSR(Mobility)

Sep' 16 99.56% 100.00% 97.90% 98.97% 98.34% 99.74% 100.00% 99.47% N/A 94.47% 99.14% 99.41% 95.79% 92.97% 98.76%

Dec' 15 97.61% N/A N/A 92.74% 96.15% 96.13% 100.00% 97.81% 100.00% 96.44% 97.08% 100.00% 92.62% 94.14% 97.74%

Sep' 15 95.94% N/A N/A N/A 98.65% N/A N/A 96.86% N/A 94.12% N/A N/A N/A 94.15% N/A

Network Quality

Sep' 16 96.16% 98.51% 98.24% 97.97% 97.02% 93.76% 96.72% 92.25% N/A 93.97% 98.30% 96.94% 89.77% 95.51% 96.68%

Dec' 15 87.02% N/A N/A 65.67% 84.63% 59.00% 90.59% 83.67% 89.49% 90.29% 25.13% 93.90% 80.49% 51.83% 68.48%

Sep' 15 88.65% N/A N/A N/A 87.68% N/A N/A 74.82% N/A 88.75% N/A N/A N/A 88.68% N/A