For Ratlam · * 3G KPI’s which are calculated from UE in Dual Mode (2G & 3G) includes samples and...

INDEPENDENT DRIVE TEST REPORT

For

RatlamNovember 2018

WEST ZONE

Key Performance Indicators: All TSPs have met the Drop Call Rate (DCR)

benchmark of 2% except Airtel 2G,Idea 2G,BSNL 3G,Idea 3G and Vodafone 3G.

All TSPs have met the Call Setup Success Rate (CSSR) of 95% except Idea 2G.

The Independent Drive Test has been carried out by M/s PhiMetrics Technologies Pvt. Ltd. on behalf of TRAI

in Ratlam City & adjoining areas from 9:00 AM to 9:00 PM; 13th November to 15th November 2018. The drive test

covered an drive route of 306 KMs & 6 hotspot over a period of 3 days. Approximately 360 calls were made for each of

the 12 networks: five 2G networks, five 3G networks and two LTE network covering 6 unique TSPs

Data SummaryVoice SummaryOverview

Service Specifications

Download 2G (Locked) - 500KB, 3G (Dual) - 20 MB, 4G (Free) - 40 MB

Upload 2G (Locked) - 100KB, 3G (Dual) - 5 MB, 4G (Free) - 10 MB

Web Browsing 3 links of e/m commerce website www.amazon.in, www.flipkart.com and PayTm

Video Streaming 130 sec clip

Latency 32 Bytes on www.google.com

Overview:Telecom Regulatory Authority of India has been entrusted with the task of laying down the standards of quality of service to be provided by

the service providers and ensuring its enforcement; and also TRAI is responsible for conducting the periodical audit of such services

provided by the service providers so as to protect the interest of the consumers of telecommunications service

TRAI is regularly monitoring the performance of Telecom Service Providers (TSP) against the benchmarks for the various Quality of Service

(QoS) parameters laid down by the Authority. TSPs submit Performance Monitoring Reports to TRAI every quarter. TRAI also undertakes

audit and assessment of Quality of Service through independent agencies to verify the Quality of Service claimed. The Audit agencies

conduct sample ‘Drive tests’ across various cities in the country as part of audit and assessment of the TSPs’ performance.

In view of complaints on call drops and other network quality issues, on behalf of TRAI, an Independent Drive Test (IDT) was conducted by

PhiMetrics Technologies Pvt. Ltd. From 13th November to 15th November 2018 covering various locations in Ratlam City & surrounding

region. The performance of Airtel, BSNL, Idea, Tata, Vodafone and Jio were monitored across various technologies (2G, 3G, and 4G). The

drive test route was defined on the basis of several factors that include - areas from where call drop complaints are commonly received;

areas of heavy usage; residential areas away from arterial roads; office areas; areas where previous Drive tests showed network issues;

etc.

The test results obtained from these drive tests were utilized to assess the network quality for Voice and Data services in terms of

Voice: Coverage, Quality, Handover Success Rate, Call Setup Success Rate, Drop Call Rate and Block Call Rate.

Data: Download and Upload Throughputs, Web Browsing Delay, Video Streaming Delay and Latency

Drive Test Details For Ratlam:

Independent Drive test was conducted for a period of 3 days from 13th November to 15th November 2018 in Ratlam city & surrounding

areas from 9:00 AM to 9:00 PM. Calls were made for 90 sec duration with wait time of 10 sec between calls in all technologies.

Voice Tests: The drive test covered a drive route of approximately 306 KMs over a period of 2 days from 13th November to 14th November

2018. Approximately 360 calls were made for each of the 12 networks: five 2G (Lock Mode) networks, five 3G (Dual mode) networks and

Two VoLTE network covering 6 unique TSPs.* In case of multiple call failure in same Cell ID in given period of 60secs has been counted as one call failure

Data Tests: Data Tests were performed at 6 static locations for 2 days on 14th November to 15th November 2018; five 2G (Lock mode)

networks, five 3G (Dual mode) networks and Four 4G (Free mode) networks covering 6 unique TSPs were tested.* For Voice and Data KPI’s, 2G measurement is done with UE locked on 2G, 3G measurement is done with UE in Dual mode (2G & 3G) and 4G measurement is done with

UE in Free Mode.

* 3G KPI’s which are calculated from UE in Dual Mode (2G & 3G) includes samples and events of 2G.

* 4G KPI’s which are calculated from the UE in Free Mode included samples and events of 2G & 3G.

Overview Details

Overview

of 30

Voice Test Drive Route - Ratlam Data Service testing across 6 Static Locations

Blo

ck C

all

Ra

te (%

)

3G

Ne

two

rkV

oLT

E

2G

Ne

two

rk

QoS compliance of the TSPs in Ratlam for Voice across technologies 2G/3G/4G-VoLTE is given below:

Not meeting Benchmark

Voice CallsKey Observations

Voice Summary Page 3 of 35

Dro

p C

all

Ra

te (%

)

3G

Ne

two

rkV

oLT

E

2G

Ne

two

rk

a) All TSPs have met the 2% QOS benchmark of Drop Call Rate (DCR%) except Airtel 2G, Idea 2G,BSNL 3G,Idea 3G and Vodafone 3G.

b) Call Block Rate (CBR%) benchmark of 3% was achieved by all TSP’s except Idea 2G .

c) NA (Not Applicable ) in CSFB failure for those TSP ,doesn't have 4G technology.

KPI2G Networks

Airtel BSNL Idea Tata VodafoneSDCCH Congestion% 0.00% 0.00% 0.28% 0.00% 0.00%

TCH Congestion % 0.00% 1.89% 4.23% 0.00% 0.00%

KPI3G Networks

Airtel BSNL Idea Tata Vodafone

CSFB Failure % 0.28% NA 0.00% NA 1.13%

SDCCH Congestion% 0.00% 0.00% 0.27% 0.00% 0.28%

RRC Congestion% 0.00% 0.82% 0.00% 0.82% 0.85%

SDCCH & RRC Congestion% 0.00% 0.82% 0.27% 0.82% 1.13%

TCH Congestion % 0.00% 0.55% 0.00% 0.00% 0.00%

RAB Congestion % 0.00% 1.10% 0.00% 1.09% 0.56%

TCH & RAB Congestion % 0.00% 1.65% 0.00% 1.09% 0.56%

0.56

2.25

4.80

0.56

2.03

Airtel

BSNL

Idea

Tata

Vodafone

2.22

1.37

3.31

0.27

0.61

Airtel

BSNL

Idea

Tata

Vodafone

0.00

1.89

6.48

0.00

1.80

Airtel

BSNL

Idea

Tata

Vodafone

0.28

2.47

0.27

1.91

2.82

Airtel

BSNL

Idea

Tata

Vodafone

0.58

0.26

Airtel

Jio

0.88

1.04

Airtel

Jio

Benchmark

3%

Benchmark

2%2%

Benchmark

3%

Benchmark

Voice Calls

a) Percentage of coverage samples for 2G ≥ -85 dB.

b) Percentage of coverage samples for 2G ≥ -85 dBm, 3G ≥ -90 dBm & LTE ≥ -110 dBm.

c) Percentage of time spent on 3G network:

d) Percentage of RLT >=48:

e) Average CST Second

Coverage

TSPs2G


Coverage% 91.40% 68.61% 82.57% 89.96% 81.80%

Key Observations

Voice Summary Page 4 of 30

TSPs3G VoLTE

Airtel BSNL Idea Tata Vodafone Airtel Jio

Coverage % 85.79% 74.89% 81.71% 85.49% 74.18% 92.32% 97.02%

TSPs2G


%RLT >=48 0.00% 0.00% 0.00% 0.00% 0.00%

TSPs3G


Time Spent on 3G% 87.41% 87.42% 49.50% 100.00% 17.60%

TSPs2G


Sec 2.66 2.89 7.41 3.71 5.43

TSPs

3G V0LTE

Airtel BSNL Idea Tata VodafoneAirtel

Jio

Sec 4.62 2.89 3.85 4.68 5.83 1.68 1.11

Data

Services Static

Data Summary

Data Download and Upload Performance (Mbps)

Data was tested at 6 locations .Following services were tested: Data Download/Upload, Latency (www.google.com), Video

Streaming (YouTube) and Web browsing (Flipkart, Amazon, PayTm)

Key Observations

of 30

4G Network:

3G Network:

Download Throughput Upload Throughput

0.92

0.97

1.26

0.96

0.86

Airtel

BSNL

Idea

Tata

Vodafone

0.45

1.63

0.59

0.49

0.65

Latency (msec)

140

170

329

139

Airtel

BSNL

Idea

Tata

3G Network

Airtel

Idea

Jio


8.04

1.65

4.97

1.52

Airtel

Idea

Jio

Vodafone

4.86

3.54

1.28

4.92

106

123

126

4G Network

Streaming (sec)

Streaming Delay further broken into 2 parameters which form the end-user perception to assess consistency on Video

streaming.

• Initial Start time

• Interruption time while playing the video.

Web browsing experience is the average time taken to fully load the websites tested.

Video Streaming Performance (130 sec YouTube video sample sizes)

Video Streaming

Avg. Initial Start Time (sec)

Avg. Interruption Time (sec)

Web Page Download Time (sec)

Data

Services Static Key Observations

Data Summary of 30

3G 4G

Airtel BSNL Idea Tata Vodafone Airtel Idea Jio Vodafone

4.49 1.89 2.08 4.88 6.64 1.50 1.66 1.90 0.72

0.47 2.90

4.96

1.89

2.08

7.79

6.64

Airtel

BSNL

Idea

Tata

Vodafone

3G Network

14.35

12.19

18.34

16.86

17.73

Airtel

BSNL

Idea

Tata

Vodafone

3G Network

1.50

1.66

1.90

0.72

4G Network

Airtel

Idea

Jio

Vodafone

Airtel

Idea

Jio

Vodafone

10.06

14.26

12.97

12.44

4G Network

Data

Services Dynamic

Data Summary

Data Download and Upload Performance (Mbps)

Data was tested between one location to another location .Following services were tested: Data Download/Upload, Latency

(www.google.com), Video Streaming (YouTube) and Web browsing (Flipkart, Amazon, PayTm)

Key Observations

of 30

4G Network:

3G Network:


0.62

0.89

1.10

0.81

0.80

Airtel

BSNL

Idea

Tata

Vodafone

0.43

1.32

0.48

0.47

0.70

Latency (msec)

228

289

398

122

212

Airtel

BSNL

Idea

Tata

Vodafone

3G Network

Airtel

Idea

Jio

Vodafone


5.10

1.65

3.00

1.41

Airtel

Idea

Jio

Vodafone

5.55

4.15

2.53

3.45

109

119

128

4G Network

Streaming (sec)

Streaming Delay further broken into 2 parameters which form the end-user perception to assess consistency on Video

streaming.

• Initial Start time

• Interruption time while playing the video.

Web browsing experience is the average time taken to fully load the websites tested.

Video Streaming Performance (130 sec YouTube video sample sizes)

Video Streaming

Avg. Initial Start Time (sec)

Avg. Interruption Time (sec)

Web Page Download Time (sec)

Data

Services Dynamic Key Observations

Data Summary of 30

3G 4G


3.22 5.26 1.52 2.53 4.02 1.69 2.53 1.15 1.11

7.39

3.22

5.26

1.52

9.92

4.02

Airtel

BSNL

Idea

Tata

Vodafone

3G Network

14.62

15.35

19.73

14.30

18.94

Airtel

BSNL

Idea

Tata

Vodafone

3G Network

1.69

2.53

1.15

1.11

4G Network

Airtel

Idea

Jio

Vodafone

Airtel

Idea

Jio

Vodafone

7.96

12.71

11.42

10.56

4G Network

SummaryCity Level Summary

Summary Page 9 of 30

Voice Call2G


Call Attempt 361 371 355 367 334

Blocked Call Rate (%) 0.00% 1.89% 6.48% 0.00% 1.80%

CSSR% (Accessibility) 100.00% 98.11% 93.52% 100.00% 98.20%

Drop Call Rate (%) 2.22% 1.37% 3.31% 0.27% 0.61%

Mobility HOSR (%) 98.48% 91.17% 98.91% 99.77% 98.37%

Rx Quality (%) 98.12% 97.82% 91.53% 97.24% 96.21%

Voice Call3G VoLTE

Airtel BSNL Idea Tata Vodafone Airtel Jio

Call Attempt 358 365 376 366 354 343 387

Blocked Call Rate (%) 0.28% 2.47% 0.27% 1.91% 2.82% 0.58% 0.26%

CSSR% (Accessibility) 99.72% 97.53% 99.73% 98.09% 97.18% 99.42% 99.74%

Drop Call Rate (%) 0.56% 2.25% 4.80% 0.56% 2.03% 0.88% 1.04%

Mobility HOSR (%) 99.97% 99.30% 98.77% 100.00% 99.01% 99.57% 99.45%

Rx Quality (%) 95.51% 95.88% 91.19% 97.50% 94.92% 87.56% 75.68%

Summary of 30

SummaryCity Level Summary(contd.)

Data Services Static2G


Download Throughput

(Kbps)47.87 132.90 118.83 48.22 146.72

Upload Throughput

(kbps)52.18 139.96 158.08 33.16 135.26

Web Browsing Delay

(sec)33.72 40.36 31.20 29.08 28.53

Latency

(msec)627 372 265 606 323

Data Services Static3G 4G


Download Throughput

(Mbps)0.92 0.97 1.26 0.96 0.86 8.04 1.65 4.97 1.52

Upload Throughput

(Mbps) 0.45 1.63 0.59 0.49 0.65 4.86 3.54 1.28 4.92

Web Browsing Delay

(sec)14.35 12.19 18.34 16.86 17.73 10.06 14.26 12.97 12.44

Video Streaming Delay

(sec)4.96 1.89 2.08 7.79 6.64 1.50 1.66 1.90 0.72

Latency

(msec)140 170 329 139 TO 106 123 126 TO

Data Services Dynamic3G 4G


Download Throughput

(Mbps)0.62 0.89 1.10 0.81 0.80 5.10 1.65 3.00 1.41

Upload Throughput

(Mbps) 0.43 1.32 0.48 0.47 0.70 5.55 4.15 2.53 3.45

Web Browsing Delay

(sec)14.62 15.35 19.73 14.30 18.94 7.96 12.71 11.42 10.56

Video Streaming Delay

(sec)3.22 5.26 1.52 9.92 4.02 1.69 2.53 1.15 1.11

Latency

(msec)228 289 398 122 212 109 119 128 TO

a) TO (Timeout) for Failed data test .

Summary of 30


Balaji Central Hotel2G


Download Throughput

(Kbps)26.03 190.04 160.63 TO 139.35

Upload Throughput (kbps) 21.27 119.40 220.02 12.81 100.81

Web Browsing Delay (sec) 33.01 43.05 32.69 11.33 28.85

Latency (msec) 528 321 221 957 321

Balaji Central Hotel3G 4G


Download Throughput

(Mbps)2.80 1.42 3.46 2.46 0.67 15.53 0.07 14.57 0.44

Upload Throughput (Mbps) 0.57 1.73 1.79 0.61 0.98 10.38 4.59 2.73 8.76

Web Browsing Delay (sec) 9.78 12.06 14.84 12.49 15.79 6.24 21.57 14.18 13.33

Video Streaming Delay (sec) 1.70 2.19 1.40 1.54 TO 1.05 1.27 0.75 TO

Latency (msec) 113 443 264 97 TO 100 167 73 TO

District Civil Hospital2G


Download Throughput

(Kbps)20.31 33.16 126.03 13.37 172.87



Latency (msec) 881 693 217 TO 280

District Civil Hospital3G 4G


Download Throughput

(Mbps)0.28 1.03 0.70 0.27 0.63 3.24 2.22 0.13 0.89

Upload Throughput (Mbps) 0.44 1.66 0.10 0.46 TO 5.57 4.64 0.15 5.82


Video Streaming Delay (sec) 10.93 1.25 1.19 TO 6.64 1.76 0.76 TO 0.72


Summary of 30


Government Medical College2G


Download Throughput

(Kbps)21.18 129.90 85.26 26.44 68.74



Latency (msec) 780 777 266 TO 425

Government Medical College3G 4G


Download Throughput

(Mbps)0.35 0.04 0.16 0.34 0.36 4.93 0.36 0.12 0.53



Video Streaming Delay (sec) 6.48 8.94 TO TO TO 1.20 1.06 TO TO


MHAW Bus Stand2G


Download Throughput

(Kbps)42.08 207.86 31.17 TO 127.20

Upload Throughput (kbps) 20.12 167.03 50.74 TO 156.25

Web Browsing Delay (sec) 46.79 34.24 29.80 TO 25.47

Latency (msec) 676 198 373 TO 320

MHAW Bus Stand3G 4G


Download Throughput

(Mbps)0.61 1.05 2.55 0.84 1.76 20.36 1.39 6.08 0.91



Video Streaming Delay (sec) 2.49 0.95 1.00 2.76 TO 1.31 1.39 0.91 TO


Summary of 30


Railway Station2G


Download Throughput

(Kbps)25.72 65.01 141.83 18.18 164.02



Latency (msec) 599 261 258 718 441

Railway Station3G 4G


Download Throughput

(Mbps)0.78 1.11 0.35 1.04 0.70 0.13 0.58 0.62 0.62



Video Streaming Delay (sec) 4.57 1.24 TO 12.82 TO TO 4.23 3.47 TO


Dil Bahar Square2G


Download Throughput

(Kbps)133.84 170.41 156.86 87.11 182.14



Latency (msec) 632 147 264 458 304

Dil Bahar Square3G 4G


Download Throughput

(Mbps)0.51 0.84 0.40 0.61 0.88 3.01 4.87 10.06 5.41



Video Streaming Delay (sec) 2.03 1.46 3.42 17.16 TO 2.07 1.04 TO TO

Latency (msec) 221 105 261 108 TO 101 100 TO TO

RF Coverage relates to the geographical footprint within the system that has sufficient RF signal strength to provide for a call/data session. The

Coverage rate of an TSP is calculated on the basis of % of samples in which the Rx level ≥ -85 dBm, RSCP is ≥ -90 dBm & RSRP ≥ -110dBm.

The details are as follows.

Airtel 2G

I. Coverage Details

Coverage Details of 30

TSPCoverage

Rate

Airtel 2G 91.40%

BSNL 2G 68.61%

Idea 2G 82.57%

Tata 2G 89.96%

Vodafone 2G 81.80%

Airtel Dual(2G/3G) 85.79%

BSNL Dual(2G/3G) 74.89%

Idea Dual(2G/3G) 81.71%

Tata Dual(2G/3G) 85.49%

Vodafone Dual(2G/3G) 74.18%

Airtel VoLTE 92.32%

Jio VoLTE 97.02%

0%

25%

50%

75%

100%

Air

tel 2

G

BS

NL

2G

Idea

2G

Tata

2G

Vo

da

fon

e 2

G

Air

tel D

ua

l(2

G/

3G

)

BS

NL

Du

al(

2G

/3

G)

Idea

Du

al(

2G

/3

G)

Tata

Du

al(

2G

/3

G)

Vo

da

fon

e D

ua

l(2

G/

3G

)

Air

tel V

oLT

E

Jio

Vo

LTE

Coverage Distribution

2G : -85 to Min/ Dual (2G/3G) : -90 to Min/ VoLTE : -110 to -130 dBm 2G : -75 to -85dBm/ Dual (2G/3G) : -80 to -90 dBm/ VoLTE : -95 to -110 dBm

2G : -65 to -75dBm/ Dual (2G/3G) : -70 to -80 dBm/ VoLTE : -80 to -95 dBm 2G : 0 to 65dBm/ Dual (2G/3G) : 0 to -70 dBm/ VoLTE : 0 to -80 dBm

BSNL 2G

Idea 2G


I. Coverage Details (contd.)



Tata 2G

Vodafone 2G

Airtel Dual (2G/3G)



BSNL Dual (2G/3G)

Idea Dual (2G/3G)



Tata Dual (2G/3G)



Vodafone Dual (2G/3G)

Airtel VoLTE



Jio VoLTE

TSP Rx Quality

Airtel 2G 98.12%

BSNL 2G 97.82%

Idea 2G 91.53%

Tata 2G 97.24%

Vodafone 2G 96.21%

Airtel Dual(2G/3G) 95.51%

BSNL Dual(2G/3G) 95.88%

Idea Dual(2G/3G) 91.19%

Tata Dual(2G/3G) 97.50%

Vodafone Dual(2G/3G) 94.92%

Airtel VoLTE 87.56%

Jio VoLTE 75.68%

0.00%

25.00%

50.00%

75.00%

100.00%

Air

tel 2

G

BS

NL

2G

Idea

2G

Tata

2G

Vo

da

fon

e 2

G

Air

tel D

ua

l(2

G/

3G

)

BS

NL

Du

al(

2G

/3

G)

Idea

Du

al(

2G

/3

G)

Tata

Du

al(

2G

/3

G)

Vo

da

fon

e D

ua

l(2

G/

3G

)

Air

tel V

olt

e

Jio

Vo

lte

Rx Quality Distribution

RxQual ≤5, EcNo ≥-14 dBm, FER≤ 4%, SINR >0 RxQual >5, EcNo <-14 dBm, FER > 4%, SINR ≤0

For measuring voice quality, as per the QoS norms, RxQual <=5 for GSM TSPs, EcNo >= -14 dBm for 3G TSP sand SINR >0 in case of VoLTE is

considered to be good, where as quality beyond this benchmark is considered to be bad. The benchmark should usually be ≥ 95%.

TSPs not meeting the Benchmark

Airtel 2G

II. Quality Details

Quality Details of 30

II. Quality Details (contd.)


BSNL 2G

Idea 2G



Tata 2G

Vodafone 2G



Airtel Dual (2G/3G)

BSNL Dual (2G/3G)



Tata Dual (2G/3G)

Idea Dual (2G/3G)



Vodafone Dual (2G/3G)

Airtel VoLTE



Jio VoLTE

TSP % Time on 3G

Airtel 3G 87.41%

BSNL3G 87.42%

Idea 3G 49.50%

Tata 3G 100.00%

Vodafone 3G 17.60%

0.00%

25.00%

50.00%

75.00%

100.00%

Air

tel 3

G

BS

NL

3G

Idea

3G

Tata

3G

Vo

da

fon

e 3

G

Technology Distribution

% Time on 3G % Time on 2G

III. Technology Details

Technology Details of 30

Airtel 3G

III. Technology Details(contd.)


BSNL 3G

Idea 3G

III. Technology Details(contd.)


Tata 3G

Vodafone 3G

For Ratlam · * 3G KPI’s which are calculated from UE in Dual Mode (2G & 3G) includes samples and...

Documents

Transcript of For Ratlam · * 3G KPI’s which are calculated from UE in Dual Mode (2G & 3G) includes samples and...