Mobitel’s Initiatives for Evaluating Customer QoE and Ensuring … · 2019-08-19 · • Faulty...

26
Mobitel’s Initiatives for Evaluating Customer QoE and Ensuring Network QoS - Ishantha Pandigamage - Ruwan Liyanage

Transcript of Mobitel’s Initiatives for Evaluating Customer QoE and Ensuring … · 2019-08-19 · • Faulty...

Page 1: Mobitel’s Initiatives for Evaluating Customer QoE and Ensuring … · 2019-08-19 · • Faulty 3G Repeater High RTWP - External Interference. NETWORK SERVICE QUALITY AUDITING.

Mobitel’sInitiatives for Evaluating

Customer QoE and Ensuring Network QoS

- Ishantha Pandigamage - Ruwan Liyanage

Page 2: Mobitel’s Initiatives for Evaluating Customer QoE and Ensuring … · 2019-08-19 · • Faulty 3G Repeater High RTWP - External Interference. NETWORK SERVICE QUALITY AUDITING.

Our Telecommunication Industry• Sri Lanka – Small Island in South East Asia• Four Mobile Operators & Two Fixed Operators• Competitive Market for Mobile Industry• Quality of Experience and Quality of Service

decides the retention of a customer• Sri Lanka has among the lowest prices in the

world, ITUo Lowest entry level charges for fixed

broadbando Ranked at no.21 for mobile broadband out of

181 • Removal of floor based price rate in 2018 • Reduction of Telecommunications Levy• Mobile Broadband : Price vs. Affordability • Compare to early years a significant improvement

in Mobile data speed • Fixed FTTH & Mobile 4.5G deployment• First 5G device Pre-Release testing , Ookla

Page 3: Mobitel’s Initiatives for Evaluating Customer QoE and Ensuring … · 2019-08-19 · • Faulty 3G Repeater High RTWP - External Interference. NETWORK SERVICE QUALITY AUDITING.

• Customer base of over 10 million• Engineering Excellence Award - Stage VII Expansion project• Awarded prestigious ISO 27001:2005 certification for the company’s solid and reliable Information Security Management

System

Journey of Mobitel

Page 4: Mobitel’s Initiatives for Evaluating Customer QoE and Ensuring … · 2019-08-19 · • Faulty 3G Repeater High RTWP - External Interference. NETWORK SERVICE QUALITY AUDITING.

CEO

CUSTOMER CARE

MARKETING

SALES

ENGINEERING

Service Quality Functions at Mobitel

SQ

IA

RA

Enterprise Risk & Information Security

REGULATOR’S QoS & QoE FUNCTION WITHIN THE ORGANISATION

Page 5: Mobitel’s Initiatives for Evaluating Customer QoE and Ensuring … · 2019-08-19 · • Faulty 3G Repeater High RTWP - External Interference. NETWORK SERVICE QUALITY AUDITING.

KEY AREAS OF SQ

• Network Performance Monitoring & Troubleshooting

• Network Service Quality Auditing

• Network Data Analytics

• Benchmarking & Drive Testing

Page 6: Mobitel’s Initiatives for Evaluating Customer QoE and Ensuring … · 2019-08-19 · • Faulty 3G Repeater High RTWP - External Interference. NETWORK SERVICE QUALITY AUDITING.

NETWORK PERFORMANCE MONITORING&

TROUBLESHOOTING

Page 7: Mobitel’s Initiatives for Evaluating Customer QoE and Ensuring … · 2019-08-19 · • Faulty 3G Repeater High RTWP - External Interference. NETWORK SERVICE QUALITY AUDITING.

Internet Data Speed Clipping• Reduction of monthly data traffic• Compared to competitor less number of

samples > 10Mbps in 3G throughput DT

• RSCP/RSRP vs. Application Throughput

• 34Mbps data clipping on application throughput while in LTE

• Further testing was carried stationary

o FTP/HTTP Download – Finland o FTP/HTTP Download – Netherland o FTP/HTTP Download – Singaporeo FTP/HTTP Download – USAo Local FTP/HTTP Download – Mobitel SL

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31

Dat

a V

olu

me

(TB

)

Day

Monthly Data UsageDec-18 Jan-19

Page 8: Mobitel’s Initiatives for Evaluating Customer QoE and Ensuring … · 2019-08-19 · • Faulty 3G Repeater High RTWP - External Interference. NETWORK SERVICE QUALITY AUDITING.

• The maximum data speed for Netherland recorded as 34.95 Mbps

• Finland was 31.74 Mbps• All Europe links had data clipping• No data limitation on US, Singapore & Local

links

Cause:• ISP traffic routing issue• Routing most Europe traffic via Singapore

ISP link

Impact:• Data revenue loss • Affected the customer experience of high

speed data downloading

0

5

10

15

20

25

30

35

32

:25

.6

32

:34

.0

32

:41

.0

32

:48

.1

32

:55

.1

33

:02

.1

33

:09

.1

33

:16

.1

33

:23

.2

33

:30

.2

33

:37

.2

33

:44

.2

33

:51

.2

33

:58

.2

34

:05

.2

34

:12

.2

34

:19

.3

34

:26

.3

34

:33

.3

34

:40

.3

34

:47

.3

34

:54

.3

35

:01

.4

35

:08

.4

35

:15

.4

35

:22

.4

35

:29

.4

35

:36

.4

35

:43

.5

35

:50

.5

35

:57

.5

36

:04

.5

36

:11

.5

36

:18

.6

36

:25

.6

36

:32

.6

36

:39

.6

36

:46

.7

36

:53

.7

37

:00

.7

37

:07

.7

37

:14

.7

37

:32

.4

37

:39

.4

Mb

ps

HTTP Application DL - Finland

0

5

10

15

20

25

30

35

40

45

50

34

:13

.7

34

:29

.8

34

:45

.9

35

:02

.0

35

:18

.1

35

:34

.2

35

:50

.3

36

:06

.3

36

:22

.4

36

:40

.5

36

:56

.6

37

:12

.7

37

:28

.7

37

:44

.8

38

:00

.9

38

:17

.0

38

:33

.0

38

:49

.3

39

:05

.4

39

:21

.5

39

:37

.5

39

:53

.6

40

:09

.7

40

:25

.8

40

:41

.8

40

:57

.9

41

:14

.0

41

:30

.1

41

:46

.2

42

:02

.2

42

:18

.3

42

:34

.4

42

:50

.4

43

:07

.1

43

:23

.1

43

:39

.2

43

:55

.3

44

:11

.3

44

:27

.4

44

:43

.5

44

:59

.6

45

:15

.7

45

:31

.7

45

:47

.8

46

:03

.9

Mb

ps

HTTP Application DL - Singapore

Internet Data Speed Clipping…

Page 9: Mobitel’s Initiatives for Evaluating Customer QoE and Ensuring … · 2019-08-19 · • Faulty 3G Repeater High RTWP - External Interference. NETWORK SERVICE QUALITY AUDITING.

• Sudden RTWP increase• Omni directional and very high RTWP (> -80

dBm)

Impact:• Poor user experience in data speed

Cause:• Faulty 3G Repeater

High RTWP - External Interference

Page 10: Mobitel’s Initiatives for Evaluating Customer QoE and Ensuring … · 2019-08-19 · • Faulty 3G Repeater High RTWP - External Interference. NETWORK SERVICE QUALITY AUDITING.

NETWORK SERVICE QUALITY AUDITING

Page 11: Mobitel’s Initiatives for Evaluating Customer QoE and Ensuring … · 2019-08-19 · • Faulty 3G Repeater High RTWP - External Interference. NETWORK SERVICE QUALITY AUDITING.

Internal Network Interference• Identification of internal interference sources• Pollution was analyzed for pilot count of

greater than 3 with a pilot level difference of -6 to -12dB of EcNo below and -95dBm of RSCP above the threshold

• Scrambling code analysis• Cross feeder analysis

UARFCN 10587 is heavily affected with cells >5

PSC 438 of COL424O is overshooting to Colombo 11

COL027K and COL267K are configured in same

scrambling code and clashing each other

Page 12: Mobitel’s Initiatives for Evaluating Customer QoE and Ensuring … · 2019-08-19 · • Faulty 3G Repeater High RTWP - External Interference. NETWORK SERVICE QUALITY AUDITING.

IP BSC Conversion• A-interface over IP• Conversion of AoTDM to AoIP• Voice Codec selection • QoS Control• Tested Scenarios:

o M2M (2G-2G, 2G-3G) o M2F (2G-PSTN)

Findings:2G – 2G Voice MOS improvement Nearly 70% of voice samples were

experiencing excellent voice quality with MOS > 4.0

Average MOS for NB 5.9 codec improved significantly

Page 13: Mobitel’s Initiatives for Evaluating Customer QoE and Ensuring … · 2019-08-19 · • Faulty 3G Repeater High RTWP - External Interference. NETWORK SERVICE QUALITY AUDITING.

2G – 3G Voice MOS degradation

• Issue: No excellent values of MOS > 4

• Initial Codec Negotiationo Previously all the initial voice samples

started with NB 5.9 o After the conversion majority of samples

started from NB 4.75 codec.

• Solution : The rate-0 is not carried in the Assignment

request Adding of AMR Codec in all RNC

2G – PSTN acceptable Voice MOS maintained

IP BSC Conversion…

Page 14: Mobitel’s Initiatives for Evaluating Customer QoE and Ensuring … · 2019-08-19 · • Faulty 3G Repeater High RTWP - External Interference. NETWORK SERVICE QUALITY AUDITING.

• Filtering neighbor relation cells > 20 km • longest neighbor distance - 207 Km• 1214 long distance neighbors removed from each

NE

Cause: • Due to Cell ID duplication• Not using the CGI in creating the Handover Table

Impact:• Customer impact minimum but nearest neighbors

were missed

Long Distance Neighbor Cell Audit

Page 15: Mobitel’s Initiatives for Evaluating Customer QoE and Ensuring … · 2019-08-19 · • Faulty 3G Repeater High RTWP - External Interference. NETWORK SERVICE QUALITY AUDITING.

NETWORK DATA ANALYTICS

Page 16: Mobitel’s Initiatives for Evaluating Customer QoE and Ensuring … · 2019-08-19 · • Faulty 3G Repeater High RTWP - External Interference. NETWORK SERVICE QUALITY AUDITING.

Network Data Analytic ToolsMTD – Mobitel Traffic Distribution viewer• Distribution of Voice & Data traffic into

1Km2 BINs• Correlation with population density• Identification of best/worst performing

GNDs• Bin-wise serving technology and cell

details

MTG – Mobitel Traffic Growth viewer• Distribution of Voice & Data traffic

growth into BINs• Analysis of traffic growth with reference

to a selected week• Serving cell patterns and cell wise traffic

growth

Page 17: Mobitel’s Initiatives for Evaluating Customer QoE and Ensuring … · 2019-08-19 · • Faulty 3G Repeater High RTWP - External Interference. NETWORK SERVICE QUALITY AUDITING.

Data Traffic Growth in 3D• Network data traffic extracted from

Mobitel Traffic Distribution(MTD) viewer • Real time 3D map with high traffic growth

regions• Drilled down to ZIP levels and District

Secretariat Division (DSD) levels• Colombo District : The highest data growth• Kaduwela DSD : The highest growth among

all island DSD’s• Sales and marketing insights• Improve customer data penetration • Engineering assist in capacity and coverage

planning

Page 18: Mobitel’s Initiatives for Evaluating Customer QoE and Ensuring … · 2019-08-19 · • Faulty 3G Repeater High RTWP - External Interference. NETWORK SERVICE QUALITY AUDITING.

• Dark red BIN : Negative Traffic growth

• Addition of 21GB daily from a 2.4km LTE cell

• IBS configured only with 3G and No LTE.

• 3G IBS traffic reduction with increased LTE traffic

• Low data speed experiencing inside IBS

Data Reduction in Customer In-Building

Page 19: Mobitel’s Initiatives for Evaluating Customer QoE and Ensuring … · 2019-08-19 · • Faulty 3G Repeater High RTWP - External Interference. NETWORK SERVICE QUALITY AUDITING.

• Completion of Island wide LTE Expansion project

• Comparison of Data Traffic growth for two years

• Analysis for Districts and DSDs

• Identification of strong and weak areas

• Insights for Sales & Marketing promotions

• Capacity and bandwidth increment

• LTE device penetration

Data Traffic Growth Analysis

Page 20: Mobitel’s Initiatives for Evaluating Customer QoE and Ensuring … · 2019-08-19 · • Faulty 3G Repeater High RTWP - External Interference. NETWORK SERVICE QUALITY AUDITING.

Data Traffic Demand Pattern

• Incremental growth

• Data traffic usage on Full moon days

14

/8/2

01

8

19

/8/2

01

8

24

/8/2

01

8

29

/8/2

01

8

3/9

/20

18

8/9

/20

18

13

/9/2

01

8

18

/9/2

01

8

23

/9/2

01

8

28

/9/2

01

8

3/1

0/2

01

8

8/1

0/2

01

8

13

/10

/20

18

18

/10

/20

18

23

/10

/20

18

28

/10

/20

18

2/1

1/2

01

8

7/1

1/2

01

8

12

/11

/20

18

17

/11

/20

18

22

/11

/20

18

27

/11

/20

18

2/1

2/2

01

8

7/1

2/2

01

8

12

/12

/20

18

17

/12

/20

18

22

/12

/20

18

27

/12

/20

18

1/1

/20

19

6/1

/20

19

11

/1/2

01

9

16

/1/2

01

9

21

/1/2

01

9

26

/1/2

01

9

31

/1/2

01

9

5/2

/20

19

10

/2/2

01

9

15

/2/2

01

9

20

/2/2

01

9

25

/2/2

01

9

2/3

/20

19

7/3

/20

19

12

/3/2

01

9

17

/3/2

01

9

22

/3/2

01

9

27

/3/2

01

9

1/4

/20

19

6/4

/20

19

11

/4/2

01

9

16

/4/2

01

9

21

/4/2

01

9

26

/4/2

01

9

1/5

/20

19

6/5

/20

19

11

/5/2

01

9

16

/5/2

01

9

21

/5/2

01

9

26

/5/2

01

9

31

/5/2

01

9

5/6

/20

19

10

/6/2

01

9

15

/6/2

01

9

20

/6/2

01

9

25

/6/2

01

9

30

/6/2

01

9

5/7

/20

19

10

/7/2

01

9

15

/7/2

01

9

20

/7/2

01

9

25

/7/2

01

9

30

/7/2

01

9

4/8

/20

19

Dat

a V

olu

me

(TB

)

Dialy Total Data Traffic

18

5.1

08

00

89

18

9.6

64

15

14

22

0.2

68

89

44

21

9.4

01

04

68

22

8.6

26

14

65

22

7.5

65

16

01

25

4.3

52

48

7

27

8.2

46

99

16

31

1.6

40

32

78

30

4.4

50

03

16

30

8.5

02

97

38

31

0.7

76

11

08

14

/8/2

01

8

19

/8/2

01

8

24

/8/2

01

8

29

/8/2

01

8

3/9

/20

18

8/9

/20

18

13

/9/2

01

8

18

/9/2

01

8

23

/9/2

01

8

28

/9/2

01

8

3/1

0/2

01

8

8/1

0/2

01

8

13

/10

/20

18

18

/10

/20

18

23

/10

/20

18

28

/10

/20

18

2/1

1/2

01

8

7/1

1/2

01

8

12

/11

/20

18

17

/11

/20

18

22

/11

/20

18

27

/11

/20

18

2/1

2/2

01

8

7/1

2/2

01

8

12

/12

/20

18

17

/12

/20

18

22

/12

/20

18

27

/12

/20

18

1/1

/20

19

6/1

/20

19

11

/1/2

01

9

16

/1/2

01

9

21

/1/2

01

9

26

/1/2

01

9

31

/1/2

01

9

5/2

/20

19

10

/2/2

01

9

15

/2/2

01

9

20

/2/2

01

9

25

/2/2

01

9

2/3

/20

19

7/3

/20

19

12

/3/2

01

9

17

/3/2

01

9

22

/3/2

01

9

27

/3/2

01

9

1/4

/20

19

6/4

/20

19

11

/4/2

01

9

16

/4/2

01

9

21

/4/2

01

9

26

/4/2

01

9

1/5

/20

19

6/5

/20

19

11

/5/2

01

9

16

/5/2

01

9

21

/5/2

01

9

26

/5/2

01

9

31

/5/2

01

9

5/6

/20

19

10

/6/2

01

9

15

/6/2

01

9

20

/6/2

01

9

25

/6/2

01

9

30

/6/2

01

9

5/7

/20

19

10

/7/2

01

9

15

/7/2

01

9

20

/7/2

01

9

25

/7/2

01

9

30

/7/2

01

9

4/8

/20

19

Dat

a V

olu

me

(TB

)

Daily Total Data Traffic

• Aftermath of Easter attack (21/04/2019)

• Social media ban lift – highest data download per day

Lowest

Highest

15

/4/2

01

9

16

/4/2

01

9

17

/4/2

01

9

18

/4/2

01

9

19

/4/2

01

9

20

/4/2

01

9

21

/4/2

01

9

22

/4/2

01

9

23

/4/2

01

9

24

/4/2

01

9

25

/4/2

01

9

26

/4/2

01

9

27

/4/2

01

9

28

/4/2

01

9

29

/4/2

01

9

30

/4/2

01

9

1/5

/20

19

2/5

/20

19

3/5

/20

19

4/5

/20

19

5/5

/20

19

6/5

/20

19

7/5

/20

19

8/5

/20

19

9/5

/20

19

10

/5/2

01

9

11

/5/2

01

9

12

/5/2

01

9

13

/5/2

01

9

14

/5/2

01

9

15

/5/2

01

9

16

/5/2

01

9

17

/5/2

01

9

18

/5/2

01

9

19

/5/2

01

9

20

/5/2

01

9

Data Traffic (TB)

DL UL

Page 21: Mobitel’s Initiatives for Evaluating Customer QoE and Ensuring … · 2019-08-19 · • Faulty 3G Repeater High RTWP - External Interference. NETWORK SERVICE QUALITY AUDITING.

BENCHMARKING & DRIVE TESTING

Page 22: Mobitel’s Initiatives for Evaluating Customer QoE and Ensuring … · 2019-08-19 · • Faulty 3G Repeater High RTWP - External Interference. NETWORK SERVICE QUALITY AUDITING.

• Web browsing : Plays important QoE in MBB• Benchmark of Webpage Loading Time • Testing of popular websites• Dynamic content changes• Accuracy of test results

Suggestion:

A Sample Webpage for Objective testinghosted in different geographical locations,to be introduced

Parameters:

Web Page loading time Downlink/uplink bandwidth RTT Device dependency A Web Page MOS

Web Page Loading

Page 23: Mobitel’s Initiatives for Evaluating Customer QoE and Ensuring … · 2019-08-19 · • Faulty 3G Repeater High RTWP - External Interference. NETWORK SERVICE QUALITY AUDITING.

• Receiving or making a CS call with background data

• Data disconnection• Reduction of data speed

Cause• Multi RAB scenario• CSFB to direct 2G • 3G to 2G handover• Data disconnection in 2G

Rectification I-RAT handover audit Activation of Voice Service Optimization

for Multi RAB Feature

Data Experience with Continuing Voice

Page 24: Mobitel’s Initiatives for Evaluating Customer QoE and Ensuring … · 2019-08-19 · • Faulty 3G Repeater High RTWP - External Interference. NETWORK SERVICE QUALITY AUDITING.

Android application developed to collect service quality related voice and broadband issues as well as no coverage

issues using end users’ location data

Main Menu

SQ Zoom Mobile App

Page 25: Mobitel’s Initiatives for Evaluating Customer QoE and Ensuring … · 2019-08-19 · • Faulty 3G Repeater High RTWP - External Interference. NETWORK SERVICE QUALITY AUDITING.

GUI to monitor and rectify collected end user issues Issue Rectification process

SQ Zoom Mobile App