Benchmarking Video Experience - huawei...Call Setup Success Rate Call Drop Rate Call Connection...

19
Benchmarking Video Experience Ken Wang President of Global Marketing and Solutions Sales

Transcript of Benchmarking Video Experience - huawei...Call Setup Success Rate Call Drop Rate Call Connection...

Page 1: Benchmarking Video Experience - huawei...Call Setup Success Rate Call Drop Rate Call Connection Delay Handover Success Rate . Video Voice Web Web Experience: Quantified with Some Major

Benchmarking Video Experience

Ken Wang

President of Global Marketing and Solutions Sales

Page 2: Benchmarking Video Experience - huawei...Call Setup Success Rate Call Drop Rate Call Connection Delay Handover Success Rate . Video Voice Web Web Experience: Quantified with Some Major

Vertical

Simple & Experience

Entertainment

Real Time & Convergent Identity & Social

Communication

500 MILLION YEARS Video per Month

100 MILLION MINs Video per Second

80% of Internet Traffic in 2019 is VIDEO

Page 3: Benchmarking Video Experience - huawei...Call Setup Success Rate Call Drop Rate Call Connection Delay Handover Success Rate . Video Voice Web Web Experience: Quantified with Some Major

50%

55%

50%

60%

41%

60% 51%

And Video Already Become the No.1 Content in Mobile Telco’s Network TODAY

50%

Page 4: Benchmarking Video Experience - huawei...Call Setup Success Rate Call Drop Rate Call Connection Delay Handover Success Rate . Video Voice Web Web Experience: Quantified with Some Major

Video in Every Moment, Video Everywhere

40 EB@2015 275 EB@2020

35% 61%

4%

2015

2.4

39

22.3

CAGR MBB VIDEO

120%

CAGR FBB VIDEO

32% 46%

2020 123

152

59

MBB Video

FBB Video

Other

17% 37%

Unit: EB, 1 EB=1,000,000 TB

Technology Evolves, Scenario Varies, Content Enriched

Page 5: Benchmarking Video Experience - huawei...Call Setup Success Rate Call Drop Rate Call Connection Delay Handover Success Rate . Video Voice Web Web Experience: Quantified with Some Major

User Experience is The Primary Productivity

The Measurable Experience is a ‘MUST’

Page 6: Benchmarking Video Experience - huawei...Call Setup Success Rate Call Drop Rate Call Connection Delay Handover Success Rate . Video Voice Web Web Experience: Quantified with Some Major

Web

Video

Voice Voice Experience:

Quantified with Only Few Parameters

Call Setup Success Rate

Call Drop Rate

Call Connection Delay

Handover Success Rate

Page 7: Benchmarking Video Experience - huawei...Call Setup Success Rate Call Drop Rate Call Connection Delay Handover Success Rate . Video Voice Web Web Experience: Quantified with Some Major

Video

Voice

Web Web Experience:

Quantified with Some Major

Parameters Web Load Success Ratio

Web Load Latency

Web Download Speed

FTP Download Mean Speed

FTP Upload Mean Speed

Page 8: Benchmarking Video Experience - huawei...Call Setup Success Rate Call Drop Rate Call Connection Delay Handover Success Rate . Video Voice Web Web Experience: Quantified with Some Major

Voice

Web

Video Video Experience:

Affected by Much More Factors!

Resolution Ratio

Frame Rate

Color Gamut

Color Depth

Dynamic Range Compression Ratio

Zapping Time

Loading Time

Pixellation

Video Freeze

Seek Response Initial Buffering Time

Page 9: Benchmarking Video Experience - huawei...Call Setup Success Rate Call Drop Rate Call Connection Delay Handover Success Rate . Video Voice Web Web Experience: Quantified with Some Major

Redefine vMOS

Same Resolution Comparison Mainly for O&M Different Resolution Comparison Mainly for User Experience

vMOS@2009 Technology Centric

U-vMOS@2015 User Experience Centric

User

Unified

Ubiquitous

720P 1080P

360P

2K

1080P

4K

720P

360P

Page 10: Benchmarking Video Experience - huawei...Call Setup Success Rate Call Drop Rate Call Connection Delay Handover Success Rate . Video Voice Web Web Experience: Quantified with Some Major

U-vMOS Architecture Design: TOP3 Objective Factors Reflect Subjective Experience

Zapping Time

sZapping

Initial Loading Time

sLoading

Seek Response Time

sSeeking Resolution Definition Color Gamut Frame Rate

Blocking

sBlocking Stalling

sStalling

“0” Distortion “0” Waiting “0” Impairment

Quality Interaction View

Camera

TV

PAD

Phone

Glass

Page 11: Benchmarking Video Experience - huawei...Call Setup Success Rate Call Drop Rate Call Connection Delay Handover Success Rate . Video Voice Web Web Experience: Quantified with Some Major

Philosophy 1:

Human-factor Engineering

Reflects Real Experience

Video

Definition

Maximum Score

5.5’ 9.7’ 42’ 100’

8K 5.00 5.00 5.00 5.00

5K 5.00 5.00 4.80 4.72

2K 4.72 4.58 4.40 4.20

1080P 4.62 4.45 4.20

720P 4.12 4.00 3.67 3.15

480P 3.86 3.64 3.11 2.44

360P 3.38 3.00 2.37 1.66

4K 4.78 4.90 4.75 4.65

4.00 4.20 4.45 4.62 1080P

Minute of

Arc Cell Phone Screen

Dot Pitch

TV Typical View Distance

2.5 m

PAD Typical View Distance

41 cm

Cell Phone Typical View

Distance 30 cm

sQuality

Page 12: Benchmarking Video Experience - huawei...Call Setup Success Rate Call Drop Rate Call Connection Delay Handover Success Rate . Video Voice Web Web Experience: Quantified with Some Major

Philosophy 2:

Validated Samples for

Experience Modeling

Score

BTV VoD

sZapping

Time

sLoading

Time

@TV

sLoading

Time

@Phone

5 <=100ms <=100ms <=100ms

3 1ms 2s 3s

2 2s 5s 5s

1 >4s 8s 10s

Score

BTV VoD

sBlocking

Count

sStalling %@TV

sStalling %@Phone

5 0 0 0%

4 1 0.1% 5 %

2 5 5% 15%

1 >10 10% 30%

sInteraction sView

4 500ms 1s

3 2 1% 10%

1s

Page 13: Benchmarking Video Experience - huawei...Call Setup Success Rate Call Drop Rate Call Connection Delay Handover Success Rate . Video Voice Web Web Experience: Quantified with Some Major

Philosophy 3:

Scenario-based Algorithm

Adapts Various Experience

• ɑ and ß is the factor(%) representing user experience of

interaction and viewing experience separately, which is

defined via consumer survey

• ɑ, ß: weight of sInteraction & sView

• ɑ, ß value range comes from research result

• Different service/different area have different values

BTV VoD

ɑ 0.66 0.71

ß 0.77 0.77

Page 14: Benchmarking Video Experience - huawei...Call Setup Success Rate Call Drop Rate Call Connection Delay Handover Success Rate . Video Voice Web Web Experience: Quantified with Some Major

(*α,β vary in different scenarios)

This is

Score

Excellent (5)

Good (4)

Fair (3)

Poor (2)

Bad (1)

Excellent (5)

Score

BTV VoD

sZapping

Time

sLoading

Time

@TV

sLoading

Time

@Phone

5 <=100ms <=100ms <=100ms

3 1ms 2s 3s

2 2s 5s 5s

1 >4s 8s 10s

Score

BTV VoD

sBlocking

Count

sStalling %@TV

sStalling %@Phone

5 0 0 0%

4 1 0.1% 5%

2 5 5% 15%

1 >10 10% 30%

Video definition Maximum Score

100’ 9.7’

8K 5 5

5K or more 4.72 5

1080p 4 4.45

720p 3.15 4

480p 2.44 3.64

360p 1.66 3

sInteraction sView sQuality vMOS

4 500ms 1s 1s

3 2 1% 10%

4K 4.65 4.78

2K 4.20 4.58

Page 15: Benchmarking Video Experience - huawei...Call Setup Success Rate Call Drop Rate Call Connection Delay Handover Success Rate . Video Voice Web Web Experience: Quantified with Some Major

Find Your U-vMOS

BTV on 42’ Screen

sQuality 3.73

sInteraction 3.77

sView 5

3.34

sQuality 2.42

sInteraction 2

sView 4

1.72

Page 16: Benchmarking Video Experience - huawei...Call Setup Success Rate Call Drop Rate Call Connection Delay Handover Success Rate . Video Voice Web Web Experience: Quantified with Some Major

Find Your U-vMOS

VOD on 5.5’ Screen

sQuality 3.4

sInteraction 3.51

sView 5

3.1

sQuality 1.51

sInteraction 2.39

sView 1.8

1.4

Page 17: Benchmarking Video Experience - huawei...Call Setup Success Rate Call Drop Rate Call Connection Delay Handover Success Rate . Video Voice Web Web Experience: Quantified with Some Major

Cooperation OPEN

Page 18: Benchmarking Video Experience - huawei...Call Setup Success Rate Call Drop Rate Call Connection Delay Handover Success Rate . Video Voice Web Web Experience: Quantified with Some Major

Coming Soon: User Experience Centric Video Network Architecture

CDN Service

Platform

Terminal

Backhaul & Metro Backbone Datacenter

Mobile

Fixed

FMC Smart Pipe

E2E O&M Content Platform Network Terminal

Video Communication

Industry Video Application

Entertainment Video

Page 19: Benchmarking Video Experience - huawei...Call Setup Success Rate Call Drop Rate Call Connection Delay Handover Success Rate . Video Voice Web Web Experience: Quantified with Some Major

Ultra-Broadband Forum 2015

Thank you