Benchmarking Video Experience - huawei...Call Setup Success Rate Call Drop Rate Call Connection...

Post on 13-Apr-2020

1 views 0 download

Transcript of Benchmarking Video Experience - huawei...Call Setup Success Rate Call Drop Rate Call Connection...

Benchmarking Video Experience

Ken Wang

President of Global Marketing and Solutions Sales

Vertical

Simple & Experience

Entertainment

Real Time & Convergent Identity & Social

Communication

500 MILLION YEARS Video per Month

100 MILLION MINs Video per Second

80% of Internet Traffic in 2019 is VIDEO

50%

55%

50%

60%

41%

60% 51%

And Video Already Become the No.1 Content in Mobile Telco’s Network TODAY

50%

Video in Every Moment, Video Everywhere

40 EB@2015 275 EB@2020

35% 61%

4%

2015

2.4

39

22.3

CAGR MBB VIDEO

120%

CAGR FBB VIDEO

32% 46%

2020 123

152

59

MBB Video

FBB Video

Other

17% 37%

Unit: EB, 1 EB=1,000,000 TB

Technology Evolves, Scenario Varies, Content Enriched

User Experience is The Primary Productivity

The Measurable Experience is a ‘MUST’

Web

Video

Voice Voice Experience:

Quantified with Only Few Parameters

Call Setup Success Rate

Call Drop Rate

Call Connection Delay

Handover Success Rate

Video

Voice

Web Web Experience:

Quantified with Some Major

Parameters Web Load Success Ratio

Web Load Latency

Web Download Speed

FTP Download Mean Speed

FTP Upload Mean Speed

Voice

Web

Video Video Experience:

Affected by Much More Factors!

Resolution Ratio

Frame Rate

Color Gamut

Color Depth

Dynamic Range Compression Ratio

Zapping Time

Loading Time

Pixellation

Video Freeze

Seek Response Initial Buffering Time

Redefine vMOS

Same Resolution Comparison Mainly for O&M Different Resolution Comparison Mainly for User Experience

vMOS@2009 Technology Centric

U-vMOS@2015 User Experience Centric

User

Unified

Ubiquitous

720P 1080P

360P

2K

1080P

4K

720P

360P

U-vMOS Architecture Design: TOP3 Objective Factors Reflect Subjective Experience

Zapping Time

sZapping

Initial Loading Time

sLoading

Seek Response Time

sSeeking Resolution Definition Color Gamut Frame Rate

Blocking

sBlocking Stalling

sStalling

“0” Distortion “0” Waiting “0” Impairment

Quality Interaction View

Camera

TV

PAD

Phone

Glass

Philosophy 1:

Human-factor Engineering

Reflects Real Experience

Video

Definition

Maximum Score

5.5’ 9.7’ 42’ 100’

8K 5.00 5.00 5.00 5.00

5K 5.00 5.00 4.80 4.72

2K 4.72 4.58 4.40 4.20

1080P 4.62 4.45 4.20

720P 4.12 4.00 3.67 3.15

480P 3.86 3.64 3.11 2.44

360P 3.38 3.00 2.37 1.66

4K 4.78 4.90 4.75 4.65

4.00 4.20 4.45 4.62 1080P

Minute of

Arc Cell Phone Screen

Dot Pitch

TV Typical View Distance

2.5 m

PAD Typical View Distance

41 cm

Cell Phone Typical View

Distance 30 cm

sQuality

Philosophy 2:

Validated Samples for

Experience Modeling

Score

BTV VoD

sZapping

Time

sLoading

Time

@TV

sLoading

Time

@Phone

5 <=100ms <=100ms <=100ms

3 1ms 2s 3s

2 2s 5s 5s

1 >4s 8s 10s

Score

BTV VoD

sBlocking

Count

sStalling %@TV

sStalling %@Phone

5 0 0 0%

4 1 0.1% 5 %

2 5 5% 15%

1 >10 10% 30%

sInteraction sView

4 500ms 1s

3 2 1% 10%

1s

Philosophy 3:

Scenario-based Algorithm

Adapts Various Experience

• ɑ and ß is the factor(%) representing user experience of

interaction and viewing experience separately, which is

defined via consumer survey

• ɑ, ß: weight of sInteraction & sView

• ɑ, ß value range comes from research result

• Different service/different area have different values

BTV VoD

ɑ 0.66 0.71

ß 0.77 0.77

(*α,β vary in different scenarios)

This is

Score

Excellent (5)

Good (4)

Fair (3)

Poor (2)

Bad (1)

Excellent (5)

Score

BTV VoD

sZapping

Time

sLoading

Time

@TV

sLoading

Time

@Phone

5 <=100ms <=100ms <=100ms

3 1ms 2s 3s

2 2s 5s 5s

1 >4s 8s 10s

Score

BTV VoD

sBlocking

Count

sStalling %@TV

sStalling %@Phone

5 0 0 0%

4 1 0.1% 5%

2 5 5% 15%

1 >10 10% 30%

Video definition Maximum Score

100’ 9.7’

8K 5 5

5K or more 4.72 5

1080p 4 4.45

720p 3.15 4

480p 2.44 3.64

360p 1.66 3

sInteraction sView sQuality vMOS

4 500ms 1s 1s

3 2 1% 10%

4K 4.65 4.78

2K 4.20 4.58

Find Your U-vMOS

BTV on 42’ Screen

sQuality 3.73

sInteraction 3.77

sView 5

3.34

sQuality 2.42

sInteraction 2

sView 4

1.72

Find Your U-vMOS

VOD on 5.5’ Screen

sQuality 3.4

sInteraction 3.51

sView 5

3.1

sQuality 1.51

sInteraction 2.39

sView 1.8

1.4

Cooperation OPEN

Coming Soon: User Experience Centric Video Network Architecture

CDN Service

Platform

Terminal

Backhaul & Metro Backbone Datacenter

Mobile

Fixed

FMC Smart Pipe

E2E O&M Content Platform Network Terminal

Video Communication

Industry Video Application

Entertainment Video

Ultra-Broadband Forum 2015

Thank you