Post on 13-Apr-2020
Benchmarking Video Experience
Ken Wang
President of Global Marketing and Solutions Sales
Vertical
Simple & Experience
Entertainment
Real Time & Convergent Identity & Social
Communication
500 MILLION YEARS Video per Month
100 MILLION MINs Video per Second
80% of Internet Traffic in 2019 is VIDEO
50%
55%
50%
60%
41%
60% 51%
And Video Already Become the No.1 Content in Mobile Telco’s Network TODAY
50%
Video in Every Moment, Video Everywhere
40 EB@2015 275 EB@2020
35% 61%
4%
2015
2.4
39
22.3
CAGR MBB VIDEO
120%
CAGR FBB VIDEO
32% 46%
2020 123
152
59
MBB Video
FBB Video
Other
17% 37%
Unit: EB, 1 EB=1,000,000 TB
Technology Evolves, Scenario Varies, Content Enriched
User Experience is The Primary Productivity
The Measurable Experience is a ‘MUST’
Web
Video
Voice Voice Experience:
Quantified with Only Few Parameters
Call Setup Success Rate
Call Drop Rate
Call Connection Delay
Handover Success Rate
Video
Voice
Web Web Experience:
Quantified with Some Major
Parameters Web Load Success Ratio
Web Load Latency
Web Download Speed
FTP Download Mean Speed
FTP Upload Mean Speed
Voice
Web
Video Video Experience:
Affected by Much More Factors!
Resolution Ratio
Frame Rate
Color Gamut
Color Depth
Dynamic Range Compression Ratio
Zapping Time
Loading Time
Pixellation
Video Freeze
Seek Response Initial Buffering Time
Redefine vMOS
Same Resolution Comparison Mainly for O&M Different Resolution Comparison Mainly for User Experience
vMOS@2009 Technology Centric
U-vMOS@2015 User Experience Centric
User
Unified
Ubiquitous
720P 1080P
360P
2K
1080P
4K
720P
360P
U-vMOS Architecture Design: TOP3 Objective Factors Reflect Subjective Experience
Zapping Time
sZapping
Initial Loading Time
sLoading
Seek Response Time
sSeeking Resolution Definition Color Gamut Frame Rate
Blocking
sBlocking Stalling
sStalling
“0” Distortion “0” Waiting “0” Impairment
Quality Interaction View
Camera
TV
PAD
Phone
Glass
…
Philosophy 1:
Human-factor Engineering
Reflects Real Experience
Video
Definition
Maximum Score
5.5’ 9.7’ 42’ 100’
8K 5.00 5.00 5.00 5.00
5K 5.00 5.00 4.80 4.72
2K 4.72 4.58 4.40 4.20
1080P 4.62 4.45 4.20
720P 4.12 4.00 3.67 3.15
480P 3.86 3.64 3.11 2.44
360P 3.38 3.00 2.37 1.66
4K 4.78 4.90 4.75 4.65
4.00 4.20 4.45 4.62 1080P
Minute of
Arc Cell Phone Screen
Dot Pitch
TV Typical View Distance
2.5 m
PAD Typical View Distance
41 cm
Cell Phone Typical View
Distance 30 cm
sQuality
Philosophy 2:
Validated Samples for
Experience Modeling
Score
BTV VoD
sZapping
Time
sLoading
Time
@TV
sLoading
Time
@Phone
5 <=100ms <=100ms <=100ms
3 1ms 2s 3s
2 2s 5s 5s
1 >4s 8s 10s
Score
BTV VoD
sBlocking
Count
sStalling %@TV
sStalling %@Phone
5 0 0 0%
4 1 0.1% 5 %
2 5 5% 15%
1 >10 10% 30%
sInteraction sView
4 500ms 1s
3 2 1% 10%
1s
Philosophy 3:
Scenario-based Algorithm
Adapts Various Experience
• ɑ and ß is the factor(%) representing user experience of
interaction and viewing experience separately, which is
defined via consumer survey
• ɑ, ß: weight of sInteraction & sView
• ɑ, ß value range comes from research result
• Different service/different area have different values
BTV VoD
ɑ 0.66 0.71
ß 0.77 0.77
(*α,β vary in different scenarios)
This is
Score
Excellent (5)
Good (4)
Fair (3)
Poor (2)
Bad (1)
Excellent (5)
Score
BTV VoD
sZapping
Time
sLoading
Time
@TV
sLoading
Time
@Phone
5 <=100ms <=100ms <=100ms
3 1ms 2s 3s
2 2s 5s 5s
1 >4s 8s 10s
Score
BTV VoD
sBlocking
Count
sStalling %@TV
sStalling %@Phone
5 0 0 0%
4 1 0.1% 5%
2 5 5% 15%
1 >10 10% 30%
Video definition Maximum Score
100’ 9.7’
8K 5 5
5K or more 4.72 5
1080p 4 4.45
720p 3.15 4
480p 2.44 3.64
360p 1.66 3
sInteraction sView sQuality vMOS
4 500ms 1s 1s
3 2 1% 10%
4K 4.65 4.78
2K 4.20 4.58
Find Your U-vMOS
BTV on 42’ Screen
sQuality 3.73
sInteraction 3.77
sView 5
3.34
sQuality 2.42
sInteraction 2
sView 4
1.72
Find Your U-vMOS
VOD on 5.5’ Screen
sQuality 3.4
sInteraction 3.51
sView 5
3.1
sQuality 1.51
sInteraction 2.39
sView 1.8
1.4
Cooperation OPEN
Coming Soon: User Experience Centric Video Network Architecture
CDN Service
Platform
Terminal
Backhaul & Metro Backbone Datacenter
Mobile
Fixed
FMC Smart Pipe
E2E O&M Content Platform Network Terminal
Video Communication
Industry Video Application
Entertainment Video
Ultra-Broadband Forum 2015
Thank you