Advances On Internet and Mobile TV

Qualcomm Technologies, Inc.

@qualcomm_techNovember 2018

Thomas StockhammerDirector Technical Standards@haudiobe

2

Outline

• Broadcaster’s Challenges

• Mobile Platforms

• Global Industry efforts

◦ 3GPP

◦ MPEG, CTA, DASH-IF

◦ DVB-I

• Summary

BROADCAST ISTANBUL19.11.2018

3

Broadcaster’s Challenge

Broadcaster

Broadcast Istanbul

4

Broadcaster’s Challenge

Internettransmission

e.g. DTT

Presentation

Presentation

Service PresentationTV device

Non-TVdeviceMobile delivery

Broadcaster

Broadcast Istanbul

5

Broadcaster’s Challenge

ServiceOffering

AggregatorInternet

transmission

Gatekeeper

e.g. DTT

§§§ Regulator

Presentation

Presentation

Where appropriate/necessary:• Licensed broadcasters only;• Protect end users

Service PresentationTV device

Non-TVdeviceMobile delivery

Broadcaster

Broadcast Istanbul

6

Peak Download Speed: 1.2 Gbps

Peak Upload Speed: 150 Mbps

Ultra HD Premium video playback and encoding @ 4K (3840x2160) 60fps, 10bit HDR, Rec 2020 color gamut

eXtended Reality (XR)

Sensors

Qualcomm® Snapdragon™ Neural Processing Engine (NPE) SDK

Snapdragon 845 - how to get access

Broadcast Istanbul

Snapdragon™

X20 LTE modemAdreno 630

Visual ProcessingSubsystem

Wi-Fi

Qualcomm®

Hexagon™ 685 DSPQualcomm

Spectra™ 280 ISP

Qualcomm

Aqstic™ AudioQualcomm®

Kryo™ 385 CPU

System MemoryQualcomm®

Mobile Security

*Compared to Snapdragon 835

Multimedia/XR/ARComputer vision, image processing,

sensor processing, graphics, video

processing, location, and cloud interaction

Benefits• Integrated and optimized

• Enhanced battery life

• Thermal efficiency

• Standardized implementation

• Mass market cost

• Variety of use cases and industry support

Entire SoC is used!

… and Snapdragon 855 comes 5G/X50 with 7nm

7

Intuitiveinteractions

Sound quality

Visual quality Interaction

and

Immersion

Qualcomm - We want to immerse youImmersion is enabled by different components that work together

Extreme pixel quantity and qualityScreen is very close to the eyes

Stereoscopic displayHumans see in 3D

Spherical viewLook anywhere with

a full 360° spherical view

High resolution audioUp to human hearing capabilities

3D audioRealistic 3D, positional, surround audio that is accurate to the real world

Crystal clear voiceClear voice that is enhanced with

noise cancellation technology

Precise motion trackingAccurate on-device motion tracking

Minimal latencyMinimized system latency

to remove perceptible lag

Natural user interfacesSeamlessly interact with VR using

natural movements, free from wires

Learn more about our vision for the future of VR: www.qualcomm.com/VRBroadcast Istanbul

SOME OBJECTİVES AND APPROACHES

19.11.2018 BROADCAST ISTANBUL

• Enabling broadcast-grade linear TV service on the Internet

• Making media service more personalized, interactive and immersive

• Enabling monetization of media services

• Making services accessible on many different devices and platforms

• Ensuring an end-to-end work flow with all enablers is in place

• Encode and package once, distribute to all

Objectives

• Interoperability programs

• Identifying commercial Demand

• Global standards and ecosystems

• End-to-end workflows and ecosystems

• Supporting implementations by test, open source, conformance and reference tools

Approaches:

9

3GPPMBMS, enTV, Media and 5G

The 3GPP Eco-systemDeveloping internet

protocol specs

ITU-R/TDeveloping Mobile

application specs

Reference

to 3GPP

specs

Partners

referring to

3GPP specs

for the local

use

Referring to specs

Cross reference

Requirements

JapanEU Korea China North America

3GPP Market

Partners

Terminal

certification

based on 3GPP

specs

Cross

reference of

specs

India

Developing Recommendations

11

MBMS/LTE eMBMS/enTV HistoryBuilding upon a strong 3GPP technology foundation

Broadcast Istanbul

eMBMS defined for LTE starting

in Rel-8/Rel-91, improving

coverage and efficiency

eMBMS enhancements in

Rel-12 include MOOD2

and

expansion to MCPTT3

Enabling terrestrial broadcast and

expanding to new services; Meeting 7/10

5G Broadcast requirements4

in Rel-14

LTE eMBMS/enTV in 3GPP Rel-14

LTE LTE-AFurther enhancements5

to fully satisfy 5G broadcast requirements 5G

Target market

focused on

Cellular operators

Target market

expanded to

Broadcasters

3GPP Rel-14 (completed)

12

Terrestrial broadcast for next-gen digital TV deliveryenTV1 — part of 3GPP Rel-14 — meets terrestrial TV broadcast requirements

Broadcast Istanbul

System layer enhancementsRadio access enhancements

Rel-14

enTV1

Rel-14

enTV

Broadcast

Broadcast

Unicast control

xMB

Content provider

Receive only modeDelivery of free-to-air content to devices

without SIM/service subscription

Transport only serviceTV broadcasters can deliver content

in native format without transcoding

Standardized interfaceContent providers can deliver media

over LTE with a unified framework

Shared broadcastMultiple operators can serve users

on a common broadcast carrier

Longer rangeNew 1-symbol numerology with longer

200us CP2 to support 15 km ISD3

More broadcast capacitySupports dedicated broadcast network

with 100% eMBMS carrier allocation

More deployment flexibilitySingle network for mobile and fixed devices

with enhanced support for rooftop reception

Better efficiencyNew subframe design reduces overhead

in dedicated broadcast transmissions

1313

TS 26.347: MBMS API and URL • MBMS User Services in

TS26.346 provide (too) many

features

• Content can be accessed

through well-defined APIs,

• application communicates

with the MBMS client to

discover services and serve

existing media players.

• Architecture

• supports distribution of

existing TV services (e.g.

DVB),

• enables new capabilities to

support dynamic bc/uc

handoff, consumption

reporting, etc.

• APIs may be implemented

within a device or as network

interface, i.e. MBMS service

terminates in a gateway (

media server)

• https://developer.android.com/re

ference/android/telephony/mbm

NetworkUE

MBMS Management

System

Application and Content

Provider

Media and Content Server

BMSC

eNode-B

xMBTS29.116

Modem

MBMS Client

MBMS-Aware Application

Media Server

Unicast

MBMS Broadcast bearers

Media Client

TS26.346

MBMS APIMedia/Content Format

Application Data

BM-SCMBMS-

GW

MME

E-UTRANSGi-mbSGmb

Sm

M1

Application Service

ProviderxMB

M3

MBMS-aware

Application

UE Modem

MBMS Client

MBMS-API

Application Service Discovery

TS26.346 including broadcast and unicast

Broadcast Istanbul

1414

HTML-5, DASH and TV Video• DASH Enhancements

• Alignment with industry profiles

and technologies to enable

cross-domain deployments

including Live and Ad Insertion

• DVB-DASH aligned

• TV video profile

• Consistent set of video profiles

HD and UHD distribution aligned

with DVB AVC

• DVB UHD-1 phase 1 and phase

2

• HTML-5 profile

• Media-centric profile aligned with

TV industry adding for example

MSE and EME APIs

Distribution Formats for hybrid services, web-centric and enables TV Video Experiences

NetworkUE

MBMS Management

System

Application and Content

Provider

HTML-5, DASH Server &

Video Encoder

BMSC

eNode-B

xMBTS29.116

Modem

MBMS Client

MBMS-Aware Application

Media Server

Unicast

MBMS Broadcast bearers

Web appDASH Client

Video decoder

TS26.346

MBMS API

HTML-5 TS 26.403DASH TS 26.247Video TS 26.116

Application Data

Broadcast Istanbul

15

5G phase-1 in Rel-15

- Licensed bands between 600MHz – 39 GHz

- LTE-Anchored 5G (NSA), and Standalone

(SA) 5G

- Basic URLLC support

- Massive MIMO

- Flexible RAN architecture

- Fulfills IMT2020 criteria

- 5G Core Network

- Network Slicing

- Service Based Architecture for the Control Plane

- Designed for scalability & virtualization

- Orchestration and management network and radio functions

- 5G Media

Summary

16

5G phase-2 in Rel-16

… towards the full 5G vision:- V2X support – autonomous driving

- Enhanced MIMO

- Support for Unlicensed bands

- Factory automation and other use cases supported

- Support of higher bands (>52.6 GHz)

- Additional accesses (Wireline Wireless Convergence, Satellite…)

17

enTV—a strong candidate for next-gen digital TV

Targeting deployments in re-farmed 700 MHz (e.g. Europe)

Regulation compliantAllows frequency reuse and adheres

to ITU-GE-06 to protect existing DTT2

services

Wide-area coverageProvides at least 50% edge coverage

3for fixed

TV and 95% area coverage for mobile TV

Diverse servicesSupports free-to-air content delivery, paid media

4

streaming, as well as applications

Diverse deploymentsSupports fixed (e.g., rooftop) and mobile

(e.g., smartphone) receptions in a common

spectrum allocation

Meeting all EU digital TV broadcast requirements

DVB-T/T2 for terrestrial TV

DVB-T/T2 for terrestrial TV

470 MHz 608 MHz 694 MHz614 MHz

eMBMS for terrestrial TV (for same # of channels)

470 MHz 608 MHz 694 MHz614 MHz

Spectrum freed-up for new use cases, e.g., 5G

Broadcast Istanbul

eMBMS / enTV’s higher efficiency1

Small radio enhancements for larger ISD in Rel-16

Any potentional new work on MBMS beyond Rel-16 (after 2019)

18

Augmented reality vs. virtual realitySimilar underlying technologies but distinct experiences

Augmented realitySuperimposes content over the real world such that the content appears to be part of the real-world scene

Simulates physical presence in real or imagined worlds, and enables the user to interact in that world

Virtual reality

Broadcast Istanbul

19Confidential and Proprietary — Qualcomm Technologies, Inc. and/or its affiliated companies.

Virtual Reality in 5G – TS 26.118The first set of enablers for VR over 5G – approved in Sep 2018

3GPP VR Service Platform

3GPP Virtual Reality Headend

Aquisition

Audio Preprocessing

Visual Preprocessing

3D Audio Signal

3D Video Signal

Temporarily synced and spatially aligned in 3GPP 3DOF system

3D Audio Encoding

2D Video Encoding

Projection and

MappingMetadata

coding

File Format Encapsulation

File Format Encapsulation

Visual Metadata

File Format Delivery

DASH Integration

DASH Integration

3GPP VR Audio Track(s)

3GPP VR Video Track(s)

Multiplexing DASH MPD

VR File VR Media Presentation

DASH Delivery

File Format Processing

File Format Processing

Access andDemultiplexing

VR Application

3D Audio Decoding

Audio ES

Metadata decoding

Roll γ

Yaw α

Pitch βX

Z

Y3GPP VR Video Track(s)

3GPP VR Audio Track(s)DASH AccessClient

2D Texture

Audio Rendering

2D Video Decoding

VR Metadata

3D Audio

Pose Generation

Visual Viewport Rendering

Controller

Video ES

Visual qualityHEVC

Sound quality

MPEG-H Audio

Intuitiveinteractions

5G

Immersion

T26.118

Broadcast Istanbul

20Confidential and Proprietary — Qualcomm Technologies, Inc. and/or its affiliated companies.

Beyond Rel-15 – beyond VR360 3DoF StreamingExtended Reality (XR), 6DoF, Split rendering, AVPROD

E-FLUS

• Framework for Live Uplink Streaming

• QoS supported "Facebook live“

• User Generated and Professional content

• Immersive Media included

XR-5G

• Study on Use Cases and Requirements for media capabilities for XR over 5G

• Addresses AR, 6DoF, different media types

• Expected to prepare normative work

NCIS

• Study on network requirements for interactive immersive services

• Inclusion of network-based rendering

• Expected to prepare normative work

AVPROD

• Study on AV Service production

• Remote audio and video production

• Studio based production

• Remote editing

• Stage Performers

TERR_BCAST

• RAN Work Item on LTE-based 5G Terrestrial Broadcast

• support of large cell radius

• more flexible support of a variety of mobility cases

Broadcast Istanbul

21

The XR Challenge

Constrained mobile wearable environment

Thermally efficient for sleek,

ultra-light designs

Long battery life for all-day

use

XR workloads

Compute intensive

Complex concurrencies

Always-on

Real-time

Latency Sensitive

Approach: Mobile Edge Computing

and Split RenderingBroadcast Istanbul

22

Other Industry EffortsMPEG, DASH-IF, DVB, CTA

23

Large Scale Internet Media Distribution

• MPEG (Comcast, Netflix, Apple, Microsoft, Dolby, Hulu, etc.)◦ CMAF converged format between HLS and DASH. Promising low-latency, encryption and so on. Great per se, technical issues◦ DASH extensions to DASH MPD to enable new service features◦ ISO BMFF core group to address extensions to packaging formats

• DASH-IF (Hulu, Netflix, Comcast, Amazon, Microsoft, Akamai, Google, etc.)◦ LL-DASH Addresses the ability to deliver low-latency in scale and quality◦ Target Ad Insertion ability to replace content downstream based on clear rules◦ Content Ingest Ability to Ingest content to distribution system with all necessary metadata◦ Event APIs ability to deliver interactive metadata

• DVB (TV Manufacturers, European Broadcasters, European Network Operators, etc.)◦ Low-Latency DASH together with DASH-IF◦ DVB-I Internet-based service layer◦ ABR Multicast addressing IP multicast based delivery

• W3C/CTA WAVE (Comcast, Netflix, Apple, Microsoft, Dolby, Hulu, BBC, Google etc.)◦ Bridging MPEG world with the web world◦ Browser and HTML-5 media playback – interactive media ◦ Encryption and DRM

• How do we get this all back to 3GPP and where is 3GPP’s role in this?

Standards and Ecosystems

Broadcast Istanbul

24

Low-LatencyDASH

19.11.2018 BROADCAST ISTANBUL

Random Access and Start-up Delay

End-to-End Latency

Compression Efficiency

Network Efficiency and Scalability

Number of Requests

Number of Invalid Requests

Robustness to Errors

Note: Not all apply for all services, but may be relevant

KEY FUNCTİONS AND PERFORMANCE INDİCATORS

19.11.2018 BROADCAST ISTANBUL

DVB

Completion of use cases (together with DASH-IF) and Commercial Requirements for Low-Latency DASH

Encoder to Screen Latency of 3.5 seconds

Live Edge Start-up Delay in the order of 1 second or less

presentation of a media time at a specific wall-clock time within 500ms tolerance

updated DVB-DASH specification shall be completed by Q4/2018

Technical work started in collaboration with DASH-IF

DASH-IF

In the progress of drafting guidelines for Low-Latency DASH

Context of real service operation issues: Program changes, ad insertion, operational problems, scalability

Guidelines include

Interface between Encoder and DASH Packager assuming CMAF packaging

DASH Packager Operation including MPD generation and MPD updates, as well as segment generation

Client Implementation Guidelines and requirements: buffers, ABR logic, etc.

Development of test, reference and conformance tools

STATUS OF THE WORK İN DASH-IF AND DVB

19.11.2018 BROADCAST ISTANBUL

ABR EncoderEncryption

CMAF Packager

C MPD Generator and

DASH Packager

Origin Server

CDN(HTTPS)

IF-1

File Format Parser

(CMAF?)

Low LatencyDASH Client

DecryptionDecoding

IF-3

IF-4

File Format Parser

Regular DASH Client

DecryptionDecoding

Session basedMPD

ModificationE.g. Ad

Insertion

DRM ServerLogic

IF-2

LOW-LATENCY STREAMİNG - CHUNKİNG

19.11.2018 BROADCAST ISTANBUL

DASH

Packager

CHCIC CNC CNC CICCNC

IS

CNC CNC CIC

CNC

CNC CNC CIC

HTTP

Chunk

HTTP

Chunk

DASH Segment

MPD

CNC = CMAF non-initial chunk

CIC = CMAF initial chunk

CH = CMAF Header

Low-Latency

DASH

Client

CDN stores

Segments

Regular

DASH

Client

Segments

Chunks

10s

3s

Encoder

Many technical details need

to be addressed

OriginDASH

Packager

MPD with ad

prepared

Segments

SCTE-35

Interpreter

MPD

Manipulator

(Proxy)

SCTE-35

Interpreter

SCTE-35 in MPD

(or emsg)

Light Extended

Live Sim

MPD with ads

Segments

DASH

Client

1‘2

1

Ad Server

TARGETED AD INSERTİON

4

Ad Parameters

Many technical details need

to be addressed

19.11.2018 BROADCAST ISTANBUL

29

CMAF and CTA WAVE

19.11.2018 BROADCAST ISTANBUL

CMAF

Content

Stand-alone

HLS

HLS as HTML-5

video tag

Stand-alone

DASH

DASH as HTML-

5 video tag

HTML-5 MSE-

based Type-3

player

CDN,

Broadcast,

multicast

Application

DASH MPD

HLS M3U8

referencing

DİFFERENT PLAYERS – SİNGLE ENCODİNG AND COMMON DELİVERY

19.11.2018

Platforms and PlayersContent OfferingManifest Delivery

BROADCAST ISTANBUL

31

DVB Internet Services (DVB-I)

19.11.2018 BROADCAST ISTANBUL

DVB-I, the mission…

• DVB-I, where the “I” stands for “Internet”

– In the context of audio-visual services, “The Internet” is used for “Over-The-Top” (OTT) delivery

– Well, “The Internet”, as in “CDN overlaid, edge assisted, adaptive delivery, media cloud”

• …To enable DVB services to be discovered and consumed by devices with basic Internet connectivity, principally a non-managed broadband connection and HTTP access, providing a similar user proposition to that of a DVB broadcast service

Broadcast Istanbul

The Internet

1..n

1..n 1..n1..n

1..n

ISP network

DVB-I, the technologies

• Harnessing foundation technologies to provide a complete DVB solution for live OTT delivery:

– DVB-DASH (ABR – adaptive bit-rate)

• ETSI TS 103 285

– Low-latency DASH (LL-DASH)

• Technical work ongoing

– Multicast ABR (MABR)

• Technical work ongoing

• Reference Architecture published A176

• Protocols selected (align with 3GPP)

• Potential synergies with other ongoing DVB work items:

– Targeted Advertising

– Home Broadcast

• Potential liaison activities:

Broadcast Istanbul

DVB-I

DVB-DASH LL-DASH MABR

Signalling/Metadata

ServiceDiscovery

DVB AV Codecs

DVB-I, the vision

• Functional overview; likely roles and elements of the DVB-I specification

Broadcast Istanbul

DVB-I service portal

Aggregator

Broadcaster

DVB-I(DASH, CMAF,

WAVE)

Gatekeeper

e.g. DTT

§§§ Regulator

Presentation

Presentation

e.g. 3GPP EnTV and 5G

Where appropriate/necessary:• Licensed broadcasters only;• Protect end users from illegal

/ subversive services

Enable integration of service lists or innovation

in their management

TV device

Non-TVdevice

35

Summary

19.11.2018 BROADCAST ISTANBUL

Standards are relevant for the TV Grade Media moving to new devices and experiences

No longer vertical services, but individual enablers

APIs, testing, reference implementations, modular designs

Global efforts – but regional ambassadors

SUMMARY

19.11.2018 BROADCAST ISTANBUL

JOİN THE EFFORTS

37

Qualcomm & al. related event on May 16, 2018https://www.qualcomm.com/videos/5g-broadcast-evolution-based-entv-3gpp

Broadcast Istanbul

Follow us on:

For more information, visit us at:

www.qualcomm.com & www.qualcomm.com/blog

Thank you!

Nothing in these materials is an offer to sell any of the

components or devices referenced herein.

©2018 Qualcomm Technologies, Inc. and/or its affiliated

companies. All Rights Reserved.

Qualcomm and Snapdragon are trademarks of Qualcomm

Incorporated, registered in the United States and other

countries. Other products and brand names may be

trademarks or registered trademarks of their respective

owners.

References in this presentation to “Qualcomm” may mean Qualcomm

Incorporated, Qualcomm Technologies, Inc., and/or other subsidiaries

or business units within the Qualcomm corporate structure, as

applicable. Qualcomm Incorporated includes Qualcomm’s licensing

business, QTL, and the vast majority of its patent portfolio. Qualcomm

Technologies, Inc., a wholly-owned subsidiary of Qualcomm

Incorporated, operates, along with its subsidiaries, substantially all of

Qualcomm’s engineering, research and development functions, and

substantially all of its product and services businesses, including its

semiconductor business, QCT.