New JavaTM Digital TV Standard goes Brazil

M. Lagally, J. PätzoldSun MicrosystemsD. Campelo, H. PerroneTQTVD

2

Agenda

> Java and Interactive TV> TV Market in Brazil> SBTVD Forum> Java DTV Use Cases in Brazil> Specification Overview> Selected TV specific APIs> Ginga-J> JavaDTV Demo

3

Java and Interactive TV

> Interactive TV = TV + applications> Java applications:

● augment audio/video content● can control media playback● can control display hardware and tuning● can start other applications● can overlay other media content● can select new program service

4

Java and Interactive TV

> Interactive Java TV Applications are available today:● BluRay ● Tru2way (OCAP)● MHP, GEM-IPTV

> Used for Games, Menus, News ticker, EPG, ...

5

TV Market in Brazil

> Brazilian Digital Terrestrial & Mobile TV● Free to Air TV. Revenue based on advertising.● 180M+ people, 55M+ TV● World's largest dual terrestrial/mobile TV

deployment● World's 4th largest TV network (80M viewers/day)

> Brazilian standards body: SBTVD> SBTVD teamed up with Sun to create royalty free

DTV specification

6

SBTVD ForumSistema Brasileiro de Televisao Digital

> Founded 2006 > Brazil's standardization organization> Aim: defining standard and regulations for

successful implementation of the digital TV infrastructure in Brazil

> Aligned interests between broadcasters, industry, government and universities

> Timeline● Dec 2007 digital broadcast started● End of 2009 Java DTV available in devices

7

Java DTV Use Cases in Brazil

> Online purchase of Audio & Video content> Interactive Advertising> Sport Statistics> Clips Download> Real-time voting> Quiz / Game Applications (also with external devices)> Localized Information (such as Weather or Traffic)> Portal Applications> E-Government

8

Java DTV benefits

> Designed to fulfill the requirements of Brazilian market

> Open Source> Royalty free> Java allows for rich media experience> Large Java developer community in Brazil

● developer experience, low learning curve

9

Java DTV Specification

> Feature parity with other Java specifications in TV space

> Resides on mature standardized JavaME specifications

● CDC, FP, PBP, JavaTV (latest versions)> Integrates LWUIT widgets for a compelling user

experience

10

Java DTV Specification

> Integrates with the other components on the set-top box

DTV Middleware Specification

Ginga-J

Common Core

Java DTV Specification

Ginga-NCLBridge

SBTVD APIs

11

Java DTV Architecture

CDC 1.1 / FP 1.1 / PBP 1.1

JavaTV 1.1

Med

ia A

PIs

Erro

r Rep

ortin

g

App

licat

ion

Man

agem

ent

MP

EG C

once

pts

Broa

dcas

t File

syst

em

MP

EG S

ectio

n Fi

lterin

g

Tuni

ng

Net

wor

king

Ext

ensi

ons

Use

r Set

tings

& P

refs

Even

ts

Inte

r-A

ppl C

omm

unic

atio

n

Con

tent

Sec

urity

Res

ourc

e M

anag

emen

t

Per

sist

ent S

tora

ge

TV G

raph

ics

SBTVD Extensions

Applications

UI W

idge

t Set

12

> Are multiplexed streams delivered over the broadcast channel

> Defined in ISO13818-1> Multiplexed streams may contain

● Elementary streams (video, audio, subtitles)● Service information (directory of the transmission

network, electronic program guide, etc.)● Applications and additional resources● IP packets● Conditional Access Messages

MPEG ConceptsMPEG2 Transport Streams

13

Networks Transport Streams Elementary Streams

Video

Audio

Subtitle

Service Information

MPEG ConceptsMPEG2 Transport Streams

14

> Identify transport stream identities> URL based> Entities

● Networks● Transport streams● Services● Elementary streams

> Example● dtv://<original_network_id>.<transport_stream_id>.<service_id>● dtv://1016.34.6

MPEG ConceptsLocators

15

Application Model

> DTV applications are PBP Xlets> Apps are transmitted as part of the broadcast

stream > Packaged into signed JAR files> Authentication of signed applications to enable

different security domains> Lifecycle is controlled via broadcast signaling

(AIT) → synchronization with TV program● start, stop, pause, resume at specific times in the

stream

16

Application ModelSignaling> Applications can be started automatically at

channel switch

TV channel 1 TV channel 2

time

App 1

App 2

App 3

App 4

App 2

star

t

star

t

star

tre

sum

e

stop

stop

paus

e

Implicit start/stopdue to channel change

17

Application ModelSecurity> Multiple applications can execute

simultaneously● Shielded from each other● Can communicate with inter-Xlet communication

> Protected file system:● Each application has it's own area in the

persistent file system● Not accessible to other applications (unless

explicitly granted)

18

Application ModelSecurity> Java sandbox ensures system integrity> Java 2 SE security model> Access to sensitive APIs is restricted to signed

applications:> Protected APIs: file system, application mgmt,

network, tuning, smartcard, service selection, preferences, interXlet communcation, persistent files

> Permissions are requested with a per application policy file (PAP)

19

Broadcast Carousel> Problem:

● unidirectional and unreliable transmission not suitable for file transfer

● Arbitrary service selection> Solved by repetitive transmission of files over

the broadcast channel

Transmission

Set-top BoxBroadcaster

20

Broadcast Carousel

> Applications, sounds, images, etc. can be embedded into transport stream

> For Java:● applications and their data resources are

transmitted over broadcast carousel> Broadcast files will be available via local virtual

filesystem> Events generated whenever new files appear,

updated or deleted

21

Video

TV Graphics: Display Model

> TV display model and desktop model are different

> Multiple screen planes are overlayed with alpha blending

> Selection plane choses between video and static picture plane

Static picturesPicture/video selectionGraphics and Text

Subtitles

Front

(Source: Draft Standard SBTVD forum N06-1)

22

Display model on ISDB-T

> Screen planes can be reserved exclusively by applications

> Each plane can be individually scaled> UI widgets, text and graphics are displayed on

the graphics plane> Display of static picture or video is selected with

switching control plane at pixel level> Subtitles are superimposed on other planes

23

Media Handling

> Java Media framework (JMF) is part of Java TV (JSR 927)

> JMF player handles time-based media streams > DTV spec provides additional controls for:

● Audio language● Closed captions / subtitles● Video format, clipping, aspect ratio and

presentation ● Video timeline● Dripfeed (progressive I- and P-frames)

24

Ginga-J Specification

> Brazil's standard for procedural middleware> Completely based on JavaDTV> Extends JavaDTV for the DTV Brazilian system:

● System Specific Service Information API● Definitions for System Specific Locators● Bridge API for integrating with the Ginga-NCL

engine● Interaction devices API● Asynchronous messaging API

25

Sample Use Case Screenshot

26

Sample Use Case Screenshot

27

Sample Use Case Screenshot

28

JavaDTV Demo> AstroTV is the DTV Middleware from TQTVD,

compliant with Ginga Standard and JavaDTV Spec.

> Demo Set Top Box Footprint:● CPU clock: 300 Mhz● 64 MB RAM (system memory)● 32 MB FLASH

29

JavaDTV Demo> JavaDTV features used in the Demo Application:

● Application Model● LWUIT framework:

● Animation, Transition, Container, Widgets (Label, Button, Image, List, etc)

● Forms, Customized Layout, Painters and Themes (i18n)

● Broadcast File System access (DSMCC OC)● Return Channel● UI Events

30

Status> Specification published on sun.com in December

2008

http://java.sun.com/javame/technology/javatv/index.jsp> Specification now in public consultation, SBTVD

forum approval expected in July> First commercial implementations on terrestrial

TV settop boxes expected by end of 2009> Java DTV is on Air: Major Brazilian Broadcasters

are already transmitting Java applications in their production signal

M. Lagally, J. Pätzold,H. Perrone, D. Campelomichael.lagally@sun.comjens.paetzold@sun.comhernan.perrone@tqtvd.comdavid.campelo@tqtvd.com