Post on 21-Jul-2015
Television Linked To The Web
www.linkedtv.eu
Lyndon Nixon, MODUL University Vienna GmbHRaphael Troncy, EURECOM
Johan Oomen, Sound and Vision
Towards New Media Applications with Linked Media – using the LinkedTV
project toolset
18 May 2015 LiME Workshop WWW2015
2
www.linkedtv.eu
What is Linked Media?
1. Web media descriptions need a common representation
of media structure
2. 2. Web media descriptions need a common representation Web media descriptions need a common representation of media contentof media content
3. 3. Web media descriptions need to use a media ontology Web media descriptions need to use a media ontology which supports description of both the structure and which supports description of both the structure and content of mediacontent of media
4. 4. The descriptions of media in terms of common representations of The descriptions of media in terms of common representations of structure and content are the basis for deriving links across structure and content are the basis for deriving links across media on the Web (Linked Media) media on the Web (Linked Media)
3
www.linkedtv.eu
LinkedTV: background
40% of TV viewers are using a companion device alongside the TV program.*
* J. Abreu, P. Almeida, B. Teles, and M. Reis. Viewer behaviors and practices in the (new) television environment. In Proceedings of the 11th European Conference on Interactive TV and Video, EuroITV '13.
http://www.linkedtv.eu
Ever saw something on TV and wanted to know more about it, but didn‘t even know how to search for it?
4
www.linkedtv.eu
LinkedTV: applications
Scenario 1:LinkedNews app Easy access to
background to the news
Focus on key concepts of
interest in each item hbbTV single screen and
dual screen apps
Scenario 2: LinkedCulture app
Easy access to
information on the art
objects discussed in the
program Secondary screen-
orientation, cast TV
program to main screen
LinkedNews demo:
https://vimeo.com/106264077
LinkedCulture demo:
https://vimeo.com/108891238
5
www.linkedtv.eu
LinkedTV technology
“...schilderij van Jan Sluijters....”
Video object and word detection
dbpedia.org/resource/Jan_Sluyters
Connection to concepts
Paintings by Jan Sluijters
Selection of related concepts
Selection of related content
Presentation engine
6
www.linkedtv.eu
Annotation task: LinkedTV Ontology
Published at http://www.linkedtv.eu/ontology (Enquiries: r.troncy@eurecom.fr)
AnnotationConcept
Keyword
ANALYSIS RESULTS (Support for segmentation)
Ontology for Media Resources (W3C)
Open Annotation Core Data Model
EXTERNAL DATASETS
Entity
NERD
Provenance
Ontology for Provenance Management
Scene
Shot
MediaFragment
Face
7
www.linkedtv.eu
Annotation task: manual approaches
The LinkedTV Editor Tool code is open source (GNU GPL 3.0) - https://github.com/linkedtv/editortool A test installation can be used at http://editortoolv2.linkedtv.eu/trial (Enquiries: jblom@beeldengeluid.nl)
8
www.linkedtv.eu
Annotation storage: LinkedTV Platform
LinkedTV Platform demo video https://vimeo.com/107047604 Further information & test access contact rolf.fricke@condat.de
9
www.linkedtv.eu
Annotation retrieval: Platform SPARQL endpoint and REST API
Survey of Semantic Media Annotation Tools for the Web:Towards new Media Applications with Linked Media
LinkedTV Platform SPARQL endpoint https://data.linkedtv.eu/sparql Further information & test access to add your own content:contact rolf.fricke@condat.de
10
www.linkedtv.eu
Examples
Annotate videos by chapter in the Editor Tool
Query the metadata on the LinkedTV Platform
Try out some media linking via DBPedia paths!
-----------------------------------------------------------------
Want more LinkedTV?
•http://showcase.linkedtv.eu•lyndon.nixon@modul.ac.at •@linkedtv