Information Technologies InstituteCentre for Research and Technology Hellas

Video Hyperlinking

Part A: Motivation and Vision

Vasileios MezarisInformation Technologies Institute (ITI)

Centre for Research and Technology Hellas (CERTH)

Benoit HuetEURECOM

IEEE ICIP’14 Tutorial, Oct. 2014ACM MM’14 Tutorial, Nov. 2014

1.2Information Technologies InstituteCentre for Research and Technology Hellas

Overview

• Part A: Motivation and Vision

• Part B: Video Fragment Creation and Annotation for Hyperlinking

• Part C: Insights into Hyperlinking Video Content

• Concluding remarks

1.3Information Technologies InstituteCentre for Research and Technology Hellas

Supporting Projects (1/2)

• LinkedTV: Linking Television to Web content, FP7 ICT IP, 2011-2015

• Second screen scenarios for enriching television content enriching television content and achieving interactioninteraction between user and content

1.4Information Technologies InstituteCentre for Research and Technology Hellas

Supporting Projects (2/2)

• MediaMixer: Community set-up and networking for the remixing of online media online media fragmentsfragments, FP7 ICT CSA, 2012-2014

• Promoting technologies enabling easier media easier media content access and content access and repurposingrepurposing

• Focus on Media Fragments

1.5Information Technologies InstituteCentre for Research and Technology Hellas

Audio-Visual Explosion

• EU alone hosts 500+ online video platforms• 42.7m hrs of footage in online archives of broadcasters

and producers (61% of archive footage is online)• UGC on the advance:

– YouTube receives 100 hrs of video/minute– Vine and Instagram video

• Internet video is now 40 percent of consumer Internet traffic, and will reach 62 percent by the end of 2015, 75% in 2017(source: CISCO)

•• How to make the content accessibleHow to make the content accessible?– Browsing, Searching, HyperlinkingHyperlinking

1.6Information Technologies InstituteCentre for Research and Technology Hellas

Search

• Efficient and Effective Search techniques for Textual Information (i.e. Google Page Rank)

• What about Multimedia Documents?Audio-Visual and Beyond

– Much work on Audio (Fingerprint/ASR)– Two decades of work on Content-Based Image

Search– Little work on MultiMultimedia

1.7Information Technologies InstituteCentre for Research and Technology Hellas

Defining Hyperlinking

• Linking multimedia documents with related contentrelated content

1.8Information Technologies InstituteCentre for Research and Technology Hellas

Defining Hyperlinking

• Linking multimedia documents with related contentrelated content

1.9Information Technologies InstituteCentre for Research and Technology Hellas

Hyperlinking in practice

• Linking multimedia documents with related content

• Automatic Hyperlink Creation– Different from Search (no user query)– Query automatically crafted from source document

content

• Outreach– Recommendation system– Second screen applications

1.10Information Technologies InstituteCentre for Research and Technology Hellas

Video Analysis for Hyperlinking

• Extracting meaningful information for hyperlinking– Video segmentation– Video analysis

1.11Information Technologies InstituteCentre for Research and Technology Hellas

Video Hyperlinking tutorial continued

• Video Hyperlinking Part B: Video Fragment Creation and Annotation for Hyperlinking:http://www.slideshare.net/linkedtv/video-hyperlinking-tutorialpartb

• Video Hyperlinking Part C: Insights into Hyperlinking Video Content:http://www.slideshare.net/linkedtv/video-hyperlinking-tutorial-part-c