Keyword Search over Relational Databases: A Metadata Approach
Metadata for video search: Trouvaille
-
Upload
vrt-medialab -
Category
Technology
-
view
2.244 -
download
2
description
Transcript of Metadata for video search: Trouvaille
6 maart 2009
Metadata for video searchTrouvaille
Karel Braeckman
VRT-medialab: onderzoek en innovatie2
Overview
Challenges
Example situation
Search and annotation Search: Trouvaille
– Sources– Demo
Annotation– Problems– Demo
VRT-medialab: onderzoek en innovatie3
Challenges
Indexing and retrieving video material Growing database of video material But video is not self-descriptive → metadata Annotation: assist archivist with modern tools
– Feature extraction– Timecoded attributes
Search: User-friendly application to search through the archive
VRT-medialab: onderzoek en innovatie4
Example: situation at VRT
Search results
Search And Annotation
VRT-medialab: onderzoek en innovatie5
Example: situation at VRT
Annotation and search with Basisplus Basisplus database contains 625 000 items 65 fields (tfw, dienst, formaat, personen, …) Some fields should be chosen from controlled list:
the VRT video thesaurus– Some hierarchy:
‘lead’, ‘broad’ / ‘narrow’ and ‘use for’ terms– More than 300 000 lead terms
VRT-medialab: onderzoek en innovatie6
Basisplus limitations
Annotation by archivist- Knowledge of all fields and thesaurus- Familiar with annotation process
But a program maker- Does not know in what field to type- Might use a different term, not contained in the thesaurus- Textual results → limited representation of video
VRT-medialab: onderzoek en innovatie7
The ideal search application
We want all relevant search results
Without any false positives→ In practice a balance between the two
User friendly
Clear list of results
Find desired result fast
Jump to relevant part in video Time coded metadata
VRT-medialab: onderzoek en innovatie8
Sources used for Trouvaille
Media AssetManagement
System(Ardome)
Current metadata archive(Basisplus)
News broadcasts(Ardome)
News feed
+ VRT video-Thesaurus+ List of Belgian cities
VRT-medialab: onderzoek en innovatie9
Trouvaille Demo
VRT-medialab: onderzoek en innovatie10
Annotation
Manual annotation is a lot of work → assist archivist withmodern tools
– Annotate efficiently– As much automation as possible
Need for time coded metadata Metadata describes the complete video item Time codes could mark the time range on which the metadata
applies.
A lot of metadata is lost during production process Teletext subtitles News rundown Scripts with shots / scenes and their contents
VRT-medialab: onderzoek en innovatie11
annotation
VRT-medialab: onderzoek en innovatie12
annotation
Assist archivist by partial automation Split video in shots, audio segments, scenes
– Archivist can easily add time coded metadata to a scene– Relevant thumbnail for every shot
Detection, even recognition of faces
VRT-medialab: onderzoek en innovatie13
annotation
Assist archivist by partial automation Split video in shots, audio segments, scenes Detection, even recognition of faces Detect reuse and duplicates
VRT-medialab: onderzoek en innovatie14
Conclusions
New search interface Trouvaille User friendly Get desired result fast Range of views
Result is a complete item in Trouvaille Annotation with time coded metadata (per scene) Search results should use this time codes
VRT-medialab: onderzoek en innovatie15
Conclusions
Annotation application Partial automation → efficient annotation Time coded metadata
Too often reverse engineering of metadata that wasreadily available at some stage during production process