Sirio, Orione and Pan: an Integrated Web System forOntology-based Video Search and Annotation

Marco Bertini, Gianpaolo D’Amico, Andrea Ferracani, Marco Meoni and Giuseppe Serra

Media Integration and Communication Center, University of Florence, Italy

Sirio & Orione: the search engine

The Sirio system is composed by three different search interfaces:

• Concept drag & drop interface to build composite queries with Boolean and temporal operators and visualexamples. A local view of the ontology graph allows to better understand how one concept is related to the others

•Natural language interface for simpler queries with Boolean/temporal operators

• Free-text interface for Google-like searches

The Orione search engine uses an ontology that has been created automatically from a flat lexicon, using WordNetto create concept relations. The ontology is modelled following the Dynamic Pictorially Enriched Ontology model

Pan: the annotation tool

The Pan video annotation system allows to browse videos, select concepts from an ontology structure, insert ormodify annotations and download previously saved annotations. Annotated videos are streamed through internet

• Ontologies can be imported and exported using the MPEG-7 or OWL formats, or created from scratch by users

• Annotations, managed by the Orione search engine, can be exported to both MPEG-7 and OWL ontology formats

• Annotations can be geotagged using Google Maps

Acknowledgments: This work was partially supported by the EU IST VidiVideo project (www.vidivideo.info - contract FP6-045547) and EU IST IM3I project(http://www.im3i.eu/ - contract FP7-222267). The authors thank Thomas M. Alisi and Nicola Martorana for their help in software development.

ACM Multimedia 2010 - DEMO Program http://www.micc.unifi.it/ {bertini, damico, ferracani, meoni, serra}@dsi.unifi.it