ICMR 2016 Multilingual Visual Sentiment...
1
Complura : Exploring and Leveraging a Large-scale Multilingual Visual Sentiment Ontology 1. Introduction Complura provides three major functions: (1) An interactive multilingual ontology browser. (2) A cross-lingual image-based sentiment analyzer. (3) A culturally-coherent, sentiment-sensitive image query expansion engine. 2. Ontology Organization S Ontology Structure ANP Detectors Hongyi Liu ∗† , Brendan Jou ∗† , Tao Chen ∗† , Mercan Topkara ∗‡ , Nikolaos Pappas ∗§ , Miriam Redi ∗¶ , Shih-Fu Chang † †Columbia University, New York, NY USA. ‡JW Player, New York, NY USA §Idiap Research Institute/EPFL, Martigny, Switzerland. ¶Yahoo, London, UK 3. System Overview 2). Sentiment Analysis Multilingual sentiment analysis using MVSO ANP detector banks 1). Ontology Browser Enables users to formulate hypothesis, choose controlled categories, and visualize image differences tagged with different languages 3). Query Expansion Image query expansion engine with cultural and sentiment coherence using the semantic structure and detectors MVSO Data Aggregation http://mvso.cs.columbia.edu/complura/ ICMR 2016 1 2 3
Transcript of ICMR 2016 Multilingual Visual Sentiment...
Complura : Exploring and Leveraging a Large-scale Multilingual Visual Sentiment Ontology
1. IntroductionComplura provides three major functions:
(1) An interactive multilingual ontology browser.
(2) A cross-lingual image-based sentiment analyzer.
(3) A culturally-coherent, sentiment-sensitive image
query expansion engine.
2. Ontology Organization
S
Ontology Structure ANP Detectors
Hongyi Liu∗†, Brendan Jou∗†, Tao Chen∗†, Mercan Topkara∗‡, Nikolaos Pappas∗§, Miriam Redi∗¶, Shih-Fu Chang†
†Columbia University, New York, NY USA. ‡JW Player, New York, NY USA§Idiap Research Institute/EPFL, Martigny, Switzerland. ¶Yahoo, London, UK
3. System Overview
2). Sentiment AnalysisMultilingual sentiment analysis using MVSO ANP detector banks
1). Ontology Browser Enables users to formulate hypothesis, choose controlled categories, and visualize image differences tagged with different languages
3). Query Expansion Image query expansion engine with cultural and sentiment coherence using the semantic structure and detectors
MVSO Data Aggregation
http://mvso.cs.columbia.edu/complura/
ICMR 2016
1 2 3
