MediaEval 2016 - EUMSSI Team at the MediaEval Person Discovery Challenge
UPC at MediaEval Hyperlinking 2013
-
Upload
xavier-giro -
Category
Technology
-
view
187 -
download
1
description
Transcript of UPC at MediaEval Hyperlinking 2013
![Page 1: UPC at MediaEval Hyperlinking 2013](https://reader033.fdocuments.us/reader033/viewer/2022042816/55962a6a1a28ab2f358b456f/html5/thumbnails/1.jpg)
MediaEval HyperlinkingCarles Ventura
Marcel TellaXavier Giró-i-Nieto
Barcelona, Catalonia18th October 2013
![Page 2: UPC at MediaEval Hyperlinking 2013](https://reader033.fdocuments.us/reader033/viewer/2022042816/55962a6a1a28ab2f358b456f/html5/thumbnails/2.jpg)
Challenge
![Page 3: UPC at MediaEval Hyperlinking 2013](https://reader033.fdocuments.us/reader033/viewer/2022042816/55962a6a1a28ab2f358b456f/html5/thumbnails/3.jpg)
Visual Features
SURF descriptors[Bay et al, CVIU 2008]
![Page 4: UPC at MediaEval Hyperlinking 2013](https://reader033.fdocuments.us/reader033/viewer/2022042816/55962a6a1a28ab2f358b456f/html5/thumbnails/4.jpg)
Visual FeaturesBag of Features [Sivic & Zisserman, 2003]
Figure: Fergus, ICCV 2009
![Page 5: UPC at MediaEval Hyperlinking 2013](https://reader033.fdocuments.us/reader033/viewer/2022042816/55962a6a1a28ab2f358b456f/html5/thumbnails/5.jpg)
Visual FeaturesHistogram intersection
![Page 6: UPC at MediaEval Hyperlinking 2013](https://reader033.fdocuments.us/reader033/viewer/2022042816/55962a6a1a28ab2f358b456f/html5/thumbnails/6.jpg)
Approach
Anchor ContextContext
Query video
Shotboundaries
![Page 7: UPC at MediaEval Hyperlinking 2013](https://reader033.fdocuments.us/reader033/viewer/2022042816/55962a6a1a28ab2f358b456f/html5/thumbnails/7.jpg)
Approach
Keyframe 1 ranked list Keyframe 2 ranked list
... ...
![Page 8: UPC at MediaEval Hyperlinking 2013](https://reader033.fdocuments.us/reader033/viewer/2022042816/55962a6a1a28ab2f358b456f/html5/thumbnails/8.jpg)
Approach
Fused ranked list of keyframes
... ...
...
![Page 9: UPC at MediaEval Hyperlinking 2013](https://reader033.fdocuments.us/reader033/viewer/2022042816/55962a6a1a28ab2f358b456f/html5/thumbnails/9.jpg)
Approach
Linked segments
...
![Page 10: UPC at MediaEval Hyperlinking 2013](https://reader033.fdocuments.us/reader033/viewer/2022042816/55962a6a1a28ab2f358b456f/html5/thumbnails/10.jpg)
Results
MAP P@5 P@10 P@20
No context 0.0282 0.2600 0.2000 0.1233
Context 0.0260 0.2400 0.1967 0.1217
![Page 11: UPC at MediaEval Hyperlinking 2013](https://reader033.fdocuments.us/reader033/viewer/2022042816/55962a6a1a28ab2f358b456f/html5/thumbnails/11.jpg)
Conclusions
● First MediaEval participation completed.
● Visual alone is useful, but not enough.
● 1.2M keyframes is challenging, video is more.
● Visual performance can be improved with:○ spatial coding○ larger vocabulary○ face / concept detectors
![Page 12: UPC at MediaEval Hyperlinking 2013](https://reader033.fdocuments.us/reader033/viewer/2022042816/55962a6a1a28ab2f358b456f/html5/thumbnails/12.jpg)
Poster