AUTOMATIC ANNOTATION OF GEO-INFORMATION IN PANORAMIC STREET VIEW BY IMAGE RETRIEVAL Ming Chen,...
-
Upload
merilyn-waters -
Category
Documents
-
view
216 -
download
2
Transcript of AUTOMATIC ANNOTATION OF GEO-INFORMATION IN PANORAMIC STREET VIEW BY IMAGE RETRIEVAL Ming Chen,...
![Page 1: AUTOMATIC ANNOTATION OF GEO-INFORMATION IN PANORAMIC STREET VIEW BY IMAGE RETRIEVAL Ming Chen, Yueting Zhuang, Fei Wu College of Computer Science, Zhejiang.](https://reader036.fdocuments.us/reader036/viewer/2022062516/56649e535503460f94b49410/html5/thumbnails/1.jpg)
AUTOMATIC ANNOTATION OF GEO-INFORMATION IN PANORAMIC STREET VIEW BY IMAGE RETRIEVAL
Ming Chen, Yueting Zhuang, Fei WuCollege of Computer Science, Zhejiang University
ICIP 2010
![Page 2: AUTOMATIC ANNOTATION OF GEO-INFORMATION IN PANORAMIC STREET VIEW BY IMAGE RETRIEVAL Ming Chen, Yueting Zhuang, Fei Wu College of Computer Science, Zhejiang.](https://reader036.fdocuments.us/reader036/viewer/2022062516/56649e535503460f94b49410/html5/thumbnails/2.jpg)
Motivation
• Recently, some geo-tagged photos have been added into street view as additional illustration images for the same scenes.
• But the quality of annotated location is very poor. In this paper, we propose a system to annotate the location tags of users’ images in panoramic street view only with visual features.
![Page 3: AUTOMATIC ANNOTATION OF GEO-INFORMATION IN PANORAMIC STREET VIEW BY IMAGE RETRIEVAL Ming Chen, Yueting Zhuang, Fei Wu College of Computer Science, Zhejiang.](https://reader036.fdocuments.us/reader036/viewer/2022062516/56649e535503460f94b49410/html5/thumbnails/3.jpg)
System Overview
![Page 4: AUTOMATIC ANNOTATION OF GEO-INFORMATION IN PANORAMIC STREET VIEW BY IMAGE RETRIEVAL Ming Chen, Yueting Zhuang, Fei Wu College of Computer Science, Zhejiang.](https://reader036.fdocuments.us/reader036/viewer/2022062516/56649e535503460f94b49410/html5/thumbnails/4.jpg)
Coordinate Transformation
• A panoramic image is often projected to a spherical surface in order to show users a photo-realistic interactive virtual experience.
![Page 5: AUTOMATIC ANNOTATION OF GEO-INFORMATION IN PANORAMIC STREET VIEW BY IMAGE RETRIEVAL Ming Chen, Yueting Zhuang, Fei Wu College of Computer Science, Zhejiang.](https://reader036.fdocuments.us/reader036/viewer/2022062516/56649e535503460f94b49410/html5/thumbnails/5.jpg)
Key Points Extraction
• We use the conventional method of motion detection to remove the moving regions of foreground.
• After the objects are removed, we extracted the key points in all panoramic images using SIFT features, which are invariant to image scale and rotation.
• The SIFT descriptors are quantized into visual key words in order to reduce the computational cost of matching.
![Page 6: AUTOMATIC ANNOTATION OF GEO-INFORMATION IN PANORAMIC STREET VIEW BY IMAGE RETRIEVAL Ming Chen, Yueting Zhuang, Fei Wu College of Computer Science, Zhejiang.](https://reader036.fdocuments.us/reader036/viewer/2022062516/56649e535503460f94b49410/html5/thumbnails/6.jpg)
Image Retrieval
• We use hierarchical K-means to obtain visual words from a training set of 20000 images. Locality-sensitive hashing is used to index these visual words.
• Given a query image, each bundling feature can be retrieved in the database after they have been extracted.
• We can get candidate subset after query images. Then we rank the candidate images by the frequency of its appearance.
![Page 7: AUTOMATIC ANNOTATION OF GEO-INFORMATION IN PANORAMIC STREET VIEW BY IMAGE RETRIEVAL Ming Chen, Yueting Zhuang, Fei Wu College of Computer Science, Zhejiang.](https://reader036.fdocuments.us/reader036/viewer/2022062516/56649e535503460f94b49410/html5/thumbnails/7.jpg)
Result