CrowdSearch: Exploiting Crowds for Accurate Real-time Image Search on Mobile Phones Original work by...
-
Upload
lesley-mccormack -
Category
Documents
-
view
215 -
download
1
Transcript of CrowdSearch: Exploiting Crowds for Accurate Real-time Image Search on Mobile Phones Original work by...
![Page 1: CrowdSearch: Exploiting Crowds for Accurate Real-time Image Search on Mobile Phones Original work by Yan, Kumar & Ganesan Presented by Shibo Li & Jian.](https://reader035.fdocuments.us/reader035/viewer/2022062712/56649ca25503460f949617fc/html5/thumbnails/1.jpg)
CrowdSearch: Exploiting Crowds for Accurate Real-time Image Search on Mobile Phones
Original work by Yan, Kumar & GanesanPresented by Shibo Li & Jian Yu
![Page 2: CrowdSearch: Exploiting Crowds for Accurate Real-time Image Search on Mobile Phones Original work by Yan, Kumar & Ganesan Presented by Shibo Li & Jian.](https://reader035.fdocuments.us/reader035/viewer/2022062712/56649ca25503460f949617fc/html5/thumbnails/2.jpg)
2
Problem Definition
• How to search information?
![Page 3: CrowdSearch: Exploiting Crowds for Accurate Real-time Image Search on Mobile Phones Original work by Yan, Kumar & Ganesan Presented by Shibo Li & Jian.](https://reader035.fdocuments.us/reader035/viewer/2022062712/56649ca25503460f949617fc/html5/thumbnails/3.jpg)
3
Problem Definition
• Mobile-based search will become more important in the future.– More than 70% of smart phone users perform searches.
• Expected to be more mobile searches than non-mobile searches soon
– Text-based mobile searches are easy as well…
• What about searching images?
![Page 4: CrowdSearch: Exploiting Crowds for Accurate Real-time Image Search on Mobile Phones Original work by Yan, Kumar & Ganesan Presented by Shibo Li & Jian.](https://reader035.fdocuments.us/reader035/viewer/2022062712/56649ca25503460f949617fc/html5/thumbnails/4.jpg)
4
Problem Definition
• Image search using mobile phones
![Page 5: CrowdSearch: Exploiting Crowds for Accurate Real-time Image Search on Mobile Phones Original work by Yan, Kumar & Ganesan Presented by Shibo Li & Jian.](https://reader035.fdocuments.us/reader035/viewer/2022062712/56649ca25503460f949617fc/html5/thumbnails/5.jpg)
5
Problem Definition
• Automatic searching
![Page 6: CrowdSearch: Exploiting Crowds for Accurate Real-time Image Search on Mobile Phones Original work by Yan, Kumar & Ganesan Presented by Shibo Li & Jian.](https://reader035.fdocuments.us/reader035/viewer/2022062712/56649ca25503460f949617fc/html5/thumbnails/6.jpg)
6
Idea
• Image searching based on crowd source.
CrowdSearch Algorithm
![Page 7: CrowdSearch: Exploiting Crowds for Accurate Real-time Image Search on Mobile Phones Original work by Yan, Kumar & Ganesan Presented by Shibo Li & Jian.](https://reader035.fdocuments.us/reader035/viewer/2022062712/56649ca25503460f949617fc/html5/thumbnails/7.jpg)
7
Challenges
• Automatic image search: – Delay↓, Cost ↓, Accuracy ↓
• People validation image search:– Delay ↑, Cost ↑, Accuracy ↑
![Page 8: CrowdSearch: Exploiting Crowds for Accurate Real-time Image Search on Mobile Phones Original work by Yan, Kumar & Ganesan Presented by Shibo Li & Jian.](https://reader035.fdocuments.us/reader035/viewer/2022062712/56649ca25503460f949617fc/html5/thumbnails/8.jpg)
8
CrowdSearch Algorithm
Overview
Implementation & Evaluations
Throughts & Criticisms
![Page 9: CrowdSearch: Exploiting Crowds for Accurate Real-time Image Search on Mobile Phones Original work by Yan, Kumar & Ganesan Presented by Shibo Li & Jian.](https://reader035.fdocuments.us/reader035/viewer/2022062712/56649ca25503460f949617fc/html5/thumbnails/9.jpg)
9
CrowdSearch: Overview
![Page 10: CrowdSearch: Exploiting Crowds for Accurate Real-time Image Search on Mobile Phones Original work by Yan, Kumar & Ganesan Presented by Shibo Li & Jian.](https://reader035.fdocuments.us/reader035/viewer/2022062712/56649ca25503460f949617fc/html5/thumbnails/10.jpg)
10
CrowdSearch: Overview
![Page 11: CrowdSearch: Exploiting Crowds for Accurate Real-time Image Search on Mobile Phones Original work by Yan, Kumar & Ganesan Presented by Shibo Li & Jian.](https://reader035.fdocuments.us/reader035/viewer/2022062712/56649ca25503460f949617fc/html5/thumbnails/11.jpg)
11
CrowdSearch: Overview
![Page 12: CrowdSearch: Exploiting Crowds for Accurate Real-time Image Search on Mobile Phones Original work by Yan, Kumar & Ganesan Presented by Shibo Li & Jian.](https://reader035.fdocuments.us/reader035/viewer/2022062712/56649ca25503460f949617fc/html5/thumbnails/12.jpg)
12
CrowdSearch: Overview
![Page 13: CrowdSearch: Exploiting Crowds for Accurate Real-time Image Search on Mobile Phones Original work by Yan, Kumar & Ganesan Presented by Shibo Li & Jian.](https://reader035.fdocuments.us/reader035/viewer/2022062712/56649ca25503460f949617fc/html5/thumbnails/13.jpg)
13
CrowdSearch: Overview
![Page 14: CrowdSearch: Exploiting Crowds for Accurate Real-time Image Search on Mobile Phones Original work by Yan, Kumar & Ganesan Presented by Shibo Li & Jian.](https://reader035.fdocuments.us/reader035/viewer/2022062712/56649ca25503460f949617fc/html5/thumbnails/14.jpg)
14
Challenge: Accuracy
![Page 15: CrowdSearch: Exploiting Crowds for Accurate Real-time Image Search on Mobile Phones Original work by Yan, Kumar & Ganesan Presented by Shibo Li & Jian.](https://reader035.fdocuments.us/reader035/viewer/2022062712/56649ca25503460f949617fc/html5/thumbnails/15.jpg)
15
Challenge: Accuracy
• Human validation improves accuracy 2-5 times.
• Majority(5) can achieve the highest accuracy up to 95%
So we send each image to 5 people to get the majority feedback.
![Page 16: CrowdSearch: Exploiting Crowds for Accurate Real-time Image Search on Mobile Phones Original work by Yan, Kumar & Ganesan Presented by Shibo Li & Jian.](https://reader035.fdocuments.us/reader035/viewer/2022062712/56649ca25503460f949617fc/html5/thumbnails/16.jpg)
16
Challenge: Delay & Cost tradeoff
![Page 17: CrowdSearch: Exploiting Crowds for Accurate Real-time Image Search on Mobile Phones Original work by Yan, Kumar & Ganesan Presented by Shibo Li & Jian.](https://reader035.fdocuments.us/reader035/viewer/2022062712/56649ca25503460f949617fc/html5/thumbnails/17.jpg)
17
Challenge: Delay & Cost tradeoff
• Parallel Scheme
![Page 18: CrowdSearch: Exploiting Crowds for Accurate Real-time Image Search on Mobile Phones Original work by Yan, Kumar & Ganesan Presented by Shibo Li & Jian.](https://reader035.fdocuments.us/reader035/viewer/2022062712/56649ca25503460f949617fc/html5/thumbnails/18.jpg)
18
Challenge: Delay & Cost tradeoff
• Serial Scheme
![Page 19: CrowdSearch: Exploiting Crowds for Accurate Real-time Image Search on Mobile Phones Original work by Yan, Kumar & Ganesan Presented by Shibo Li & Jian.](https://reader035.fdocuments.us/reader035/viewer/2022062712/56649ca25503460f949617fc/html5/thumbnails/19.jpg)
19
CrowdSearch: compromised scheme
![Page 20: CrowdSearch: Exploiting Crowds for Accurate Real-time Image Search on Mobile Phones Original work by Yan, Kumar & Ganesan Presented by Shibo Li & Jian.](https://reader035.fdocuments.us/reader035/viewer/2022062712/56649ca25503460f949617fc/html5/thumbnails/20.jpg)
20
CrowdSearch: compromised scheme
• Prediction requires delay and accuracy models
![Page 21: CrowdSearch: Exploiting Crowds for Accurate Real-time Image Search on Mobile Phones Original work by Yan, Kumar & Ganesan Presented by Shibo Li & Jian.](https://reader035.fdocuments.us/reader035/viewer/2022062712/56649ca25503460f949617fc/html5/thumbnails/21.jpg)
21
Delay Model
• Statistically, both of the delays follow the exponential distribution.
• Overall delay distribution is the convolution of the acceptance and submission delay.
![Page 22: CrowdSearch: Exploiting Crowds for Accurate Real-time Image Search on Mobile Phones Original work by Yan, Kumar & Ganesan Presented by Shibo Li & Jian.](https://reader035.fdocuments.us/reader035/viewer/2022062712/56649ca25503460f949617fc/html5/thumbnails/22.jpg)
22
Delay Prediction
![Page 23: CrowdSearch: Exploiting Crowds for Accurate Real-time Image Search on Mobile Phones Original work by Yan, Kumar & Ganesan Presented by Shibo Li & Jian.](https://reader035.fdocuments.us/reader035/viewer/2022062712/56649ca25503460f949617fc/html5/thumbnails/23.jpg)
23
Accuracy Prediction
![Page 24: CrowdSearch: Exploiting Crowds for Accurate Real-time Image Search on Mobile Phones Original work by Yan, Kumar & Ganesan Presented by Shibo Li & Jian.](https://reader035.fdocuments.us/reader035/viewer/2022062712/56649ca25503460f949617fc/html5/thumbnails/24.jpg)
24
Decision Engine
![Page 25: CrowdSearch: Exploiting Crowds for Accurate Real-time Image Search on Mobile Phones Original work by Yan, Kumar & Ganesan Presented by Shibo Li & Jian.](https://reader035.fdocuments.us/reader035/viewer/2022062712/56649ca25503460f949617fc/html5/thumbnails/25.jpg)
25
Overview
Implementation & Evaluations
Throughts & Criticisms
![Page 26: CrowdSearch: Exploiting Crowds for Accurate Real-time Image Search on Mobile Phones Original work by Yan, Kumar & Ganesan Presented by Shibo Li & Jian.](https://reader035.fdocuments.us/reader035/viewer/2022062712/56649ca25503460f949617fc/html5/thumbnails/26.jpg)
26
Implementation
![Page 27: CrowdSearch: Exploiting Crowds for Accurate Real-time Image Search on Mobile Phones Original work by Yan, Kumar & Ganesan Presented by Shibo Li & Jian.](https://reader035.fdocuments.us/reader035/viewer/2022062712/56649ca25503460f949617fc/html5/thumbnails/27.jpg)
27
Power Consideration
• Should some image processing occur on the local device or should it be outsourced to the server?
– Use remoteprocessing when WiFi is available.
– Use local processingwhen only 3G is available
![Page 28: CrowdSearch: Exploiting Crowds for Accurate Real-time Image Search on Mobile Phones Original work by Yan, Kumar & Ganesan Presented by Shibo Li & Jian.](https://reader035.fdocuments.us/reader035/viewer/2022062712/56649ca25503460f949617fc/html5/thumbnails/28.jpg)
28
Evaluation
• Delay model meets the exponential distribution
![Page 29: CrowdSearch: Exploiting Crowds for Accurate Real-time Image Search on Mobile Phones Original work by Yan, Kumar & Ganesan Presented by Shibo Li & Jian.](https://reader035.fdocuments.us/reader035/viewer/2022062712/56649ca25503460f949617fc/html5/thumbnails/29.jpg)
29
CrowdSearch Performance
CrowdSearch optimized algorithm
![Page 30: CrowdSearch: Exploiting Crowds for Accurate Real-time Image Search on Mobile Phones Original work by Yan, Kumar & Ganesan Presented by Shibo Li & Jian.](https://reader035.fdocuments.us/reader035/viewer/2022062712/56649ca25503460f949617fc/html5/thumbnails/30.jpg)
30
Overview
Implementation & Evaluations
Throughts & Criticisms
![Page 31: CrowdSearch: Exploiting Crowds for Accurate Real-time Image Search on Mobile Phones Original work by Yan, Kumar & Ganesan Presented by Shibo Li & Jian.](https://reader035.fdocuments.us/reader035/viewer/2022062712/56649ca25503460f949617fc/html5/thumbnails/31.jpg)
31
Thoughts/Criticism
• Only 1000 images in the backend database.– Would increasing the number of automated search images increase
total task time in a significant way?
• The evaluation only based on 4 categories.– Buildings, Books, Flowers and Faces
• Suggestion:• Internet database• Let the user to choose the categories
• Too many distractions in a single image
![Page 32: CrowdSearch: Exploiting Crowds for Accurate Real-time Image Search on Mobile Phones Original work by Yan, Kumar & Ganesan Presented by Shibo Li & Jian.](https://reader035.fdocuments.us/reader035/viewer/2022062712/56649ca25503460f949617fc/html5/thumbnails/32.jpg)
32
Thoughts/Criticism
• Too many disturbances in a single image
![Page 33: CrowdSearch: Exploiting Crowds for Accurate Real-time Image Search on Mobile Phones Original work by Yan, Kumar & Ganesan Presented by Shibo Li & Jian.](https://reader035.fdocuments.us/reader035/viewer/2022062712/56649ca25503460f949617fc/html5/thumbnails/33.jpg)
33
Q&A
Thank you!