Internet Resources Discovery (IRD)
description
Transcript of Internet Resources Discovery (IRD)
![Page 1: Internet Resources Discovery (IRD)](https://reader035.fdocuments.us/reader035/viewer/2022062521/568149e9550346895db7133c/html5/thumbnails/1.jpg)
Internet Resources Discovery (IRD)
Meta-Search Engines (MSEs)
![Page 2: Internet Resources Discovery (IRD)](https://reader035.fdocuments.us/reader035/viewer/2022062521/568149e9550346895db7133c/html5/thumbnails/2.jpg)
T.Sharon-A.Frank2
Contents• Meta Search Engine (MSE)• Why use several SEs?• Highlighted MSEs• Hebrew MSEs• MSE comparison• When to use MSE – pros and cons• How to choose MSE?
![Page 3: Internet Resources Discovery (IRD)](https://reader035.fdocuments.us/reader035/viewer/2022062521/568149e9550346895db7133c/html5/thumbnails/3.jpg)
T.Sharon-A.Frank3
Search Engines Generations
• 1st Generation - Basic SEs:
• 2nd Generation - Meta SEs:
• 3rd Generation - Popularity SEs:
![Page 4: Internet Resources Discovery (IRD)](https://reader035.fdocuments.us/reader035/viewer/2022062521/568149e9550346895db7133c/html5/thumbnails/4.jpg)
T.Sharon-A.Frank4
2nd Generation SEs - MetaSEs• Using several SEs in parallel.• The results are filtered, ranked and
presented to the user as a uniformed list.• The ranking is a combination of the
number of sources each page appeared in, and the ranking in each source.
![Page 5: Internet Resources Discovery (IRD)](https://reader035.fdocuments.us/reader035/viewer/2022062521/568149e9550346895db7133c/html5/thumbnails/5.jpg)
T.Sharon-A.Frank5
Meta SE is a Meta-Service• It doesn’t use an Index/database of its
own.• It uses other external search services that
provide the information necessary to fulfill user queries.
![Page 6: Internet Resources Discovery (IRD)](https://reader035.fdocuments.us/reader035/viewer/2022062521/568149e9550346895db7133c/html5/thumbnails/6.jpg)
T.Sharon-A.Frank6
Meta Search Engine
MetaCrawler
Yahoo Web Crawler Open Text Lycos InfoSeek Inktomi Galaxy Excite
Google · Yahoo · Jeeves Ask About · LookSmart · OvertureFindWhat
![Page 7: Internet Resources Discovery (IRD)](https://reader035.fdocuments.us/reader035/viewer/2022062521/568149e9550346895db7133c/html5/thumbnails/7.jpg)
T.Sharon-A.Frank7
Premises of a Meta SE
• No single search is sufficient.• Problem in expressing the query.• Low quality references can be detected.
![Page 8: Internet Resources Discovery (IRD)](https://reader035.fdocuments.us/reader035/viewer/2022062521/568149e9550346895db7133c/html5/thumbnails/8.jpg)
T.Sharon-A.Frank8
Why use Several SEs?• Search Engines differ more than we think!
![Page 9: Internet Resources Discovery (IRD)](https://reader035.fdocuments.us/reader035/viewer/2022062521/568149e9550346895db7133c/html5/thumbnails/9.jpg)
T.Sharon-A.Frank9
Overlap between Google and Yahoo
Source: Jux2 analysis of 500 top search terms, April 2004http://www.jux2.com/stats.php
![Page 10: Internet Resources Discovery (IRD)](https://reader035.fdocuments.us/reader035/viewer/2022062521/568149e9550346895db7133c/html5/thumbnails/10.jpg)
T.Sharon-A.Frank10
Who Overlaps Whom?
![Page 11: Internet Resources Discovery (IRD)](https://reader035.fdocuments.us/reader035/viewer/2022062521/568149e9550346895db7133c/html5/thumbnails/11.jpg)
T.Sharon-A.Frank11
Try it yourself @ jux2
![Page 12: Internet Resources Discovery (IRD)](https://reader035.fdocuments.us/reader035/viewer/2022062521/568149e9550346895db7133c/html5/thumbnails/12.jpg)
T.Sharon-A.Frank12
MSE - Motivation
1. The number and variety of SEs.2. Each SE provides an incomplete snapshot of Web.3. Users are forced to try and retry their queries across
different SEs.4. Each SE has its own interface.5. Irrelevant, outdated or unavailable responses.6. Each query is independent.7. No individual customization.8. The result is not homogenized.
![Page 13: Internet Resources Discovery (IRD)](https://reader035.fdocuments.us/reader035/viewer/2022062521/568149e9550346895db7133c/html5/thumbnails/13.jpg)
T.Sharon-A.Frank13
Problems of MSEs• No advanced search options.• Using the lowest common denominator.• Sponsored results from the SEs are not
highlighted.
![Page 14: Internet Resources Discovery (IRD)](https://reader035.fdocuments.us/reader035/viewer/2022062521/568149e9550346895db7133c/html5/thumbnails/14.jpg)
T.Sharon-A.Frank14
Highlighted MSEs
![Page 15: Internet Resources Discovery (IRD)](https://reader035.fdocuments.us/reader035/viewer/2022062521/568149e9550346895db7133c/html5/thumbnails/15.jpg)
T.Sharon-A.Frank15
Mamma
![Page 16: Internet Resources Discovery (IRD)](https://reader035.fdocuments.us/reader035/viewer/2022062521/568149e9550346895db7133c/html5/thumbnails/16.jpg)
T.Sharon-A.Frank16
Dogpile
![Page 17: Internet Resources Discovery (IRD)](https://reader035.fdocuments.us/reader035/viewer/2022062521/568149e9550346895db7133c/html5/thumbnails/17.jpg)
T.Sharon-A.Frank17
Dogpile Advanced (1)
![Page 18: Internet Resources Discovery (IRD)](https://reader035.fdocuments.us/reader035/viewer/2022062521/568149e9550346895db7133c/html5/thumbnails/18.jpg)
T.Sharon-A.Frank18
Dogpile Advanced (2)
![Page 19: Internet Resources Discovery (IRD)](https://reader035.fdocuments.us/reader035/viewer/2022062521/568149e9550346895db7133c/html5/thumbnails/19.jpg)
T.Sharon-A.Frank19
Dogpile Advanced (3)
![Page 20: Internet Resources Discovery (IRD)](https://reader035.fdocuments.us/reader035/viewer/2022062521/568149e9550346895db7133c/html5/thumbnails/20.jpg)
T.Sharon-A.Frank20
Dogpile Advanced (4)
![Page 21: Internet Resources Discovery (IRD)](https://reader035.fdocuments.us/reader035/viewer/2022062521/568149e9550346895db7133c/html5/thumbnails/21.jpg)
T.Sharon-A.Frank21
Dogpile Preferences (1)
![Page 22: Internet Resources Discovery (IRD)](https://reader035.fdocuments.us/reader035/viewer/2022062521/568149e9550346895db7133c/html5/thumbnails/22.jpg)
T.Sharon-A.Frank22
Dogpile Preferences (2)
![Page 23: Internet Resources Discovery (IRD)](https://reader035.fdocuments.us/reader035/viewer/2022062521/568149e9550346895db7133c/html5/thumbnails/23.jpg)
T.Sharon-A.Frank23
Vivisimo• Vivísimo supports the most advanced features
of the major search engines.• Need to just use Vivísimo syntax, which
follows the most standard conventions. • Vivísimo translates your query into the
corresponding syntax of each underlying search engine.
• Also, Vivísimo only queries the search engines that support your chosen syntax.
![Page 24: Internet Resources Discovery (IRD)](https://reader035.fdocuments.us/reader035/viewer/2022062521/568149e9550346895db7133c/html5/thumbnails/24.jpg)
T.Sharon-A.Frank24
Vivisimo Advanced (1)
![Page 25: Internet Resources Discovery (IRD)](https://reader035.fdocuments.us/reader035/viewer/2022062521/568149e9550346895db7133c/html5/thumbnails/25.jpg)
T.Sharon-A.Frank25
Vivisimo Advanced (2)
![Page 26: Internet Resources Discovery (IRD)](https://reader035.fdocuments.us/reader035/viewer/2022062521/568149e9550346895db7133c/html5/thumbnails/26.jpg)
T.Sharon-A.Frank26
Clusty
![Page 27: Internet Resources Discovery (IRD)](https://reader035.fdocuments.us/reader035/viewer/2022062521/568149e9550346895db7133c/html5/thumbnails/27.jpg)
T.Sharon-A.Frank27
Ixquick (1)
![Page 28: Internet Resources Discovery (IRD)](https://reader035.fdocuments.us/reader035/viewer/2022062521/568149e9550346895db7133c/html5/thumbnails/28.jpg)
T.Sharon-A.Frank28
Ixquick (2)
![Page 29: Internet Resources Discovery (IRD)](https://reader035.fdocuments.us/reader035/viewer/2022062521/568149e9550346895db7133c/html5/thumbnails/29.jpg)
T.Sharon-A.Frank29
Ixquick (3)
![Page 30: Internet Resources Discovery (IRD)](https://reader035.fdocuments.us/reader035/viewer/2022062521/568149e9550346895db7133c/html5/thumbnails/30.jpg)
T.Sharon-A.Frank30
KartOO – Visual MSE
![Page 31: Internet Resources Discovery (IRD)](https://reader035.fdocuments.us/reader035/viewer/2022062521/568149e9550346895db7133c/html5/thumbnails/31.jpg)
T.Sharon-A.Frank31
MetaSEs in Hebrew
![Page 32: Internet Resources Discovery (IRD)](https://reader035.fdocuments.us/reader035/viewer/2022062521/568149e9550346895db7133c/html5/thumbnails/32.jpg)
T.Sharon-A.Frank32
When to use a MSE?• When single Basic-SE fails to provide good
results. • One-stop shopping - prefer to search multiple
SEs/sites at once to get blended ranked results (so as to save effort/time).
• Searching for multi-faceted topics. • Want to get clustered results to focus search
on the relevant keywords. • Looking for current events/news.
![Page 33: Internet Resources Discovery (IRD)](https://reader035.fdocuments.us/reader035/viewer/2022062521/568149e9550346895db7133c/html5/thumbnails/33.jpg)
T.Sharon-A.Frank33
MSE pros• Useful when you want to retrieve a relatively
small number of relevant results. • An excellent choice for obscure topics. • A good option when you are not having luck
finding what you want when you search. • Appropriate when you want to get an overall
picture of what is available on the Web on your topic.
![Page 34: Internet Resources Discovery (IRD)](https://reader035.fdocuments.us/reader035/viewer/2022062521/568149e9550346895db7133c/html5/thumbnails/34.jpg)
T.Sharon-A.Frank34
MSE cons• Use is limited primarily to simple queries. • Little or no field searching is available. • Most services return a limited number of results
that do not represent the total results from any source engine.
• Sponsored results are not highlighted (even though probably not first).
![Page 35: Internet Resources Discovery (IRD)](https://reader035.fdocuments.us/reader035/viewer/2022062521/568149e9550346895db7133c/html5/thumbnails/35.jpg)
T.Sharon-A.Frank35
How to Choose your MetaSE
• Search engines used• Operators supported• Special features• Speed• Presentation
![Page 36: Internet Resources Discovery (IRD)](https://reader035.fdocuments.us/reader035/viewer/2022062521/568149e9550346895db7133c/html5/thumbnails/36.jpg)
T.Sharon-A.Frank36
Meta-SEs Features Chart
Red – not working
![Page 37: Internet Resources Discovery (IRD)](https://reader035.fdocuments.us/reader035/viewer/2022062521/568149e9550346895db7133c/html5/thumbnails/37.jpg)
T.Sharon-A.Frank37
Practical RecommendationsUse Ixquick for fast results and maximal
syntax flexibility.Use Vivisimo/Clusty (as a start) for
Clustering and/or Hebrew.Use Dogpile to include Google, date
range, or spelling corrections.Use none for non-MSE tasks
(see MSE cons)…
![Page 38: Internet Resources Discovery (IRD)](https://reader035.fdocuments.us/reader035/viewer/2022062521/568149e9550346895db7133c/html5/thumbnails/38.jpg)
T.Sharon-A.Frank38
Bibliography• http://www.cs.washington.edu/homes/etzioni/papers/m
etacrawler.pdf• http://www.cs.washington.edu/homes/etzioni/papers/ie
ee-metacrawler.pdf• http://searchenginewatch.com/links/article.php/2156241• http://vivisimo.com/advanced?form=Advanced• http://vivisimo.com/help.html• http://searchenginewatch.com/searchday/article.php/
2226841