Anatomy of Commercial CLIR...
Transcript of Anatomy of Commercial CLIR...
![Page 1: Anatomy of Commercial CLIR Applicationsclef.isti.cnr.it/workshop2002/presentations/com-clir.pdfPartial Survey of CLIR Systems Fully Functional Partially Functional Non-Commercial Commercial](https://reader035.fdocuments.us/reader035/viewer/2022071111/5fe7548113541d3d422a92ff/html5/thumbnails/1.jpg)
September 19, 2002Anatomy of Commercial CLIR Applications © 2002, Evans, Grefenstette, van Gent, Qu 1
Anatomy of CommercialCLIR Applications
CLEF Workshop 2002Rome, Italy
September 19, 2002
David A. Evans1, Gregory Grefenstette1,Joop van Gent2, Yan Qu1
1Clairvoyance Corporation & 2Irion Technologies
![Page 2: Anatomy of Commercial CLIR Applicationsclef.isti.cnr.it/workshop2002/presentations/com-clir.pdfPartial Survey of CLIR Systems Fully Functional Partially Functional Non-Commercial Commercial](https://reader035.fdocuments.us/reader035/viewer/2022071111/5fe7548113541d3d422a92ff/html5/thumbnails/2.jpg)
September 19, 2002Anatomy of Commercial CLIR Applications © 2002, Evans, Grefenstette, van Gent, Qu 2
Many Thanks!
• Carol Peters (CLEF)• Susan Feldman & Steve McClure (IDC)• Páraic Sheridan (MNIS-TextWise Labs)• Peter Schäuble (Eurospider)• Debbie Moran & Lynnae Evans
(Clairvoyance)
![Page 3: Anatomy of Commercial CLIR Applicationsclef.isti.cnr.it/workshop2002/presentations/com-clir.pdfPartial Survey of CLIR Systems Fully Functional Partially Functional Non-Commercial Commercial](https://reader035.fdocuments.us/reader035/viewer/2022071111/5fe7548113541d3d422a92ff/html5/thumbnails/3.jpg)
September 19, 2002Anatomy of Commercial CLIR Applications © 2002, Evans, Grefenstette, van Gent, Qu 3
The World is (Finally)Clamoring for CLIR…
NOT!!
![Page 4: Anatomy of Commercial CLIR Applicationsclef.isti.cnr.it/workshop2002/presentations/com-clir.pdfPartial Survey of CLIR Systems Fully Functional Partially Functional Non-Commercial Commercial](https://reader035.fdocuments.us/reader035/viewer/2022071111/5fe7548113541d3d422a92ff/html5/thumbnails/4.jpg)
September 19, 2002Anatomy of Commercial CLIR Applications © 2002, Evans, Grefenstette, van Gent, Qu 4
Reflecting on Commercial CLIR
• What is CLIR?• What is the state of the market?• What’s in a commercial application?• Specific Cases
– Cindor– AnswerWorks– Lirix (Grefenstette)– TwentyOne (van Gent)
• Future directions– Pidgin (van Gent)– InSiteProxy (Qu)
• Concluding thoughts• Discussion?
![Page 5: Anatomy of Commercial CLIR Applicationsclef.isti.cnr.it/workshop2002/presentations/com-clir.pdfPartial Survey of CLIR Systems Fully Functional Partially Functional Non-Commercial Commercial](https://reader035.fdocuments.us/reader035/viewer/2022071111/5fe7548113541d3d422a92ff/html5/thumbnails/5.jpg)
September 19, 2002Anatomy of Commercial CLIR Applications © 2002, Evans, Grefenstette, van Gent, Qu 5
What is CLIR?
![Page 6: Anatomy of Commercial CLIR Applicationsclef.isti.cnr.it/workshop2002/presentations/com-clir.pdfPartial Survey of CLIR Systems Fully Functional Partially Functional Non-Commercial Commercial](https://reader035.fdocuments.us/reader035/viewer/2022071111/5fe7548113541d3d422a92ff/html5/thumbnails/6.jpg)
September 19, 2002Anatomy of Commercial CLIR Applications © 2002, Evans, Grefenstette, van Gent, Qu 6
CLIR Functional Architecture
User QueryQuery
Translation
DocumentRetrieval
DocumentTranslation
DB
1
2
3
A completeCLIR systemwill do 1+2+3.
A minimalCLIR systemwill do 1+2.
Othercombinationsof functionsdo not yieldCLIR systems.
![Page 7: Anatomy of Commercial CLIR Applicationsclef.isti.cnr.it/workshop2002/presentations/com-clir.pdfPartial Survey of CLIR Systems Fully Functional Partially Functional Non-Commercial Commercial](https://reader035.fdocuments.us/reader035/viewer/2022071111/5fe7548113541d3d422a92ff/html5/thumbnails/7.jpg)
September 19, 2002Anatomy of Commercial CLIR Applications © 2002, Evans, Grefenstette, van Gent, Qu 7
CLIR ≠ MT + IR…
• Problems for Machine Translation (MT)– Queries are minimal texts– Alternative interpretations of a query are
sometimes better than one– Best methods for MT not always available for
all language pairs
• Problems for Information Retrieval (IR)– Most “efficient” IR may not be applicable to all
languages– Need for language-specific coordination of
indexing and retrieval
![Page 8: Anatomy of Commercial CLIR Applicationsclef.isti.cnr.it/workshop2002/presentations/com-clir.pdfPartial Survey of CLIR Systems Fully Functional Partially Functional Non-Commercial Commercial](https://reader035.fdocuments.us/reader035/viewer/2022071111/5fe7548113541d3d422a92ff/html5/thumbnails/8.jpg)
September 19, 2002Anatomy of Commercial CLIR Applications © 2002, Evans, Grefenstette, van Gent, Qu 8
Language ID
CLIR Functional Architecture
User QueryQuery
Translation
DocumentRetrieval
DocumentTranslation
DB
Language-SpecificSearch
Strategy
IR & Language-
Specific Resources
Document Summarization / Fact Extraction
MultilingualDocument /
DBM
NLP
![Page 9: Anatomy of Commercial CLIR Applicationsclef.isti.cnr.it/workshop2002/presentations/com-clir.pdfPartial Survey of CLIR Systems Fully Functional Partially Functional Non-Commercial Commercial](https://reader035.fdocuments.us/reader035/viewer/2022071111/5fe7548113541d3d422a92ff/html5/thumbnails/9.jpg)
September 19, 2002Anatomy of Commercial CLIR Applications © 2002, Evans, Grefenstette, van Gent, Qu 9
What is the state of the CLIR Market?
![Page 10: Anatomy of Commercial CLIR Applicationsclef.isti.cnr.it/workshop2002/presentations/com-clir.pdfPartial Survey of CLIR Systems Fully Functional Partially Functional Non-Commercial Commercial](https://reader035.fdocuments.us/reader035/viewer/2022071111/5fe7548113541d3d422a92ff/html5/thumbnails/10.jpg)
September 19, 2002Anatomy of Commercial CLIR Applications © 2002, Evans, Grefenstette, van Gent, Qu 10
Market Trends
• English becoming less dominant on WWW
– Many “words” of non-English languages now on web pages
• Commercial / Business Web Sites increasingly in languages other than English
– Almost 45% of business web sites worldwide are in languages other than English
– Only about 17% of all business web sites are exclusively in English
Oct 1996 Ratio to English
Aug 1999 Ratio to English
Mar 2001 Ratio to English
English 6,082,090,000 1.000 28,222,100,000 1.000 76,598,718,000 1.000 German 228,938,428 0.038 1,994,229,409 0.071 7,035,850,000 0.092 French 223,316,023 0.037 1,529,795,169 0.054 3,836,874,000 0.050 Spanish 104,319,158 0.017 1,125,646,460 0.040 2,658,631,000 0.035 Italian 123,555,682 0.020 817,270,444 0.029 1,845,026,000 0.024 Portuguese 106,167,245 0.017 589,391,943 0.021 1,333,664,000 0.017 Finnish 20,647,404 0.003 107,260,274 0.004 326,379,000 0.004
Multi-Lingual Environment
Source: Grefenstette, TIA 2001
More than One Non-English
4.0%
English Only17.0%
English & Other(s)38.8%
One Non-English40.2%
Source: IDC, 2001
![Page 11: Anatomy of Commercial CLIR Applicationsclef.isti.cnr.it/workshop2002/presentations/com-clir.pdfPartial Survey of CLIR Systems Fully Functional Partially Functional Non-Commercial Commercial](https://reader035.fdocuments.us/reader035/viewer/2022071111/5fe7548113541d3d422a92ff/html5/thumbnails/11.jpg)
September 19, 2002Anatomy of Commercial CLIR Applications © 2002, Evans, Grefenstette, van Gent, Qu 11
Market Trends
• Continuing growth of the Web– Increasing number of sites– Increasing number of users
• Continuing orientation of business to “self service”
• Internationalization of trade, consumer activities
• Improvements in technology (including HLT)
• Government emphasis on multi-language efforts
General Trends
![Page 12: Anatomy of Commercial CLIR Applicationsclef.isti.cnr.it/workshop2002/presentations/com-clir.pdfPartial Survey of CLIR Systems Fully Functional Partially Functional Non-Commercial Commercial](https://reader035.fdocuments.us/reader035/viewer/2022071111/5fe7548113541d3d422a92ff/html5/thumbnails/12.jpg)
September 19, 2002Anatomy of Commercial CLIR Applications © 2002, Evans, Grefenstette, van Gent, Qu 12
Market Trends
• Distinct sectors and applications– Government (e.g., intelligence agencies;
legal/legislative requirements)– Technical (e.g., research organizations—
pharmaceutical, chemical, engineering groups; patent attorneys)
– General business (e.g., competitive intelligence; business communications)
– Services (e.g., customer support)• Public-sector (government) spending is up
– U.S.: TIDES, Communicator, ROAR, others– E.U.: Euromap, Elsnet, etc.
• Revenue for “cross-language software” (including MT) growing 30% annually (IDC)
Demand for CLIR
![Page 13: Anatomy of Commercial CLIR Applicationsclef.isti.cnr.it/workshop2002/presentations/com-clir.pdfPartial Survey of CLIR Systems Fully Functional Partially Functional Non-Commercial Commercial](https://reader035.fdocuments.us/reader035/viewer/2022071111/5fe7548113541d3d422a92ff/html5/thumbnails/13.jpg)
September 19, 2002Anatomy of Commercial CLIR Applications © 2002, Evans, Grefenstette, van Gent, Qu 13
Market Trends
• CLIR-specific (non-MT) revenue currently < 10% total• Worldwide revenue for CLIR products 2002−−−−2003
likely under $15M
Revenue ProjectionsWorldwide Revenue for Cross-Language Software
(Source: IDC, 2001 )
3751.8
67.3 73.4
96.3
130.1
176.6
237.5
0
50
100
150
200
250
1998 1999 2000 2001 2002 2003 2004 2005
$M
![Page 14: Anatomy of Commercial CLIR Applicationsclef.isti.cnr.it/workshop2002/presentations/com-clir.pdfPartial Survey of CLIR Systems Fully Functional Partially Functional Non-Commercial Commercial](https://reader035.fdocuments.us/reader035/viewer/2022071111/5fe7548113541d3d422a92ff/html5/thumbnails/14.jpg)
September 19, 2002Anatomy of Commercial CLIR Applications © 2002, Evans, Grefenstette, van Gent, Qu 14
Market Trends
• Asian Languages– Japanese, Chinese, …, Arabic
• Effective translation of retrieved information• Focus on task-specific applications
– (FA)QA– Patent interpretation– Customer support
• Transparency– Minimal user interaction– Speed– Fluency
• Speech ⇒⇒⇒⇒ (Text ⇒⇒⇒⇒ Text ⇒⇒⇒⇒) Speech
CLIR Application Requirements
![Page 15: Anatomy of Commercial CLIR Applicationsclef.isti.cnr.it/workshop2002/presentations/com-clir.pdfPartial Survey of CLIR Systems Fully Functional Partially Functional Non-Commercial Commercial](https://reader035.fdocuments.us/reader035/viewer/2022071111/5fe7548113541d3d422a92ff/html5/thumbnails/15.jpg)
September 19, 2002Anatomy of Commercial CLIR Applications © 2002, Evans, Grefenstette, van Gent, Qu 15
Improve Prioritization,Filtering, Synopsizing,General Potentiation ofInformation and Messages
Momentum in Wireless IM
Source: Wireless Internet Report, Morgan Stanley Dean Witter, via The Economist, October 14, 2000
20000 €
10 €
30 €
20 €
40 €
50 €
60 €
70 €
Voice
Events
(E-Mail, Music,Downloads, etc.)
M-Commerce
Advertising
2008
Forecast average revenues per user per month, European mobile operators
![Page 16: Anatomy of Commercial CLIR Applicationsclef.isti.cnr.it/workshop2002/presentations/com-clir.pdfPartial Survey of CLIR Systems Fully Functional Partially Functional Non-Commercial Commercial](https://reader035.fdocuments.us/reader035/viewer/2022071111/5fe7548113541d3d422a92ff/html5/thumbnails/16.jpg)
September 19, 2002Anatomy of Commercial CLIR Applications © 2002, Evans, Grefenstette, van Gent, Qu 16
A brief survey of CLIR systems…
![Page 17: Anatomy of Commercial CLIR Applicationsclef.isti.cnr.it/workshop2002/presentations/com-clir.pdfPartial Survey of CLIR Systems Fully Functional Partially Functional Non-Commercial Commercial](https://reader035.fdocuments.us/reader035/viewer/2022071111/5fe7548113541d3d422a92ff/html5/thumbnails/17.jpg)
September 19, 2002Anatomy of Commercial CLIR Applications © 2002, Evans, Grefenstette, van Gent, Qu 17
Partial Survey of CLIR SystemsFullyFunctional
PartiallyFunctional
Non-Commercial Commercial
1+2+3
1+2 Pidgin
AnswerWorks
Eurospider
Cindor
Lirix
Knowledge Concepts
AltaVista
InSiteProxy
Various Research Efforts
Various Research Efforts
Verity (et al.)
Various Research Efforts
Convera/RetrievalWare
Open Text
FileNet
TwentyOne
NTT ?
Babel Fish
![Page 18: Anatomy of Commercial CLIR Applicationsclef.isti.cnr.it/workshop2002/presentations/com-clir.pdfPartial Survey of CLIR Systems Fully Functional Partially Functional Non-Commercial Commercial](https://reader035.fdocuments.us/reader035/viewer/2022071111/5fe7548113541d3d422a92ff/html5/thumbnails/18.jpg)
September 19, 2002Anatomy of Commercial CLIR Applications © 2002, Evans, Grefenstette, van Gent, Qu 18
Cindor(MNIS-TextWise Labs)
![Page 19: Anatomy of Commercial CLIR Applicationsclef.isti.cnr.it/workshop2002/presentations/com-clir.pdfPartial Survey of CLIR Systems Fully Functional Partially Functional Non-Commercial Commercial](https://reader035.fdocuments.us/reader035/viewer/2022071111/5fe7548113541d3d422a92ff/html5/thumbnails/19.jpg)
September 19, 2002Anatomy of Commercial CLIR Applications © 2002, Evans, Grefenstette, van Gent, Qu 19
Cindor
• Full CLIR (1+2+3), targeting document retrieval• Core technology components
– Language analysis—proprietary; using InXightLinguistX for tokenization, stemming, POS tagging in several (foreign) languages
– Conceptual Interlingua—proprietary; language-neutral lexical representation, using modified version of WordNet; includes genre/domain typing and supports word-sense disambiguation, proper-noun ID, phrase detection
– Search Management—proprietary; includes query analysis; may be replaced by generic SE
• Document translation via “Gist-in-Time” (Alis)
General Characterization
![Page 20: Anatomy of Commercial CLIR Applicationsclef.isti.cnr.it/workshop2002/presentations/com-clir.pdfPartial Survey of CLIR Systems Fully Functional Partially Functional Non-Commercial Commercial](https://reader035.fdocuments.us/reader035/viewer/2022071111/5fe7548113541d3d422a92ff/html5/thumbnails/20.jpg)
September 19, 2002Anatomy of Commercial CLIR Applications © 2002, Evans, Grefenstette, van Gent, Qu 20
Cindor
• Six languages– English, French, German, Italian, Japanese, Spanish– Chinese under development
• Query interpretation not based on MT system
Other Points
![Page 21: Anatomy of Commercial CLIR Applicationsclef.isti.cnr.it/workshop2002/presentations/com-clir.pdfPartial Survey of CLIR Systems Fully Functional Partially Functional Non-Commercial Commercial](https://reader035.fdocuments.us/reader035/viewer/2022071111/5fe7548113541d3d422a92ff/html5/thumbnails/21.jpg)
September 19, 2002Anatomy of Commercial CLIR Applications © 2002, Evans, Grefenstette, van Gent, Qu 21
Cindor
• Major effort to market system and toolkit in early 2001
• Extended trial at Unilever (NL) Food Science research group to search Japanese patents– Gisting of retrieved documents inadequate– Complete (quality) MT for Japanese not possible
• Experience with Hong-Kong-based financial services company– Chinese→English MT not adequate
• Market “not there yet” in 2001– Infrastructure issues still in early stages– MT functionality critical, but not sufficient
• Suspended commercial push mid-2001
Commercial Observations
![Page 22: Anatomy of Commercial CLIR Applicationsclef.isti.cnr.it/workshop2002/presentations/com-clir.pdfPartial Survey of CLIR Systems Fully Functional Partially Functional Non-Commercial Commercial](https://reader035.fdocuments.us/reader035/viewer/2022071111/5fe7548113541d3d422a92ff/html5/thumbnails/22.jpg)
September 19, 2002Anatomy of Commercial CLIR Applications © 2002, Evans, Grefenstette, van Gent, Qu 22
Cindor Illustration
![Page 23: Anatomy of Commercial CLIR Applicationsclef.isti.cnr.it/workshop2002/presentations/com-clir.pdfPartial Survey of CLIR Systems Fully Functional Partially Functional Non-Commercial Commercial](https://reader035.fdocuments.us/reader035/viewer/2022071111/5fe7548113541d3d422a92ff/html5/thumbnails/23.jpg)
September 19, 2002Anatomy of Commercial CLIR Applications © 2002, Evans, Grefenstette, van Gent, Qu 23
Cindor Illustration
![Page 24: Anatomy of Commercial CLIR Applicationsclef.isti.cnr.it/workshop2002/presentations/com-clir.pdfPartial Survey of CLIR Systems Fully Functional Partially Functional Non-Commercial Commercial](https://reader035.fdocuments.us/reader035/viewer/2022071111/5fe7548113541d3d422a92ff/html5/thumbnails/24.jpg)
September 19, 2002Anatomy of Commercial CLIR Applications © 2002, Evans, Grefenstette, van Gent, Qu 24
Cindor Illustration
![Page 25: Anatomy of Commercial CLIR Applicationsclef.isti.cnr.it/workshop2002/presentations/com-clir.pdfPartial Survey of CLIR Systems Fully Functional Partially Functional Non-Commercial Commercial](https://reader035.fdocuments.us/reader035/viewer/2022071111/5fe7548113541d3d422a92ff/html5/thumbnails/25.jpg)
September 19, 2002Anatomy of Commercial CLIR Applications © 2002, Evans, Grefenstette, van Gent, Qu 25
Cindor Illustration
![Page 26: Anatomy of Commercial CLIR Applicationsclef.isti.cnr.it/workshop2002/presentations/com-clir.pdfPartial Survey of CLIR Systems Fully Functional Partially Functional Non-Commercial Commercial](https://reader035.fdocuments.us/reader035/viewer/2022071111/5fe7548113541d3d422a92ff/html5/thumbnails/26.jpg)
September 19, 2002Anatomy of Commercial CLIR Applications © 2002, Evans, Grefenstette, van Gent, Qu 26
Cindor Illustration
![Page 27: Anatomy of Commercial CLIR Applicationsclef.isti.cnr.it/workshop2002/presentations/com-clir.pdfPartial Survey of CLIR Systems Fully Functional Partially Functional Non-Commercial Commercial](https://reader035.fdocuments.us/reader035/viewer/2022071111/5fe7548113541d3d422a92ff/html5/thumbnails/27.jpg)
September 19, 2002Anatomy of Commercial CLIR Applications © 2002, Evans, Grefenstette, van Gent, Qu 27
AnswerWorks(WexTech ⇐⇐⇐⇐ Knexys)
![Page 28: Anatomy of Commercial CLIR Applicationsclef.isti.cnr.it/workshop2002/presentations/com-clir.pdfPartial Survey of CLIR Systems Fully Functional Partially Functional Non-Commercial Commercial](https://reader035.fdocuments.us/reader035/viewer/2022071111/5fe7548113541d3d422a92ff/html5/thumbnails/28.jpg)
September 19, 2002Anatomy of Commercial CLIR Applications © 2002, Evans, Grefenstette, van Gent, Qu 28
AnswerWorks
• CLIR (1+2(+3?)), targeting customer support• Core HLT components (via Knexys)
– Language analysis—proprietary; language-specific tokenization, normalization/disambiguation, phrase identification
– ConceptNet—proprietary; multi-lingual lexicon (mapping to English?); weak and strong synonyms supported
– Indexing and retrieval—proprietary; index of data based on “linguistic image” (= terms processed under language analysis); matching queries to documents (answers) based on linguistic-image similarity
• Eight languages– English, French, German, Italian, Dutch, Spanish,
Portugese, Japanese; (others under development)
General Characterization
![Page 29: Anatomy of Commercial CLIR Applicationsclef.isti.cnr.it/workshop2002/presentations/com-clir.pdfPartial Survey of CLIR Systems Fully Functional Partially Functional Non-Commercial Commercial](https://reader035.fdocuments.us/reader035/viewer/2022071111/5fe7548113541d3d422a92ff/html5/thumbnails/29.jpg)
September 19, 2002Anatomy of Commercial CLIR Applications © 2002, Evans, Grefenstette, van Gent, Qu 29
Lirix(Xerox)
![Page 30: Anatomy of Commercial CLIR Applicationsclef.isti.cnr.it/workshop2002/presentations/com-clir.pdfPartial Survey of CLIR Systems Fully Functional Partially Functional Non-Commercial Commercial](https://reader035.fdocuments.us/reader035/viewer/2022071111/5fe7548113541d3d422a92ff/html5/thumbnails/30.jpg)
September 19, 2002Anatomy of Commercial CLIR Applications © 2002, Evans, Grefenstette, van Gent, Qu 30
LIRIXLinguistic Information Retrieval Technology
• Mono-lingual and cross-lingual search engine• LIRIX uses advanced linguistic techniques:
– Query expansion: e.g., “election” ⇒ “elect, elector, elected, etc.”
– Multi-word dictionary lookup: e.g., “ignition key” ⇒ “clé de contact”
– Relation detection: e.g., Query = “presidential election”
“…to elect its first President.” OK (verb/obj)“The President has been elected…” OK (subj/verb)“The elected government of President X” No relation
• XRCE’s web site search engine:http://www.xrce.xerox.com/search.html
![Page 31: Anatomy of Commercial CLIR Applicationsclef.isti.cnr.it/workshop2002/presentations/com-clir.pdfPartial Survey of CLIR Systems Fully Functional Partially Functional Non-Commercial Commercial](https://reader035.fdocuments.us/reader035/viewer/2022071111/5fe7548113541d3d422a92ff/html5/thumbnails/31.jpg)
September 19, 2002Anatomy of Commercial CLIR Applications © 2002, Evans, Grefenstette, van Gent, Qu 31
Core System
Search Tools
Linguistic Tools
LIRIX
XeLDA
Verity API
Finite State Tools
Users
WWW orIntranet
Corpus
Index
Dictionaries Data Flow
Function Call
Results
Query
Query Suggestion Tool
SQLETIndex
Lirix Architecture
![Page 32: Anatomy of Commercial CLIR Applicationsclef.isti.cnr.it/workshop2002/presentations/com-clir.pdfPartial Survey of CLIR Systems Fully Functional Partially Functional Non-Commercial Commercial](https://reader035.fdocuments.us/reader035/viewer/2022071111/5fe7548113541d3d422a92ff/html5/thumbnails/32.jpg)
September 19, 2002Anatomy of Commercial CLIR Applications © 2002, Evans, Grefenstette, van Gent, Qu 32
Lirix Illustration
![Page 33: Anatomy of Commercial CLIR Applicationsclef.isti.cnr.it/workshop2002/presentations/com-clir.pdfPartial Survey of CLIR Systems Fully Functional Partially Functional Non-Commercial Commercial](https://reader035.fdocuments.us/reader035/viewer/2022071111/5fe7548113541d3d422a92ff/html5/thumbnails/33.jpg)
September 19, 2002Anatomy of Commercial CLIR Applications © 2002, Evans, Grefenstette, van Gent, Qu 33
Lirix Illustration
![Page 34: Anatomy of Commercial CLIR Applicationsclef.isti.cnr.it/workshop2002/presentations/com-clir.pdfPartial Survey of CLIR Systems Fully Functional Partially Functional Non-Commercial Commercial](https://reader035.fdocuments.us/reader035/viewer/2022071111/5fe7548113541d3d422a92ff/html5/thumbnails/34.jpg)
September 19, 2002Anatomy of Commercial CLIR Applications © 2002, Evans, Grefenstette, van Gent, Qu 34
TwentyOne(Irion Technologies)
![Page 35: Anatomy of Commercial CLIR Applicationsclef.isti.cnr.it/workshop2002/presentations/com-clir.pdfPartial Survey of CLIR Systems Fully Functional Partially Functional Non-Commercial Commercial](https://reader035.fdocuments.us/reader035/viewer/2022071111/5fe7548113541d3d422a92ff/html5/thumbnails/35.jpg)
September 19, 2002Anatomy of Commercial CLIR Applications © 2002, Evans, Grefenstette, van Gent, Qu 35
Irion CLIR End-User Applications
– Adjust: cross-lingual filtering and classification
– TwentyOne: cross-lingual information retrieval
– Pidgin: cross-lingual dialog & chat
![Page 36: Anatomy of Commercial CLIR Applicationsclef.isti.cnr.it/workshop2002/presentations/com-clir.pdfPartial Survey of CLIR Systems Fully Functional Partially Functional Non-Commercial Commercial](https://reader035.fdocuments.us/reader035/viewer/2022071111/5fe7548113541d3d422a92ff/html5/thumbnails/36.jpg)
September 19, 2002Anatomy of Commercial CLIR Applications © 2002, Evans, Grefenstette, van Gent, Qu 36
TwentyOne
• Cross-lingual information retrieval system for 6 languages
• Automatic language detection• Linguistic analysis and index
enhancement• Document retrieval and phrase retrieval• Fuzzy search
General Characterization
![Page 37: Anatomy of Commercial CLIR Applicationsclef.isti.cnr.it/workshop2002/presentations/com-clir.pdfPartial Survey of CLIR Systems Fully Functional Partially Functional Non-Commercial Commercial](https://reader035.fdocuments.us/reader035/viewer/2022071111/5fe7548113541d3d422a92ff/html5/thumbnails/37.jpg)
September 19, 2002Anatomy of Commercial CLIR Applications © 2002, Evans, Grefenstette, van Gent, Qu 37
Capturing and Indexing
Fuzzyindex
Fuzzyindexer
9
Doc.
Web
Disk
Scan
1
Convert2
Xml
Word Index
Word/Doc Indexer 8
! Ps! Doc! Pdf! Htm! Tiff
Filter
! co-occurrence! score
7
Examples
Expand! synonyms! hyponyms! translations
6
Multiling.Wordnets
5
WSD! concept ! score
Examples
Lang Id3 4
NLP
! tokenise! tag! parse! names! normalise Examples
![Page 38: Anatomy of Commercial CLIR Applicationsclef.isti.cnr.it/workshop2002/presentations/com-clir.pdfPartial Survey of CLIR Systems Fully Functional Partially Functional Non-Commercial Commercial](https://reader035.fdocuments.us/reader035/viewer/2022071111/5fe7548113541d3d422a92ff/html5/thumbnails/38.jpg)
September 19, 2002Anatomy of Commercial CLIR Applications © 2002, Evans, Grefenstette, van Gent, Qu 38
Cross-Lingual Search
NLP2
Lid1
Docs
Fuzzy & Compound
index
3
4
Fuzzy Search &Compound splitting
Expanded Query7
Phrase Weighting
Weighted Phrases
8
DisplaySummarizeTranslate
Doc
5 WordDoc Index
Word SearchScored
Xml
Query
![Page 39: Anatomy of Commercial CLIR Applicationsclef.isti.cnr.it/workshop2002/presentations/com-clir.pdfPartial Survey of CLIR Systems Fully Functional Partially Functional Non-Commercial Commercial](https://reader035.fdocuments.us/reader035/viewer/2022071111/5fe7548113541d3d422a92ff/html5/thumbnails/39.jpg)
September 19, 2002Anatomy of Commercial CLIR Applications © 2002, Evans, Grefenstette, van Gent, Qu 39
Document and Phrase Scores
• Showing evidence in context, Googlestyle with linguistic phrase marking
• Best matching document does not necessarily contain the best matching phrase.
• Exact semantic relation may not be expressed in the document:– toxic medication
– medicines for toxication
![Page 40: Anatomy of Commercial CLIR Applicationsclef.isti.cnr.it/workshop2002/presentations/com-clir.pdfPartial Survey of CLIR Systems Fully Functional Partially Functional Non-Commercial Commercial](https://reader035.fdocuments.us/reader035/viewer/2022071111/5fe7548113541d3d422a92ff/html5/thumbnails/40.jpg)
September 19, 2002Anatomy of Commercial CLIR Applications © 2002, Evans, Grefenstette, van Gent, Qu 40
Phrase Matching
• Fuzzy matching• Origin: un-translated, synonyms,
translations• Focus
– Number of query words in phrase– Number of phrase words in query
• Structure: Head or modifier• Concept score (WSD)• Co-occurrence score
![Page 41: Anatomy of Commercial CLIR Applicationsclef.isti.cnr.it/workshop2002/presentations/com-clir.pdfPartial Survey of CLIR Systems Fully Functional Partially Functional Non-Commercial Commercial](https://reader035.fdocuments.us/reader035/viewer/2022071111/5fe7548113541d3d422a92ff/html5/thumbnails/41.jpg)
September 19, 2002Anatomy of Commercial CLIR Applications © 2002, Evans, Grefenstette, van Gent, Qu 41
![Page 42: Anatomy of Commercial CLIR Applicationsclef.isti.cnr.it/workshop2002/presentations/com-clir.pdfPartial Survey of CLIR Systems Fully Functional Partially Functional Non-Commercial Commercial](https://reader035.fdocuments.us/reader035/viewer/2022071111/5fe7548113541d3d422a92ff/html5/thumbnails/42.jpg)
September 19, 2002Anatomy of Commercial CLIR Applications © 2002, Evans, Grefenstette, van Gent, Qu 42
![Page 43: Anatomy of Commercial CLIR Applicationsclef.isti.cnr.it/workshop2002/presentations/com-clir.pdfPartial Survey of CLIR Systems Fully Functional Partially Functional Non-Commercial Commercial](https://reader035.fdocuments.us/reader035/viewer/2022071111/5fe7548113541d3d422a92ff/html5/thumbnails/43.jpg)
September 19, 2002Anatomy of Commercial CLIR Applications © 2002, Evans, Grefenstette, van Gent, Qu 43
![Page 44: Anatomy of Commercial CLIR Applicationsclef.isti.cnr.it/workshop2002/presentations/com-clir.pdfPartial Survey of CLIR Systems Fully Functional Partially Functional Non-Commercial Commercial](https://reader035.fdocuments.us/reader035/viewer/2022071111/5fe7548113541d3d422a92ff/html5/thumbnails/44.jpg)
September 19, 2002Anatomy of Commercial CLIR Applications © 2002, Evans, Grefenstette, van Gent, Qu 44
![Page 45: Anatomy of Commercial CLIR Applicationsclef.isti.cnr.it/workshop2002/presentations/com-clir.pdfPartial Survey of CLIR Systems Fully Functional Partially Functional Non-Commercial Commercial](https://reader035.fdocuments.us/reader035/viewer/2022071111/5fe7548113541d3d422a92ff/html5/thumbnails/45.jpg)
September 19, 2002Anatomy of Commercial CLIR Applications © 2002, Evans, Grefenstette, van Gent, Qu 45
![Page 46: Anatomy of Commercial CLIR Applicationsclef.isti.cnr.it/workshop2002/presentations/com-clir.pdfPartial Survey of CLIR Systems Fully Functional Partially Functional Non-Commercial Commercial](https://reader035.fdocuments.us/reader035/viewer/2022071111/5fe7548113541d3d422a92ff/html5/thumbnails/46.jpg)
September 19, 2002Anatomy of Commercial CLIR Applications © 2002, Evans, Grefenstette, van Gent, Qu 46
![Page 47: Anatomy of Commercial CLIR Applicationsclef.isti.cnr.it/workshop2002/presentations/com-clir.pdfPartial Survey of CLIR Systems Fully Functional Partially Functional Non-Commercial Commercial](https://reader035.fdocuments.us/reader035/viewer/2022071111/5fe7548113541d3d422a92ff/html5/thumbnails/47.jpg)
September 19, 2002Anatomy of Commercial CLIR Applications © 2002, Evans, Grefenstette, van Gent, Qu 47
Pidgin(Irion Technologies)
![Page 48: Anatomy of Commercial CLIR Applicationsclef.isti.cnr.it/workshop2002/presentations/com-clir.pdfPartial Survey of CLIR Systems Fully Functional Partially Functional Non-Commercial Commercial](https://reader035.fdocuments.us/reader035/viewer/2022071111/5fe7548113541d3d422a92ff/html5/thumbnails/48.jpg)
September 19, 2002Anatomy of Commercial CLIR Applications © 2002, Evans, Grefenstette, van Gent, Qu 48
Pidgin Server Model
Carp
Irion
TuTwenteInterplein
IR
CLAS
TRANS
CHAT*
PARS-GEN
DIAL MOD
EA-RESOL EU APPLquery
PMLSession
File 2/9
answer
3a/84
5/7
6a
6b
6c
1/10a
10b
3b
DB
DB
NLF
![Page 49: Anatomy of Commercial CLIR Applicationsclef.isti.cnr.it/workshop2002/presentations/com-clir.pdfPartial Survey of CLIR Systems Fully Functional Partially Functional Non-Commercial Commercial](https://reader035.fdocuments.us/reader035/viewer/2022071111/5fe7548113541d3d422a92ff/html5/thumbnails/49.jpg)
September 19, 2002Anatomy of Commercial CLIR Applications © 2002, Evans, Grefenstette, van Gent, Qu 49
Market Areas• Within one country:
– Communication / providing information through the web between governmental organizations and minority groups and expats
– Company intranets in multinational organizations
• Abroad:– Communication / providing information through the web in so-called
“Euregions”– Information sharing between residences of international NGOs– European Commission and Union– Communication between companies and their customers abroad– Company extranets in multinational organizations
![Page 50: Anatomy of Commercial CLIR Applicationsclef.isti.cnr.it/workshop2002/presentations/com-clir.pdfPartial Survey of CLIR Systems Fully Functional Partially Functional Non-Commercial Commercial](https://reader035.fdocuments.us/reader035/viewer/2022071111/5fe7548113541d3d422a92ff/html5/thumbnails/50.jpg)
September 19, 2002Anatomy of Commercial CLIR Applications © 2002, Evans, Grefenstette, van Gent, Qu 50
The mission of Irion : Equal access to the information society for everybody
![Page 51: Anatomy of Commercial CLIR Applicationsclef.isti.cnr.it/workshop2002/presentations/com-clir.pdfPartial Survey of CLIR Systems Fully Functional Partially Functional Non-Commercial Commercial](https://reader035.fdocuments.us/reader035/viewer/2022071111/5fe7548113541d3d422a92ff/html5/thumbnails/51.jpg)
September 19, 2002Anatomy of Commercial CLIR Applications © 2002, Evans, Grefenstette, van Gent, Qu 51
InSiteProxy™(Clairvoyance)
![Page 52: Anatomy of Commercial CLIR Applicationsclef.isti.cnr.it/workshop2002/presentations/com-clir.pdfPartial Survey of CLIR Systems Fully Functional Partially Functional Non-Commercial Commercial](https://reader035.fdocuments.us/reader035/viewer/2022071111/5fe7548113541d3d422a92ff/html5/thumbnails/52.jpg)
September 19, 2002Anatomy of Commercial CLIR Applications © 2002, Evans, Grefenstette, van Gent, Qu 52
The NeedWeb Site Analysis of
Top 20 Public Companies in China
12
0
5
10
15
20
25
top 20 yahooindex
searchinterface
functionalsearch
Englishversion
functionalEnglish
31
http://www.networkchinese.com/chineseprof/statistic/cn_100.html
31.5
![Page 53: Anatomy of Commercial CLIR Applicationsclef.isti.cnr.it/workshop2002/presentations/com-clir.pdfPartial Survey of CLIR Systems Fully Functional Partially Functional Non-Commercial Commercial](https://reader035.fdocuments.us/reader035/viewer/2022071111/5fe7548113541d3d422a92ff/html5/thumbnails/53.jpg)
September 19, 2002Anatomy of Commercial CLIR Applications © 2002, Evans, Grefenstette, van Gent, Qu 53
The Solution—InSiteProxy™
• Information access to (foreign) Web sites– Not indexed by Web portals
(e.g., Yahoo!China)– Missing their own search interface– Having poor search functionality
![Page 54: Anatomy of Commercial CLIR Applicationsclef.isti.cnr.it/workshop2002/presentations/com-clir.pdfPartial Survey of CLIR Systems Fully Functional Partially Functional Non-Commercial Commercial](https://reader035.fdocuments.us/reader035/viewer/2022071111/5fe7548113541d3d422a92ff/html5/thumbnails/54.jpg)
September 19, 2002Anatomy of Commercial CLIR Applications © 2002, Evans, Grefenstette, van Gent, Qu 54
Starting with an English Query
Select best translations:��, �����
Obtain query terms in source language: information, technology
Obtain translations from bilingual lexicons:��������|��|��|����, �����
![Page 55: Anatomy of Commercial CLIR Applicationsclef.isti.cnr.it/workshop2002/presentations/com-clir.pdfPartial Survey of CLIR Systems Fully Functional Partially Functional Non-Commercial Commercial](https://reader035.fdocuments.us/reader035/viewer/2022071111/5fe7548113541d3d422a92ff/html5/thumbnails/55.jpg)
September 19, 2002Anatomy of Commercial CLIR Applications © 2002, Evans, Grefenstette, van Gent, Qu 55
Fetch all subpagesat this URL
Starting with an English Query
Then, For each subpage, create
a CLARIT document;Index database of documents
![Page 56: Anatomy of Commercial CLIR Applicationsclef.isti.cnr.it/workshop2002/presentations/com-clir.pdfPartial Survey of CLIR Systems Fully Functional Partially Functional Non-Commercial Commercial](https://reader035.fdocuments.us/reader035/viewer/2022071111/5fe7548113541d3d422a92ff/html5/thumbnails/56.jpg)
September 19, 2002Anatomy of Commercial CLIR Applications © 2002, Evans, Grefenstette, van Gent, Qu 56
Retrieval Results
• Retrieve from database• Wrap results in HTML form
![Page 57: Anatomy of Commercial CLIR Applicationsclef.isti.cnr.it/workshop2002/presentations/com-clir.pdfPartial Survey of CLIR Systems Fully Functional Partially Functional Non-Commercial Commercial](https://reader035.fdocuments.us/reader035/viewer/2022071111/5fe7548113541d3d422a92ff/html5/thumbnails/57.jpg)
September 19, 2002Anatomy of Commercial CLIR Applications © 2002, Evans, Grefenstette, van Gent, Qu 57
Click to See a Result Page
![Page 58: Anatomy of Commercial CLIR Applicationsclef.isti.cnr.it/workshop2002/presentations/com-clir.pdfPartial Survey of CLIR Systems Fully Functional Partially Functional Non-Commercial Commercial](https://reader035.fdocuments.us/reader035/viewer/2022071111/5fe7548113541d3d422a92ff/html5/thumbnails/58.jpg)
September 19, 2002Anatomy of Commercial CLIR Applications © 2002, Evans, Grefenstette, van Gent, Qu 58
Translated Result Page
![Page 59: Anatomy of Commercial CLIR Applicationsclef.isti.cnr.it/workshop2002/presentations/com-clir.pdfPartial Survey of CLIR Systems Fully Functional Partially Functional Non-Commercial Commercial](https://reader035.fdocuments.us/reader035/viewer/2022071111/5fe7548113541d3d422a92ff/html5/thumbnails/59.jpg)
September 19, 2002Anatomy of Commercial CLIR Applications © 2002, Evans, Grefenstette, van Gent, Qu 59
Some Concluding Thoughts…
![Page 60: Anatomy of Commercial CLIR Applicationsclef.isti.cnr.it/workshop2002/presentations/com-clir.pdfPartial Survey of CLIR Systems Fully Functional Partially Functional Non-Commercial Commercial](https://reader035.fdocuments.us/reader035/viewer/2022071111/5fe7548113541d3d422a92ff/html5/thumbnails/60.jpg)
September 19, 2002Anatomy of Commercial CLIR Applications © 2002, Evans, Grefenstette, van Gent, Qu 60
Summary
• The Market is “not there yet”– But the Underlying Drivers are in Place
• Quality of MT is a Gating Factor– But Services and Consumer eCommerce may be
Ripe Targets
• Commercial CLIR Systems are “Complex”– But Hybrid Systems may be Viable
• Funding for Research & Development is “Healthy”– But use it Wisely! …– Develop Asian Language (and Arabic) Support– Don’t Focus on Document Retrieval alone
![Page 61: Anatomy of Commercial CLIR Applicationsclef.isti.cnr.it/workshop2002/presentations/com-clir.pdfPartial Survey of CLIR Systems Fully Functional Partially Functional Non-Commercial Commercial](https://reader035.fdocuments.us/reader035/viewer/2022071111/5fe7548113541d3d422a92ff/html5/thumbnails/61.jpg)
September 19, 2002Anatomy of Commercial CLIR Applications © 2002, Evans, Grefenstette, van Gent, Qu 61
The End