ETD Search Services
description
Transcript of ETD Search Services
![Page 2: ETD Search Services](https://reader033.fdocuments.us/reader033/viewer/2022051001/56814f12550346895dbca4b7/html5/thumbnails/2.jpg)
Acknowledgements (selected)
Support: Adobe, AOL, DFG, NSF (DUE-0333531,0136690,0121679; IIS-0086227,0080748 ), OCLC, UNESCO, VTLS
Colleagues: Vinod Chachra, Tom Dehn, Marcos Gonçalves, Thom Hickey, Aaron Krowne, Ming Luo, Gail McMillan, Hussein Suleman, Jeff Young
![Page 3: ETD Search Services](https://reader033.fdocuments.us/reader033/viewer/2022051001/56814f12550346895dbca4b7/html5/thumbnails/3.jpg)
Where are the data coming from?
From this community! Please join us, share your data! OCLC NDLTD Union
– 112,652 ETDs metadata– 44 institutions– Will be able to provide 3 formats
DC ETDMS MARC21
![Page 4: ETD Search Services](https://reader033.fdocuments.us/reader033/viewer/2022051001/56814f12550346895dbca4b7/html5/thumbnails/4.jpg)
Where are the data coming from?
OCLC (Research) contacts are– Thom Hickey [[email protected]]– Jeff Young [[email protected]]– Tom Dehn [[email protected]]
VTLS has some additional data sources– Providing data other than through OAI-PMH– Including in Korean and Greek– Contact is Vinod Chachra [[email protected]]
![Page 5: ETD Search Services](https://reader033.fdocuments.us/reader033/viewer/2022051001/56814f12550346895dbca4b7/html5/thumbnails/5.jpg)
Institutions in OCLC NDLTD Union Set (1)
![Page 6: ETD Search Services](https://reader033.fdocuments.us/reader033/viewer/2022051001/56814f12550346895dbca4b7/html5/thumbnails/6.jpg)
Institutions in OCLC NDLTD Union Set (2)
![Page 7: ETD Search Services](https://reader033.fdocuments.us/reader033/viewer/2022051001/56814f12550346895dbca4b7/html5/thumbnails/7.jpg)
![Page 8: ETD Search Services](https://reader033.fdocuments.us/reader033/viewer/2022051001/56814f12550346895dbca4b7/html5/thumbnails/8.jpg)
OCLC SRU
What is SRU?– Search and Retrieve URL Service (SRU) is web
service based protocols for searching databases– Derived from Z39.50 – Uses Common Query Language– Current version: V1.1, 13th February 2004– Three basic operations, explain, scan and searchRetrieve
![Page 9: ETD Search Services](https://reader033.fdocuments.us/reader033/viewer/2022051001/56814f12550346895dbca4b7/html5/thumbnails/9.jpg)
![Page 10: ETD Search Services](https://reader033.fdocuments.us/reader033/viewer/2022051001/56814f12550346895dbca4b7/html5/thumbnails/10.jpg)
CQL Examples(from http://www.loc.gov/z3950/agency/zing/cql/)
dc.title cql.stem
dc.title = "cat" cat
dc.title = "cat" author = "smith"
dc.title any "cat" bath.author cql.exact "smith, j."
dc.title any/relevant/rel.CORI "cat fish" dc.author exact/stem "smith, j."
dc.title = cat "<element>"
dc.title = "cat" and bath.author = "smith" " cat" or hat
dc.title = "cat" prox/distance=1/unit=word dc.title = "in""cat" prox/distance>2/ordered "hat"
dc.title=cat and/rel.sum dc.title=dog > dc="http://www.dublincore.org/" dc.title = "cat"
![Page 11: ETD Search Services](https://reader033.fdocuments.us/reader033/viewer/2022051001/56814f12550346895dbca4b7/html5/thumbnails/11.jpg)
![Page 12: ETD Search Services](https://reader033.fdocuments.us/reader033/viewer/2022051001/56814f12550346895dbca4b7/html5/thumbnails/12.jpg)
OCLC SRU Interface
![Page 13: ETD Search Services](https://reader033.fdocuments.us/reader033/viewer/2022051001/56814f12550346895dbca4b7/html5/thumbnails/13.jpg)
VTLS Search
Based on Virtua system from– VTLS (www.vtls.com)– Visionary Technology in Library Solutions
Developed in C++ Uses Oracle Database
![Page 14: ETD Search Services](https://reader033.fdocuments.us/reader033/viewer/2022051001/56814f12550346895dbca4b7/html5/thumbnails/14.jpg)
Virtua User Interface
Scan Search Key Word Search Expert Search
![Page 15: ETD Search Services](https://reader033.fdocuments.us/reader033/viewer/2022051001/56814f12550346895dbca4b7/html5/thumbnails/15.jpg)
![Page 16: ETD Search Services](https://reader033.fdocuments.us/reader033/viewer/2022051001/56814f12550346895dbca4b7/html5/thumbnails/16.jpg)
VTLS Union CatalogContent Languages
The VTLS NDLTD Union Catalog has data in 6 different languages. These are: English German Greek Korean Portuguese Spanish
Examples follow
![Page 17: ETD Search Services](https://reader033.fdocuments.us/reader033/viewer/2022051001/56814f12550346895dbca4b7/html5/thumbnails/17.jpg)
Language = German; hits = 137
![Page 18: ETD Search Services](https://reader033.fdocuments.us/reader033/viewer/2022051001/56814f12550346895dbca4b7/html5/thumbnails/18.jpg)
Full record display
![Page 19: ETD Search Services](https://reader033.fdocuments.us/reader033/viewer/2022051001/56814f12550346895dbca4b7/html5/thumbnails/19.jpg)
Virginia Tech ETD Union
Componentized Digital Library Software Uses OCLC’s OAI data provider Mirrored in China by CALIS About 200 queries and 400 pages per
day for the past year and usage is increasing
![Page 20: ETD Search Services](https://reader033.fdocuments.us/reader033/viewer/2022051001/56814f12550346895dbca4b7/html5/thumbnails/20.jpg)
DiscoveryCurrent
AwarenessPreservation
Service Providers
Data Providers
Meta
data
harv
estin
g
The World According to OAI
![Page 21: ETD Search Services](https://reader033.fdocuments.us/reader033/viewer/2022051001/56814f12550346895dbca4b7/html5/thumbnails/21.jpg)
VT ETD Union System Diagram
BrowseSearch What’s New
OCLC data provider
User Interface
![Page 22: ETD Search Services](https://reader033.fdocuments.us/reader033/viewer/2022051001/56814f12550346895dbca4b7/html5/thumbnails/22.jpg)
Open Digital Library Protocol
Extended OAI-PMH
Protocol for Metadata Harvesting
![Page 23: ETD Search Services](https://reader033.fdocuments.us/reader033/viewer/2022051001/56814f12550346895dbca4b7/html5/thumbnails/23.jpg)
Open Digital Library Component
Extended OPEN ARCHIVE
OPENARCHIVE
![Page 24: ETD Search Services](https://reader033.fdocuments.us/reader033/viewer/2022051001/56814f12550346895dbca4b7/html5/thumbnails/24.jpg)
Open Digital Library Components
Running now– XML-File (data provider from file system)– Search: simple or in-memory (Essex) or generalized– Union, browse, recent, filter– E-journal/review, Submit, Edit, Annotation– Recommender, Rating; Mirroring (see JCDL’02)– Working with NCSA: from DB, unstructured text
Others in process– Classification/categorization– Registry (and other connections with web services)
![Page 25: ETD Search Services](https://reader033.fdocuments.us/reader033/viewer/2022051001/56814f12550346895dbca4b7/html5/thumbnails/25.jpg)
1010100101010010101010010101010101010101
Program
1010100101010010101010010101010101010101
Document
1010100101010010101010010101010101010101
Document
1010100101010010101010010101010101010101
Document
1010100101010010101010010101010101010101
Program
1010100101010010101010010101010101010101
Program
1010100101010010101010010101010101010101
Image
1010100101010010101010010101010101010101
Image
1010100101010010101010010101010101010101
Image
1010100101010010101010010101010101010101
Video
1010100101010010101010010101010101010101
Video
1010100101010010101010010101010101010101
Video
open digital library
OA OA
OA
OA
OA
OA
OA
OA
OA
PMH
PMH
XPMH
XPMH
XPMH
XPMH
XPMH
XPMH
XPMH
XPMH
XPMH
XPMH
XPMH
![Page 26: ETD Search Services](https://reader033.fdocuments.us/reader033/viewer/2022051001/56814f12550346895dbca4b7/html5/thumbnails/26.jpg)
1010100101010010101010010101010101010101
Program
1010100101010010101010010101010101010101
Document
1010100101010010101010010101010101010101
Document
1010100101010010101010010101010101010101
ETD-1
1010100101010010101010010101010101010101
Program
1010100101010010101010010101010101010101
ETD-2
1010100101010010101010010101010101010101
Image
1010100101010010101010010101010101010101
Image
1010100101010010101010010101010101010101
ETD-3
1010100101010010101010010101010101010101
Video
1010100101010010101010010101010101010101
Video
1010100101010010101010010101010101010101
ETD-4
ETD DL for the Networked Digital Library of Theses and Dissertations
(www.ndltd.org)
Search
Filter
Filter
Union
Recent
Browse
PMH
PMH
PMH
ODLRecent
ODLBrowse
ODLUnion
ODLUnion
ODLSearch
ODLUnionPMH
PMH
US
ER
INT
ER
FA
CE
Students and researchers ETD collections
Example Open Digital Library
![Page 27: ETD Search Services](https://reader033.fdocuments.us/reader033/viewer/2022051001/56814f12550346895dbca4b7/html5/thumbnails/27.jpg)
![Page 28: ETD Search Services](https://reader033.fdocuments.us/reader033/viewer/2022051001/56814f12550346895dbca4b7/html5/thumbnails/28.jpg)
ETD Union Search Mirror Site in China (CALIS)(http://ndltd.calis.edu.cn – popular site!)
![Page 29: ETD Search Services](https://reader033.fdocuments.us/reader033/viewer/2022051001/56814f12550346895dbca4b7/html5/thumbnails/29.jpg)
Quality of Search Services
Composability Efficiency Effectiveness
OCLC SRU Medium High High
VTLS Low High Medium
Virginia Tech ETD Union Search
High Medium Medium
![Page 30: ETD Search Services](https://reader033.fdocuments.us/reader033/viewer/2022051001/56814f12550346895dbca4b7/html5/thumbnails/30.jpg)
Comparison of Software
Software Used Software License
Price of Software
Full Text Search
OCLC SRU Homegrown N/A N/A No
VTLS VIRTUA(VTLS.com)
Commercial Depends on user number, collection size
No
Virginia Tech ETD Union Search
Open Digital Library
BSD-like Open Source License
Free No
Virginia TechETD collection
Ultraseek(Verity.com)
Commercial Depends on user number, collection size
Yes
![Page 31: ETD Search Services](https://reader033.fdocuments.us/reader033/viewer/2022051001/56814f12550346895dbca4b7/html5/thumbnails/31.jpg)
Next Steps with VT ETD Union
Web Services based component
Easier user interface configuration
Better precision of search results; full-text?
Research studies (e.g., Ryan Richardson dissertation)– Studies of collections and genre– Summaries using concept maps– Cross-language retrieval
![Page 32: ETD Search Services](https://reader033.fdocuments.us/reader033/viewer/2022051001/56814f12550346895dbca4b7/html5/thumbnails/32.jpg)
References:
Z39.50 International - Next Generation: http://www.loc.gov/z3950/agency/zing
VT Service: http://rocky.dlib.vt.edu/~etdunion/cgi-bin/OCLCUnion/UI/index.pl
VTLS Service: http://www.vtls.com/ndltd OCLC Service (SRU):
http://alcme.oclc.org/ndltd/SearchbySru.html
![Page 33: ETD Search Services](https://reader033.fdocuments.us/reader033/viewer/2022051001/56814f12550346895dbca4b7/html5/thumbnails/33.jpg)
Thank You!
Paper with more details is available at URL: http://tennessee.cc.vt.edu/~lming/software/ETDSearchServices0.7.doc
DLRL: www.dlib.vt.edu, http://dlbox.nudl.org/
Fox: http://fox.cs.vt.edu