Fun with Geospatial Metadata, CUGIR, CORC, MARC, and OAI: The CSDGM to MARC Grant Project
description
Transcript of Fun with Geospatial Metadata, CUGIR, CORC, MARC, and OAI: The CSDGM to MARC Grant Project
![Page 1: Fun with Geospatial Metadata, CUGIR, CORC, MARC, and OAI: The CSDGM to MARC Grant Project](https://reader034.fdocuments.us/reader034/viewer/2022051116/5681582e550346895dc5944c/html5/thumbnails/1.jpg)
Fun with Geospatial Metadata, CUGIR, CORC, MARC, and OAI: The CSDGM to MARC
Grant Project
Adam Chandler, Olin LibraryElaine Westbrooks, Mann Library
Vivek Uppal, Dept. of Computer Science
Metadata Working GroupOctober 12, 2001
![Page 3: Fun with Geospatial Metadata, CUGIR, CORC, MARC, and OAI: The CSDGM to MARC Grant Project](https://reader034.fdocuments.us/reader034/viewer/2022051116/5681582e550346895dc5944c/html5/thumbnails/3.jpg)
3
Problem
How do we create a persistent URL pointing to “deep web” digital objects across very different systems?
![Page 4: Fun with Geospatial Metadata, CUGIR, CORC, MARC, and OAI: The CSDGM to MARC Grant Project](https://reader034.fdocuments.us/reader034/viewer/2022051116/5681582e550346895dc5944c/html5/thumbnails/4.jpg)
What is GIS?What is CUGIR?What are Geospatial Metadata? What is CORC?
4
Overview (1)
![Page 5: Fun with Geospatial Metadata, CUGIR, CORC, MARC, and OAI: The CSDGM to MARC Grant Project](https://reader034.fdocuments.us/reader034/viewer/2022051116/5681582e550346895dc5944c/html5/thumbnails/5.jpg)
Overview (2)
What is the FGDC Clearinghouse?Bucket ArchitectureWhat is OAI?DemonstrationOutcomes
5
![Page 6: Fun with Geospatial Metadata, CUGIR, CORC, MARC, and OAI: The CSDGM to MARC Grant Project](https://reader034.fdocuments.us/reader034/viewer/2022051116/5681582e550346895dc5944c/html5/thumbnails/6.jpg)
“A system for capturing, storing, checking, manipulating, analyzing and displaying data which are spatially referenced to the Earth.” (DoE, 1987)
6
What is GIS?
![Page 7: Fun with Geospatial Metadata, CUGIR, CORC, MARC, and OAI: The CSDGM to MARC Grant Project](https://reader034.fdocuments.us/reader034/viewer/2022051116/5681582e550346895dc5944c/html5/thumbnails/7.jpg)
GISGIS
ProceduresProcedures
DataData
HardwareHardware
SoftwareSoftwarePeoplePeople
7
![Page 8: Fun with Geospatial Metadata, CUGIR, CORC, MARC, and OAI: The CSDGM to MARC Grant Project](https://reader034.fdocuments.us/reader034/viewer/2022051116/5681582e550346895dc5944c/html5/thumbnails/8.jpg)
8
Examples of GIS
![Page 9: Fun with Geospatial Metadata, CUGIR, CORC, MARC, and OAI: The CSDGM to MARC Grant Project](https://reader034.fdocuments.us/reader034/viewer/2022051116/5681582e550346895dc5944c/html5/thumbnails/9.jpg)
CUGIR
Brief HistorySubject areasUnrestricted access to data &
metadataNational Geospatial Data
Clearinghouse & NSDI
9
![Page 10: Fun with Geospatial Metadata, CUGIR, CORC, MARC, and OAI: The CSDGM to MARC Grant Project](https://reader034.fdocuments.us/reader034/viewer/2022051116/5681582e550346895dc5944c/html5/thumbnails/10.jpg)
Geospatial Metadata
Brief HistoryDefinitionPurpose / Uses / BenefitsCUGIR Examples: TAZ
Content Standard for Digital Geospatial Metadata
10
![Page 11: Fun with Geospatial Metadata, CUGIR, CORC, MARC, and OAI: The CSDGM to MARC Grant Project](https://reader034.fdocuments.us/reader034/viewer/2022051116/5681582e550346895dc5944c/html5/thumbnails/11.jpg)
What is CORC?PathfindersHarvests MetadataAuthority ControlClassification
Metadata: MARC / DC-RDF
11
CORC
![Page 12: Fun with Geospatial Metadata, CUGIR, CORC, MARC, and OAI: The CSDGM to MARC Grant Project](https://reader034.fdocuments.us/reader034/viewer/2022051116/5681582e550346895dc5944c/html5/thumbnails/12.jpg)
FGDC Clearinghouse
12
![Page 13: Fun with Geospatial Metadata, CUGIR, CORC, MARC, and OAI: The CSDGM to MARC Grant Project](https://reader034.fdocuments.us/reader034/viewer/2022051116/5681582e550346895dc5944c/html5/thumbnails/13.jpg)
13
![Page 14: Fun with Geospatial Metadata, CUGIR, CORC, MARC, and OAI: The CSDGM to MARC Grant Project](https://reader034.fdocuments.us/reader034/viewer/2022051116/5681582e550346895dc5944c/html5/thumbnails/14.jpg)
14 14
CUGIR
![Page 15: Fun with Geospatial Metadata, CUGIR, CORC, MARC, and OAI: The CSDGM to MARC Grant Project](https://reader034.fdocuments.us/reader034/viewer/2022051116/5681582e550346895dc5944c/html5/thumbnails/15.jpg)
15
![Page 16: Fun with Geospatial Metadata, CUGIR, CORC, MARC, and OAI: The CSDGM to MARC Grant Project](https://reader034.fdocuments.us/reader034/viewer/2022051116/5681582e550346895dc5944c/html5/thumbnails/16.jpg)
16
Show Metadata
![Page 17: Fun with Geospatial Metadata, CUGIR, CORC, MARC, and OAI: The CSDGM to MARC Grant Project](https://reader034.fdocuments.us/reader034/viewer/2022051116/5681582e550346895dc5944c/html5/thumbnails/17.jpg)
17
![Page 18: Fun with Geospatial Metadata, CUGIR, CORC, MARC, and OAI: The CSDGM to MARC Grant Project](https://reader034.fdocuments.us/reader034/viewer/2022051116/5681582e550346895dc5944c/html5/thumbnails/18.jpg)
18
http://130.11.52.184/servlet/FGDCServlet/retrieve?on=2&el=F&db=current&rp=3&mr=1&ac=current&cid=181
Non-Persistent URL
![Page 19: Fun with Geospatial Metadata, CUGIR, CORC, MARC, and OAI: The CSDGM to MARC Grant Project](https://reader034.fdocuments.us/reader034/viewer/2022051116/5681582e550346895dc5944c/html5/thumbnails/19.jpg)
Clearinghouse Problems
0 hits for users 50% of time (unpublished research)
> 10% or more or nodes are offline (Z39.50)
FGDC Clearinghouse is not well known
Record maintenance is a undefined
Harvesting is not a part of model
Data/Metadata are coupled with the server software (i.e., “smart archive, dumb object” DL model)
19
![Page 20: Fun with Geospatial Metadata, CUGIR, CORC, MARC, and OAI: The CSDGM to MARC Grant Project](https://reader034.fdocuments.us/reader034/viewer/2022051116/5681582e550346895dc5944c/html5/thumbnails/20.jpg)
Open Archives Initiative
Data Provider
Service Provider
http (get request)
xml response
low-barrier interoperability data-provider & service-provider model metadata harvesting model shared metadata format & parallel,
community-specific metadata formats authentication : on purpose outside protocolSource: Herbert Van De Sompel, CS 502, Spring 2001
20
![Page 21: Fun with Geospatial Metadata, CUGIR, CORC, MARC, and OAI: The CSDGM to MARC Grant Project](https://reader034.fdocuments.us/reader034/viewer/2022051116/5681582e550346895dc5944c/html5/thumbnails/21.jpg)
21
OAI example
![Page 22: Fun with Geospatial Metadata, CUGIR, CORC, MARC, and OAI: The CSDGM to MARC Grant Project](https://reader034.fdocuments.us/reader034/viewer/2022051116/5681582e550346895dc5944c/html5/thumbnails/22.jpg)
22
![Page 23: Fun with Geospatial Metadata, CUGIR, CORC, MARC, and OAI: The CSDGM to MARC Grant Project](https://reader034.fdocuments.us/reader034/viewer/2022051116/5681582e550346895dc5944c/html5/thumbnails/23.jpg)
23
“Buckets are part of the larger ‘Smart Object, Dumb Archive’ DL Model (Maly, Nelson, & Zubair, 1999). SODA is a reaction to the vertically integrated (and non-interoperable) DLs that tended to grow from the ad-hoc origins of many popular DLs (Esler & Nelson, 1998). Separating the functionality of the archive from that of the DL allows for greater interoperability and federation of DLs. The archive's purpose is to provide DLs the location of buckets (the DLs can poll the buckets themselves for their metadata), and the DLs build their own indexes.”
Buckets
Source: M. Nelson: “Smart Objects and Open Archives.” D-Lib Magazine, February 2001, 7(2) http://www.dlib.org/dlib/february01/nelson/02nelson.html
![Page 24: Fun with Geospatial Metadata, CUGIR, CORC, MARC, and OAI: The CSDGM to MARC Grant Project](https://reader034.fdocuments.us/reader034/viewer/2022051116/5681582e550346895dc5944c/html5/thumbnails/24.jpg)
24
On Buckets and OAI
“Just as buckets break the dependency of the information objects on archives, the Open Archives Initiative (OAI) breaks the dependency of archives on DLs …”
- Michael L. Nelson
![Page 25: Fun with Geospatial Metadata, CUGIR, CORC, MARC, and OAI: The CSDGM to MARC Grant Project](https://reader034.fdocuments.us/reader034/viewer/2022051116/5681582e550346895dc5944c/html5/thumbnails/25.jpg)
25
On Buckets and OAI
“The OAI does not address the issue of smart objects, but the archives in the OAI are very similar to the archives described in the SODA model in that they have minimal functionality. OAI archives aim for greater interoperability through performing less sophisticated functions (no keyword search functions defined, T&C is not handled at the protocol level) -- a sort of Reduced Instruction Set Computer philosophy for archives.”
- Michael L. Nelson
![Page 26: Fun with Geospatial Metadata, CUGIR, CORC, MARC, and OAI: The CSDGM to MARC Grant Project](https://reader034.fdocuments.us/reader034/viewer/2022051116/5681582e550346895dc5944c/html5/thumbnails/26.jpg)
26
Problem Revisited
How do we create a persistent URL pointing to “deep web” digital objects across very different systems?
![Page 27: Fun with Geospatial Metadata, CUGIR, CORC, MARC, and OAI: The CSDGM to MARC Grant Project](https://reader034.fdocuments.us/reader034/viewer/2022051116/5681582e550346895dc5944c/html5/thumbnails/27.jpg)
27
Project Workflow
Converter
Authority
Control
![Page 28: Fun with Geospatial Metadata, CUGIR, CORC, MARC, and OAI: The CSDGM to MARC Grant Project](https://reader034.fdocuments.us/reader034/viewer/2022051116/5681582e550346895dc5944c/html5/thumbnails/28.jpg)
28
Step 1: Convert SGML -> MARC
![Page 29: Fun with Geospatial Metadata, CUGIR, CORC, MARC, and OAI: The CSDGM to MARC Grant Project](https://reader034.fdocuments.us/reader034/viewer/2022051116/5681582e550346895dc5944c/html5/thumbnails/29.jpg)
29
Step 2: MARC & Bucket Location
![Page 30: Fun with Geospatial Metadata, CUGIR, CORC, MARC, and OAI: The CSDGM to MARC Grant Project](https://reader034.fdocuments.us/reader034/viewer/2022051116/5681582e550346895dc5944c/html5/thumbnails/30.jpg)
30
Step 3a: Import to CORC (MARC)
30
MARCView:
856 “Bucket”
![Page 31: Fun with Geospatial Metadata, CUGIR, CORC, MARC, and OAI: The CSDGM to MARC Grant Project](https://reader034.fdocuments.us/reader034/viewer/2022051116/5681582e550346895dc5944c/html5/thumbnails/31.jpg)
31
Step 3b: Import to CORC (DC RDF)
31
DC RDFView:
856 “Bucket”
![Page 32: Fun with Geospatial Metadata, CUGIR, CORC, MARC, and OAI: The CSDGM to MARC Grant Project](https://reader034.fdocuments.us/reader034/viewer/2022051116/5681582e550346895dc5944c/html5/thumbnails/32.jpg)
32
Step 4a: Import DC-RDF
![Page 33: Fun with Geospatial Metadata, CUGIR, CORC, MARC, and OAI: The CSDGM to MARC Grant Project](https://reader034.fdocuments.us/reader034/viewer/2022051116/5681582e550346895dc5944c/html5/thumbnails/33.jpg)
33
Step 4b: Import DC RDF to Local Mysql Database
![Page 34: Fun with Geospatial Metadata, CUGIR, CORC, MARC, and OAI: The CSDGM to MARC Grant Project](https://reader034.fdocuments.us/reader034/viewer/2022051116/5681582e550346895dc5944c/html5/thumbnails/34.jpg)
34
MARC Record in Voyager
34
Click here to see bucket
![Page 35: Fun with Geospatial Metadata, CUGIR, CORC, MARC, and OAI: The CSDGM to MARC Grant Project](https://reader034.fdocuments.us/reader034/viewer/2022051116/5681582e550346895dc5944c/html5/thumbnails/35.jpg)
35
Table: Bucket
![Page 36: Fun with Geospatial Metadata, CUGIR, CORC, MARC, and OAI: The CSDGM to MARC Grant Project](https://reader034.fdocuments.us/reader034/viewer/2022051116/5681582e550346895dc5944c/html5/thumbnails/36.jpg)
36
Table: DC
![Page 37: Fun with Geospatial Metadata, CUGIR, CORC, MARC, and OAI: The CSDGM to MARC Grant Project](https://reader034.fdocuments.us/reader034/viewer/2022051116/5681582e550346895dc5944c/html5/thumbnails/37.jpg)
37
Project Outcomes
1. Access for patrons-1,300 MARC Records in OPAC-1,300 MARC Records in CORC/WorldCat-2,600 DC-RDF Records in OAI
2. OAI data provider (DLF agreement)3. CORC evaluation4. Foundation for CUGIR 2.05. Data for cross-collection access
research