Metadata Cleanup with Linked Data and OpenRefine...• Formerly known as Google Refine • Java tool...

18
Metadata Cleanup with Linked Data and OpenRefine Greer Martin Metadata Technologies Librarian Loyola University Chicago

Transcript of Metadata Cleanup with Linked Data and OpenRefine...• Formerly known as Google Refine • Java tool...

Page 1: Metadata Cleanup with Linked Data and OpenRefine...• Formerly known as Google Refine • Java tool • GUI in browser • Functionality: Export/import data, facets, clusters, clean,

Metadata Cleanup with Linked Data and OpenRefine

Greer MartinMetadata Technologies Librarian

Loyola University Chicago

Page 2: Metadata Cleanup with Linked Data and OpenRefine...• Formerly known as Google Refine • Java tool • GUI in browser • Functionality: Export/import data, facets, clusters, clean,
Page 3: Metadata Cleanup with Linked Data and OpenRefine...• Formerly known as Google Refine • Java tool • GUI in browser • Functionality: Export/import data, facets, clusters, clean,
Page 4: Metadata Cleanup with Linked Data and OpenRefine...• Formerly known as Google Refine • Java tool • GUI in browser • Functionality: Export/import data, facets, clusters, clean,
Page 5: Metadata Cleanup with Linked Data and OpenRefine...• Formerly known as Google Refine • Java tool • GUI in browser • Functionality: Export/import data, facets, clusters, clean,

Other Data Sources for Reconciliation

• FAST (Faceted Application of Subject Terminology)• VIVO Scientific Collaboration Platform• VIAF• Sharedshelf Built Work Registry• OpenCorporates• dbpedia• GeoNames

Page 6: Metadata Cleanup with Linked Data and OpenRefine...• Formerly known as Google Refine • Java tool • GUI in browser • Functionality: Export/import data, facets, clusters, clean,

OpenRefine

• Powerful data cleanup tool• Formerly known as Google Refine• Java tool• GUI in browser• Functionality: Export/import data, facets, clusters, clean, GREL,

reconciliation

Page 7: Metadata Cleanup with Linked Data and OpenRefine...• Formerly known as Google Refine • Java tool • GUI in browser • Functionality: Export/import data, facets, clusters, clean,

• 1,500 collections, mostly university records

• Use Re:Discovery Proficio for archival records management system

• Inconsistent use of authorities and controlled vocabularies

University Archives & Special Collections, Paul V. Galvin Library, Illinois Institute of Technology

ArchivesSpace Migration

Page 8: Metadata Cleanup with Linked Data and OpenRefine...• Formerly known as Google Refine • Java tool • GUI in browser • Functionality: Export/import data, facets, clusters, clean,
Page 9: Metadata Cleanup with Linked Data and OpenRefine...• Formerly known as Google Refine • Java tool • GUI in browser • Functionality: Export/import data, facets, clusters, clean,
Page 10: Metadata Cleanup with Linked Data and OpenRefine...• Formerly known as Google Refine • Java tool • GUI in browser • Functionality: Export/import data, facets, clusters, clean,

https://github.com/cmh2166/lc-reconcile

https://lc-reconcile.herokuapp.com/

Page 11: Metadata Cleanup with Linked Data and OpenRefine...• Formerly known as Google Refine • Java tool • GUI in browser • Functionality: Export/import data, facets, clusters, clean,
Page 12: Metadata Cleanup with Linked Data and OpenRefine...• Formerly known as Google Refine • Java tool • GUI in browser • Functionality: Export/import data, facets, clusters, clean,

Post-reconciliation

Page 13: Metadata Cleanup with Linked Data and OpenRefine...• Formerly known as Google Refine • Java tool • GUI in browser • Functionality: Export/import data, facets, clusters, clean,

AddingURIs

Page 14: Metadata Cleanup with Linked Data and OpenRefine...• Formerly known as Google Refine • Java tool • GUI in browser • Functionality: Export/import data, facets, clusters, clean,

Reconcile-csv• OpenRefine

reconciliation service that matches one dataset against another

• Found at: http://okfnlabs.org/reconcile-csv/

• Good for adding local metadata

Page 15: Metadata Cleanup with Linked Data and OpenRefine...• Formerly known as Google Refine • Java tool • GUI in browser • Functionality: Export/import data, facets, clusters, clean,
Page 16: Metadata Cleanup with Linked Data and OpenRefine...• Formerly known as Google Refine • Java tool • GUI in browser • Functionality: Export/import data, facets, clusters, clean,

Conclusion

• Structured data = cleanup and migration is possible!

• OpenRefine for cleaning, reconciliation, JSON export

Page 17: Metadata Cleanup with Linked Data and OpenRefine...• Formerly known as Google Refine • Java tool • GUI in browser • Functionality: Export/import data, facets, clusters, clean,

Resources

• Free Your Metadata: http://freeyourmetadata.org/• OpenRefine Wiki: https://github.com/OpenRefine/OpenRefine• Video tutorials: http://openrefine.org

Page 18: Metadata Cleanup with Linked Data and OpenRefine...• Formerly known as Google Refine • Java tool • GUI in browser • Functionality: Export/import data, facets, clusters, clean,

Thank you!Greer Martin

[email protected]