Post on 19-Dec-2015
Procedures for Bulk Loading:
Authority, Bibliographic, Holdings, and Purchase Order Records into Voyager
Planning
Who needs to be involved?SystemsCatalogingAcquisitionsPublic ServicesRSCVendors
Planning
Decide how you want to load the records
Add UnconditionallyReplaceMergeCreate Mfhds, purchase orders, items?
Planning
Where will holdings information come from?VendorCreate during PrebulkCreate during Bulk ImportCreate holdings tag with MarcEdit
Duplicate Detection Profileshttp://www.library.yale.edu/lso/databaseadmin/dbloads/dupdetect.htm
Choose how you want the records loaded (add-unconditionally, replace, merge)Define which fields (tags) to use as a match point between incoming records and records in the databaseFor merge profile, indicate which tags should be copied from the existing database record and merged with the incoming record.
Bulk Import Rules
http://www.library.yale.edu/lso/databaseadmin/dbloads/bulkimport.htm
• The loader pulls information from the Bulk Import Rules for the specific load.
• Type of records being loaded: bibs, auths, mfhds, P.O.’s, items, or a combination of these
• Duplicate Detection profile to use• Item types, call number hierarchy, mapping locations,
barcodes, and P.O. information
Preprocessing Programs
tagchangernew.jarcjkloadernew.jartag949buildernew.jaraddlocalyale.jar
addmfhdindicators.jaraddmultiple 866.jarMarcEditPrebulk
Decide which preprocessing programs will be needed in order to load, match, and display the records correctly.
Uses for Prebulkhttp://www.library.yale.edu/lso/databaseadmin/
dbloads/prebulk.htm
Remove bad records from file before loadingStrip fields from recordsCreate an interleaved file of bibs and mfhds for loadingRecord count in file
Configuration Files
Configuration profiles are used by Prebulk to determine how records are to be preprocessed before being loaded into production by the Bulk Import program. Configuration files are written using the vi editor on the server because they must be tab delimited.
•http://www.library.yale.edu/lso/databaseadmin/dbloads/configfile.htm
Database Loads Page(a work in progress)
http://www.library.yale.edu/lso/databaseadmin/dbloads/loads.htm
Includes detail for each database load we are currently runningMore detail on Duplicate Detection profiles, Prebulk, and Bulk ImportYUL Tag Table updates notesDatabase loads scheduleMore to come!
Questions?