Digital Initiatives at the State Library of NC (NCLA Conference 2009)

Transparency in Government: State Library StyleOur most recent digital projects

Jennifer Davison, Head, Government Documents [email protected]

Amy Rudersdorf, Director, Digital Information Management [email protected]

Government & Heritage Library, State Library of North Carolina

http://digital-library.ncdcr.gov

Topics

• Introduction & Overview of Services• Current Digital Projects & Programs• Future Directions for Government Information Access

and Maintenance

http://statelibrary.ncdcr.gov


INTRODUCTION & OVERVIEW OF SERVICES



Organizational Structure, Department of Cultural Resources

Museums, Arts Council

Historic Sites, Archaeology, Symphony



Organizational Structure, SL & SA

STATE LIBRARY• Library Development (LSTA, public library

support)• Library for the Blind & Physically

Handicapped• Government & Heritage Library (physical

library) - provides services related to North Carolina history, government history and genealogy

– NC State Publications Clearinghouse identifies, collects, catalogs, promotes and provides public access to state agency created publications in all formats

– Official depository of state publications

• Digital Information Management Program develops recommendations & tests solutions that support the identification, collection, cataloging, storage, & preservation of digital state government information

STATE ARCHIVES• Provides services to state government

and public by collecting, preserving and making available for public use historical and evidential materials relating to North Carolina

• Official archival agency of the State of North Carolina

• Collects public records: all formats regardless of “physical form or characteristics”

• Public records are documents, papers, letters, maps, books, photographs, films, sound recordings, email, geospatial data, magnetic or other tapes, electronic data processing records, artifacts, or ‑other documentary material, regardless of physical form or characteristics, made or received … in connection with the transaction of public business by any agency of North Carolina government



Government Documents Branch

• State & Federal Publications• Primary focus is on state publications• Mandate to facilitate public access to publications issued by State

agencies• State Publications Clearinghouse

– Identifies and collections state publications– Catalogs new state publications in any format– Distributes paper publications through the depository system– Created and adds to the digital State Publications Collection– Works with state agencies

• The State Library has a mandate to be the permanent depository of publications in any format– Currently working on DENR library publications– Actively filling in gaps in print and digital collection

• http://statelibrary.ncdcr.gov/govdocs/index.html



Digital Information Management Program (DIMP)

• Established in 2006 to:– Identify and promote solutions to ensure long-term

preservation and ready and permanent public access to born-digital and digitized information produced by (or on behalf of) North Carolina state government.

• Support the activities of the Government Documents Branch• Support the activities of NC state agency publications creators

and distributors• Develop, implement, and/or maintain digital collections and

related resources from the State Library of NC

• http://statelibrary.ncdcr.gov/dimp



Digital Information Management Program (DIMP)

• Work is supported through:– State legislation

• Three state-funded positions in 2006• Mandate

– Federal funding through a statewide leadership grant• Access to State Government Information Initiative



Access to State Government Information Initiative (ASGII)

• Collectively and collaboratively address the issues and challenges of providing permanent public access to born-digital state government information.

• Develop recommendations and test solutions that support the identification, collection, cataloging, storage, and preservation of state government information and statistical data in all formats, including born digital, for permanent public access.

• Collaborative effort involving the State Library, State Data Center, State Archives and Records, and most recently, the Carolina Digital Library & Archives.

• http://statelibrary.ncdcr.gov/digidocs



Digital Collections

• Made accessible using hosted CONTENTdm

• Local enhancements include – tagging and comments– RSS feeds

• Any collection can be subscribed to• Most active collections are

– State Publications Collection– NC MOSAIC



CURRENT DIGITAL PROJECTS & PROGRAMS



NC MOSAIC

• NC MOSAIC stands for Managing, Organizing, and Strengthening Access to Institutional Collections.

• Brings together in one location links to important collections of North Carolina government information



NC MOSAIC

• Collections include maps, publications, records, and historical documents that have been made available on the Internet by county government, state agencies, and academic institutions in North Carolina

• Browse by institutions, geographic locations, topics, and formats

• Keyword search



NC MOSAIC: Record View



North Carolina Census Data: 1960-1980



North Carolina Census Data: 1960-1980


• Ten census profiles, hundreds of documents• Compiled by the State Data Center (SDC) in the 1960s,

1970s, and 1980s • Full-text searchable • The profiles were originally developed by the SDC from

datasets provided by the U.S. Census Bureau.– county and state statistics– hand-colored maps related to labor, population, housing,

and economic conditions.


NC Census Data: Available Profiles (1 of 2)


Ten Profiles Available:1. 1960 Census of Population and Housing/Counts of Population and

Housing Units by Enumeration District – Surrey and Union Counties missing

2. 1960 Enumeration District Map– 80 maps available

3. 1970 Selected Characteristics for a County (Special Report for Townships)– Union County missing

4. 1980 Census of Population and Housing - Characteristics of Persons/North Carolina (Summary Tape File 1)

5. 1980 Census of Population and Housing / Summary Tape File 3A (50)




6. 1980 Master Area Reference File (Census Master Enumeration District [MED] List)

7. 1980 PB82 - Age of Householder by Family Income | 1980 PB92 - Income of Unrelated Individuals 15 and Over by Age and Sex

– Lenoir County missing8. 1980 PB113 - Poverty Status in 1979 by Presence and Age of Related

Children | 1980 PB117 - Poverty Status in 1979 by Relationship and Age | 1980 PB120 - Poverty Status in 1979

– Clay and Wayne Counties missing9. Selected Variables for Zip Codes by County in North Carolina / Zip Codes

Which Cross County Lines are Split Between Counties / 1980 Summary Tape File 3-B, 1980 Census of Population and Housing

– Surrey and Wilkes Counties missing10. 1980 Detailed Occupation by Race and Sex for the Civilian Labor Force

– Jackson and Union Counties missing



• Site includes in-depth guides to using the profiles, including column-by-column descriptions of the data to be found in each

• Links to related resources at the state and federal levels


http://digital-library.ncdcr.gov 20 http://statelibrary.ncdcr.gov

http://digital-library.ncdcr.gov http://statelibrary.ncdcr.gov

http://digital-library.ncdcr.gov 22 http://statelibrary.ncdcr.gov


STATE PUBLICATIONS COLLECTION

• Content from 31 agencies• Over 750 individual titles• Over 2500 total items• Spanish language• Variety of titles and topics

• What’s coming in the SPC– Sound files– Additional searches– Lot’s of new content– Historic content from the Ensuring Democracy project



How to find the State Publications Collection



State Publications Collection

• http://statelibrary.ncdcr.gov/govdocs/cdm/index.html



State Publications Collection: Browse by Agency



Ensuring Democracy Through Digital Access

• NC ECHO Digitization Grant• Large-scale digitization project • Approximately 200 titles, primarily serials (~2,300 volumes)• 750,000 total pages of state agency produced content



Ensuring Democracy: The Partners

– ECU - project lead and producing educational component– UNC-CH - scanning– State Library of North Carolina - PDF's added to the State

Publications Collection; long-term preservation of these files; coordinating which institutions materials are available to be scanned

– North Carolina Legislative Library– North Carolina Supreme Court Library

– All members will provide items to be digitized– All members participated in the selection of the content



Ensuring Democracy: The Content

Key titles– Session Laws– Public Documents– House and Senate

Journals – Agency biennial/annual

reports

Primary audience– Researchers– Historians– Students



Ensuring Democracy Through Digital Access: Scanning

• Internet Archive’s Scribe technology (archive.org)– high-speed, – high-quality mass digitization

techniques for bound materials. produce approximately 3,000 digitized pages of original text per day.

– Creates access files (color and b/w PDF's, flipbook, dejaVu)– Creates archival masters (jpeg2000)– Creates OCR’d text (abbyy Fine Reader files, txt)



Ensuring Democracy Through Digital Access: Metadata

• Using a combination of Dublin Core and NC ECHO Preservation Metadata for Digital Objects

• Workflow– Initially, metadata extracted by Internet Archive from MARC

records in local catalogs (Z39.5) for use at http://www.archive.org– Internet Archive creates various XML files containing descriptive,

technical, and administrative metadata– ECU extracts “locally required” metadata elements from IA XML

files– ECU data dumped into State Library’s CONTENTdm collection– Records reviewed, corrected, enhanced by grant project staff

according to State Library guidelines for the description of state government documents



Ensuring Democracy Through Digital Access: Website

• ECU developing state of the art website containing dynamic Web 2.0 features– Several sections, including*:

• 5-6 “history salons” – in-depth research on topics of interest to the public

• K12 students/educators – will include lesson plans• Brief descriptions of main titles within the collection• Comments, tagging, tag clouds, geographic mapping, blogs,

etc.?• Library professionals section – will contain information about

technical aspects related to the collections development

*Look for the site soon at http://ncgovdocs.org



Ensuring Democracy Internet Archive Page:http://www.archive.org/details/ncgovdocs



North Carolina State Government Web Site Archives – New additions / Web 2.0 Harvests

• Search the State Agency Web Site Archive – now available from 1996 – current!

• Working with Governor’s Office, State ITS, and State Archives to harvest all of the governor’s Web 2.0 and Social Networking sites

• Soon to expand to include all State Agency social media sites

– Facebook, blogs, Twitter, YouTube, Flickr, and LinkedIn

– Includes moderator updates, user comments, and photographs



On the horizon

• Educational website to help Agency Staff create and maintain “long-term, preserve-able” born-digital documents

• More partnerships within State Government and NC academia

• In partnership with the State Archives, working to develop a Digital Preservation Plan for DCR


Digital Initiatives at the State Library of NC (NCLA Conference 2009)

Education

Transcript of Digital Initiatives at the State Library of NC (NCLA Conference 2009)