WORKING NOTES AS AN ARCHIVAL CHALLENGEARCHIVAL … · 2013. 4. 22. · Michael Buckland, School of...

44
WORKING NOTES AS AN ARCHIVAL CHALLENGE ARCHIVAL CHALLENGE Michael Buckland, School of Information, UC Berkeley Michael Buckland, School of Information, UC Berkeley Patrick Golden, School of Information, UC Berkeley Andrew Hyslop, California State Archives S it f C lif i A hi i t AGM 2013 Society of California Archivists AGM 2013 April 13, 2013

Transcript of WORKING NOTES AS AN ARCHIVAL CHALLENGEARCHIVAL … · 2013. 4. 22. · Michael Buckland, School of...

Page 1: WORKING NOTES AS AN ARCHIVAL CHALLENGEARCHIVAL … · 2013. 4. 22. · Michael Buckland, School of Information, UC BerkeleyMichael Buckland, School of Information, UC Berkeley Patrick

WORKING NOTES AS ANARCHIVAL CHALLENGEARCHIVAL CHALLENGE

Michael Buckland, School of Information, UC BerkeleyMichael Buckland, School of Information, UC BerkeleyPatrick Golden, School of Information, UC BerkeleyAndrew Hyslop, California State Archives

S i t f C lif i A hi i t AGM 2013Society of California Archivists AGM 2013April 13, 2013

Page 2: WORKING NOTES AS AN ARCHIVAL CHALLENGEARCHIVAL … · 2013. 4. 22. · Michael Buckland, School of Information, UC BerkeleyMichael Buckland, School of Information, UC Berkeley Patrick

Working Notes as an Archival Challenge

April 13, 2013 Society of California Archivisits AGM

Working Notes as an Archival Challenge

I Introduction to “Editorial Practices and the Web”:I. Introduction to Editorial Practices and the Web : Project rationale, progress, and status

U & htt // dit t /II. Use case & http://editorsnotes.org/

III. Archiving editors’ working notes

IV. Potential for archivists’ working notes

V. Questions & discussion

Page 3: WORKING NOTES AS AN ARCHIVAL CHALLENGEARCHIVAL … · 2013. 4. 22. · Michael Buckland, School of Information, UC BerkeleyMichael Buckland, School of Information, UC Berkeley Patrick

Problems of Documentary Editions

April 13, 2013 Society of California Archivisits AGM

Problems of Documentary Editions• Requires specialized expertise for many years.q p p y y

• Funding is difficult.

• Much of the editors’ research not included because• Much of the editors research not included because inconclusive or marginally relevant to the publication.

• Limitations of the printed edition: Costly Limit on numberLimitations of the printed edition: Costly. Limit on number of pages, so editors’ notes reduced. Small editions bought by libraries. Not widely available.

• Relatively isolated work.

• Working notes and unpublished notes discarded.

The return on investment far less that it could be.

Page 4: WORKING NOTES AS AN ARCHIVAL CHALLENGEARCHIVAL … · 2013. 4. 22. · Michael Buckland, School of Information, UC BerkeleyMichael Buckland, School of Information, UC Berkeley Patrick

Editorial Practices and the Web: April 13, 2013 Society of California Archivisits AGM

Objectives1. Increased return on investment by making editors’ notes y g

promptly and more fully available through Web publication;

2. Gain in efficiency through collaborative, shared access to working notes among related projects; and

3. More effective interoperability with archival finding aids, library pathfinders, and other scholarly infrastructure as all become more closely associated in digitalall become more closely associated in digital environment.

Page 5: WORKING NOTES AS AN ARCHIVAL CHALLENGEARCHIVAL … · 2013. 4. 22. · Michael Buckland, School of Information, UC BerkeleyMichael Buckland, School of Information, UC Berkeley Patrick

A Case Study: A Digital Remedy

April 13, 2013 Society of California Archivisits AGM

A Case Study: A Digital RemedySave as .html ! Make editors’ notes available in full as early as possible on a webpage regardless of what happens in the eventual published edition.  Immediately available.  Indexed by Google, etc.

Page 6: WORKING NOTES AS AN ARCHIVAL CHALLENGEARCHIVAL … · 2013. 4. 22. · Michael Buckland, School of Information, UC BerkeleyMichael Buckland, School of Information, UC Berkeley Patrick

A Case Study: A Digital Remedy

April 13, 2013 Society of California Archivisits AGM

A Case Study: A Digital RemedySave as .html ! Make editors’ notes available in full as early as possible on a webpage regardless of what happens in the eventual published edition.  Immediately available.  Indexed by Google, etc.

Ideas Working notes Notes

Notes in memory or handwritten

Notes, clippings, images. in folders, boxes,

Brief notes in published volume

handwritten boxes,

Page 7: WORKING NOTES AS AN ARCHIVAL CHALLENGEARCHIVAL … · 2013. 4. 22. · Michael Buckland, School of Information, UC BerkeleyMichael Buckland, School of Information, UC Berkeley Patrick

A Case Study: A Digital Remedy

April 13, 2013 Society of California Archivisits AGM

A Case Study: A Digital RemedySave as .html ! Make editors’ notes available in full as early as possible on a webpage regardless of what happens in the eventual published edition.  Immediately available.  Indexed by Google, etc.

Ideas Working notes Notes

Notes in memory or handwritten

Notes, clippings, images. in folders, boxes,

Brief notes in published volume

handwritten boxes,

Notes keyed or  Files in digital Detailed notes  rapidly webscanned

grepositories

rapidly web accessible

Page 8: WORKING NOTES AS AN ARCHIVAL CHALLENGEARCHIVAL … · 2013. 4. 22. · Michael Buckland, School of Information, UC BerkeleyMichael Buckland, School of Information, UC Berkeley Patrick

A Case Study: A Digital Remedy

April 13, 2013 Society of California Archivisits AGM

A Case Study: A Digital RemedySave as .html ! Make editors’ notes available in full as early as possible on a webpage regardless of what happens in the eventual published edition.  Immediately available.  Indexed by Google, etc.

Ideas Working notes Notes

Notes in memory or handwritten

Notes, clippings, images. in folders, boxes

Brief notes in published volume

Notes keyed or  Files in digital Detailed notes  rapidly web

handwritten boxes,

scannedg

repositoriesrapidly web accessible

Published on the Web

Page 9: WORKING NOTES AS AN ARCHIVAL CHALLENGEARCHIVAL … · 2013. 4. 22. · Michael Buckland, School of Information, UC BerkeleyMichael Buckland, School of Information, UC Berkeley Patrick

A Case Study: A Digital Remedy

April 13, 2013 Society of California Archivisits AGM

A Case Study: A Digital RemedySave as .html ! Make editors’ notes available in full as early as possible on a webpage regardless of what happens in the eventual published edition.  Immediately available.  Indexed by Google, etc.

Ideas Working notes Notes

Notes in memory or handwritten

Notes, clippings, images. in folders, boxes

Brief notes in published volume

Notes keyed or  Files in digital Detailed notes  rapidly web

handwritten boxes,

scannedg

repositoriesrapidly web accessible

Published on the Web

More a change in work practice than a technical challenge.

Page 10: WORKING NOTES AS AN ARCHIVAL CHALLENGEARCHIVAL … · 2013. 4. 22. · Michael Buckland, School of Information, UC BerkeleyMichael Buckland, School of Information, UC Berkeley Patrick

Editorial Practices and the Web:April 13, 2013 Society of California Archivisits AGM

Phase 1 AgendaIncrease use of digital notes• Increase use of digital notes

• Create shared website for working notes: editorsnotes orgeditorsnotes.org

• Make editors’ working notes openly available

E t d t lib i l ll ti t ’ t l• Extend to library special collection curators’ notes also

Page 11: WORKING NOTES AS AN ARCHIVAL CHALLENGEARCHIVAL … · 2013. 4. 22. · Michael Buckland, School of Information, UC BerkeleyMichael Buckland, School of Information, UC Berkeley Patrick

Editorial Practices and the Web:April 13, 2013 Society of California Archivisits AGM

Phase 2 AgendaIntroduce digital humanities tools• Introduce digital humanities tools.

• Extend to archivists’ working notes. (To follow).

• Projects end, scholarship doesn’t. “Hibernating archive.” • Archival processing of editors’ notes when project ends.

• Work practices preprocess for archival deposit.

• Predispose for later continued scholarship.

Page 12: WORKING NOTES AS AN ARCHIVAL CHALLENGEARCHIVAL … · 2013. 4. 22. · Michael Buckland, School of Information, UC BerkeleyMichael Buckland, School of Information, UC Berkeley Patrick

April 13, 2013 Society of California Archivisits AGM

EXAMPLE USE CASE

Page 13: WORKING NOTES AS AN ARCHIVAL CHALLENGEARCHIVAL … · 2013. 4. 22. · Michael Buckland, School of Information, UC BerkeleyMichael Buckland, School of Information, UC Berkeley Patrick

Documentary editing

April 13, 2013 Society of California Archivisits AGM

Documentary editing

Edit ll ti f d t l tt ti l• Editors prepare collections of documents: letters, articles, diaries, essays, etc.

Printed volumes provide context for better understanding• Printed volumes provide context for better understanding subjects’ experiences and general milieu through footnotes, images, chronologies, articles

Page 14: WORKING NOTES AS AN ARCHIVAL CHALLENGEARCHIVAL … · 2013. 4. 22. · Michael Buckland, School of Information, UC BerkeleyMichael Buckland, School of Information, UC Berkeley Patrick

Documentary editing: workflow

April 13, 2013 Society of California Archivisits AGM

Documentary editing: workflow

1) Gather documents1) Gather documents

2) Contextualize select items

3) Publish final product

4) Repeat as funding allows

Page 15: WORKING NOTES AS AN ARCHIVAL CHALLENGEARCHIVAL … · 2013. 4. 22. · Michael Buckland, School of Information, UC BerkeleyMichael Buckland, School of Information, UC Berkeley Patrick

Case study: Emma Goldman Papers

April 13, 2013 Society of California Archivisits AGM

Case study: Emma Goldman Papers

Page 16: WORKING NOTES AS AN ARCHIVAL CHALLENGEARCHIVAL … · 2013. 4. 22. · Michael Buckland, School of Information, UC BerkeleyMichael Buckland, School of Information, UC Berkeley Patrick

Case study: Emma Goldman Papers

April 13, 2013 Society of California Archivisits AGM

Case study: Emma Goldman Papers

Page 17: WORKING NOTES AS AN ARCHIVAL CHALLENGEARCHIVAL … · 2013. 4. 22. · Michael Buckland, School of Information, UC BerkeleyMichael Buckland, School of Information, UC Berkeley Patrick

Case study: Emma Goldman Papers

April 13, 2013 Society of California Archivisits AGM

Case study: Emma Goldman Papers

Page 18: WORKING NOTES AS AN ARCHIVAL CHALLENGEARCHIVAL … · 2013. 4. 22. · Michael Buckland, School of Information, UC BerkeleyMichael Buckland, School of Information, UC Berkeley Patrick

Case study: Emma Goldman Papers

April 13, 2013 Society of California Archivisits AGM

Case study: Emma Goldman Papers

Page 19: WORKING NOTES AS AN ARCHIVAL CHALLENGEARCHIVAL … · 2013. 4. 22. · Michael Buckland, School of Information, UC BerkeleyMichael Buckland, School of Information, UC Berkeley Patrick

Case study: Emma Goldman Papers

April 13, 2013 Society of California Archivisits AGM

Case study: Emma Goldman Papers

Page 20: WORKING NOTES AS AN ARCHIVAL CHALLENGEARCHIVAL … · 2013. 4. 22. · Michael Buckland, School of Information, UC BerkeleyMichael Buckland, School of Information, UC Berkeley Patrick

Case study: Emma Goldman Papers

April 13, 2013 Society of California Archivisits AGM

Case study: Emma Goldman Papers

Page 21: WORKING NOTES AS AN ARCHIVAL CHALLENGEARCHIVAL … · 2013. 4. 22. · Michael Buckland, School of Information, UC BerkeleyMichael Buckland, School of Information, UC Berkeley Patrick

Documentary editing: Problems

April 13, 2013 Society of California Archivisits AGM

Documentary editing: Problems• Published volumes & necessary work are expensivey p

• Lack of space for all footnotes

M h f h d i ith l d i f t t• Much of research done is either glossed over in footnotes or not included at all• Fact checkingFact checking

• Falsification or dead ends

• Tangential biographical details

• Preservation & legacy

Page 22: WORKING NOTES AS AN ARCHIVAL CHALLENGEARCHIVAL … · 2013. 4. 22. · Michael Buckland, School of Information, UC BerkeleyMichael Buckland, School of Information, UC Berkeley Patrick

How do projects take notes?

April 13, 2013 Society of California Archivisits AGM

How do projects take notes?Patrick—

Lenin:Had any of his family members y ybeside his brother, been imprisoned?What was the book he had written on ‘political economy’ that was used in

?Russsian Universities?

New York (Evening?) Post, September 1918 editorial on IWWSeptember 1918 editorial on IWW verdict for the huge IWW trial in Chicago.

Page 23: WORKING NOTES AS AN ARCHIVAL CHALLENGEARCHIVAL … · 2013. 4. 22. · Michael Buckland, School of Information, UC BerkeleyMichael Buckland, School of Information, UC Berkeley Patrick

How do projects take notes?

April 13, 2013 Society of California Archivisits AGM

How do projects take notes?• Sources consulted notesSources consulted, notes

taken based on findings

• Notes stored in a WordNotes stored in a Word documents? Yellow notebook? Email?

• Negative conclusion reached to question, but no one will ever knowno one will ever know

Page 24: WORKING NOTES AS AN ARCHIVAL CHALLENGEARCHIVAL … · 2013. 4. 22. · Michael Buckland, School of Information, UC BerkeleyMichael Buckland, School of Information, UC Berkeley Patrick

Editors’ Notes

April 13, 2013 Society of California Archivisits AGM

Editors Notes• http://editorsnotes.org/p g

• http://ecai.org/mellon2010/

Fi di f l f th “d b i ” f h• Finding a safe place for the “debris” of research

• Improving return on investment for documentary editing j tprojects

• Central focus on changing work practices of editors and researchers rather than digitizing what already existsresearchers rather than digitizing what already exists

Page 25: WORKING NOTES AS AN ARCHIVAL CHALLENGEARCHIVAL … · 2013. 4. 22. · Michael Buckland, School of Information, UC BerkeleyMichael Buckland, School of Information, UC Berkeley Patrick

Editors’ Notes: Design principles

April 13, 2013 Society of California Archivisits AGM

Editors Notes: Design principles

1) Minimal amount of “friction” for researchers

2) Flexibility for different work habits2) Flexibility for different work habits

3) Consistency in data models

4) Existing technology wherever possible

5) Adherence to web standards

Page 26: WORKING NOTES AS AN ARCHIVAL CHALLENGEARCHIVAL … · 2013. 4. 22. · Michael Buckland, School of Information, UC BerkeleyMichael Buckland, School of Information, UC Berkeley Patrick

Data model

April 13, 2013 Society of California Archivisits AGM

Data model

Page 27: WORKING NOTES AS AN ARCHIVAL CHALLENGEARCHIVAL … · 2013. 4. 22. · Michael Buckland, School of Information, UC BerkeleyMichael Buckland, School of Information, UC Berkeley Patrick

Documents

April 13, 2013 Society of California Archivisits AGM

Documents• Zotero for documentZotero for document

metadata (http://zotero.org/) • Ability to describe a wide

range of documentsg• Read/write API• Citeproc-js for generation of

citations and bibliographic g preferences

• High quality, zoomablescans with http://zoom it/scans with http://zoom.it/

• Transcripts in HTML with interface to annotate passages of text

Page 28: WORKING NOTES AS AN ARCHIVAL CHALLENGEARCHIVAL … · 2013. 4. 22. · Michael Buckland, School of Information, UC BerkeleyMichael Buckland, School of Information, UC Berkeley Patrick

Topics

April 13, 2013 Society of California Archivisits AGM

Topics• Primary method ofPrimary method of

indexing items

• Classified by typeClassified by type

• Interface for clustering/mergingclustering/merging

• Experimenting with structured data

Page 29: WORKING NOTES AS AN ARCHIVAL CHALLENGEARCHIVAL … · 2013. 4. 22. · Michael Buckland, School of Information, UC BerkeleyMichael Buckland, School of Information, UC Berkeley Patrick

Notes

April 13, 2013 Society of California Archivisits AGM

Notes• Most difficult part of the projectp p j

• Notes are messy, purposefully

H t d l thi h ti & idi ti ?• How to model something so chaotic & idiosyncratic?

• Goals: Easy to use; flexible but consistent

Page 30: WORKING NOTES AS AN ARCHIVAL CHALLENGEARCHIVAL … · 2013. 4. 22. · Michael Buckland, School of Information, UC BerkeleyMichael Buckland, School of Information, UC Berkeley Patrick

Notes

April 13, 2013 Society of California Archivisits AGM

Notes• Description p

• Status • Open, closed, hibernating

A i d• Assigned users

• Sections• Citation with optional

commentary

• Plain text

• Future: Maps? Timelines? Chronologies?

Page 31: WORKING NOTES AS AN ARCHIVAL CHALLENGEARCHIVAL … · 2013. 4. 22. · Michael Buckland, School of Information, UC BerkeleyMichael Buckland, School of Information, UC Berkeley Patrick

April 13, 2013 Society of California Archivisits AGM

Demonstration with Lenin examplep

Page 32: WORKING NOTES AS AN ARCHIVAL CHALLENGEARCHIVAL … · 2013. 4. 22. · Michael Buckland, School of Information, UC BerkeleyMichael Buckland, School of Information, UC Berkeley Patrick

What changed for researchers?

April 13, 2013 Society of California Archivisits AGM

What changed for researchers?

Free text Structured blocks

Implicit people, l t

Explicit linkable places, events entities

Filing cabinets Open access

Page 33: WORKING NOTES AS AN ARCHIVAL CHALLENGEARCHIVAL … · 2013. 4. 22. · Michael Buckland, School of Information, UC BerkeleyMichael Buckland, School of Information, UC Berkeley Patrick

Benefits of our approach

April 13, 2013 Society of California Archivisits AGM

Benefits of our approach• Connections linking topics are freed from the minds of g p

editors & researchers and indexed for anyone to see

• Standardized records of work can easily be revisited from ywithin a project or from outside

• New way of seeing the outer edges of humanities y g gresearch

• Evidence of intense, often messy, scholarship behind concise, clean footnotes

Page 34: WORKING NOTES AS AN ARCHIVAL CHALLENGEARCHIVAL … · 2013. 4. 22. · Michael Buckland, School of Information, UC BerkeleyMichael Buckland, School of Information, UC Berkeley Patrick

Technology

April 13, 2013 Society of California Archivisits AGM

Technology• Django Python web frameworkj g y

• PostgreSQL database

S th f d t b i ti• South for database migrations

• Haystack for full-text searching

• Zotero for document description

• Open Refine (prev. Google Refine) for duplicate detectionOpen Refine (prev. Google Refine) for duplicate detection

• Bootstrap & jQuery for frontend development

Page 35: WORKING NOTES AS AN ARCHIVAL CHALLENGEARCHIVAL … · 2013. 4. 22. · Michael Buckland, School of Information, UC BerkeleyMichael Buckland, School of Information, UC Berkeley Patrick

April 13, 2013 Society of California Archivisits AGM

ARCHIVING WORKING NOTES

Page 36: WORKING NOTES AS AN ARCHIVAL CHALLENGEARCHIVAL … · 2013. 4. 22. · Michael Buckland, School of Information, UC BerkeleyMichael Buckland, School of Information, UC Berkeley Patrick

Editorial Practices and the Web:April 13, 2013 Society of California Archivisits AGM

Phase 2 AgendaIntroduce digital humanities tools• Introduce digital humanities tools.

• Extend to archivists’ working notes. (To follow).

• Projects end, scholarship doesn’t. “Hibernating archive.” • Archival processing of editors’ notes when project ends.

• Work practices preprocess for archival deposit.

• Predispose for later continued scholarship.

Page 37: WORKING NOTES AS AN ARCHIVAL CHALLENGEARCHIVAL … · 2013. 4. 22. · Michael Buckland, School of Information, UC BerkeleyMichael Buckland, School of Information, UC Berkeley Patrick

April 13, 2013 Society of California Archivisits AGM

POTENTIAL FORPOTENTIAL FORARCHIVISTS’ WORKING NOTES

Page 38: WORKING NOTES AS AN ARCHIVAL CHALLENGEARCHIVAL … · 2013. 4. 22. · Michael Buckland, School of Information, UC BerkeleyMichael Buckland, School of Information, UC Berkeley Patrick

Archivists’ Working Notes

April 13, 2013 Society of California Archivisits AGM

Archivists Working Notes

Initial Observations

Documentary editors notes’ differ from archivists’ notes

Bibliographic citations vs. archival description 

Scholarly editions vs. finding aids and catalog entries

Intensive research vs. scope and content creation

Item level vs. series level

Page 39: WORKING NOTES AS AN ARCHIVAL CHALLENGEARCHIVAL … · 2013. 4. 22. · Michael Buckland, School of Information, UC BerkeleyMichael Buckland, School of Information, UC Berkeley Patrick

Archivists’ Working Notes

April 13, 2013 Society of California Archivisits AGM

Archivists Working Notes

Initial Observations

Shared benefits

Greater exposure of collection items

Increased access to materials

Digital humanities tools

Repository collaboration

Complements finding aids, guides, and pathfinders

Page 40: WORKING NOTES AS AN ARCHIVAL CHALLENGEARCHIVAL … · 2013. 4. 22. · Michael Buckland, School of Information, UC BerkeleyMichael Buckland, School of Information, UC Berkeley Patrick

Archivists’ Working Notes

April 13, 2013 Society of California Archivisits AGM

Archivists Working Notes

Initial Observations

Shared benefits

Notes captured, not lost

Immediate availability of notes

Dual purpose tool

Internal working notes for archivists

External resource for researchers

Page 41: WORKING NOTES AS AN ARCHIVAL CHALLENGEARCHIVAL … · 2013. 4. 22. · Michael Buckland, School of Information, UC BerkeleyMichael Buckland, School of Information, UC Berkeley Patrick

Archivists’ Working Notes

April 13, 2013 Society of California Archivisits AGM

Archivists Working Notes

Points of note capturePoints of note capture

Appraisal 

Accessioning

Processing

Reference

Exhibit/curatorial 

Website 

Research guide/finding aids

Page 42: WORKING NOTES AS AN ARCHIVAL CHALLENGEARCHIVAL … · 2013. 4. 22. · Michael Buckland, School of Information, UC BerkeleyMichael Buckland, School of Information, UC Berkeley Patrick

Archivists’ Working Notes

April 13, 2013 Society of California Archivisits AGM

Archivists Working Notes

Criteria for an archivists’ note?Criteria for an archivists  note?

A “wow” item

S l t d i t Selected processing notes

Reference notes

Historical significance

Related collections

Archivist’s choice

Reseachers’ notes

Page 43: WORKING NOTES AS AN ARCHIVAL CHALLENGEARCHIVAL … · 2013. 4. 22. · Michael Buckland, School of Information, UC BerkeleyMichael Buckland, School of Information, UC Berkeley Patrick

Archivists’ Working Notes

April 13, 2013 Society of California Archivisits AGM

Archivists Working Notes

Ch ll t hi l ti i t tiChallenges to archival practice integration

More Product, Less Process (MPLP) workflow

f d k Ease of entry and note‐taking

Duplication of efforts

Draft notes online /quality control

Opportunity costs and workload addition

Resources, staffing, and funding 

Public expectations

Page 44: WORKING NOTES AS AN ARCHIVAL CHALLENGEARCHIVAL … · 2013. 4. 22. · Michael Buckland, School of Information, UC BerkeleyMichael Buckland, School of Information, UC Berkeley Patrick

Thank You

April 13, 2013 Society of California Archivisits AGM

Thank YouEmma Goldman Papers, Berkeley

Andrew W Mellon Foundation Stanton-Anthon Papers, Rutgers

Margaret Sanger Papers, NYU

California State Archives

Andrew W. Mellon Foundation

Coleman Fung Foundation

Michael Buckland [email protected]

California State Archives

Patrick Golden [email protected] Hyslop [email protected]

Project information: http://ecai.org/mellon2010/Project site: http://editorsnotes org/Project site: http://editorsnotes.org/