Outline for the Day
description
Transcript of Outline for the Day
![Page 1: Outline for the Day](https://reader036.fdocuments.us/reader036/viewer/2022062323/56816156550346895dd0ddcf/html5/thumbnails/1.jpg)
1
Building Blocks for Digital Curation Programs Standards as Frameworks for Action Lunch 12:00-1:00 Use and Re-use Over Time Sustainability, Advocacy, and Engagement Wrap up and Evaluation
There will be a break in the morning and afternoon
Outline for the Day
![Page 2: Outline for the Day](https://reader036.fdocuments.us/reader036/viewer/2022062323/56816156550346895dd0ddcf/html5/thumbnails/2.jpg)
2
Become familiar with the concepts and objectives of workflows that enable long-term access
Explore options for managing expectations across the lifecycle
Review the fundamentals of user-based evaluation for assessing and improving services
Understand the benefits of developing a culture of assessment for repository sustainability
Goals for Part 3: Use & Re-Use
![Page 3: Outline for the Day](https://reader036.fdocuments.us/reader036/viewer/2022062323/56816156550346895dd0ddcf/html5/thumbnails/3.jpg)
3
1. Conceptual frameworks2. Organizational infrastructure3. Technological infrastructure4. Resource framework5. Policy framework6. Roles & responsibilities7. Stakeholders
8. Content characteristics9. Standards10. Holistic workflows11. Strategy & planning12. Outreach & advocacy13. Ongoing evaluation
Building Blocks re: Use & Re-Use
![Page 4: Outline for the Day](https://reader036.fdocuments.us/reader036/viewer/2022062323/56816156550346895dd0ddcf/html5/thumbnails/4.jpg)
4
EFFECTIVE WORKFLOWS
![Page 5: Outline for the Day](https://reader036.fdocuments.us/reader036/viewer/2022062323/56816156550346895dd0ddcf/html5/thumbnails/5.jpg)
5
DigCCurr: Transition Point in Life of Digital Object
![Page 6: Outline for the Day](https://reader036.fdocuments.us/reader036/viewer/2022062323/56816156550346895dd0ddcf/html5/thumbnails/6.jpg)
6
Work Flow
“the sequence of processes through which a piece of work passes from initiation to completion”(Oxford English Dictionary, Second Edition, 1989)
![Page 7: Outline for the Day](https://reader036.fdocuments.us/reader036/viewer/2022062323/56816156550346895dd0ddcf/html5/thumbnails/7.jpg)
7
Converging Developments Tools
Perform functions Populate workflows
Workflows Integrated into repositories or standalone Combine 1 or more tools with human action
![Page 8: Outline for the Day](https://reader036.fdocuments.us/reader036/viewer/2022062323/56816156550346895dd0ddcf/html5/thumbnails/8.jpg)
Workflow Concepts Definition of workflow:
Description of practice and procedures Automation of repetitive tasks Graphic representation of flow of work
Workflow engine concepts: Orchestration: composition and execution of new
services (definition) Choreography: interaction/coordinated action
between services (description)
![Page 9: Outline for the Day](https://reader036.fdocuments.us/reader036/viewer/2022062323/56816156550346895dd0ddcf/html5/thumbnails/9.jpg)
9
In practice, the functions have to be pieced together in specific ways that are appropriate to an organizational context or need
If the functions are the verbs, then the workflows are the sentences (or paragraphs...)
Workflows vs. Functions
![Page 10: Outline for the Day](https://reader036.fdocuments.us/reader036/viewer/2022062323/56816156550346895dd0ddcf/html5/thumbnails/10.jpg)
10
Tasks are discrete Workflows link tasks in a logical fashion Workflows depend upon interoperability
Workflows vs. Tasks
![Page 11: Outline for the Day](https://reader036.fdocuments.us/reader036/viewer/2022062323/56816156550346895dd0ddcf/html5/thumbnails/11.jpg)
Workflow Influences Critical path method (project management)
1. List all activities2. Determine time (duration) for completion3. Identify dependencies between activities
Process Improvement examples: Six Sigma Total Quality Management (TQM) Business Process Reengineering
![Page 12: Outline for the Day](https://reader036.fdocuments.us/reader036/viewer/2022062323/56816156550346895dd0ddcf/html5/thumbnails/12.jpg)
Considerations Purpose
As is: document what is happening now To be: document what should happen
Right-sized Appropriate granularity for problem, setting Extent and type of documentation
Maintenance changes in staff, roles New or changed functions New tools and common workflows
![Page 13: Outline for the Day](https://reader036.fdocuments.us/reader036/viewer/2022062323/56816156550346895dd0ddcf/html5/thumbnails/13.jpg)
EXAMPLES
13
![Page 14: Outline for the Day](https://reader036.fdocuments.us/reader036/viewer/2022062323/56816156550346895dd0ddcf/html5/thumbnails/14.jpg)
PANIC, 2003-2004
![Page 15: Outline for the Day](https://reader036.fdocuments.us/reader036/viewer/2022062323/56816156550346895dd0ddcf/html5/thumbnails/15.jpg)
version 0.10 in 2013
![Page 16: Outline for the Day](https://reader036.fdocuments.us/reader036/viewer/2022062323/56816156550346895dd0ddcf/html5/thumbnails/16.jpg)
16
![Page 17: Outline for the Day](https://reader036.fdocuments.us/reader036/viewer/2022062323/56816156550346895dd0ddcf/html5/thumbnails/17.jpg)
Discussion 3: Archival Scenario
--What kinds of risks do
archivists need to avoid/mitigate to preserve authentic digital records?
![Page 18: Outline for the Day](https://reader036.fdocuments.us/reader036/viewer/2022062323/56816156550346895dd0ddcf/html5/thumbnails/18.jpg)
EVALUATION & ASSESSMENT
![Page 19: Outline for the Day](https://reader036.fdocuments.us/reader036/viewer/2022062323/56816156550346895dd0ddcf/html5/thumbnails/19.jpg)
Evaluation “A systematic process for ascertaining
whether and why an object of study meets the goals envisioned for that object.”
Gary Marchionini & Gregory Crane, “Evaluating Hypermedia and Learning: Methods and Results from the Perseus Project,” Transactions on Information Systems (TOIS) , Vol. 12 Issue 1 (January 1994): 6.
19
![Page 20: Outline for the Day](https://reader036.fdocuments.us/reader036/viewer/2022062323/56816156550346895dd0ddcf/html5/thumbnails/20.jpg)
Assessment vs. Evaluation Academics tend to use the term “evaluation” for
this constellation of activities. Administrators in higher education and libraries
are coming to use the term “assessment” when thinking about their programs.
In both cases, we want to know how well we are doing and base that assessment in measurable data.
20
![Page 21: Outline for the Day](https://reader036.fdocuments.us/reader036/viewer/2022062323/56816156550346895dd0ddcf/html5/thumbnails/21.jpg)
High-Level Rationale for Evaluation & Assessment Assessment is the basis of self-
understanding and improvement. Sharing results through publication leads to
profession-wide benchmarks and overall understand and improvement.
A culture of assessment can arise when fostered by administrators and managers.
![Page 22: Outline for the Day](https://reader036.fdocuments.us/reader036/viewer/2022062323/56816156550346895dd0ddcf/html5/thumbnails/22.jpg)
Rationale The ability to accurately compare and
contrast program metrics with like institutions helps to set standards for services assist in planning for improvements to those
functions. The ultimate goal of these projects was to
provide archivists with data collection and analysis tools to support decision-making.
22
![Page 23: Outline for the Day](https://reader036.fdocuments.us/reader036/viewer/2022062323/56816156550346895dd0ddcf/html5/thumbnails/23.jpg)
Elements of Evaluation/Assessment
Goals and objectives of object, system, process, etc.
Evaluators. Often other humans, i.e., staff and users of
system. Methodology. Data. Comparison of goals for object, event, process,
etc. under study. Conclusions.
23
![Page 24: Outline for the Day](https://reader036.fdocuments.us/reader036/viewer/2022062323/56816156550346895dd0ddcf/html5/thumbnails/24.jpg)
Evaluation Issues Complex process. Requires some level of training. Takes time and resources. No single golden method exists. Multiple methods yield best view of “reality.” Rigorous sampling is essential – study is only as
good as the sample. Quantitative / qualitative: an artificial dichotomy? Privacy and Institutional Review Board (IRB)
approval.
24
![Page 25: Outline for the Day](https://reader036.fdocuments.us/reader036/viewer/2022062323/56816156550346895dd0ddcf/html5/thumbnails/25.jpg)
BUILDING A CULTURE OF ASSESSMENT
![Page 26: Outline for the Day](https://reader036.fdocuments.us/reader036/viewer/2022062323/56816156550346895dd0ddcf/html5/thumbnails/26.jpg)
What Is a Culture of Assessment? “An organizational environment in which
decisions are based on facts, research and analysis, and where services are planned and delivered in ways that maximize positive outcomes and impacts for customers and stakeholders.”
Amos Lakos & Shelley Phipps, “Creating a Culture of Assessment,” portal: Libraries and the Academy,
Vol. 4, No. 3 (2004), pp. 345–361.
![Page 27: Outline for the Day](https://reader036.fdocuments.us/reader036/viewer/2022062323/56816156550346895dd0ddcf/html5/thumbnails/27.jpg)
27
Assessment, based on measurable, reliable, and valid data, is a pathway to sustainability.
Assessment metrics make the case for value and continuing funding.
User-based assessment metrics are an advocacy tool, drawing in the user, the collections donor, and the resource allocator.
Why a Culture of Assessment?
![Page 28: Outline for the Day](https://reader036.fdocuments.us/reader036/viewer/2022062323/56816156550346895dd0ddcf/html5/thumbnails/28.jpg)
Creating a Culture of Assessment User-based evaluation needs to be
established on concepts that are specific to archives and special collections.
If archivists do not do this for themselves, someone else will.
Archival Metrics Toolkits developed by and for archivistsCollaboration between researchers and
practitioners.
28
![Page 29: Outline for the Day](https://reader036.fdocuments.us/reader036/viewer/2022062323/56816156550346895dd0ddcf/html5/thumbnails/29.jpg)
USER-BASED EVALUATION
29
![Page 30: Outline for the Day](https://reader036.fdocuments.us/reader036/viewer/2022062323/56816156550346895dd0ddcf/html5/thumbnails/30.jpg)
User-Based Evaluation Tells us how users view our constellation of services,
service delivery, and resources, such as collections. Is not collection-based but user-centric. Can tell us about fulfillment of needs as well as user
satisfaction. Helps information professionals better allocate their
resources for improved performance and user satisfaction.
Few user-based studies have been conducted and fewer published, especially from archives and museums, so there is much to learn.
Little comparability across studies conducted. 30
![Page 31: Outline for the Day](https://reader036.fdocuments.us/reader036/viewer/2022062323/56816156550346895dd0ddcf/html5/thumbnails/31.jpg)
Evaluation of Digital Projects Designed to:
assess what has been achieved with large investments of resources.
improve current provision (e.g. usability testing, interface design).
provide public accountability (often public funds are used).
Fulfill requirements of funding bodies.
31
![Page 32: Outline for the Day](https://reader036.fdocuments.us/reader036/viewer/2022062323/56816156550346895dd0ddcf/html5/thumbnails/32.jpg)
Evaluation of Digital Projects Helps to show who the users are and what
they are doing/requesting. Measures the project’s/program’s impact
(e.g. on teaching, research, lifelong learning).
Informs future developments and as a basis for future projects or grants.
32
![Page 33: Outline for the Day](https://reader036.fdocuments.us/reader036/viewer/2022062323/56816156550346895dd0ddcf/html5/thumbnails/33.jpg)
And…. No good understanding yet of the use of
digital objects in collections. We don’t know what people want/need in
terms of:The collection,Services, or What constitutes good service.
33
![Page 34: Outline for the Day](https://reader036.fdocuments.us/reader036/viewer/2022062323/56816156550346895dd0ddcf/html5/thumbnails/34.jpg)
ARCHIVAL METRICS PROJECTS
34
![Page 35: Outline for the Day](https://reader036.fdocuments.us/reader036/viewer/2022062323/56816156550346895dd0ddcf/html5/thumbnails/35.jpg)
www.archivalmetrics.org
35
![Page 36: Outline for the Day](https://reader036.fdocuments.us/reader036/viewer/2022062323/56816156550346895dd0ddcf/html5/thumbnails/36.jpg)
Archival Metrics Toolkits Developed to meet the needs of archivists
in evaluating their services to specific user groups: Researcher Archival WebsiteOnline Finding Aids Student ResearcherTeaching Support
36
![Page 37: Outline for the Day](https://reader036.fdocuments.us/reader036/viewer/2022062323/56816156550346895dd0ddcf/html5/thumbnails/37.jpg)
37
![Page 38: Outline for the Day](https://reader036.fdocuments.us/reader036/viewer/2022062323/56816156550346895dd0ddcf/html5/thumbnails/38.jpg)
Discussion 4: Archival Scenario
--1. What types of evaluation
have you conducted in your repository?
2. What types would you like to conduct?