Sno isle metrics stories & tips

40
INFOBLITZ: METRICS STORIES & TIPS Outcomes, Value & Impact: Metrics for Library Success

Transcript of Sno isle metrics stories & tips

Page 1: Sno isle metrics stories & tips

INFOBLITZ: METRICS STORIES & TIPS

Outcomes, Value & Impact: Metrics for Library Success

Page 2: Sno isle metrics stories & tips

About Sno-Isle Libraries: Where?

• Island and Snohomish counties

• 700,000 residents

• 2,260 sq. miles/585K hectares

2

Page 3: Sno isle metrics stories & tips

More About Sno-Isle Libraries

• 21 locations, 460+ employees

• $48+ mil budget

• 1+ mil items, 9.1 mil circ

• Wide mix of service areas• Suburbs

• Rural

• Island

• Tribal lands

3

Page 4: Sno isle metrics stories & tips

Metrics Stories & Tips

Christa Werle, Public Services Project Manager

Ideation to Projects with Impact

Terry Beck, Information Services Manager

Gathering Data

Lindsay Hanson, Data Analysis Librarian

Analysis & Business Intelligence

Page 5: Sno isle metrics stories & tips

IDEATION TO PROJECTS WITH IMPACTChrista Werle, Public Services Project Manager

Page 6: Sno isle metrics stories & tips

10 hits/month avg.

Page 7: Sno isle metrics stories & tips

Culture Change Initiatives

• Idea Management

• Proposing Projects with Purpose

• Project Planning for Impact

Page 8: Sno isle metrics stories & tips

Idea Management

aka: Strategic Innovation

Page 9: Sno isle metrics stories & tips

Idea Management

Anyone and everyone. 98% staff participation.

• What is the demand for this idea and how does it benefit our strategic plan?

• What outcome (change in the customer experience) could be measured for this idea?

• Is the impact of this idea found locally, regionally, or system-wide?

• What or who inspired this idea and who have you already talked to about it?

Page 10: Sno isle metrics stories & tips

Proposing Projects With Purpose

Authors & Supervisors

55% of Public Services Management to date

Proposal Ready =

• Need identified• Non-anecdotal evidence• Measurable change• Key stakeholders identified

Page 11: Sno isle metrics stories & tips

Proposing Projects With Purpose

Supported and further developed by:

• Data Analysis Librarian

• Strategic Review Group (cross-departmental PMO)

http://www.ducttapemarketing.com/wp-content/uploads/2011/09/custom-cartoon-duct-tapelores.jpg

Page 12: Sno isle metrics stories & tips

Project Planning for Impact

Page 13: Sno isle metrics stories & tips

Project Planning for Impact

“Create a plan for measures and evaluation of the success of the project, aka Quality Control.”

Page 14: Sno isle metrics stories & tips

GATHERING DATA: INFORMATION SERVICES PROJECT, 2014

Terry Beck, Information Services Manager

Page 15: Sno isle metrics stories & tips
Page 16: Sno isle metrics stories & tips

We knew that we couldn’t keep operating this way

• Reference stats were down 16% from 2009

• Job descriptions were confusing

• Staff and supervisors couldn’t differentiate positions

• Staff were starting to work outside their job classification

Page 17: Sno isle metrics stories & tips

• Desk schedules

• Outreach to schools

• Service to small business/entrepreneur community

• Build literate and economically sound communities

Make better use of our highly educated and trained librarian staff

Page 18: Sno isle metrics stories & tips
Page 19: Sno isle metrics stories & tips

But what do our customers

want/expect?

Page 20: Sno isle metrics stories & tips

Information Services Project

Customer Survey• It had to be short

• It had to use as much “non-library” language as possible

• Avoiding “You’re wonderful”

• Staff had to understand the why and the how

• Building heads lead us to stakeholders

• Paper was possible, but costly

Page 21: Sno isle metrics stories & tips

Bringing staff along

• Building heads and stakeholders

• Who’s on the list

• Tip: Be cautious when you survey educators via their school or institution email during the summer

Page 22: Sno isle metrics stories & tips

Our results

• Web link - 354

• Community Contacts - 176

• Paper survey in community libraries - 52

Page 23: Sno isle metrics stories & tips

How important is it to get assistance?Web Link Results

1.Selecting a book to read

2.Finding information for a hobby

3.Learning to use different library resources

Page 24: Sno isle metrics stories & tips

How important is it to get assistance?Community Contacts Results

1.Selecting a book to read

2.Learning to use different library resources

3.Learning to use various technologies

Page 25: Sno isle metrics stories & tips

How important is it to get assistance?Paper Survey Results

1.Selecting a book to read

TIE

• Conducting personal research regarding a health topic

• Conducting academic level research

• Learning to use different library resources

Page 26: Sno isle metrics stories & tips

Other—the unregulated text box

• Collection suggestions

• Marketing suggestions

• Building suggestions

• Staffing suggestions

Page 27: Sno isle metrics stories & tips

And it all led to Informed Change• CE requirement for all librarians

• Adoption of “the grid”

• Lead Librarians for Business Services, Readers Services, Public Computing, Data Analysis Librarian

• Information Services Statement of Service

• All-librarians meeting (no supervisors)

• Training Plan

• Mentoring

• Contact Center

• Availability (0800 until close of business day, 7 days a week)

• Annual customer survey

Page 28: Sno isle metrics stories & tips

And in November. . .

We survey our customers again via:

• Website

• Email to stakeholders

• No paper!

Lindsay Hanson, Data Analysis Librarian

Page 29: Sno isle metrics stories & tips

ANALYSIS & BUSINESS INTELLIGENCELindsay Hanson, Data Analysis Librarian

Page 30: Sno isle metrics stories & tips

Outcomes Based Assessment

A framework for determining whether our efforts and resources are achieving the intended results.

www.evaluationtoolkit.org/illustrations/4/original/miracle_cartoon.jpg?1231530108

Page 31: Sno isle metrics stories & tips

Why do we care?

• We only have a limited amount of resources

• We want to have a positive impact in our community

• And – we want to be able to demonstratethe positive impact we’re having

Page 32: Sno isle metrics stories & tips

How is this any different from what we’ve always done?

• Profound shift in the way we think about what we do

• Requires clear parameters from the get-go

• Necessitates us to evaluate differently

Page 33: Sno isle metrics stories & tips

Outcomes Based Assessment Framework

Inputs Outputs Outcomes Impact

Resource Perspective

Operational Perspective

User Perspective

Stakeholder/ Community Perspective

Page 34: Sno isle metrics stories & tips

Outcomes Based Assessment Framework

Inputs Outputs Outcomes Impact

Resource Perspective

Operational Perspective

User Perspective

Stakeholder/ Community Perspective

Page 35: Sno isle metrics stories & tips

Outcomes Based Assessment FrameworkExample: Job Search Program

Inputs Outputs Outcomes Impact

Staff TimeMaterials Cost

Space

Program AttendeesCirculation

Changes in user behavior

– new skills

Increase employment

levels

Page 36: Sno isle metrics stories & tips

Evaluating Outcomes

For Information Services

• Biannual Staff Surveys

• Annual Customer Survey

• Book-A-Librarian Statistics

Page 37: Sno isle metrics stories & tips

Evaluating Outcomes

For Projects and Other Initiatives

• Monitor specific outputs over time to indicate changes in customer behavior

• Utilize our partners for assistance with evaluation

• Targeted Surveys

Page 38: Sno isle metrics stories & tips

Future of Data Management at Sno-Isle

How do we keep track of all of these data and

ensure that the information continues

to be useful?

http://allantyoung.com/wp-content/uploads/2008/04/informationoverloadcartoon.jpg

Page 39: Sno isle metrics stories & tips

Q & A

Page 40: Sno isle metrics stories & tips

Metrics Stories & Tips

Christa Werle, Public Services Project Manager

[email protected], 360-651-7160

Terry Beck, Information Services Manager

[email protected], 360-651-7016

Lindsay Hanson, Data Analysis Librarian

[email protected], 360-651-7062