Promoting a Culture of Assessment throughout the UCLA...
15
Promoting a Culture of Assessment throughout the UCLA Library Organization Promoting a Culture of Assessment throughout the UCLA Library Organization Dana Peterman Diane Mizrachi Sharon Shafer Todd Grappone Dana Peterman Strategic Planning Implementation Coordinator Digital and Distinctive Product Manager
Transcript of Promoting a Culture of Assessment throughout the UCLA...
Promoting a Culture of Assessment throughout the UCLA Library Organization
Promoting a Culture of Assessment throughout the UCLA Library Organization
Dana Peterman
Diane Mizrachi
Sharon Shafer
Todd GrapponeDana Peterman
Strategic Planning Implementation Coordinator
Digital and Distinctive Product Manager
Promoting a Culture of Assessment throughout the UCLA Library Organization
July 4, 2019 2
Overview
• UCLA Library environment
• Developing tools and skills
• Promotion and education
• What [will] happen[ed]
Promoting a Culture of Assessment throughout the UCLA Library Organization
• 45,000 students in 125 majors
• 100 librarians
• 350 full-time staff working
• > 12 libraries
• Units report to the University Librarian through four Associate University Librarians and management staff
• Matrix ambitions, but still partially siloed
July 4, 2019 3
Environment/Organization – Big, Complex
Promoting a Culture of Assessment throughout the UCLA Library Organization
July 4, 2019 4
• “We use a transparent, user-centered, evidence-based approach to assessour activities and impact.”
• “We nurture an environment of ongoing evaluation, transparent decisionmaking…”
• “Our research support improves continuously through assessment-basedimprovements."
• “We improve our instructional services, focusing on effective pedagogical practices and ongoing assessment.”
• “Our space-related initiatives begin with a data-driven, user-centered approach.”
LIBRARY STRATEGIC GOALS PAVING THE WAY FOR ASSESSMENT
Why assessment?
Promoting a Culture of Assessment throughout the UCLA Library Organization
July 4, 2019 5
Tools & skills – history and assumptions
Earth was cooling
~ 2006
Present
• Failing toward success - Data Warehouse
• Ubiquitous skills required - Confluence, JIRA & BOX
• Library strategic plan implementation
• Our assessment solution - Data Lake
Promoting a Culture of Assessment throughout the UCLA Library Organization
July 4, 2019 6
Team Leads: Sharon Shafer and Diane Mizrachi
Cabinet Sponsor: Todd Grappone
Strategic Planning Consultant: Dana Peterman
Members:
• Simon Lee
• Sandra Farfan-Gracia
• Estefani Bowline
• Neil Hodge
MEMBERS
Who’s doing the work
Promoting a Culture of Assessment throughout the UCLA Library Organization
CULTURE OF ASSESSMENT
July 4, 2019 7
ACT Goals
• Workshop
• Consult
• Iterate
• Align with strategic directions
Promoting a Culture of Assessment throughout the UCLA Library Organization
July 4, 2019 8
Primary Tool - UCLA Library Data Lake
GMO
• Centralizes assessment-related activities in the Library via Confluence
• Allows staff to add &/or discover studies, data, reports, and tools
• Uses templates to provides guidance for assessment activities
• Offers consultations
• Enables communication with management and stakeholders
Promoting a Culture of Assessment throughout the UCLA Library Organization
Reach out – validate and expand legitimacy within the broader UCLA community
July 4, 2019 9
Promotion of UCLA Library Data Lake
Communicate – written, verbal, and administrative
Create skin in the game – users help development the tool
Follow-up – let people know that we’re listening to them and supporting them
Educate – workshops that introduce, expansion via stakeholders
See Sharon Shafer in Room 3, 45 minutes from now to learn about the Data Lake tool
Promoting a Culture of Assessment throughout the UCLA Library Organization
July 4, 2019 10
Assessment Form - 1
5/24/2019 ASSESSMENT: Optimizing UCLA Library Special Collections Pages for Findability - Assessment for Change Team - Confluence
https://docs.library.ucla.edu/display/ACT/ASSESSMENT%3A+Optimizing+UCLA+Library+Special+Collections+Pages+for+Findability 1/2
Dashboard /… / Assessment
Created by Caroline Cube, last modified by Dana Peterman on May 15, 2019
ASSESSMENT: Optimizing UCLA Library Special Collections Pages for Findability
Person(s) associated @ Caroline Cube @ Courtney E. Jacobs
Group or Unit primarily responsible for the assessment Library Special Collections
Today is the start of your planned project 01 May 2019
What date would you ideally like to complete your project? 01 Jul 2019
Status= Brainstorm | Inprocess | Not conducting | Needs LeadershipReview | No action needed | Completed see <report url>
Inprocess
Leader(s) &/or sponsor(s) brought in with @name
JIRA (if applicable)
Purpose | Assessment is used to make decisions that guide our future, not to validate decisions of the past |
What change(s) do you want to make? Reconfigure website for better findability. Apply searchengine optimization concepts to the website. Changewebsite based on internal and external users input toaccommodate current and predicted usage. Would likecollecting priorities section to be more frequentlyaccessed.
What key questions do you need to answer to inform that change andwhat data will you need to answer them?
1. How does the public interact with the LSC pages onthe Library website :https://www.library.ucla.edu/specialcollections
2. How can we increase the accessing of LSC'swebsite from external resources?
3. How do we enhance patron navigation while on theLSC website?
4. What social media avenues should we prioritize?5. How do undergraduates find and use our site? DATA sources
Google Analytics data is the best data resource.set up a recurring 2x a year report or whatevermight be standard
OAC finding aid usageset up a recurring 2x a year report or whatevermight be standard
LibGuide statistics related to LSC collectingpriorities.Anecdotal experiences gathered from LSC publicservicesInterview/usability with undergraduates.
How might this assessment inform goals more broadly in the UCLALibrary department missions and UCLA?
Optimizing LSC's web presence supports the entireStrategic Plan Goals, especially
Play a visible, vital, and valued role in UCLA's life
Ensure effective access to information andresources
Function as the heart that enables research tothrive
Become a platform and catalyst for innovation inteaching and learning
Develop a strong culture of engagement andleadership
Provide excellent spaces for people to beproductive
Logic Model Use this chart to brainstorm your ideas for an assessment.
Outcomes (Changes) Inputs(Resources)
Activities(Interventions)
Beneficiaries (Participants)
Results for a specific population,community, or institution
E.g.
Outcome 1= Students will learn how to lookup a book in the catalog and find it on theshelf
Staff, finances,information tech,space, time,physical resources
E.g.
Input 1 = Librarian
Input 2 = Librarycatalog
Input 3 = Libraryclassroom
Input 4 = Bookstacks
Programs, services,& processes
E.g.
Activity 1 = Inclasslibrary sessions students find a bookin the catalog
Activity 2 = Touringthe shelves
Targeted population(s) for agiven service and indirectbeneficiaries. Tip | SeePersonas and Stakeholders
E.g.
Population 1 = Undergraduatesin English 3 courses
Short term we have better SEO ourwebsite
Data fromwebsites
Anecdotalinformation gathered
Patrons
Undergraduates
Promoting a Culture of Assessment throughout the UCLA Library Organization
July 4, 2019 11
Assessment Form - 2
Promoting a Culture of Assessment throughout the UCLA Library Organization
Broader view, methods and consultationSTUDENT AFFAIRS & RESEARCH OFFICE – WORKSHOP 1
July 4, 2019 12
Education - Workshops
USER ENGAGEMENT - WORKSHOP 3
ACT - WORKSHOP 2
Methods and introduction to assessment lifecycle
Focused topics in a matrixed environment
Promoting a Culture of Assessment throughout the UCLA Library Organization
July 4, 2019 13
What [will] happen[ed]
Assessment is difficult and requires mentoring and follow-up
• Forms need to be simple – even logic models are hard
• Workshops and in-person consultations must be continuously offered
• People want to do too much and do not have all the tools they need
Management support, engagement, and data-informed decision making is necessary
• Librarians need to be taught how and when to advocate to avoid creating orphan studies
• Communication and transparency across an assessment lifecycle is critical
Recognizing and documenting assessment escapes people
• Teaching is not enough
• We need to take responsibility for centralizing our work
Promoting a Culture of Assessment throughout the UCLA Library Organization
July 4, 2019 14
What [will] happen[ed]
• Conduct follow-up consultations with people working on assessments at UCLA
• Schedule and conduct a series of assessment workshops using a Carpentry model
• Populate the Lake with more data and past reports
• Connect assessments with projects
• Teach staff how to identify and advocate with stakeholders in a way that focuses on results
Promoting a Culture of Assessment throughout the UCLA Library Organization
Thank YouThank YouThank You
July 4, 2019 15
Ask me some questionsCollaborate with us
Sign up at http://bit.ly/2EDIlcBFeed Me
