Post on 29-Nov-2021
Unraveling the (search) stringAssessing library discovery layers
using patron queries
Robert Heaton Collection Management Librarian
Liz W oolcott Head of Cataloging & Metadata Services
Library Assessment Conference 20 20 –20 21
@LizW oolcott#LAC20
Institutional context
Location: Logan, UtahFTE: 22,0 72 (fall 20 20 )Budget: $12 million, $6 million materialsILS+discovery tool: Sierra+Encore Duet
Introduction
Research questions
W hat are users’ general strategies? (W hat are they doing?)How effective are users’ searches? (Is it working?)
Introduction
Methods
Data scraped: from Encore Duet, 3,60 4 URLs visited and the corresponding 68,0 22 search results
Dates collected: 3 days in Fall 20 19Tools used: Google Analytics, Airtable, OctoparseCoding objectives: URL content, search queries, known items
Introduction
General observations: Type of searchFindings
Macroeconomics: Private and Public
Choice by Gwartney, Stroup, Sobel, and Macpherson 15th
edition
John Steiner
Shanghai International Settlement
mozart piano sonata no 18 in
d major milgram
kenneth heineman
campus wars
leaf NDVI transmission
traffic analysis logan utah
nouns
https:/ / ...
Findings General observations: Search timing
User strategies: Overview
Search term adjustments 📝📝Selection of facets 💎💎Use of advanced search 🔍🔍
Findings
User strategies: OverviewFindings
User strategies: Search term adjustmentsFindings
1
2
3…
📝📝
User strategies: Search term adjustmentsFindings 📝📝
User strategies: Search term adjustments (continued)
Findings 📝📝
User strategies: FacetsFindings 💎💎
User strategies: FacetsFindings 💎💎
User strategies: Facets (continued)Findings 💎💎
User strategies: Facets (continued)Findings 💎💎
User strategies: Facets (continued)Findings 💎💎
User strategies: Facets (continued)Findings 💎💎
User strategies: Advanced searchFindings 🔍🔍
User strategies: Advanced searchFindings 🔍🔍
User strategies: Advanced search (continued)
Findings 🔍🔍
User strategies: Advanced search vs. facets
Findings💎💎
🔍🔍
Search effectiveness: Search- term adjustments
Findings 📝📝
Search effectiveness: Advanced searchFindings
43.7%incorrect usage
of Advanced Search
🔍🔍
Search effectiveness: Number of results
W ith No Article Results Available…
Average no. of resultsper page decreasedby
35%
Findings
53%of searches returned
0 results
Search effectiveness:Comparison of search strategy use
Findings 📝📝
💎💎
Search effectiveness: DiscoverabilityFindings
Search effectiveness: Discoverability & deliverability
Discoverability vs. Deliverabilityof Known Items
Findings
Available
Yes No
Appeared in Results
Yes 40 6 57
No 61 84
Search effectiveness: DeliverabilityFindings
Search effectiveness: DeliverabilityFindings
User strategies
Known item only searches
Topical only searches Both
Average # pages visited 2 pages 4 pages 7 pages
Average search session time 3 minutes 7 minutes 14 minutes
Uses facets 10 .6% 31.3% 25%
Uses advanced search 5.31% 10 .8% 15%
Uses search term changes 22.0 8% 40 .66% 82.5%
Discussion
User Engagement and Strategies by Search Type
Search effectivenessDiscussion
Common search strategies are successful
Strong relevancy ranking of known items
User searches are suited to web- scale discovery Users want full text
Electronic access is relatively seamless; some physical circulation
Unanswered questions
How much do tool defaults influence search strategy?W hat user behaviors would likely be consistent no matter the tool?How can we reduce specific types of failed searches?Did users find the best resources, especially in topic searches?How effective is our collection of materials (apart from discoverability)?
Discussion
Taking actionConclusion
Current implementation
Instruction and support
Exploring alternatives
User needs
User strategies
Success metrics
Relevant Domains
Insights from Our Research
Any questions?
robert.heaton@usu.edu
liz.woolcott@usu.eduTwitter: @LizW oolcott
Conclusion