Usage and Usability Assessment- Library Practices and Concerns
Report on Usability Process and Assessment of Yufind
Transcript of Report on Usability Process and Assessment of Yufind
![Page 1: Report on Usability Process and Assessment of Yufind](https://reader033.fdocuments.us/reader033/viewer/2022052523/5557833dd8b42aa3378b4616/html5/thumbnails/1.jpg)
Report on Usability Process and Assessment of Yufind
NelinetMay 27, 2009
Usability and Assessment at Yale University Library http://www.library.yale.edu/usability
![Page 2: Report on Usability Process and Assessment of Yufind](https://reader033.fdocuments.us/reader033/viewer/2022052523/5557833dd8b42aa3378b4616/html5/thumbnails/2.jpg)
Collecting evidence from Orbis
log files.
Assess current behavior2
![Page 3: Report on Usability Process and Assessment of Yufind](https://reader033.fdocuments.us/reader033/viewer/2022052523/5557833dd8b42aa3378b4616/html5/thumbnails/3.jpg)
Log file line3
12/2/07 20:06
20071202200646 Title Index
TALL JOHN DOGGET JNR 0
![Page 4: Report on Usability Process and Assessment of Yufind](https://reader033.fdocuments.us/reader033/viewer/2022052523/5557833dd8b42aa3378b4616/html5/thumbnails/4.jpg)
Log file sample descriptive data4
Most common search: title (41.8%) followed by keyword (31.4%)
Average search phrase is 2.5 words long
Most common phrase searched is united states
Most common number of hits: 0 (21.4% )
![Page 5: Report on Usability Process and Assessment of Yufind](https://reader033.fdocuments.us/reader033/viewer/2022052523/5557833dd8b42aa3378b4616/html5/thumbnails/5.jpg)
Examples of title searches5
BOOKS ON PHOTOGRAPHY? ALABAMA 2004? PATHOPHYSIOLOGY CHILDREN?
JOHNSON, JAMES?
INTRODUCTION TO AFRICAN AMERICAN STUDIES: A READER?
Topic
Name
Close
![Page 6: Report on Usability Process and Assessment of Yufind](https://reader033.fdocuments.us/reader033/viewer/2022052523/5557833dd8b42aa3378b4616/html5/thumbnails/6.jpg)
Classification of Reasons for 0 Hits6
N=506
![Page 7: Report on Usability Process and Assessment of Yufind](https://reader033.fdocuments.us/reader033/viewer/2022052523/5557833dd8b42aa3378b4616/html5/thumbnails/7.jpg)
Declining search types7
![Page 8: Report on Usability Process and Assessment of Yufind](https://reader033.fdocuments.us/reader033/viewer/2022052523/5557833dd8b42aa3378b4616/html5/thumbnails/8.jpg)
Some conclusions from log analysis8
![Page 9: Report on Usability Process and Assessment of Yufind](https://reader033.fdocuments.us/reader033/viewer/2022052523/5557833dd8b42aa3378b4616/html5/thumbnails/9.jpg)
Next Gen OPAC --
Yufind9
![Page 10: Report on Usability Process and Assessment of Yufind](https://reader033.fdocuments.us/reader033/viewer/2022052523/5557833dd8b42aa3378b4616/html5/thumbnails/10.jpg)
10
Search for Geriatrics
![Page 11: Report on Usability Process and Assessment of Yufind](https://reader033.fdocuments.us/reader033/viewer/2022052523/5557833dd8b42aa3378b4616/html5/thumbnails/11.jpg)
After deciding to implement Yufind, use data from log files to help design usability tests
Conduct usability tests11
![Page 12: Report on Usability Process and Assessment of Yufind](https://reader033.fdocuments.us/reader033/viewer/2022052523/5557833dd8b42aa3378b4616/html5/thumbnails/12.jpg)
Creating usability tests for Yufind12
Objective: Would the participant see and choose facets? (more than 26% of the time)
Priority = HighSuccess = See and try to use the facets
Objective: Would the participant use facets successfully?
Priority = HighClick on the appropriate facet and reach desired outcome within two clicks
![Page 13: Report on Usability Process and Assessment of Yufind](https://reader033.fdocuments.us/reader033/viewer/2022052523/5557833dd8b42aa3378b4616/html5/thumbnails/13.jpg)
E-books only service13
![Page 14: Report on Usability Process and Assessment of Yufind](https://reader033.fdocuments.us/reader033/viewer/2022052523/5557833dd8b42aa3378b4616/html5/thumbnails/14.jpg)
Alternative interface for catalog14
![Page 15: Report on Usability Process and Assessment of Yufind](https://reader033.fdocuments.us/reader033/viewer/2022052523/5557833dd8b42aa3378b4616/html5/thumbnails/15.jpg)
Questions
Find books within a set by a particular author (John Adams).
In a set of books about healthcare, find some that are about healthcare reform.
Within a subject-based display of ebooksfind a topic-based subset.
15
![Page 16: Report on Usability Process and Assessment of Yufind](https://reader033.fdocuments.us/reader033/viewer/2022052523/5557833dd8b42aa3378b4616/html5/thumbnails/16.jpg)
16
![Page 17: Report on Usability Process and Assessment of Yufind](https://reader033.fdocuments.us/reader033/viewer/2022052523/5557833dd8b42aa3378b4616/html5/thumbnails/17.jpg)
Facets: key findings17
Were seen and sometimes used butSubsets didn’t always make senseHard to navigate (not alphabetical)
Little use of call number facetSome preferred search refinement to facetsParticipants noted potential usefulness: format, languageSome users are a target market, others are not
![Page 18: Report on Usability Process and Assessment of Yufind](https://reader033.fdocuments.us/reader033/viewer/2022052523/5557833dd8b42aa3378b4616/html5/thumbnails/18.jpg)
Did facets increase metadata use?
Opportunities for facet use
Facet
Use|Success
Search Refinement with 2nd
search Use|Success
5 (question 2a undergraduate) 3|1 3|15 (question 5a undergraduate) 2|2 1|08 (question 5 medical) 4|4 4|1
All opportunities=189|7
50.0% | 38.9%8|1
44.4% | 16.7%
18
YES
![Page 19: Report on Usability Process and Assessment of Yufind](https://reader033.fdocuments.us/reader033/viewer/2022052523/5557833dd8b42aa3378b4616/html5/thumbnails/19.jpg)
Relevance ranking and facets19
![Page 20: Report on Usability Process and Assessment of Yufind](https://reader033.fdocuments.us/reader033/viewer/2022052523/5557833dd8b42aa3378b4616/html5/thumbnails/20.jpg)
Best practices for facets
Implement a more narrowly focused searchPresent a limited number of facets based on user behaviorGood facets require good dataWell defined, mutually exclusive and have clear labelsFacets work best when they are tied to the level of the search of selection process
20
![Page 21: Report on Usability Process and Assessment of Yufind](https://reader033.fdocuments.us/reader033/viewer/2022052523/5557833dd8b42aa3378b4616/html5/thumbnails/21.jpg)
21
![Page 22: Report on Usability Process and Assessment of Yufind](https://reader033.fdocuments.us/reader033/viewer/2022052523/5557833dd8b42aa3378b4616/html5/thumbnails/22.jpg)
22
![Page 23: Report on Usability Process and Assessment of Yufind](https://reader033.fdocuments.us/reader033/viewer/2022052523/5557833dd8b42aa3378b4616/html5/thumbnails/23.jpg)
Limit facets based on user behavior
AuthorJournal/book/videoLanguageClassification
AvailabilityLocationFulltext
First Level Second Level
23
![Page 24: Report on Usability Process and Assessment of Yufind](https://reader033.fdocuments.us/reader033/viewer/2022052523/5557833dd8b42aa3378b4616/html5/thumbnails/24.jpg)
Implement changes and re-assess24
![Page 25: Report on Usability Process and Assessment of Yufind](https://reader033.fdocuments.us/reader033/viewer/2022052523/5557833dd8b42aa3378b4616/html5/thumbnails/25.jpg)
Survey (83 respondents)
79.3% found the results they expected and 75.6% found what they needed
41 respondents or 50% tried facets. Of these, 85.0% were positive about the results.
57.8% of respondents preferred Yufind to Orbis
System Usability Score = 66
25
![Page 26: Report on Usability Process and Assessment of Yufind](https://reader033.fdocuments.us/reader033/viewer/2022052523/5557833dd8b42aa3378b4616/html5/thumbnails/26.jpg)
First place you would look to find a book?
Answer Options Response Count PercentOrbis 33 40.2%Yufind 29 35.4%Google 14 17.1%Amazon 4 4.9%Worldcat 2 2.4%
26
![Page 27: Report on Usability Process and Assessment of Yufind](https://reader033.fdocuments.us/reader033/viewer/2022052523/5557833dd8b42aa3378b4616/html5/thumbnails/27.jpg)
Standards & priority functionality27
![Page 28: Report on Usability Process and Assessment of Yufind](https://reader033.fdocuments.us/reader033/viewer/2022052523/5557833dd8b42aa3378b4616/html5/thumbnails/28.jpg)
Patron empowerment28
![Page 29: Report on Usability Process and Assessment of Yufind](https://reader033.fdocuments.us/reader033/viewer/2022052523/5557833dd8b42aa3378b4616/html5/thumbnails/29.jpg)
Error handling29
![Page 30: Report on Usability Process and Assessment of Yufind](https://reader033.fdocuments.us/reader033/viewer/2022052523/5557833dd8b42aa3378b4616/html5/thumbnails/30.jpg)
Effective and efficient search and delivery
Provide alternative navigation through facets
Visual shelf list
Integration with circulation/ordering/ILL
30
![Page 31: Report on Usability Process and Assessment of Yufind](https://reader033.fdocuments.us/reader033/viewer/2022052523/5557833dd8b42aa3378b4616/html5/thumbnails/31.jpg)
Usability process
Assess current behavior
Conduct usability protocol testing
Implement changes and re-assess
Determine standards & priority functionality
Need more cooperative efforts
31
![Page 32: Report on Usability Process and Assessment of Yufind](https://reader033.fdocuments.us/reader033/viewer/2022052523/5557833dd8b42aa3378b4616/html5/thumbnails/32.jpg)
Results available32
Usability and Assessment at Yale University Library http://www.library.yale.edu/usability
Send questions to [email protected]
http://www.library.yale.edu/libepub/usability/yulstudies.html