WVU Libraries 2016 Website Survey Pt.1

WVU Libraries 2016 Website Survey: 04/1/2016 – 04/15/2016

WVU Libraries Website Survey Pt.1/3

WVU Libraries, 2016

1


Introduction

The WVU Libraries Web Team - comprised of representatives from each individual library and library department at WVU - is faced with designing a library search box in an ever-changing ecosphere of catalogs, search resources, priorities, and online trends.

To conduct research, the Web Team decided to take on the daunting task of designing, constructing, and administering a comprehensive higher-education libraries search box usability test in three tiers.

2


Communication Strategy

Tier 1 Usability Test - starting from the macrocosm of at least 1,000 of our users - faculty, staff, students, etc. – users would provide information through a completely randomized Qualtrics survey.

Tier 2 Usability Test – reduce testing down to at least 100 of our users interacting with animated wireframes through intercepts.

Tier 3 Usability Test – further reduce testing all the way to at least 10 users doing specific audio and video recorded usability testing, and fully functional search boxes.

3


Goals & Objectives

Get information from our target users that inform refined usability testing with interactive prototypes

Determine top tasks for users, and top tasks for different target audiences Assess library assistance naming conventions Evaluate search box placements Enable users to provide insights on their search process Gauge multiple search box mechanism desirability for different target

audiences Survey preferred contact and information avenues Rank contact mechanisms for users and for different target audiences Allow users to provide feedback

4


Messaging

All WVU faculty, staff, and students are eligible to win! Take the WVU Libraries’ website survey, provide your email address, and be in the running to win a tablet of your choice – Android, Apple, or Windows – worth up to $500!

WVU Libraries will be giving away two $500 prizes to a random survey taker. The survey should take less than 30 minutes. The questions focus on what you visit the library website to do most often, as well as how we can make the search box on our homepage easier to use.

You must provide your email address to be eligible to be entered in the drawing. For WVU employees, the value of the prize may be a taxable benefit. Library employees are not eligible to win.

5


Tier 1 Questions

s6


Section 1/17

7


Section 2/17

8


Section 3/17

9


Section 4/17

10


Section 5/17

11


Section 6/17

12


Section 7/17

13


Section 8/17

14


Section 9/17

15


Section 10/17

16


Section 11/17

17


Section 12/17

18


Section 13/17

19


Section 14/17

20


Section 15/17

21


Section 16/17

22


Section 17/17

23


User Results1,856 Started / 1,325 Completed (71% Completion Rate)

s24


Section 1:Q2/17Users ResponsesClinical Faculty Member 5

Library Faculty / Staff Member 9

Administrator 13

Faculty Equivalent / Academic Professional 26

Faculty Member 57

Medicine Employee 60

Staff Member 140

Graduate Student 503

Undergraduate Student 1,043

Clinical Faculty Member0%

Library Faculty / Staff Member

1%

Administrator1%

Faculty Equivalent / Academic Professional

1%

Faculty Member3%

Medicine Employee3%

Staff Member8%

Graduate Student27%

Undergraduate Student56%

25


Section 2:Q1/17

Top Tasks VotesReserve a study room 636Search for articles 490Find a databse to ssearch 400Find library hours 355Find an open computer 322

Select the 5 tasks / resources (from the list below) that are MOST IMPORTANT to you when considering products and services at WVU Libraries.

26

712930

490185

243292

400152

275138

71110

3841

19341

189138

5571

15615

5216

68253

7547

636335

13660

25119

20838

2336

436

1018

169

329

1714

2164

3226

2021

5036

5018

2219

177

6428

10372

4517

24671

1355

13345

54229

32261

521

5339

5929

5115

82

0 100 200 300 400 500 600 700

Instant Message/Chat a question to a librarianFind contact information for the Libraries.

Email the Libraries.Search for articles.

Search for a specific known article.Search for books, dvds, or other print/physical materials.

Search for materials on a specific topic.Find a database to search.

Search in PubMed.Search in EbscoHost.

Search in Academic Search Complete.Search in Lexis Nexis Academic.

Search in JSTOR.Search in CQ Researcher.

Search in PsycInfo.Search in Google Scholar.

Search in CINAHL.Access a specific known database.

Find a specific known eJournal.Find borrowing (fines, loan periods, renewals, etc.) information.Find items your professor has put on reserve at Access Services.

Find articles, book chapters, movies, or other materials your professor has put on eReserves.Place items on course reserve at Access Services for your courses.

Place items on eReserve for your courses.Report a problem with a database or other electronic resource.

Use the call numbers/locations page to determine where to find a book.Find printing, scanning, or copying information (locations, prices, sizes, etc.).

Locate a research guide for a subject area.Locate a research guide for a specific course.

Reserve a study room.Find library hours.

Find hours for Eliza’s or DaVinci’s.Find information about borrowing equipment (video cameras, digital voice recorders, etc.)

Find information about computers and laptops at the library.Place an interlibrary loan request.

Get help with citations (APA, MLA, etc.)Request a research consultation with a librarian.

Find information about library services for distance learners.Find library events.

Read library news articles.Read WVRHC news articles.

Read the Libraries’ twitter feed.Link to the Libraries social media pages (Facebook, Twitter, Instagram, etc.)

Donate to the Libraries.Find out how the Libraries support Open Access publishing.

Read Ex Libris, the Libraries’ NewsletterFind accessibility information.Find directions to the library.

Locate the contact information for a specific library employee.Suggest a purchase (for a book or other resource) to the Libraries.

Visit a digital collection.Find out about the Libraries’ collections.

Take the Libraries’ Plagiarism Tutorial.Find information about courses offered by the Libraries.

Request library instruction for your course.Get tips for designing research assignments

Get dates and times for library offered workshops (PubMed, RefWorks, etc.)Find pricing and other information for poster printing.

Find resources for patents and trademarksFind information about systems maintained by the Libraries.

Find information for Alumni.Search alumni databases.

Find information for student veterans.Submit a thesis or dissertation.

Identify and contact a subject librarian.Renew books, dvds, or other materials.

Check your library account.Pay a fine.

Find an obituary.Locate primary sources.

Find images.Access MDID.

Find videos.Place an E-ZBorrow request.

Place a BookExpress+ request.Use Refworks or Endnote.

Reserve a classroom.Find an open computer.

Find out what software is on library computers.Fill out a proxy form online to enable someone to check out materials on your card.

Locate library policies and procedures such as gifts, laptops, accessibility, etc.Look for available jobs at the library.

Find information about services for distance learning/off campus/study abroad students or faculty.Search for archives and manuscripts materials.

Search for digital photographs.Obtain an article from a West Virginia newspaper.

Get information about programming in the LibrariesLocate a WVU service or personnel.


Section 3:Q1/17

Users Responses PercentagesAsk A Librarian 569 41%Help 219 16%Contact Us 218 16%Chat 203 14%Support 115 8%Ask Us 80 6%Total 1,404 100%

Ask A Librarian40%

Help16%

Contact Us16%

Chat14%

Support8%

Ask Us6%

When you need assistance at WVU Libraries, which link would you be more likely to click?

27


Section 3:Q2/17Which way would you be more likely to contact WVU Libraries? Please rank the following in terms how likely you are to use the service, wherein 1 is very likely and 7 is unlikely.

0

50

100

150

200

250

300

350

400

450

500

Very Likely Likely Somewhat Likely NA SomewhatUnlikely

Unlikely Very Unlikely

Tota

l Res

pons

es

Instant Messaging Send Email Telephone Call Text Messaging

In Person Website Form Social Media

28


Section 3:Q3/17In which of the following two pictures is the green box more dominant?

Answer Responses PercentagesA 582 41%B 428 30%Both are equally dominant 359 26%I think that... 35 2%Total 1,404 100%

A41%

B30%

Both are equally dominant26%

I think that...3%41% 30%

29


Section 4:Q1-3/17

You are looking for the hours for Eliza’s Coffee Shop on the website. Which tab would you choose to search for them?

You are working on a paper for your psychology class and your professor said you should use PsycINFO, EbscoHost, or PubMed to search for articles. Which tab would you use to search for PsycInfo, EbscoHost, or PubMed?

You need to find scholarly information about climate change. Which tab would you choose to search for “climate change”? Check all that apply.

Answers Responses PercentagesArticles 28 2%Books 9 1%Databases 44 3%eJournals 30 2%DOI 49 3%Site Search 1,255 89%Total 1,415 100%

Answers Responses PercentagesArticles 110 8%Books 28 2%Databases 1,012 72%eJournals 186 13%DOI 21 1%Site Search 58 4%Total 1,415 100%

Articles28%

Books18%

Databases21%

eJournals22%

DOI4%

Site Search7%

Answers ResponsesArticles 1,058Books 662Databases 766eJournals 835DOI 143Site Search 254

30


Section 5:Q1-3/17

You are working on a paper for English 102 about police militarization. In which tab would you type “police militarization” to search for articles? Check all that apply.

You missed your film class last week and need to find a copy of the movie Breakfast at Tiffany’s from the library, so you can watch it before your test. Which tab would you use to search for this film to see if you can check it out?

What would you expect to find when you search on the WorldCat tab? Check all that apply.

WorldCat15%

Databases31%Google

Scholar39%

Site Search15%

Answers ResponsesWorldCat 373Databases 749Google Scholar 930Site Search 355

Answers Responses PercentagesWorldCat 399 28%Databases 277 20%Google Scholar 112 8%Site Search 631 44%Total 1,419 100%

Articles19%

Books20%

Journals19%

Film & Media21%

Databases12%

WVU Libraries Information

9%Answers ResponsesArticles 765Books 804Journals 726Film & Media 822Databases 469WVU Libraries Information 346

31


Section 6:Q1-3/17

You have the DOI (digital object identifier, which is a serial code used to uniquely identify objects-- it’s something you use in an APA citation in your bibliography) of an article. Which tab would you use to search for it?

You are writing a paper about economics during the World War II era. Where would you start searching for articles?

What would you expect to find when you search on the Catalog tab? Check all that apply.

Answers Responses PercentagesCatalog 548 39%Databases 404 29%Google Scholar 248 18%Site Search 216 15%Total 1,416 100%

Answers Responses PercentagesCatalog 166 12%Databases 585 41%Google Scholar 565 40%Site Search 100 7%Total 1,416 100%

Answers ResponsesArticles 924Books 1,029Journals 967Film & Media 772Databases 477WVU Libraries Information 363

Articles20%

Books23%

Journals21%

Film & Media17%

Databases11%

WVU Libraries Information

8%

32


Section 7:Q1-2/17 Pretend this is the main search box on the library homepage. What would you expect the links on the bottom to do?

Pretend this is the main search box on the library homepage. What would you expect to find when you search? Check all that apply.

Answers Responses PercentagesChange the search box to search with that specific search tool. 342 24%Open a new tab to a different page for that search tool. 387 28%Filter the search box results to results for that search tool. 300 21%Go to a different page for that search tool. 377 27%Total 1,406 100%

Answers Responses PercentagesArticles 1,154 82%Books 1,078 77%Videos 762 54%Book chapters 679 48%Journals 1,077 77%eJournals 1,049 75%Databases 1,029 73%WVU Libraries Information 742 53%Archival materials 803 57%

1,1541,078

762679

1,077 1,049 1,029

742803

0

200

400

600

800

1,000

1,200

1,400

Tota

l Res

pons

es

33


Section 8:Q1-2/17 Pretend this is the main search box on the library homepage. What would you expect the links on the bottom to do?

What would you expect to see if you clicked on Articles?

Answers ResponsesA menu of options to search like articles, books, databases, eJournals, site search, etc. 559

Advanced search options for articles 347Either a or b would make sense to me 494I’d expect to see something else 20Total 1,420

A menu of options to search like articles, books, databases,

eJournals, site search,

Advanced search options for articles

25%

Either a or b would make sense to me

35%

I’d expect to see something else 1%

Answers Responses PercentagesChange the search box to a help box. 190 13%Open a new tab to a different page for contacting a librarian. 726 51%Go to a different page to get help. 504 35%Total 1,420 100%

34


Section 9:Q1-2/17

You are looking for information about how to check out a laptop. Which option would you choose to search for that information?

Your professor mentioned that there is a publication of great articles for teachers of English as a Second Language. Which option would you choose from the menu to search for it?

Answers ResponsesArticles 723Books 87Databases 215DOI 31eJournals 267Site Search 88Total 1,411

Articles52%

Books6%

Databases15%

DOI2%

eJournals19%

Site Search6%

Answers Responses PercentagesArticles 44 3%Books 29 2%Databases 87 6%DOI 125 9%eJournals 30 2%Site Search 1,096 78%Total 1,411 100%

35


Section 10:Q1-2/17

You want to find out if the library has the newest Jack Reacher book by Lee Child. Which option would you choose to search for this book?

You heard the library subscribes to Ancestry.com. Which option would you choose before searching for it?

Answers Responses PercentagesWorldCat 115 8%Databases 465 33%Google Scholar 119 8%Site Search 714 51%Total 1,413 100%

WorldCat27%

Databases23%Google Scholar

9%

Site Search41%

Answers ResponsesWorldCat 381Databases 327Google Scholar 124Site Search 581Total 1,413

36


Section 11/17Describe the above search box image by checking any number of the following 28 words:

Answer ResponsesEasy to use 722Straight Forward 706Useful 637Understandable 585Simplistic 568Clean 550Helpful 527Familiar 463Time-Saving 366Expected 292Predictable 262Comprehensive 242Appealing 241Intuitive 215Dated 166Old 162Customizable 154Impersonal 86Confusing 75Busy 71Complex 70Time-consuming 60Unpredictable 51Frustrating 48Annoying 46Too Technical 40Intimidating 39Inspiring 34

37



Answer ResponsesEasy to use 625Straight Forward 619Simplistic 585Clean 535Useful 512Understandable 479Helpful 391Familiar 360Time-Saving 285Expected 238Predictable 225Dated 191Old 180Appealing 174Intuitive 160Confusing 150Comprehensive 149Impersonal 107Customizable 97Annoying 79Frustrating 73Unpredictable 71Time-consuming 66Complex 65Too Technical 56Intimidating 49Busy 33Inspiring 28

38



Answer ResponsesSimplistic 587Easy to use 525Straight Forward 508Clean 443Useful 413Understandable 383Helpful 326Familiar 311Old 257Confusing 253Dated 247Expected 238Time-Saving 221Predictable 200Unpredictable 161Impersonal 160Appealing 138Intuitive 135Comprehensive 133Annoying 126Frustrating 104Customizable 79Time-consuming 71Complex 71Too Technical 39Intimidating 37Busy 30Inspiring 17

39



Answer ResponsesUseful 657Helpful 590Easy to use 588Straight Forward 540Understandable 497Customizable 414Time-Saving 395Comprehensive 357Simplistic 350Clean 335Familiar 295Appealing 226Complex 215Intuitive 191Expected 190Busy 179Predictable 175Time-consuming 124Old 123Confusing 120Dated 119Too Technical 107Annoying 103Intimidating 103Frustrating 78Impersonal 56Inspiring 35Unpredictable 35

40



Answer ResponsesEasy to use 686Straight Forward 652Useful 584Simplistic 573Helpful 540Clean 528Understandable 525Familiar 360Time-Saving 338Appealing 281Expected 233Intuitive 194Predictable 177Comprehensive 171Old 161Customizable 152Dated 143Impersonal 85Confusing 80Annoying 68Unpredictable 66Frustrating 60Complex 51Time-consuming 47Busy 43Too Technical 35Intimidating 34Inspiring 23

41


Section 16:Q1/17 Please rank the following in terms of which search box you would be more likely to use to search for loan periods and limits, wherein 1 is very likely and 4 is unlikely.

0

100

200

300

400

500

600

700

Very Likely Likely Maybe Unlikely

Tota

l Res

pons

es

A B C D

42


Section 16:Q2/17 Please rank the following in terms of which search box you would be more likely to use to find an article on 17-year cicadas, wherein 1 is very likely and 4 is unlikely.

0

100

200

300

400

500

600

700


Tota

l Res

pons

es

A B C D

43


Section 16:Q3/17 Please rank the following in terms of which search box you would be more likely to use to research ancient Greek pottery, wherein 1 is very likely and 4 is unlikely.

0

50

100

150

200

250

300

350

400

450


Tota

l Res

pons

es

A B C D

44


Target Audience Results

s45


Target Audiences Primary Target Audience

(73% / 107,062 students per month) WVU undergraduate students who are 48% female or 52% male, are primarily Caucasian, African American, Hispanic, or Asian in ethnicity, are United States citizens or are international students, are 21 years in their average age, and are 49% from the state of West Virginia or 51% from other United States, territories, or countries.

Secondary Target Audience

(19% / 27,865 students per month) WVU graduate students who 41% male or 59% female, are 83% US citizens, 14% nonimmigrants mostly from India or the People’s Republic of China, and are 31 years in their average age.

Tertiary Target Audience

(8% / 11,733 students per month) WVU administration, faculty, staff, and Morgantown, West Virginia community members.

46


Section 2/17

47

1st 2nd 3rd 4th 5th

Primary Target Audience

Reserve a Study room

Find an Open Computer

Find a Database to Search

Search for Articles

Find Library Hours


Search for Articles

Reserve a Study room


Search for Materials on a Specific Topic

Search EbscoHost


Search for Articles

Search for Books, DVDs, or Other Print/ Physical Materials


Search for a Specific Known Article

Find Library Hours

Select the 5 tasks / resources (from the list below) that are MOST IMPORTANT to you when considering products and services at WVU Libraries. Reserve a

Study RoomFind an Open Computer

Search for Articles

Find a Database to

SearchFind Library

Hours

Search for Specific

Materials / Specific Articles

Search EbscoHost

Search for Books, DVDs, or Other Print/

Physical Materials


Section 3:Q1/17

48

When you need assistance at WVU Libraries, which link would you be more likely to click?




Contact Us 109 65 44

Ask A Librarian 327 160 82

Help 124 64 31

Support 66 28 21

Chat 104 69 30

Ask Us 40 23 17 0

100

200

300

400

500

600

Contact Us Ask A Librarian Help Support Chat Ask Us

Primary Target Audience Secondary Target Audience Tertiary Target Audience


Section 3:Q2/17

49

Which way would you be more likely to contact WVU Libraries? Please rank the following in terms how likely you are to use the service, wherein 1 is very likely and 7 is unlikely. In Person

Send Email

Instant Message

Telephone Call

First Choice Second Choice Third Choice

PrimaryTargetAudience

In Person Send Email InstantMessage

Secondary TargetAudience

Send Email In Person InstantMessage

TertiaryTargetAudience

Send Email TelephoneCall

InstantMessage


Section 5:Q1 & 3/17

50

You need to find scholarly information about climate change. Which tab would you choose to search for “climate change”? Check all that apply.

What would you expect to find when you search on the WorldCat tab? Check all that apply.

First Second Third

Primary Target Audience Google Scholar Databases Site Search

Secondary Target Audience Google Scholar Databases WorldCat

Tertiary Target Audience Google Scholar Databases WorldCat

First Choice Second Choice Third Choice

Primary Target Audience Film & Media Articles Books

Secondary Target Audience Books Film & Media Articles

Tertiary Target Audience Books Film & Media Articles


Section 11/17

51

Describe the above search box image by checking any number of the following 28 words:

Simplistic

Easy to use

Straight Forward

Useful

Understandable Clean

1st Word 2nd Word 3rd Word 4th Word 5th Word

PrimaryTarget Audience

Easy to use Straight Forward Useful Understandable Simplistic


Easy to use Straight Forward Useful Clean Simplistic

TertiaryTarget Audience

Straight Forward Easy to use Useful Understandable Clean


Section 12/17

52


Useful

Easy to use

Straight Forward

Simplistic

UnderstandableClean



Easy to use Straight Forward Useful Understandable Simplistic


Straight Forward Easy to use Simplistic Clean Useful


Easy to use Straight Forward Clean Simplistic Understandable


Section 13/17

53


Simplistic

Easy to use

Straight Forward

Clean

Useful



Simplistic Easy to ues Straight Forward Clean Useful


Simplistic Easy to use Straight Forward Clean Useful


Straight Forward Simplistic Easy to use Clean Useful


Section 14/17

54


Understandable

Straight Forward

Easy to use

HelpfulUseful

Time-Saving



Useful Helpful Easy to use Straight Forward Understandable


Easy to Use Helpful Straight Forward Understandable Time-Saving


Easy to use Useful Helpful Straight Forward Understandable


Section 15/17

55


SimplisticHelpful

Easy to use

Straight Forward

UsefulClean

Understandable



Easy to use Straight Forward Useful Simplistic Helpful


Easy to use Straight Forward Simplistic Useful Clean


Straight Forward Easy to use Understandable Clean Useful


Section 16/17

56

Please rank the following in terms of which search box you would be more likely to use to search for loan periods and limits, wherein 1 is very likely and 4 is unlikely.

Please rank the following in terms of which search box you would be more likely to use to find an article on 17-year cicadas, wherein 1 is very likely and 4 is unlikely.

Please rank the following in terms of which search box you would be more likely to use to research ancient Greek pottery, wherein 1 is very likely and 4 is unlikely.


D C D


D C D


B C A


The End

s57

WVU Libraries 2016 Website Survey Pt.1

Services

Transcript of WVU Libraries 2016 Website Survey Pt.1