Conducting Usability Testing with a Team of One

28
Conducting usability research with a team of one By Christine Kowalski

description

Here's the presentation I gave at the 2009 HighEdWeb Regional Conference at Cornell University

Transcript of Conducting Usability Testing with a Team of One

Page 1: Conducting Usability Testing with a Team of One

Conducting usability research with a team of one

By Christine Kowalski

Page 2: Conducting Usability Testing with a Team of One

“Redesign? Sure, but let’s do some usability testing first…”

Page 3: Conducting Usability Testing with a Team of One

Spring 2007 – Pre-Redesign Usability Research

Had a TOTAL “thank you for your time” budget of $150 dollars for one focus group, dozens of card sorts and usability tests, and an online web survey that was sent to over 27,000 people

Had 3 students help with the “testing and analysis” phase of the project

Page 4: Conducting Usability Testing with a Team of One

“Hooray we’re finished! Well, not quite…”

Page 5: Conducting Usability Testing with a Team of One

Fall 2008 – Post-Redesign Usability Research

Had a TOTAL “thank you for your time” budget of $100 dollars for one focus group, 25 usability tests, and an online web survey that was sent to over 10,000 people

No students helping with the “testing and analysis” phase of the project, and only other “web team” co-worker resigned in April 2008

Page 6: Conducting Usability Testing with a Team of One

Wait a minute…Total budgets of $100 and $150 - really?

Well, no. The actual costs were…

In 2007, $253.04 Catering = $96.24 Focus group video taping = $106.80 5 Starbucks gift cards = $50.00

In 2008, $277.90 Catering = $126.50 Focus group video taping = $151.40

Page 7: Conducting Usability Testing with a Team of One

So how do you do this research by yourself?

Step back and take a look at what it’s going to take to accomplish your goals:

Time

People

Money

Supervisor approval

Page 8: Conducting Usability Testing with a Team of One

Or in my case, it was more like, “How do I overcome these four major hurdles?”

“I don’t have time during the day”

“I don’t have enough manpower”

“I don’t have a budget”

“I don’t have buy-in from my supervisor”

Page 9: Conducting Usability Testing with a Team of One

Hurdle #1 - “I don’t have enough time during the day”

Test end-users on your lunch break

Evaluate participants before or after work

Arrange to do the usability test on the weekends

Have your student intern perform the evaluations

Ask a user to take a “5-Second Test”

How to overcome it

Page 10: Conducting Usability Testing with a Team of One

Helpful hint to overcome hurdle #1:

More people tend to be available on campus for a focus group and usability testing at lunchtime. How many people would pass up a free lunch?

Page 11: Conducting Usability Testing with a Team of One

Hurdle #2 - “I don’t have enough manpower”

Get web stat collection tools to do the work for you

Use a web cam to capture usability tests

Test fewer participants: “5 users is all you need”

Collect the data over a longer time-frame

How to overcome it

Page 12: Conducting Usability Testing with a Team of One

Helpful hint to overcome hurdle #2:

You can do the testing yourself -- just have the patience to spread the data collection out over a longer period of time.

Page 13: Conducting Usability Testing with a Team of One

Hurdle #3 - “I don’t have a budget”

Use free tools to help you collect web site data

Ask your Admissions department, Alumni Association, and fundraising departments for freebies they might be trying to get rid of

Use pen/paper instead of renting video equipment

Ask people to volunteer their time

How to overcome it

Page 14: Conducting Usability Testing with a Team of One

Helpful hint to overcome hurdle #3:

No matter which web site you are testing, see what you can get for free from the fundraising departments to give away to the participants -- be resourceful!

Page 15: Conducting Usability Testing with a Team of One

Hurdle #4 - “I don’t have buy-in from my supervisor”

Show how usability testing is a not big production

Illustrate the results/statistics of preliminary tests

Ask your design team to watch a usability test

Hold a post-focus group viewing party

How to overcome it

Page 16: Conducting Usability Testing with a Team of One

Helpful hint to overcome hurdle #4:

Identify which groups would benefit the most from your website getting a lot of hits. Have them champion your cause.

Page 17: Conducting Usability Testing with a Team of One

An overview of a few helpful tools I use…

Userfly

Crazy Egg

Google Analytics

Page 18: Conducting Usability Testing with a Team of One

Userfly --http://userfly.com

A web usability test capturing tool that records a screencast of your users' behavior:

Allows you to record 10 captures per month for free

It tracks everything from simple mouse movements to complex interactions with AJAX elements

Page 19: Conducting Usability Testing with a Team of One

Userfly - Pros and Cons

Advantages:

Provides info on the user's browser, each page visited, and time spent on each page

Clicking on a particular page plays back the interaction, showing where the user moved his or her mouse and where he or she clicked

After watching the capture you can decide to keep or discard it

Page 20: Conducting Usability Testing with a Team of One

Userfly - Pros and Cons

Disadvantages:

The walkthrough fails to automatically pan as the user scrolls - you have to manually scroll to keep up with the mouse movements

No sound or video capture, so you can’t read the person’s facial expressions or hear what they say

You do not receive another “extra” capture if you delete one

Page 21: Conducting Usability Testing with a Team of One

Crazy Egg -- http://crazyegg.com/ A free web analytics tool that has four

different ways to view your data: Overlay - find out how many people clicked on

each individual element [links, graphics, etc.]

Confetti - get user info on each click or “dot”

List - view a full summary of raw click data

Heat Map - see what's hot and what's not

Page 22: Conducting Usability Testing with a Team of One

Crazy Egg - Overlay

Page 23: Conducting Usability Testing with a Team of One

Crazy Egg - Confetti

Page 24: Conducting Usability Testing with a Team of One

Crazy Egg - Heat Map

Page 25: Conducting Usability Testing with a Team of One

Google Analytics -- http://www.google.com/analytics/

A free web analytics tool that shows how visitors actually interact with your site:

Users can see a statistical output of graphs and charts of data, and make informed site design improvements

Unique feature - a clickable world map, where you can see what regions, countries, states and cities your users are from.

Page 26: Conducting Usability Testing with a Team of One

Google Analytics - Dashboard

Page 27: Conducting Usability Testing with a Team of One

Google Analytics - Map

Page 28: Conducting Usability Testing with a Team of One

Thank you for your time!

Any questions?

Christine Kowalski

Web Design Specialist

University at Buffalo

[email protected]