Conducting Usability Testing with a Team of One

download Conducting Usability Testing with a Team of One

of 28

  • date post

    11-Nov-2014
  • Category

    Technology

  • view

    2.053
  • download

    0

Embed Size (px)

description

Here's the presentation I gave at the 2009 HighEdWeb Regional Conference at Cornell University

Transcript of Conducting Usability Testing with a Team of One

  • 1. Conducting usability research with a team of one By Christine Kowalski
  • 2. Redesign? Sure, but lets do some usability testing first
  • 3. Spring 2007 Pre-Redesign Usability Research
    • Had a TOTAL t h ank you for your time budget of $150 dollars for one focus group, dozens of card sorts and usability tests, and an online web survey that was sent to over 27,000 people
    • Had 3 students help with the t e sting and analysis phase of the project
  • 4. Hooray were finished! Well, not quite
  • 5. Fall 2008 Post-Redesign Usability Research
    • Had a TOTAL t h ank you for your time budget of $100 dollars for one focus group, 25 usability tests, and an online web survey that was sent to over 10,000 people
    • No students helping with the t e sting and analysis phase of the project, and only other w e b team co-worker resigned in April 2008
  • 6. Wait a minuteTotal budgets of $100 and $150 - really?
    • Well, no. The actual costs were
      • In 2007, $253.04
        • Catering = $96.24
        • Focus group video taping = $106.80
        • 5 Starbucks gift cards = $50.00
      • In 2008, $277.90
        • Catering = $126.50
        • Focus group video taping = $151.40
  • 7. So how do you do this research by yourself?
    • Step back and take a look at what its going to take to accomplish your goals:
      • Time
      • People
      • Money
      • Supervisor approval
  • 8. Or in my case, it was more like, How do I overcome these four major hurdles?
    • I dont have time during the day
    • I dont have enough manpower
    • I dont have a budget
    • I dont have buy-in from my supervisor
  • 9. Hurdle #1 - I dont have enough time during the day
    • Test end-users on your lunch break
    • Evaluate participants before or after work
    • Arrange to do the usability test on the weekends
    • Have your student intern perform the evaluations
    • Ask a user to take a 5-Second Test
    How to overcome it
  • 10. Helpful hint to overcome hurdle #1:
    • More people tend to be available on campus for a focus group and usability testing at lunchtime. How many people would pass up a free lunch?
  • 11. Hurdle #2 - I dont have enough manpower
    • Get web stat collection tools to do the work for you
    • Use a web cam to capture usability tests
    • Test fewer participants: 5 users is all you need
    • Collect the data over a longer time-frame
    How to overcome it
  • 12. Helpful hint to overcome hurdle #2:
    • You can do the testing yourself -- just have the patience to spread the data collection out over a longer period of time.
  • 13. Hurdle #3 - I dont have a budget
    • Use free tools to help you collect web site data
    • Ask your Admissions department, Alumni Association, and fundraising departments for freebies they might be trying to get rid of
    • Use pen/paper instead of renting video equipment
    • Ask people to volunteer their time
    How to overcome it
  • 14. Helpful hint to overcome hurdle #3:
    • No matter which web site you are testing, see what you can get for free from the fundraising departments to give away to the participants -- be resourceful!
  • 15. Hurdle #4 - I dont have buy-in from my supervisor
    • Show how usability testing is a not big production
    • Illustrate the results/statistics of preliminary tests
    • Ask your design team to watch a usability test
    • Hold a post-focus group viewing party
    How to overcome it
  • 16. Helpful hint to overcome hurdle #4:
    • Identify which groups would benefit the most from your website getting a lot of hits. Have them champion your cause.
  • 17. An overview of a few helpful tools I use
    • Userfly
    • Crazy Egg
    • Google Analytics
  • 18. Userfly -- http://userfly.com
    • A web usability test capturing tool that records a screencast of your users' behavior:
    • Allows you to record 10 captures per month for free
    • It tracks everything from simple mouse movements to complex interactions with AJAX elements
  • 19. Userfly - Pros and Cons
    • Advantages:
      • Provides info on the user's browser, each page visited, and time spent on each page
      • Clicking on a particular page plays back the interaction, showing where the user moved his or her mouse and where he or she clicked
      • After watching the capture you can decide to keep or discard it
  • 20. Userfly - Pros and Cons
    • Disadvantages:
      • The walkthrough fails to automatically pan as the user scrolls - you have to manually scroll to keep up with the mouse movements
      • No sound or video capture, so you cant read the persons facial expressions or hear what they say
      • You do not receive another extra capture if you delete one
  • 21. Crazy Egg -- http: //crazyegg .com/
    • A free web analytics tool that has four different ways to view your data:
    • Overlay - find out how many people clicked on each individual element [links, graphics, etc.]
    • Confetti - get user info on each click or dot
    • Lis t - view a full summary of raw click data
    • Heat Map - see what's hot and what's not
  • 22. Crazy Egg - Overlay
  • 23. Crazy Egg - Confetti
  • 24. Crazy Egg - Heat Map
  • 25. Google Analytics -- http://www. google .com/analytics/
    • A free web analytics tool that shows how visitors actually interact with your site:
    • Users can see a statistical output of graphs and charts of data, and make informed site design improvements
    • Unique feature - a clickable world map, where you can see what regions, countries, states and cities your users are from.
  • 26. Google Analytics - Dashboard
  • 27. Google Analytics - Map
  • 28. Thank you for your time!
    • Any questions?
    • Christine Kowalski
    • Web Design Specialist
    • University at Buffalo
    • [email_address]