Getting the most from guerrilla usability testing
59
Transcript of Getting the most from guerrilla usability testing
Getting the most from guerrilla usability testing
Chris BushHead of Experience Design
@wearesigma@suthen#agilecam
15 years in user centred design roles
Heads up Sigma’s talented UX team (Manchester & Cambridge)
Help out @NUXUK, Previously: WaSP ILG and WaSP Interact
What is usability testing and why it matters
Some common usability findings
How to run a guerrilla usability testing session
Raise your hands
When did you usability test?
Project start 1st release
When do we usability test?
Project start 1st release
What is usability testing?
Usability means making sure something works well, and that a person of average ability or experience can use it for its intended purpose without getting hopelessly frustrated.
- Steve Krug
Why does it matter?
The procedure is actually quite simple. First, you arrange the items into different groups. Of course one pile may
be sufficient depending on how much there is to do. If you have to go somewhere else due to lack of facilities that
is the next step; otherwise you are pretty well set. It is important not to overdo things. That is, it is better to do too
few things at once than too many. In the short run this may not seem important but complications can easily
arise. A mistake can be expensive as well. At first, the whole procedure will seem complicated. Soon, however, it
will become just another facet of life. It is difficult to foresee any end to the necessity for this task in the
immediate future, but then, one can never tell. After the procedure is completed one arranges the materials into
different groups again. Then they can be put into their appropriate places. Eventually they will be used once
more and the whole cycle will then have to be repeated. However, that is part of life.
Washing clothes
The procedure is actually quite simple. First, you arrange the items into different groups. Of course one pile may
be sufficient depending on how much there is to do. If you have to go somewhere else due to lack of facilities that
is the next step; otherwise you are pretty well set. It is important not to overdo things. That is, it is better to do too
few things at once than too many. In the short run this may not seem important but complications can easily
arise. A mistake can be expensive as well. At first, the whole procedure will seem complicated. Soon, however, it
will become just another facet of life. It is difficult to foresee any end to the necessity for this task in the
immediate future, but then, one can never tell. After the procedure is completed one arranges the materials into
different groups again. Then they can be put into their appropriate places. Eventually they will be used once
more and the whole cycle will then have to be repeated. However, that is part of life.
Context aids understanding
Common findings
Navigation
Navigationisn’t
predictable
..orobvious
Good siteshave clear
sign posting
Page flow
Poorpageflow
What next??Scroll back up!
And fill in this...
Right sidecontentis often
overlooked
Muchbetter
Calls to action
Primary action Secondary action Tertiary action
CTAsare oftenformulaic
Primary action Secondary action Tertiary action
Primary action Secondary action Tertiary action
Simplicity
Which form do visitors use most?
Which form do visitors use most?
14%
86%
Which form do visitors use most?
This one requires you to think about
what you need...
...You probably don’t really know
yet
Which form do visitors use most?
By asking usersrelevant questions.
You limit the amount of
thinking they need to do to achieve
their overall goal
Which form do visitors use most?
Which in turn provides users
with a much better and more
positive experience.
How well do they convert?
17%
55%
Running your own usability test- it’s easier than you think
Pros:• Requires no specialist equipment• Very portable (on location, café, office, home)• Great for early stage testing (Prototypes, etc.)• Great for AGILE and Rapid Iterative Testing and Evaluation (RITE)• Minimal overhead (Time, People, Cost)
Cons:• Moderator or reviewer bias• The team takes on responsibility for ensuring
everything is organised (Users, Room, Tasks, Write up)
• Finding a good testing room is sometimes tricky
Go Guerrilla
Getting the most from your research
In general• Any users are better than none (5 to 10 is ideal)• Aim for a good cross-section of representative users • Max 30-45 minutes to complete
Task design *• Create a list of research objectives • Design your tasks• and then word tasks as scenarios
On the day• Ask users to think aloud to help you gain insights• Rotate tasks • Use a discussion guide for consistency• Use a scribe
Where to start
Research objective• Do users understand the secondary navigation system?• Do users have any challenges with forms errors?
Task• Can users find and complete the returns form?
Scenario“After receiving your new camera you have noticed the lens is cracked. Using the site can you request a replacement?“
• Be pragmatic about leading questions• Do a control test (you’re testing your scenarios at this point)
Designing your tasks
Software• Open broadcast software – FREE!
(https://obsproject.com)
• Reflector ($15)
Hardware• PC / Mac• Webcam / Document camera
Alternative• Silverback v2 (free – Mac only)• Camtasia - PC
Technical kit
Choosing users
Don’t forget that editors are your
users too!
On the day
Don’t do this!
• Find the most comfortable room you can find
• Sit back from the user- Sit outside of the users field of view
• Use reflective questioning- Participant: What does this do?- You: What do you think it does?
• Don’t be a monster!If the user is struggling, it’s ok to help them.Just wait a bit, then wait a bit longer before you do.
• Use your research questions to keep you focused
• Document both the positive and negative findings
• Take 30mins to review notes after each session
On the day
Insights & reporting
Creating a matrix of issues
can help your team keep track of your finding
Keep your reporting
Simple&
Actionable
In summary Aim to use 5-10 users
Pilot your scenarios before engaging real users - Tasks nearly always need rewording
Make the test room as comfortable as possible
Sit back from the user, so they don’t feel like they are being watched
Use reflective questioning
Capture good and bad findings
Wrap up after each session
Make your write-up actionable
Thank YouAny questions?
@wearesigma - @suthen
