Guerrilla tactics in usability testing

@thedxw www.dxw.com @lily_dart @rosebotanic@thedxw www.dxw.com @lily_dart @rosebotanic

Guerrilla tactics in usability testing When time and money are against you

@thedxw www.dxw.com @lily_dart @rosebotanic

dxw is an agency specialising in agile, user-focused digital services for the public sector.

We like making users happy.


the art of pouncing on lone people in cafes and public spaces, [then] quickly filming them whilst they use a website for a couple of minutes”

“@MartinBelam


Guerrilla usability testing

Can tell you:



Can tell you:

￫ If users can understand the purpose of the site



Can tell you:


￫ If users can navigate to the content they want



Can tell you:



￫ If users understand the language you’re using



Can tell you:



￫ If users understand the language you’re using

￫ If users are satisfied with what they find


Guerrilla considerations

Consider:



Consider:

￫ Environment



Consider:

￫ Environment

￫ Incentives



Consider:

￫ Environment

￫ Incentives

￫ Understanding who you’re speaking to


Today

We will cover:

￫ How to prepare a session

￫ Practice running a session

￫ Analyse findings

More info: http://bit.ly/dxw-guerrilla-survival-guide


Task: Groups

￫ Break into groups

￫ Introduce yourself

￫ Select a product owner

￫ Working on, or familiar with a website or service

￫ Find a device to test the website on


Task: Decide what to test

￫ Product owner has 1 minute to explain the service:

￫ Who is using the service?

￫ Why are they using the service?

￫ What does the service allow them to do?

￫ Pick one thing that is high priority on that service, either:

￫ A piece of content

￫ Or, a transaction

￫ Fill in the story sheet


Scenarios

We prefer scenarios over tasks:


Scenarios


￫ To give participants context


Scenarios



￫ To allow for more natural behaviour


Scenarios



￫ To allow for more natural behaviour

￫ To avoid pattern matching


You have just been offered a full-time job and are about to sign the employment contract.

The contract says that you only get 5 days of paid holiday per year. You aren’t sure if, legally, that’s enough. Where do you go to check?

Example scenario


Task: Scenario

Write a scenario:

￫ Look back at your story sheet

￫ Think about what circumstance might create that need

￫ Write a scenario for your participants, considering:

￫ How much detail is needed

￫ How relatable the situation is


Break

5 minutes


Recording findings

Focus on insights, over conclusions:


Recording findings


￫ Participant quotes


Recording findings



￫ Participant actions


Recording findings




￫ Positive findings as well as negative ones


Interviewing technique

To get the most value from your session:




￫ Ask participants to speak their thoughts aloud





￫ Use non-leading prompts if they go quiet





￫ Use non-leading prompts if they go quiet

￫ Let participants come to their own conclusions


Task: Testing the website

Test your session out:

￫ Product owner will move to the next group

￫ Lead researcher runs guerrilla usability session

￫ Other researchers write insights on post-it notes:




Analysing findings

Create findings out of insights:


Analysing findings


￫ Focus on understanding user needs and behaviour


Analysing findings


￫ Focus on understanding user needs and behaviour

￫ Avoid designing solutions


Task: Analyse

Analyse your findings with your group:

￫ Discuss your post-it notes

￫ Group similar quotes and actions together

￫ Agree 3 findings to discuss


Task: Your findings


Today

We practised:

￫ How to prepare a script using scenarios

￫ How to interview participants without leading them

￫ How to collect and analyse findings collaboratively


Next steps

Learn more about:

￫ Environment

￫ Incentives

￫ Screening participants

￫ Interview technique

More info at http://bit.ly/dxw-guerrilla-survival-guide


Thank you

Guerrilla tactics in usability testing

Data & Analytics

Transcript of Guerrilla tactics in usability testing