Post on 14-Jul-2015
Guerrilla UX Live!@johnnyforeigner @saritarink @martarosurrutia
Session structure
Welcome
Arrange groups - 5 mins
Intro to UX and Usability testing - 25 min
Usability Testing poker - 35 min
Discussion - 15 min
Wrap up - 5 m
Who’s who?
Testing…
22
22
22
Product owners
Moderators
3
3
4
4
5
5
3
3
4
4
5
5
3
3
4
4
5
5
5
UsersA
A
A
A
Q
Q
K
KK
K
KK
Observers
5
5
6
6
7
7
8
8
9
9
10
10
5
5
6
6
7
7
8
8
9
9
10
10
5
5
5 6
6
7
7
8
8
9
9
10
10
Lack of information is the root of bad design decisions.
Usability tests = observe people using your product so you can make decisions
about what to do next
Usability Test
GOOD FOR
Understanding if users can do your task
Where the interface fails
Users Expectations
Length of processes
Usability Test
NOT GOOD FOR
Understanding who your users are
Users opinion about your product
Understanding likelihood of buying
“I would prefer if it was pink”
“Yes, I would definitely buy it”
What needs doing
Draw a test plan
Find and select participants
Prepare test materials
Run the tests
Note taking
Analyse data and observations
1
2
3
4
5
6
1. Draw a test planWhat to test?
Core value of your product: Journey to Activation
Acquisition: Sign up
Activation: First use, onboarding,
Retention: core value, most frequent tasks
Referral: Sharing, inviting
Revenue: Check out, etc
2. Scenario and a back story
A scenario is a person in action.
(If this is difficult… maybe you need to revisit your personas?)
2. Scenario and a back story
“Today I am going to show you an e-commerce website for baby clothes.
Imagine you are a mum of a 3 month old baby, he’s asleep. You are exhausted, but will take the chance to buy him some baby grows online. You saw this website on a friend’s page on Facebook and now you are going to check it out. Ideally, you would like to buy 5 baby grows. How would you go about that?”
3. Find and select participants
Try to test with your real audience
If that fails, try anyone
Usability test, not UX research
4. Prepare test materialsPrototype, production app, live product
Reset app
Fake id for registration or log in, credit card details
Email verification
Fake content
Analog materials (packaging, instructions)
Objects or physical products
5. Putting people at easeStarting the test by putting people at ease
Explaining what will happen
How long it will take
What they will be asked about
Reassure them you are not testing them, you’re testing the product
“There are no right or wrong answers”
6. Running the testTRY
Encourage users to think aloud
The power of silence
Push questions back onto them
Ask for clarification
Explore expectations
How to deal with complete failure
6. Running the testAVOID
Using the words that show up on the screen
Leading questions
“was that task difficult?”
“how did you find that task?”
“Would you” questions
7. Note taking
7. Note taking
user 1
user 2user 3
8. Rapid analysis
3 top things
Frequency, impact and persistence
LET’S DO IT!
2
2PRO
DU
CT
C 3
3
4
4
5
5
2
2PRO
DU
CT
A 3
3
4
4
5
5
2
2PRO
DU
CT
B 3
3
4
4
5
5
5
A
A
A
A
Q
Q
Q
Q
Q
Q
K
K
K
K
K
K
6
6
7
7
8
8
9
9
10
10
6
6
7
7
8
8
9
9
10
10
6
67
78
8
9
910
10
Planning
2
2PRO
DU
CT
C 3
3
4
4
5
5
2
2PRO
DU
CT
A 3
3
4
4
5
5
2
2PRO
DU
CT
B 3
3
4
4
5
5
5
A
A
A
A
Q
Q
Q
Q
Q
Q
K
K
K
K
K
K
6
6
7
7
8
8
9
9
10
10
6
6
7
7
8
8
9
9
10
10
6
67
78
8
9
910
10
ROUND 1: Ace of base
2
2PRO
DU
CT
C 3
3
4
4
5
5
2
2PRO
DU
CT
A 3
3
4
4
5
5
2
2PRO
DU
CT
B 3
3
4
4
5
5
5
A
A
A
A Q
Q
Q
Q
Q
Q
K
K
K
K
K
K
6
6
7
7
8
8
9
9
10
10
6
6
7
7
8
8
9
9
10
10
6
67
78
8
9
910
10
ROUND 2: Kings of Convenience
2
2PRO
DU
CT
C 3
3
4
4
5
5
2
2PRO
DU
CT
A 3
3
4
4
5
5
2
2PRO
DU
CT
B 3
3
4
4
5
5
5
A
A
A
A
Q
Q
Q
Q
Q
Q
K
K
K
K
K
K
6
6
7
7
8
8
9
9
10
10
6
6
7
7
8
8
9
9
10
10
6
67
78
8
9
910
10
ROUND 3: Queens of the Stone Age
What you have learned• Deciding what you need to test
• Choosing tasks to test
• Writing great test scripts
• Conducting UX/Usability tests
• Effective note taking
• Tips for effective interviews
• Tools and techniques for recording and sharing
• Rapid analysis and decision making
Resources
Now it gets meta…
Thank you
@johnnyforeigner @saritarink @martarosurrutia