2012 © Humix, all rights reserved2012 © Humix, all rights reserved

Unmoderated remote user testing:Do’s and don’ts

2012 © Humix, all rights reserved 2

Remote User Testing

2012 © Humix, all rights reserved 3

Synchronous vs asynchronous

2012 © Humix, all rights reserved 4

Moderated vs unmoderated

2012 © Humix, all rights reserved 5

Moderated usability testing

2012 © Humix, all rights reserved 6

Unmoderated remoteusability testing

2012 © Humix, all rights reserved 7

Figures

Source: www.measuringusability.com/blog/ux-methods.php 2011 UPA Salary Survey (biennal)

2012 © Humix, all rights reserved2012 © Humix, all rights reserved

ADVANTAGES

8

2012 © Humix, all rights reserved 9

Test large groups

2012 © Humix, all rights reserved 10

Real environments

2012 © Humix, all rights reserved 11

Reduce costs

2012 © Humix, all rights reserved 12

Recruitment

2012 © Humix, all rights reserved 13

Organisation

2012 © Humix, all rights reserved 14

Fast results

2012 © Humix, all rights reserved 15

Quantitative & Qualitative

2012 © Humix, all rights reserved 16

Intercept users

2012 © Humix, all rights reserved 17

Self-reported feedback

2012 © Humix, all rights reserved2012 © Humix, all rights reserved

DRAWBACKS

18

2012 © Humix, all rights reserved 19

Gold diggers

2012 © Humix, all rights reserved 20

No interaction

2012 © Humix, all rights reserved 21

Only survey answers

2012 © Humix, all rights reserved 22

False positives

2012 © Humix, all rights reserved 23

Task time…

2012 © Humix, all rights reserved2012 © Humix, all rights reserved

TOOLS

24

2012 © Humix, all rights reserved 25

Choose the right tool

Functionality of tools has a huge impact on the type of info you’re able to gather

2012 © Humix, all rights reserved 26

Choose the right tool

• What is your budget?• What is your goal?• How much support do you need?• Will you be able to conduct competitive

research? • Can you test prototypes? • Can you export findings? • How will the results be visualized? • Does it come in different languages? • Can you combine different methods

using the same tool? • Are there integrated recruiting tools?

2012 © Humix, all rights reserved 27

Information Architecture tools

Card sorting

2012 © Humix, all rights reserved 28

Information Architecture tools

Tree testing

2012 © Humix, all rights reserved 29

Click based feedback

Task & Interface testing

2012 © Humix, all rights reserved 30

Feedback gathering

2012 © Humix, all rights reserved 31

Unmoderated remote usability testing tools

2012 © Humix, all rights reserved 32

When to use URUT?

• Not a replacement for moderated testing or research

• Best used to complement your qualitative research

2012 © Humix, all rights reserved 33

Interesting reading

• Remote Research: Real Users, Real Time, Real Research by Nate Bolt, Tony Tulathimutte, 2010

• Beyond the usability lab: Conducting Large-scale Online User Experience Studies, Bill Albert, Tom Tullis, Donna Tedesco, 2010

2012 © Humix, all rights reserved

www.humix.be

Lonneke.Spinhof@humix.be

@humix @lonnekespinhof