Reto Lämmler • UXCamp Hamburg 2015@rlaemmler @testingtime

Blind Dates – Or the right choice of test users

Why do I want to talk about this?

The UX industry still designs too much based on

assumptions.

Talking to a user is worth more than a thousand

assumptions.

• From Zurich, Switzerland• Co-Founder & CEO of www.testingtime.com• MAS Human Computer Interaction Design• VP Product Management at Doodle.com• BS Computer Science

About meTest early, test often.

Why user testing?

Designer UI UserMental Model

Blind Date

Test SubjectCollaboration platform for architects, naval engineers etc.

“There are some times when it’s important to test your product with your exact market, and other times when users from any demographic can give you the feedback you need.”

Source: www.usertesting.com/blog/2015/02/09/demographics

Testing with Exact DemographicsWhen to Use Them and When to Lose Them

User Testing

Hallway Testing

Extreme User InterviewsIDEO Method Cards

What does Jacob think?

Jacob Nielsen About simplified User Testing

The three main rules:1. Get representative users2. Ask them to perform representative tasks with the

design 3. Shut up and let the users do the talking.

The last thing you want to hear during a usability study session is a participant saying, “I don’t use this kind of [system],” or “I never do that [task] for my job.” That person cannot help you discover the problems with that system or how well the system supports users’ tasks.

Jacob Nielsen About representative Users

The right choice of test users

Recruit Test Users by

Category

Test Users by CategoryConsumers vs Experts

Consumers• Shopping• News• Travel• Social• Entertainment• …

Experts• Medical• Engineering• Architecture• Finance• Legal• …

Experts are also ConsumersBut Consumers are not always Experts.

Expert

Consumer

Everyone can be potentially recruited to test a consumer application.

E.g. A neuro scientist uses www.travel.ch

Only Experts from the field can be recruited to test an Expert application.

E.g. A neuro scientist uses NemoDevices.

Recruit Test Users byPersonas & Scenarios

Test Users by PersonasPrimary vs. Secondary vs. Other Personas

PrimarySecondar

y or Supportiv

eNon-

Personas

Primary and Secodary PersonasWith some example scenarios in mind

Primary Personas• Experienced Kiter who wants to purchase a new

Kite• Newbie Kiter who wants to find a beginners course• …

Secondary Personas• A worried parent who wants to learn about the

sport• Godfather who wants to find a gift for a godchild• …

Supportive and Non-PersonasWith some example scenarios in mind

Supportive• Site Manager who maintains the inventory• Human Resources maintaining job listings• …

Non-Personas• …?

Recruit Test Users by Test Object

Website, App, DocumentationTest objects

Website / App

Navigation

Content

Accessibility

Task Completion

…

…

Devices

Packaging, Food, DevicesTest objects

Food…

Packaging…

Recruiting service for UX people

DACH Panel20‘000+

When do you blind date and when do you choose

carefully?

My LearningsAnd recommendations

• It’s still better to test with anyone, than no testing at all

There is always something you can learn.

• Choose smaller tests over extensive studiesBut iterate as often as necessary

• UX is not a project, it’s an ongoing processSo don’t excuse it with «I’m not ready yet.»

Test early.Test often.

reto@testingtime.com@rlaemmler @testingtime