User testing: the agile wayAnna, Andre, Esther en Matthijs

We are Angi Studio

In 13 years, 350+ successful online projects

userchecks

research

concept:

functional testing and automated tests

implementation:analyticsmonitoring:

A/B or multivariate testing

improvement:

1

2

34

5

The next hour…Why test your assumptions?

Choosing the right method

The advantages of user checks

Maximising your impact

DIY usercheck!

Choosing the right method

userchecks

research

concept:

functional testing and automated tests

implementation:analyticsmonitoring:

A/B or multivariate testing

improvement:

1

2

34

5

The advantages

Connect better with end-users› Observing behaviour

› Understanding underlying reasoning

› Taking away impediments

1

Manage risks› Design decisions based on findings, not

suspicions

› Eliminate mistakes early in the process

› Save time and money

› Playground for new ideas

2

Fast & flexible› Designer involved with the test

› Change design in-between tests

› No unnecessary documentation3

Maximising your impact

Who plays which part?

PARTICIPANT

TEST LEADER

NOTE TAKER

CLIENT

www.nngroup.com/articles/why-you-only-need-to-test-with-5-users/

It’s better to have 1 participant in the beginning of the process than 50 at the end

Test copy, proposition and recognisability. Not ‘just’ usability!

Usercheck process› Introduction

› Introductory interview

› Go through scenarios with prototype

› Exit interview

Afterwards: discuss findings and draw conclusions

USER CHECK PARTICIPANT

“My son always helps me with internet things”

USER CHECK PARTICIPANT

“I recently gave my mother a subscription for her birthday”

USER CHECK PARTICIPANT

“I disagree with these procedures”

Usercheck process› Introduction

› Introductory interview

› Go through scenarios with prototype

› Exit interview

Afterwards: discuss findings and draw conclusions

EXAMPLE SCENARIO

“You received the Skipr newsletter today in your email. You want to read one of the articles.”

Usercheck process› Introduction

› Introductory interview

› Go through scenarios with prototype

› Exit interview

Afterwards: discuss findings and draw conclusions

ResultsUsers experience it as ‘restless’, much information and ads

Buildup of news-feed is very good: a fast view on the latest news. No need to go back to the email-newsletter

Autoscrolling to the next article was declared very useful and pleasant

“ Wow, there’s other messages that are relevant, I just saw it. I don’t have to keep switching back to the overview list” (in the newsletter)

DIY usercheck

PARTICIPANT

“I need to fill in a form here, but it would be much easier to have a mobile app”

PARTICIPANT

“I really like the design”

PARTICIPANT

“This is not very helpful for myself, but my daughters would really like this feature”

Let’s get going!Make groups of 5 people + 1 laptop

Any questions? You can always contact anna@angistudio.com or call +316 48 933 107