Remote v Moderated Usability Testing - by Paul Rouke from PRWD

50
What is Usability and User Experience? I’ve fond memories of the session that my talk is about…

description

Paul Rouke, Head of Usability at PRWD, talks at the Internet Retailing Conference 2011 on both the importance of usability testing to businesses along with comparing the process and type of insights that moderated and remote usability testing delivers

Transcript of Remote v Moderated Usability Testing - by Paul Rouke from PRWD

Page 1: Remote v Moderated Usability Testing - by Paul Rouke from PRWD

What is Usability and User Experience?

I’ve fond memories of the session that my talk is about…

Page 2: Remote v Moderated Usability Testing - by Paul Rouke from PRWD
Page 3: Remote v Moderated Usability Testing - by Paul Rouke from PRWD

What is Usability and User Experience?

Thankfully this is my earlier tweet…

Page 4: Remote v Moderated Usability Testing - by Paul Rouke from PRWD
Page 5: Remote v Moderated Usability Testing - by Paul Rouke from PRWD

Remote versus ModeratedUsability Testing

by Paul RoukeHead of Usability at PRWD

4th October 2011 @ Internet Retailing Conference Novotel, Hammersmith, London

Page 6: Remote v Moderated Usability Testing - by Paul Rouke from PRWD

The UK’s Leading North WestBased Usability & Conversion Optimisation Consultancy

About PRWD

We provide services to help retailers improve their website conversion rate

•Usability testing (moderated & remote)•Expert evaluations•Usability training•In-house consultancy•Conversion rate optimisation

Page 7: Remote v Moderated Usability Testing - by Paul Rouke from PRWD

PRWD Clients IncludePRWD clients that we can talk about

Page 8: Remote v Moderated Usability Testing - by Paul Rouke from PRWD

How important is usability testing?

Comparison of moderated & remote testing

What business questions can usability testing answer?

A moderated test session with one of you!

Session agenda

Page 9: Remote v Moderated Usability Testing - by Paul Rouke from PRWD

How important is usability testing?

Comparison of moderated & remote testing

What business questions can usability testing answer?

A moderated test session with one of you!

Session agenda

Page 10: Remote v Moderated Usability Testing - by Paul Rouke from PRWD

We all know how important it is to be considerate of what people want…

especially when buying Christmas presents…

…look what can happen when we’re not!

Page 11: Remote v Moderated Usability Testing - by Paul Rouke from PRWD
Page 12: Remote v Moderated Usability Testing - by Paul Rouke from PRWD
Page 13: Remote v Moderated Usability Testing - by Paul Rouke from PRWD

What is Usability and User Experience?

From experience, usability testing is THE most enlightening and powerful activity that

retailers can carry out to answer a very extensive

range of questions which can be crucial to how their e-commerce

site performs

Page 14: Remote v Moderated Usability Testing - by Paul Rouke from PRWD

What is Usability and User Experience?

a short case study...

Page 15: Remote v Moderated Usability Testing - by Paul Rouke from PRWD
Page 16: Remote v Moderated Usability Testing - by Paul Rouke from PRWD

Matthew Lawson, Head of conversion at Appliances Online

“I introduced user-centered design, but I had to

get the business bought into it. So I did this by

buying 125 videos from WhatUsersDo, where

you set a task for a customer to go away onto

your site and try and make a purchase”

Page 17: Remote v Moderated Usability Testing - by Paul Rouke from PRWD

“This gave us 250 hours of footage which was too

much content to watch through. So I used crowd

sourcing... we gave five videos to each senior

manager including the CEO and this gave us insight

into what we needed to change from our

proposition, the size of the images to where we put

the buy button and it actually gave our customers a

voice which went directly to the managers”

Page 18: Remote v Moderated Usability Testing - by Paul Rouke from PRWD

What is Usability and User Experience?

Results?

Page 19: Remote v Moderated Usability Testing - by Paul Rouke from PRWD

9.5% increase in sales

37% more visitors viewed product videos

11% increase in customer reviews

33% reduction in calls about delivery

Page 20: Remote v Moderated Usability Testing - by Paul Rouke from PRWD

What is Usability and User Experience?

Full insights & videos available here

http://bit.ly/lovetesting

Page 21: Remote v Moderated Usability Testing - by Paul Rouke from PRWD

Have we ever watched people using our website?Do we actually know why so many people leave our website at a certain stage?Do we know why visitors are choosing to call customer services?Do we know why visitors aren’t clicking on what we want them to?

How much money do we spend getting people to our website versus making sure they do what we want them to do once they are there?

A few questions for you to consider

Page 22: Remote v Moderated Usability Testing - by Paul Rouke from PRWD

How important is usability testing?

Comparison of moderated & remote testing

What business questions can usability testing answer?

A moderated test session with one of you!

Session agenda

Page 23: Remote v Moderated Usability Testing - by Paul Rouke from PRWD

1

2

3

4

Planning

Testing

Expert Analysis & Reporting

In-house Strategy Presentation

Page 24: Remote v Moderated Usability Testing - by Paul Rouke from PRWD

1 Planning

Determining tasks & journey’s

Basic user recruitment

Advanced user recruitment

Recruit client’s customers

Location

Remote Moderated

Anywhere To where you can get to

Page 25: Remote v Moderated Usability Testing - by Paul Rouke from PRWD

1

2

3

4

Planning

Testing

Expert Analysis & Reporting

In-house Strategy Presentation

Page 26: Remote v Moderated Usability Testing - by Paul Rouke from PRWD

2 Test session - activities

Session is facilitated by a moderator

User’s provide think out-loud feedback

User’s take part on their own computer

User’s asked questions in real-time

Client can observe the sessions live

Client can ask questions live

Remote Moderated

Page 27: Remote v Moderated Usability Testing - by Paul Rouke from PRWD

2 Test session - outputs

Screen capture of user’s session

Audio recording of user’s comments

Webcam recording of users

Remote Moderated

Page 28: Remote v Moderated Usability Testing - by Paul Rouke from PRWD

2 Test session – turnaround times

Average turnaround times*

Remote Moderated

24 hours 2 weeks

* From finalising scenario to having videos of test session

Page 29: Remote v Moderated Usability Testing - by Paul Rouke from PRWD
Page 30: Remote v Moderated Usability Testing - by Paul Rouke from PRWD

1

2

3

4

Planning

Testing

Expert Analysis & Reporting

In-house Strategy Presentation

Page 31: Remote v Moderated Usability Testing - by Paul Rouke from PRWD
Page 32: Remote v Moderated Usability Testing - by Paul Rouke from PRWD
Page 33: Remote v Moderated Usability Testing - by Paul Rouke from PRWD

1

2

3

4

Planning

Testing

Expert Analysis & Reporting

In-house Strategy Presentation

Page 34: Remote v Moderated Usability Testing - by Paul Rouke from PRWD

4 In-house strategy presentation

What this typically involves

1.Observing video recordings

2.Knowledge sharing on key insights gained

3.Discussing the impact on the business strategy

4.Planning next steps

Page 35: Remote v Moderated Usability Testing - by Paul Rouke from PRWD

How important is usability testing?

Comparison of moderated & remote testing

What business questions can usability testing answer?

A moderated test session with one of you!

Session agenda

Page 36: Remote v Moderated Usability Testing - by Paul Rouke from PRWD

What is Usability and User Experience?

First of all, what types of insight can usability testing provide?

Page 37: Remote v Moderated Usability Testing - by Paul Rouke from PRWD

Online behaviourUser attitudesBrand perceptionCustomer research

Usability & user experience

Usability testing can provide insights on...

& last but by no means least…

Page 38: Remote v Moderated Usability Testing - by Paul Rouke from PRWD

What is Usability and User Experience?

What questions do people want to know the answers

to in order to commit to buy/click/proceed?

Page 39: Remote v Moderated Usability Testing - by Paul Rouke from PRWD

What is Usability and User Experience?

How do users respond to being forced to register or

create an account?

Page 40: Remote v Moderated Usability Testing - by Paul Rouke from PRWD

What is Usability and User Experience?

What are the main reasons you decide not to buy from

a retailer online?

Page 41: Remote v Moderated Usability Testing - by Paul Rouke from PRWD

What is Usability and User Experience?

How important are product videos to you and when would

you expect to see them?

Page 42: Remote v Moderated Usability Testing - by Paul Rouke from PRWD

What is Usability and User Experience?

67 business questions usability testing can answer

http://bit.ly/67questions

Page 43: Remote v Moderated Usability Testing - by Paul Rouke from PRWD

How important is usability testing?

Comparison of moderated & remote testing

What business questions can usability testing answer?

A moderated test session with one of you!

Session agenda

Page 44: Remote v Moderated Usability Testing - by Paul Rouke from PRWD
Page 45: Remote v Moderated Usability Testing - by Paul Rouke from PRWD

9 women x 9 hours

Some insights from usability testing with our client

XX

Page 46: Remote v Moderated Usability Testing - by Paul Rouke from PRWD
Page 47: Remote v Moderated Usability Testing - by Paul Rouke from PRWD

How quickly do we want to gain feedback

from users?

Page 48: Remote v Moderated Usability Testing - by Paul Rouke from PRWD

What depth of insight do we want

to gain from usability testing?

Page 49: Remote v Moderated Usability Testing - by Paul Rouke from PRWD

Connect with me

http://uk.linkedin.com/in/paulrouke

Office:0161 228 0585

Mobile:07739 745 126

Email:paulrouke @ prwd.co.uk

Web:http://www.prwd.co.uk

PRWD22 Lever StreetManchesterM1 1EA

http://twitter.com/paulrouke

Page 50: Remote v Moderated Usability Testing - by Paul Rouke from PRWD

Thankyou for listening to “Remote versus Moderated

Usability Testing” by Paul Rouke

Slides, usability testing resources & best practice available here:

http://bit.ly/CROresources