What They Don't Teach You About Usability Testing (english version)

46
What They Don’t Teach You About Usability Testing Jen Wang

description

This presentation is given in 2010 UiGathering Taiwan to share my pratical experience (or tips) on using usaiblity testing method to evaluate mobile devices.

Transcript of What They Don't Teach You About Usability Testing (english version)

Page 1: What They Don't Teach You About Usability Testing (english version)

What They Don’t Teach You About Usability Testing

Jen Wang 

Page 2: What They Don't Teach You About Usability Testing (english version)

Usable

Page 3: What They Don't Teach You About Usability Testing (english version)

Usable

Useful

Page 4: What They Don't Teach You About Usability Testing (english version)

Usable

Useful

Satisfied

Page 5: What They Don't Teach You About Usability Testing (english version)
Page 6: What They Don't Teach You About Usability Testing (english version)

Expert

Page 7: What They Don't Teach You About Usability Testing (english version)

User

Page 8: What They Don't Teach You About Usability Testing (english version)

Usability Testing

Page 9: What They Don't Teach You About Usability Testing (english version)

PlanningRecruiting

Testing

Analyzing

Reporting

Page 10: What They Don't Teach You About Usability Testing (english version)
Page 11: What They Don't Teach You About Usability Testing (english version)

ideal vs. reality

Page 12: What They Don't Teach You About Usability Testing (english version)

ideal vs. reality

Page 13: What They Don't Teach You About Usability Testing (english version)

Test Settings

Data Log

Source of Users

Task Design

Thinking Aloud

Page 14: What They Don't Teach You About Usability Testing (english version)

Test Settings

Page 15: What They Don't Teach You About Usability Testing (english version)

Lab Boardroom

Page 16: What They Don't Teach You About Usability Testing (english version)

Car Simulation

Page 17: What They Don't Teach You About Usability Testing (english version)

Does real context impact the testing results?

Page 18: What They Don't Teach You About Usability Testing (english version)

Kaikkonen,A., Kekäläinen,A., Cankar,M., Kallio,T., and Kankainen, A., Usability Testing of Mobile Applications: A Comparison between Laboratory and Field Testing, Journal of Usability Studies, Issue 1, Volume 1, November 2005, pp. 4-17

Lab Field

Page 19: What They Don't Teach You About Usability Testing (english version)

Data Log

Page 20: What They Don't Teach You About Usability Testing (english version)

Machine Memory

Page 21: What They Don't Teach You About Usability Testing (english version)

When memory low, how to increase the ability taking

notes?

Page 22: What They Don't Teach You About Usability Testing (english version)

Completion time

Task description

Quick Script

Page 23: What They Don't Teach You About Usability Testing (english version)

Success criteriaSuccess/Failed

Failed reasons

Quick Script

Page 24: What They Don't Teach You About Usability Testing (english version)

Path A for completing this task

Path B for completing this task

Quick Script

Page 25: What They Don't Teach You About Usability Testing (english version)

Food for Increasing Brain Power!

Page 26: What They Don't Teach You About Usability Testing (english version)

Source of Users

Page 27: What They Don't Teach You About Usability Testing (english version)

From Agency Friends & Family

Page 28: What They Don't Teach You About Usability Testing (english version)

10 x 5,000 = 50,000

Per usability testing, in-house recruiting saved NT$50000 than outsourcing at least.

Page 29: What They Don't Teach You About Usability Testing (english version)

10 x 5,000 x 12 = 600,000

Recruiting users by snowballing is cheaper, but…

Page 30: What They Don't Teach You About Usability Testing (english version)

In-house recruitment is quite time consuming…

Page 31: What They Don't Teach You About Usability Testing (english version)

User Database

Page 32: What They Don't Teach You About Usability Testing (english version)

Task Design

Page 33: What They Don't Teach You About Usability Testing (english version)

New Feature

Voice Command

New + Main

Voice Command

Call HandlingRouting

Page 34: What They Don't Teach You About Usability Testing (english version)

x 10 = 10 users

Except for new feature, main features are tested in each usability testing, so that plenty of user data can be collected through several testings.

Page 35: What They Don't Teach You About Usability Testing (english version)

x 10 x 12 = 120 users

Page 36: What They Don't Teach You About Usability Testing (english version)

How to determine the main functions for our products?

Page 37: What They Don't Teach You About Usability Testing (english version)

Nothing changed.

Page 38: What They Don't Teach You About Usability Testing (english version)

Become another product.

Page 39: What They Don't Teach You About Usability Testing (english version)

Thinking Aloud

Page 40: What They Don't Teach You About Usability Testing (english version)

Explanation Demonstration

Page 41: What They Don't Teach You About Usability Testing (english version)

How to make Taiwan users comfortable with thinking

aloud?

Page 42: What They Don't Teach You About Usability Testing (english version)

Easy-going Practice (math pratice)

Page 43: What They Don't Teach You About Usability Testing (english version)

ideal vs. reality

Page 44: What They Don't Teach You About Usability Testing (english version)

ideal vs. reality

Page 45: What They Don't Teach You About Usability Testing (english version)

Thank You