Remote Research at IxD10

83
REMOTE DESIGNRESEARCH INTERACTION 10

description

My talk on Remote Research from the 2010 IxD10 conference in Savannah.

Transcript of Remote Research at IxD10

Page 1: Remote Research at IxD10

REMOTE DESIGN!RESEARCHINTERACTION 10

Page 2: Remote Research at IxD10
Page 3: Remote Research at IxD10

I’M!NATE!BOLT

Page 4: Remote Research at IxD10

I’M!NATE!BOLTROBOTIC!DOG!TREATS

Page 5: Remote Research at IxD10

I’M!NATE!BOLTROBOTIC!DOG!TREATSDINOSAUR!EXPLAINS!IA

Page 6: Remote Research at IxD10

10 YEARS234 STUDIES2,815 PARTICIPANTS (MODERATED)89 ORGANIZATIONS19,120 HOURS

Page 7: Remote Research at IxD10

#ixd10 #Remote

Page 8: Remote Research at IxD10
Page 9: Remote Research at IxD10

#ixd10 #Remote7

Page 10: Remote Research at IxD10

SO!ANYWAY WHAT’s UP WITH YOU?

Have you conducted remote testing before? Biggest concern (about remote silly)?

Page 11: Remote Research at IxD10

THE!REMOTEDESIGN RESEARCH

SITUATION

Page 12: Remote Research at IxD10
Page 13: Remote Research at IxD10
Page 14: Remote Research at IxD10

DESIGN!RESEARCH

CONCEPT TESTING

PERSONA DEVELOPMENT

SURVEYS

ETHNOGRAPHY

NEEDS ASSESSMENT

IDEATION

GAME"BASED ELICITATION

Page 15: Remote Research at IxD10

Remote Research

Definition:

Research where the participant is not sharing physical space with the researcher.

In personRemote

% of qualitative research done remotely*

*Source: BP’s best guess

Page 16: Remote Research at IxD10

THE!WHOLEREMOTEPART!OF!THIS

Page 17: Remote Research at IxD10

When does remote win?

Page 18: Remote Research at IxD10

Native Environment

Cheap ethnography, not cheap lab.

Page 19: Remote Research at IxD10

Real Time

Allows self-motivated tasks.

Page 20: Remote Research at IxD10

I’ll trade you time for physical presence

Page 21: Remote Research at IxD10

Involved Observers

Easier to collaborate in real time.

Page 22: Remote Research at IxD10

Geography

Page 23: Remote Research at IxD10

When does remote fail?

Page 24: Remote Research at IxD10

Bandwidth

Yes, it’s an issue.

Page 25: Remote Research at IxD10

Translation

It’s expensive and difficult to do live.

Page 26: Remote Research at IxD10

Minors

Consent is a bear.Especially if they’re under 13.

Page 27: Remote Research at IxD10

Faces

Most users don’t have webcams.Webcams are a little invasive.

Page 28: Remote Research at IxD10

DesigningREMOTE!STUDIES

Page 29: Remote Research at IxD10

TIME-AWARE TasksTold to find purple pumps.

Doesn’t care.

Has to wear this for sister’s wedding this weekend.

Whole different interview.

Page 30: Remote Research at IxD10

Real Time OBservers

Page 31: Remote Research at IxD10
Page 32: Remote Research at IxD10

Portable Research

Page 33: Remote Research at IxD10

Change on the fly

“No one seems engaged in the laptop customizer”

“Let’s add questions about who they get recommendations from”

Page 34: Remote Research at IxD10
Page 35: Remote Research at IxD10

prototypes, wireframes, Sketches = heck yes

Page 36: Remote Research at IxD10

TOOLS

Page 37: Remote Research at IxD10
Page 38: Remote Research at IxD10
Page 39: Remote Research at IxD10

Usabilla

Clicks & QuestionsHeatmapsYou do your own recruiting$49 - $199

Page 40: Remote Research at IxD10
Page 41: Remote Research at IxD10

Loop11 (un-moderated)

Page 42: Remote Research at IxD10
Page 43: Remote Research at IxD10
Page 44: Remote Research at IxD10

PlainFrame SNEAK!PREVIEW

Page 45: Remote Research at IxD10
Page 46: Remote Research at IxD10
Page 47: Remote Research at IxD10

Communication

Reliable

Can be expensive for international

Conference calls needed for observers

The Past

phone

Cheap or free

Harder for users

Can combine with screensharing to stress user’s connection

The Future

Skype / VOIP

Page 48: Remote Research at IxD10

Screen-sharing

Adobe Connect

LiveLook

WebEx

GoToMeeting

StandaloneUserVue

Integrated

Page 49: Remote Research at IxD10

Adobe Acrobat Connect - $39/mo

Page 50: Remote Research at IxD10

Recording Tools

Phone Patch

Cables

HardwareCamtasia (Windows)

iShowU HD (Mac)

Software

Page 51: Remote Research at IxD10

RecruitingFOR!REMOTE

Page 52: Remote Research at IxD10

Recruiting Options

Grab someone in the hallway

Grab someone who isn’t directly involved in your project

IM your friends for a quick look

Panels and recruiting agencies

Real customers from marketing lists

Site intercepts

realness

Page 53: Remote Research at IxD10

Gold Standard

Live recruitingGet as close as you can

Page 54: Remote Research at IxD10

Recruiting Options

EthnioLinks or house ads to online formsRecruiting agenciesCustomer email listsPanelsCraigslist/online ads

Page 55: Remote Research at IxD10

use Ethnio when

Website accessSome budgetQuotas are relatively simple

Page 56: Remote Research at IxD10

use forms when

You can place a link but not codeLow budgetQuotas are relatively complexOptions:

Google Docs

Wufoo

Page 57: Remote Research at IxD10

use Agencies when

No website accessPeople whine about first-time visitorsHigher budgetOnline recruiting failed

Page 58: Remote Research at IxD10

Customer lists

Sub-segmentsOwnership requirementsNo website access

Page 59: Remote Research at IxD10

PANELS

Page 60: Remote Research at IxD10

Craigslist

When other methods don’t workNo doughTakes a whileEmbarrassing to admit to your friends

Page 61: Remote Research at IxD10

Live Recruiting Math

Target: 6 recruits/hourAllow for: 1% response (low average)

You Need: 8-10,000 uniques/day

Page 62: Remote Research at IxD10
Page 63: Remote Research at IxD10
Page 64: Remote Research at IxD10

Paying Incentives

Collect minimal personal infoDeliver quicklyAppropriate for location

Page 65: Remote Research at IxD10

HOW!TO!BEgraceful

When All Your

TECHNOLOGY

BREAKS

Page 66: Remote Research at IxD10

What they worry about

Page 67: Remote Research at IxD10

WHO!ARE!YOU!AND!CAN!I TRUST!YOU?

Page 68: Remote Research at IxD10

IF!YOU!CAN!SEE!MY!SCREEN,CAN!YOU!SEE!MY!FACE?

Page 69: Remote Research at IxD10

WILL!YOU!BE!ABLE!TO!TAKECONTROL!OF!MY!COMPUTER?

Page 70: Remote Research at IxD10

WILL!YOU!HELP!ME!GET!THE PLUG"IN

OFF!MY!COMPUTER!AT!THE!END?

Page 71: Remote Research at IxD10

WILL!THIS!WORK!IF!I!HAVE!AFIREWALL/PROXY/STRICT!IT

DEPARTMENT?

Page 72: Remote Research at IxD10

IS!THIS!GOING!TO!END!UP!ONYOUTUBE?

Page 73: Remote Research at IxD10

Advanced TechniquesHigh Emotions

Page 74: Remote Research at IxD10

OXYMORON?Remote empathy

Page 75: Remote Research at IxD10

hybrid studies

Numbers actually do lie sometimesAnd they don’t tell you the why3-5 remote interviews is all you need

Page 76: Remote Research at IxD10

mobile Research?

Page 77: Remote Research at IxD10

Advanced TechniquesOne to many moderation

Multi-threading

Page 78: Remote Research at IxD10

Burn the scriptFind out what matters.

Page 79: Remote Research at IxD10

The Future

Page 80: Remote Research at IxD10

remoteusability.com

Page 81: Remote Research at IxD10
Page 82: Remote Research at IxD10
Page 83: Remote Research at IxD10

@boltron