Collaborative Research | uxlx 2014

212
Collaborative Research with Erika Hall (@mulegirl) UXLX

description

Slides from a half-day workshop I gave in Lisbon, on June 5, 2014.

Transcript of Collaborative Research | uxlx 2014

Page 1: Collaborative Research | uxlx 2014

Collaborative Research

with Erika Hall (@mulegirl)

UXLX

Page 2: Collaborative Research | uxlx 2014

Hello!

Page 3: Collaborative Research | uxlx 2014
Page 4: Collaborative Research | uxlx 2014

I have a question...

Page 5: Collaborative Research | uxlx 2014

Do you enjoy being right?

Page 6: Collaborative Research | uxlx 2014

You are correct!

Page 7: Collaborative Research | uxlx 2014

YESSS!

Page 8: Collaborative Research | uxlx 2014
Page 9: Collaborative Research | uxlx 2014

p0wned!

Page 10: Collaborative Research | uxlx 2014

No.

Page 11: Collaborative Research | uxlx 2014

?

Page 12: Collaborative Research | uxlx 2014

>? !

Page 13: Collaborative Research | uxlx 2014

Dogma

Page 14: Collaborative Research | uxlx 2014

Flickr/Chris Voll

Page 15: Collaborative Research | uxlx 2014

Ego!

Page 16: Collaborative Research | uxlx 2014
Page 17: Collaborative Research | uxlx 2014

Why?

Page 18: Collaborative Research | uxlx 2014
Page 19: Collaborative Research | uxlx 2014
Page 20: Collaborative Research | uxlx 2014
Page 21: Collaborative Research | uxlx 2014
Page 22: Collaborative Research | uxlx 2014

People!

Page 23: Collaborative Research | uxlx 2014

Collaboration!

Page 24: Collaborative Research | uxlx 2014

TextAgenda

Page 25: Collaborative Research | uxlx 2014

TextAgenda

9–10:30

10:30–11

11–12:30

Introduction.

The research process

Questions and activities

Understanding your organization

Break

User research

Analysis

Models and reports

Finale

Page 26: Collaborative Research | uxlx 2014

Barriers

Page 27: Collaborative Research | uxlx 2014
Page 28: Collaborative Research | uxlx 2014
Page 29: Collaborative Research | uxlx 2014
Page 30: Collaborative Research | uxlx 2014
Page 31: Collaborative Research | uxlx 2014

Overcoming Objections

Page 32: Collaborative Research | uxlx 2014
Page 33: Collaborative Research | uxlx 2014

Laziness

Page 34: Collaborative Research | uxlx 2014

Laziness

Fear

Page 35: Collaborative Research | uxlx 2014

Laziness

Fear

Lunch

Page 36: Collaborative Research | uxlx 2014

Laziness

Fear

Lunch

Following

Page 37: Collaborative Research | uxlx 2014

Laziness

Fear

Lunch

Following

Losing Control

Page 38: Collaborative Research | uxlx 2014

Laziness

Fear

Lunch

Following

Losing Control

Sharing

Page 39: Collaborative Research | uxlx 2014

Shared Understanding

Page 40: Collaborative Research | uxlx 2014

We don’t havethe time.

Page 41: Collaborative Research | uxlx 2014

We don’t havethe money.

Page 42: Collaborative Research | uxlx 2014

We don’t have the expertise.

Page 43: Collaborative Research | uxlx 2014

We’re already A/B testing

Page 44: Collaborative Research | uxlx 2014

Everyone wants better products, faster.

Page 45: Collaborative Research | uxlx 2014

No one wants to read a report.

Page 46: Collaborative Research | uxlx 2014
Page 47: Collaborative Research | uxlx 2014
Page 48: Collaborative Research | uxlx 2014
Page 49: Collaborative Research | uxlx 2014

What is your experience?

Page 50: Collaborative Research | uxlx 2014

Research + Collaboration

Page 51: Collaborative Research | uxlx 2014

A design project isa series of decisions.

Page 52: Collaborative Research | uxlx 2014

Data doesn’t change minds.

Page 53: Collaborative Research | uxlx 2014

Whatis

What ought to be

Page 54: Collaborative Research | uxlx 2014
Page 55: Collaborative Research | uxlx 2014

Design-Led

Research-Led

ExpertMindset

ParticipatoryMindset

Users seen as subjects Users seen as partners

Design-ledwith

expert mindset

Design-ledwith

participatory mindset

Research-ledwith expert mindset

Research-ledwith participatory

mindset

Dubberly Design Office

Page 56: Collaborative Research | uxlx 2014

Goal Driven

Skeptical Mindset

Increase chance of successReduce risk

Willing to question the value of any approach

Page 57: Collaborative Research | uxlx 2014

Team + Goal + Reality = Good

Page 58: Collaborative Research | uxlx 2014
Page 59: Collaborative Research | uxlx 2014

One Simple

Process

Page 60: Collaborative Research | uxlx 2014

Form Questions

AnalyzeData

GatherData

Page 61: Collaborative Research | uxlx 2014

Form Questions

AnalyzeData

Think Critically

Page 62: Collaborative Research | uxlx 2014

Form Questions

AnalyzeData

Observe

Page 63: Collaborative Research | uxlx 2014

Form Questions

AnalyzeData

Interview

Page 64: Collaborative Research | uxlx 2014

Form Questions

AnalyzeData

Read

Page 65: Collaborative Research | uxlx 2014

Form Questions

AnalyzeData

Read

Experiment

Interview

Observe

Think

Page 66: Collaborative Research | uxlx 2014

PersonalView

PersonalView

PersonalView

Page 67: Collaborative Research | uxlx 2014

SharedReality

Page 68: Collaborative Research | uxlx 2014

Researchis a Craft

Page 69: Collaborative Research | uxlx 2014
Page 70: Collaborative Research | uxlx 2014

Form Questions

AnalyzeData

GatherData

Page 71: Collaborative Research | uxlx 2014

Questions determine results.

Page 72: Collaborative Research | uxlx 2014

Questions give research meaning.

Page 73: Collaborative Research | uxlx 2014

Research high-priority questions.

Page 74: Collaborative Research | uxlx 2014

Good Questions

SpecificActionablePractical

Page 75: Collaborative Research | uxlx 2014

A Bad Question

“What do people think about pets?”

Page 76: Collaborative Research | uxlx 2014

A Better Question

“How do single urban adults choose and acquire a pet?”

Page 77: Collaborative Research | uxlx 2014

A Bad Question

“What do people do around here all day?”

Page 78: Collaborative Research | uxlx 2014

A Better Question

“How do editors and designers work together?”

Page 79: Collaborative Research | uxlx 2014

The Best Question

The unknown with the most risk.

Page 80: Collaborative Research | uxlx 2014
Page 81: Collaborative Research | uxlx 2014

Bias

Page 82: Collaborative Research | uxlx 2014

Bias: Something that causes an influence or prejudice

Page 83: Collaborative Research | uxlx 2014

Confirmation Bias:

You selectively weight the information that confirms what you already believe.

Page 84: Collaborative Research | uxlx 2014

Sampling Bias:

Your sample of research subjects isn’t sufficiently representative.

Page 85: Collaborative Research | uxlx 2014

Interviewer Bias:

You insert your opinion into interviews.

Page 86: Collaborative Research | uxlx 2014

Social Desirability Bias

People don’t say the true things that they worry will make them look bad.

Page 87: Collaborative Research | uxlx 2014

Ease

Clear Display

Related

Primed Idea

Good Mood

Feels True

Feels Familiar

Feels Good

Feels Effortless

Daniel Kahneman

Page 88: Collaborative Research | uxlx 2014

Feeling confident?It’s not a good sign.

Page 89: Collaborative Research | uxlx 2014

You might have a bad case ofDunning-Kruger.

Page 90: Collaborative Research | uxlx 2014

Critical Thinking

Page 91: Collaborative Research | uxlx 2014

Critical Thinking

DisciplinedSelf-correctingClearLogical

Page 92: Collaborative Research | uxlx 2014

Uncritical Thinking

“I hate yellow, so a yellow website won’t succeed.”

Page 93: Collaborative Research | uxlx 2014

Critical Thinking

“I hate yellow, but based on the evidence, it might work for our audience.”

Page 94: Collaborative Research | uxlx 2014

Critical Thinking

“I don’t know.”

Page 95: Collaborative Research | uxlx 2014

Activities!

Page 96: Collaborative Research | uxlx 2014

Form Questions

AnalyzeData

GatherData

Page 97: Collaborative Research | uxlx 2014
Page 98: Collaborative Research | uxlx 2014
Page 99: Collaborative Research | uxlx 2014

Questions About

Users

ProductOrg

Competition

InterviewsInterviews

UsabilityTesting

A/BTesting

ContextualInquiry

LiteratureReview

SWOTAnalysis

BrandAudit

Usability Testing

CompetitiveAnalysis

HeuristicAnalysis

Descriptive

Evaluative

Evaluative

Evaluative

Analytic

Analytic

Generative

Descriptive

Page 100: Collaborative Research | uxlx 2014

ResearchActivity

TopicPurpose

Time

Money

Page 101: Collaborative Research | uxlx 2014

Phone InterviewsWhat do we

need to know about?

What kind of decision will it

inform?

How long do we have?

What is our budget?

Contextual Inquiry

In-Person Interviews

Usability Testing

Competitive Analysis

Page 102: Collaborative Research | uxlx 2014

Why not just make a

prototype?

Page 103: Collaborative Research | uxlx 2014
Page 104: Collaborative Research | uxlx 2014

20

If we only test bottle openers, we may never realize customers prefer screw-top bottles.

– Victor Lombardi, Why We Fail

Page 105: Collaborative Research | uxlx 2014

Topics

Page 106: Collaborative Research | uxlx 2014

Organizational Research

Page 107: Collaborative Research | uxlx 2014
Page 108: Collaborative Research | uxlx 2014

Stakeholders

Page 109: Collaborative Research | uxlx 2014

Stakeholders

Page 110: Collaborative Research | uxlx 2014

Executives

Page 111: Collaborative Research | uxlx 2014

Sales People

Page 112: Collaborative Research | uxlx 2014

Customer Service

Page 113: Collaborative Research | uxlx 2014

Editors

Page 114: Collaborative Research | uxlx 2014

Production Team

Page 115: Collaborative Research | uxlx 2014

Organizational research helps you with:

Requirements

Politics

Workflow

Capabilities

Goodwill

Page 116: Collaborative Research | uxlx 2014

Requirements

What are the top business priorities for this project/product?

Page 117: Collaborative Research | uxlx 2014

Politics

What does success mean to the individual stakeholders?

Page 118: Collaborative Research | uxlx 2014

Workflow

Do we have to change how people are working together to be successful?

Page 119: Collaborative Research | uxlx 2014

Workflow

How do we have to change how people are working together to be successful?

Page 120: Collaborative Research | uxlx 2014

Workflow

How can we possibly change how people are working together?

Page 121: Collaborative Research | uxlx 2014

Capabilities

What are the strengths and weaknesses of our team?

Page 122: Collaborative Research | uxlx 2014

Capabilities

Where is the internal expertise?

Page 123: Collaborative Research | uxlx 2014

Goodwill

How can this project make your job easier (or harder)?

Page 124: Collaborative Research | uxlx 2014
Page 125: Collaborative Research | uxlx 2014
Page 126: Collaborative Research | uxlx 2014

Get them alone

Page 127: Collaborative Research | uxlx 2014

Basic Stakeholder Questions

What is your title? How long have you been in this role?

What are your essential duties and responsibilities?

What does a typical day look like?

Who are the people you work most closely with? How is that going?

What does success mean from your perspective, what will have changed for the better once this project is complete?

Do you have any concerns about this project?

What do you think the greatest challenges to success are? Internal and external?

Page 128: Collaborative Research | uxlx 2014

For each stakeholder, note the following:

What’s their general attitude toward this project?

What’s the goal as they describe it?

To what extent are this person’s incentives aligned with the project’s success?

How much and what type of influence do they have?

Who else do they communicate with on a regular basis?

To what extent does this stakeholder need to participate throughout the project, and in which role?

Is what you heard in harmony or in conflict with what you’ve heard from others throughout the organization?

Page 129: Collaborative Research | uxlx 2014

Stakeholder power moves

“Why are you asking me this?”

“I don’t understand that question. It doesn’t make any sense.”

“I don’t feel comfortable talking to you about that.”

“No one pays attention to anything I have to say, so I don’t know why I should bother talking to you.”

“How much more time is this going to take?”

Page 130: Collaborative Research | uxlx 2014

Practice!

Page 131: Collaborative Research | uxlx 2014

10 minutes practice. Find a partner. Take turns.

What is your title? How long have you had this job?

What are your essential duties and responsibilities?

What is a typical day like?

Who are the people you work most closely with? How is that going?

What do you think the greatest challenges to your success are? Internal and external?

Page 132: Collaborative Research | uxlx 2014

Empathy

Page 133: Collaborative Research | uxlx 2014

Break!

Page 134: Collaborative Research | uxlx 2014

To Review

Team + Goal + Shared Reality = Good

Research is a simple process you can apply to however you work. You shouldn’t be dogmatic.

Even though this sounds obvious, some people will resist this because questions can feel threatening.

Facts will not change the minds of people who are threatened.

You need to appeal to what you know is important to them, and fit your facts into their story.

So, understanding what is important to your stakeholders is necessary for design and research to succeed.

Page 135: Collaborative Research | uxlx 2014

UserResearch

Page 136: Collaborative Research | uxlx 2014

Photo: Flickr/theloushe

Ethnography

Page 137: Collaborative Research | uxlx 2014

How to do bad user research:Ask people what they want.

Page 138: Collaborative Research | uxlx 2014

How to do bad user research:Ask people what they like.

Page 139: Collaborative Research | uxlx 2014

Never ask users what they want or like.

Page 140: Collaborative Research | uxlx 2014

The Four Ds of Design Ethnography

Page 141: Collaborative Research | uxlx 2014

Deep DiveDaily Life

Data AnalysisDrama

Page 142: Collaborative Research | uxlx 2014

“...true ethnography reveals not just what people say they do, but what they actually do.”

–PARC

Page 143: Collaborative Research | uxlx 2014
Page 144: Collaborative Research | uxlx 2014

Photo: Flickr/lintmachine

Page 145: Collaborative Research | uxlx 2014

The Art ofThe Interview

Page 146: Collaborative Research | uxlx 2014

Interviewing is not talking.

Page 147: Collaborative Research | uxlx 2014

Interviewing is listening.

Page 148: Collaborative Research | uxlx 2014

Good Interviewers:

Know Your Question

Warm Up

Shut Up

Page 149: Collaborative Research | uxlx 2014

Interview Structure:

Introduction

Body

Conclusion

Page 150: Collaborative Research | uxlx 2014

Introduction:

Smile

Express gratitude

Describe the process

Ask to record

Warm up questions

Page 151: Collaborative Research | uxlx 2014

Body:

Ask open-ended questions

Probe for more

Allow silence

Use questions as checklist

Page 152: Collaborative Research | uxlx 2014

Conclusion:

Transition to wrap-up

Ask if there is anything else

Thank for time

Page 153: Collaborative Research | uxlx 2014

You are the hostYou are the student

Page 154: Collaborative Research | uxlx 2014

Out of your comfort zone,and into theirs.

Page 155: Collaborative Research | uxlx 2014

Interview ChecklistCreate a welcoming atmosphere to make participants feel at ease.

Always listen more than you speak.

Take responsibility to accurately convey the thoughts and behaviors of the people you are studying.

Start each interview with a general description of the goal, but be careful of focusing responses too narrowly.

Avoid leading questions and closed yes/no questions. Ask follow-up questions.

Prepare an outline of your interview questions in advance, but don’t be afraid to stray from it.

Also note the exact phrases and vocabulary that participants use.

Page 156: Collaborative Research | uxlx 2014

Look forGoals

Priorities

Tasks

Motivators

Barriers

Habits

Relationships

Tools

Environment

Page 157: Collaborative Research | uxlx 2014

Roles

Interviewer

Notetaker

Observer

Page 158: Collaborative Research | uxlx 2014

Practice!

Page 159: Collaborative Research | uxlx 2014

Interview Scenario

You work for an e-commerce site that wants to develop a new service to help people give gifts.

The goal of the research is to identify unmet needs people might have with regard to giving gifts.

Page 160: Collaborative Research | uxlx 2014

Interview Practice

Break into groups of 3-4 people

1 interviewee, 1 interviewer , 1 notetaker, 1 observer (optional),

Switch in 15 minutes

2 rounds

Page 161: Collaborative Research | uxlx 2014

Look forGoals

Priorities

Tasks

Motivators

Barriers

Habits

Relationships

Tools

Environment

Page 162: Collaborative Research | uxlx 2014
Page 163: Collaborative Research | uxlx 2014

How did that go?

Page 164: Collaborative Research | uxlx 2014

How about a focus group?

Page 165: Collaborative Research | uxlx 2014
Page 166: Collaborative Research | uxlx 2014

14

“Even when the subjects are well selected, focus groups are supposed to be merely the source of ideas that need to be researched.”

–Robert K. Merton, Sociologist,invented focus groups

Page 167: Collaborative Research | uxlx 2014

Everybody Lies

Page 168: Collaborative Research | uxlx 2014

Competitive Research

Page 169: Collaborative Research | uxlx 2014

How else might your target customer solve

the same problem?

Page 170: Collaborative Research | uxlx 2014

Competitive Review

What do they say they offer?

Who is their customer? How is this the same or different from your target audience or users?

What are the key differentiators—the factors that make them uniquely valuable to their target market, if any?

How do the user needs or wants they’re serving overlap or differ from those that you’re serving or desire to serve?

What do you notice that they’re doing particularly well or badly?

Based on this assessment, where do you see emerging or established conventions in how they do things, opportunities to offer something clearly superior, or good practices you’ll need to adopt or take into consideration to compete with them?

Page 171: Collaborative Research | uxlx 2014

Your target customershave to love youmore than they

hate change.

Page 172: Collaborative Research | uxlx 2014

(Usability) Testing

Page 173: Collaborative Research | uxlx 2014

A good research activity:

•Answers a key question

•Addresses identified assumptions

•Informs specific decisions

•Involves your team

•Fits your level of expertise

•Fits your schedule and budget

Page 174: Collaborative Research | uxlx 2014

•Fundamentally research is a simple process

•There are many activities and definitions

•No pressure!

•Select the methods that inform decisions

•Begin by understanding your organization

•Never ask what people like

•People are lazy, forgetful creatures of habit

•Keep each other honest

•Practice and learn

Page 175: Collaborative Research | uxlx 2014

Research and Collaboration

Working together across disciplines and making decisions based on evidence shouldn’t be hard, but they can be.

Done right, research and working collaboratively reinforce each other through a shared understanding of reality.

Start with your goal in mind, not with any process or buzzword.

Asking questions and cutting across traditional roles can both be threatening to the established order.

Commit to clear communication and critical thinking.

Research questions follow from goals, assumptions, and risk.

Always have a framework and a plan.

Page 176: Collaborative Research | uxlx 2014

Creating Meaning From Data

Page 177: Collaborative Research | uxlx 2014

1. Compile data2. Analyze3. Identify Insights4. Create Model

Page 178: Collaborative Research | uxlx 2014
Page 179: Collaborative Research | uxlx 2014

Basic Analysis

Closely review the notes.

Look for interesting behaviors, emotions, actions, and verbatim quotes.

Write what you observed on a sticky note (coded to the source, the actual user, so you can trace it back).

Group the notes.

Watch the patterns emerge.

Rearrange the notes as you continue to assess the patterns.

Page 180: Collaborative Research | uxlx 2014
Page 181: Collaborative Research | uxlx 2014

Observation

Observation

Observation

Observation

Observation

Observation

Page 182: Collaborative Research | uxlx 2014

Observation

Observation

Observation

Observation

Observation

Observation

Observation

Page 183: Collaborative Research | uxlx 2014

Collaborates on purchases

Observation

Observation

Observation

Observation

Observation

Observation

Observation

Page 184: Collaborative Research | uxlx 2014

Collaborates on purchases

Uses several devices

Observation

Observation

Observation

Observation

Observation

Observation

Observation

Page 185: Collaborative Research | uxlx 2014

Collaborates on purchases

Uses several devices

Needs affirmation

Observation

Observation

Observation

Observation

Observation

Observation

Observation

Page 186: Collaborative Research | uxlx 2014

Ground rules

Acknowledge that the goal of this exercise is to better understand the context and needs of the user. Focus solely on that goal.

Respect the structure of the session. Refrain from identifying larger patterns before you’ve gone through the data.

Clearly differentiate observations from interpretations (what happened versus what it means).

No specific solutions until after you’ve gone through insights and principles. Solutions come next.

Page 187: Collaborative Research | uxlx 2014

Practice!

Page 188: Collaborative Research | uxlx 2014
Page 189: Collaborative Research | uxlx 2014

20 minutes analysis.

Break into groups of 6-8 people

Each group work together to fill out one diagram with the strongest patterns.

Negotiate and advocate for your perspective.

Page 190: Collaborative Research | uxlx 2014

Look for

Goals

Priorities

Tasks

Motivators

Barriers

Habits

Relationships

Tools

Environment

Page 191: Collaborative Research | uxlx 2014
Page 192: Collaborative Research | uxlx 2014

20 minutes analysis.

Break into groups of 6-8 people

Each group work together to fill out one diagram with the strongest patterns.

Negotiate and advocate for your perspective.

Page 193: Collaborative Research | uxlx 2014

How did that go?

Page 194: Collaborative Research | uxlx 2014

Models

Page 195: Collaborative Research | uxlx 2014
Page 196: Collaborative Research | uxlx 2014
Page 197: Collaborative Research | uxlx 2014
Page 198: Collaborative Research | uxlx 2014
Page 199: Collaborative Research | uxlx 2014
Page 200: Collaborative Research | uxlx 2014
Page 201: Collaborative Research | uxlx 2014

Reporting

Page 202: Collaborative Research | uxlx 2014
Page 203: Collaborative Research | uxlx 2014

You are collaborating withyour future selves.

Page 204: Collaborative Research | uxlx 2014

Research ReportStudy Title

Date Completed

Research Goal

Activities

Related Decisions

Key Insights

Supporting Observations

Recommended Actions

Questions for Further Study

Page 205: Collaborative Research | uxlx 2014

A useful report supports

Clear goals

Shared values

Access to information

Clear decision-making

Page 206: Collaborative Research | uxlx 2014

You decide if it’s important for the report to be

Informing?

Inspiring?

Focusing?

Remembering?

Recording?

Deciding?

Page 207: Collaborative Research | uxlx 2014

Finale

Page 208: Collaborative Research | uxlx 2014

In summary

Research creates a shared understanding of reality.

Asking questions is uncomfortable. Embrace that feeling.

A truly collaborative approach and environment is necessary for research to be effective, and it also makes it more fun.

Clear goals and good questions are required.

Choose only the research activities that answer real questions and inform your top priority design and development decisions.

Practice! Observe and listen every day.

Document! Report! Share! It’s easy to lose what you learn.

Page 209: Collaborative Research | uxlx 2014

Any questions?

Page 210: Collaborative Research | uxlx 2014

Additional sources:Designing Together by Dan A. Brownhttp://www.designingtogetherbook.com/

LeanUX by Jeff Gothelfhttp://www.leanuxbook.com/

Remote Research by Nate Bolt & Tony Tony Tulathimuttehttp://rosenfeldmedia.com/books/remote-research/

Interviewing Users by Steve Portigalhttp://rosenfeldmedia.com/books/interviewing-users/

Google Ventures Library | Designhttp://www.gv.com/library/design/

Pacific Standard Magazine http://www.psmag.com/

Helsinki Design Lab (closed, but excellent publications still available)http://www.helsinkidesignlab.org/pages/publications

Page 211: Collaborative Research | uxlx 2014

Brief books for people who make websites No.

9

JUST ENOUGHRESEARCH

Erika Hall

You might enjoy the book.

www.abookapart.comFor 15% off, use code: UXLXJER14

Page 212: Collaborative Research | uxlx 2014