Out Of Box Experience Design

103
Out of Box Experience Design Harry Brignull Pete Gale

TAGS:

description

Out of Box Experience Design: presentation by Harry Brignull & Pete Gale. More info at www.90percentofeverything.com

Transcript of Out Of Box Experience Design

Page 1: Out Of Box Experience Design

Out of Box Experience DesignHarry Brignull

Pete Gale

Page 2: Out Of Box Experience Design

Who are these guys?

Harry Brignull: User Experience Consultant, Madgex

Pete Gale: Head of User Experience, Cogapp

Page 3: Out Of Box Experience Design

The problem:Self Install Broadband Packages are hard to install yourself

Page 4: Out Of Box Experience Design

Which means...

Customers call in for help

Call center costs ramp up

Frustrated customers less likely to renew contracts

Page 5: Out Of Box Experience Design

Which means...

In this case, good OOBE design isn’t just about being nice or ‘building a luxury brand’

- its all about reducing costs!

Page 6: Out Of Box Experience Design

What’s the problem?

N.D.F.

Page 7: Out Of Box Experience Design

How Big?

Scherf, K. Consumer Electronics Association Conference, Home Networking Panel, 2002.

With return rates of 20-30%, home networking gear is currently the most returned item at “big box” electronics stores

Page 8: Out Of Box Experience Design

Kent Sullivan, Microsoft. Paul Sorenson, Intel, Ease Of Use Roundtable, 2004.

How Big?

“No Defect Found” return rate runs as high as 90%+

(depending on product category)

Page 9: Out Of Box Experience Design

eBrain Research October, 2002 Consumer Electronics Association (CEA)

How Big?

Consumer electronic returns

costs are estimated at $10B annually

(Only 2-5% of returns are found to be defective)

Page 10: Out Of Box Experience Design

source: wikipedia

Where are we now?

Page 11: Out Of Box Experience Design

Where the story starts...

A UK ISP approached Flow Interactive to help them with this problem.

I ended up speccing and running an iterative user testing project for them.

Today I am going to give you some insights.

Off the record - no recording please.

Page 12: Out Of Box Experience Design

Before I start...

Some questions to think about:

★ If OOBE design seems easy, why are OOBEs usually so awful?

★ If you feel like you could do this work - what’s stopping you from pitching for & winning projects like this?

Page 13: Out Of Box Experience Design

User Centred Design

A quick primer for the unitiated

Page 14: Out Of Box Experience Design

User Centred Design

A quick primer for the unitiated

Page 15: Out Of Box Experience Design

A simple recipe, many variations

Prototyping

User Research

Iteration

Collaboration

Page 16: Out Of Box Experience Design
Page 17: Out Of Box Experience Design
Page 18: Out Of Box Experience Design
Page 19: Out Of Box Experience Design
Page 20: Out Of Box Experience Design

Survival of the fittest:

with each iteration, you iron out problems.

Page 21: Out Of Box Experience Design
Page 22: Out Of Box Experience Design

Web Apps

Physical products

Vehicles

Product packaging

Instructional Materials

Shop floorplans

... literally ANYTHING that

people use!

Page 23: Out Of Box Experience Design

Web Apps

Physical products

Vehicles

Product packaging

Instructional Materials

Shop floorplans

... literally ANYTHING that

people use!

Out the other side...

Something that caters for user needs.

i.e. more usable, more useful and more enjoyable!

Page 24: Out Of Box Experience Design

In a nutshellWhat is the challenge for OOBE design?

Page 25: Out Of Box Experience Design

We wish our users would behave like this…

Page 26: Out Of Box Experience Design

We wish our users would behave like this…

- Reads the manual before starting

- Extremely careful

- Systematic

- Doesn’t miss a detail

Page 27: Out Of Box Experience Design

But they actually behave more like this…

Page 28: Out Of Box Experience Design

But they actually behave more like this…

- They are impatient

- They rarely read big blocks of text

- In the absence of immediate, direct instructions, they will steam ahead

- They expect to be able to “muddle through”

Page 29: Out Of Box Experience Design

Our challenge is to design the OOBE to work well with

this natural style of user behaviour

Page 30: Out Of Box Experience Design

Our ApproachHow did we apply the UCD philosophy?

Page 31: Out Of Box Experience Design

Stakeholder interviews revealed different departmental perspectives

“What’s your definition of success?”

Page 32: Out Of Box Experience Design
Page 33: Out Of Box Experience Design

Engineer“Success happens when about all the bits fit into the box safely, cheaply &

efficiently”

Page 34: Out Of Box Experience Design

Engineer“Success happens when about all the bits fit into the box safely, cheaply &

efficiently”

Packaging designer “Success is a sexy

cardboard template”

Page 35: Out Of Box Experience Design

Engineer“Success happens when about all the bits fit into the box safely, cheaply &

efficiently”

Developer: “Success happens when

my code complies with the requirement specs”

Packaging designer “Success is a sexy

cardboard template”

Page 36: Out Of Box Experience Design

The silo effect

To achieve an effective user experience, you have to break the silos.

User Experience Design relies on a holistic view.

Page 37: Out Of Box Experience Design

Project outline

Traditional usability consulting

Client hands over materials to a consultancy

User testing carried out

Report written, recommendations given

Redesign carried out by Client

Page 38: Out Of Box Experience Design

Project outline

Traditional usability consulting

Client hands over materials to a consultancy

User testing carried out

Report written, recommendations given

Redesign carried out by ClientX

Page 39: Out Of Box Experience Design

UX design problems are symptomatic of organizational problems

We wanted to treat the disease, not the symptom.

Page 40: Out Of Box Experience Design

UX consultancy as relationship therapyPart of it involves showing them how to work together

Page 41: Out Of Box Experience Design

Project outline

Rapid iteration user testing:

20 real users from all walks of life, 1 on 1 sessions

Given a box and told to self install / think aloud

All client stakeholders took take 1 week out the office and attend the research sessions

The viewing room was not a boring “cinema” set-up, but an active vibrant workshop

Page 42: Out Of Box Experience Design

Project outline

During sessions, the team would tweak the OOBE and build a new prototype

Between sessions, the newly modified version of the OOBE would be swapped in.

The final prototype was a “living implementation” of the new design (no scope for misinterpretaiton)

A very memorable, engaging experience

Page 43: Out Of Box Experience Design

Lab set-up

Lab split into two rooms using a divider

Room 1: Hallway - phone connection

Room 2: Spare room - Desktop PC

Analogue camera set-up: user could be seen picture-in-picture in either room. Streamed into viewing room and recorded onto DVD

Live editing: I’d switch camera angles from a console as the user moved around.

Page 44: Out Of Box Experience Design

Findings

Page 45: Out Of Box Experience Design

Findings

Page 46: Out Of Box Experience Design
Page 47: Out Of Box Experience Design
Page 48: Out Of Box Experience Design
Page 49: Out Of Box Experience Design
Page 50: Out Of Box Experience Design
Page 51: Out Of Box Experience Design
Page 52: Out Of Box Experience Design
Page 53: Out Of Box Experience Design

Ten steps before you start

• Open Box• Evaluate magazine• Evaluate DVD box• Open DVD box• Evaluate paperwork• Open “Set up guide”• Evaluate first layer of instructions• Unfold “set up guide”• Evaluate main instructions

Page 54: Out Of Box Experience Design

Ten steps before you start

• Open Box• Evaluate magazine• Evaluate DVD box• Open DVD box• Evaluate paperwork• Open “Set up guide”• Evaluate first layer of instructions• Unfold “set up guide”• Evaluate main instructions

EVERY STEP CREATED POTENTIAL FOR USER ERROR

Page 55: Out Of Box Experience Design

After observing the first few users

we saw that they were overwhelmed by the instructions, and instead tended to do this:

Page 56: Out Of Box Experience Design
Page 57: Out Of Box Experience Design
Page 58: Out Of Box Experience Design

“I’m making an educated guess” [tries to force ethernet

into DSL socket]

Page 59: Out Of Box Experience Design

“I’m making an educated guess” [tries to force ethernet

into DSL socket]

“My method is trial and error”

Page 60: Out Of Box Experience Design

“I’m making an educated guess” [tries to force ethernet

into DSL socket]

“My method is trial and error”

“I wouldn’t read the instructions unless I had to”

Page 61: Out Of Box Experience Design

Lazy = smartBased on prior experience, this heuristic saves effort

1. Muddle through quickly

2. if problem is encountered

3. then refer to instructions

Page 62: Out Of Box Experience Design

Productive Laziness

“Productive laziness involves avoiding unnecessary work.” - Aaron Sloman, Cognitive Scientist

The chess champion who wins by working through all the possible sequences of moves several steps ahead [...] is not as intelligent as the player who avoids explicitly examining so many cases...”

http://icanhaz.com/cognition

Page 63: Out Of Box Experience Design

“This looks easy, you just plug the coloured cables into the coloured slots!”

Page 64: Out Of Box Experience Design

The octapus of death

Page 65: Out Of Box Experience Design

The octapus of death

Page 66: Out Of Box Experience Design

The octapus of deathAs soon as they have all the cables hooked in, they are screwed.

Page 67: Out Of Box Experience Design

We realised we needed to prevent this.

Page 68: Out Of Box Experience Design

How?

Page 69: Out Of Box Experience Design

The traditional solution

Read me

first!

Page 70: Out Of Box Experience Design

The traditional solutionInstructions on how to use the instructions!

Read me

first!

Page 71: Out Of Box Experience Design

The traditional solutionInstructions on how to use the instructions!

Read me

first!X

Page 72: Out Of Box Experience Design

A better solutionGuide behaviour through physical affordances

Page 73: Out Of Box Experience Design

A better solutionGuide behaviour through physical affordances

Page 74: Out Of Box Experience Design

The Bento Box approachLayering controls sequence of exposure.

The first thing you see = the first thing you do

Page 75: Out Of Box Experience Design

The new ‘clamshell’ designPresents the user with just two things upon opening: the device and a quickstart guide

Page 76: Out Of Box Experience Design

Better but not perfectCertain steps were still problematic

Page 77: Out Of Box Experience Design

Too much information overwhems users So we set to work on simplifying the complex copy and diagrams

Page 78: Out Of Box Experience Design

If its possible to cut out a word, cut it out. George Orwell

Page 79: Out Of Box Experience Design

“Your Broadband features.

Your service includes many useful and exciting features. Select what you’d like to set up now from the following list. You can set features up later if you prefer.”

Page 80: Out Of Box Experience Design
Page 81: Out Of Box Experience Design

Becomes

“Select the features you wish to install”

Page 82: Out Of Box Experience Design
Page 83: Out Of Box Experience Design

“If the illustrator has taken the time to draw

this, then it must be significant in some

way.”

Page 84: Out Of Box Experience Design
Page 85: Out Of Box Experience Design

This diagram was intended to show the various devices that need a microfilter

Users tended to stall here, and would visually scan the diagram looking for the key point. They thought

they were missing something.

Page 86: Out Of Box Experience Design
Page 87: Out Of Box Experience Design

The message communicated in this diagram is much clearer.

There are no unnecessary details.

Every drop of ink serves a purpose.

Page 88: Out Of Box Experience Design

Another pain pointWhere’s the damn password?

Page 89: Out Of Box Experience Design

Wep Key:

57c50e60b4c553d97597b8a078

... On the back of the modem in another room!

Page 90: Out Of Box Experience Design

Umm, is that a Zero or an O?Transcription errors are an inevitable problem

Page 91: Out Of Box Experience Design

We added a “wireless details” card

The problem went away completely!

Page 92: Out Of Box Experience Design

We added a “wireless details” card

The problem went away completely!

Page 93: Out Of Box Experience Design

Demonstrates the need for ecological validityA classic lab set-up would have the missed this problem

Page 94: Out Of Box Experience Design

Cumulative costs

With HTML and CSS, improvements are a one-off cost, but not with physical products!

Even tiny tweaks need to have extensive cost-benefit evaluation...

cost

No of units

html

physical

Page 95: Out Of Box Experience Design

Conclusions

Page 96: Out Of Box Experience Design

Where do I start?

Page 97: Out Of Box Experience Design

Where do I start?

Affordances to manage starting points Progressive disclosure to manage complexity

Page 98: Out Of Box Experience Design

Allow for implicit checking & error correction

Page 99: Out Of Box Experience Design

Technical solutions to technical problems

Page 100: Out Of Box Experience Design

Context

Which cable? where?

Page 101: Out Of Box Experience Design

Consistency

Page 102: Out Of Box Experience Design

Consistency

Ensure consistency let users check this

Page 103: Out Of Box Experience Design

Thank you