RITE: Testing and Business Driver

33
Jim Kalbach Carola Weller RITE Testing and a Business Driver

description

Presentation at Euro 2012, Rome, by Jim Kalbach and Carola Weller Topics such as “Agile Design“ and “Lean UX“ are all the rage these days. With these approaches, designers seek to prototype, test and revise their designs quickly and with little documentation. Rapid Iterative Testing and Evaluation, or RITE for short, is a specific method that fits into this canon. The key, we believe, is design collaboration—bringing stakeholders together. This does not just mean “design-by-committee,” where designers can easily get out-voted. On the contrary: putting designers, product managers and business stakeholders in the same room with the same stimuli gives designers a stronger voice in shaping the solution. Of course, there were also challenges to our approach. For instance, not all stakeholders from the various departments saw the need to attend or didn’t know what to expect at first. (But after several rounds of RITE, they didn’t want to be left out.) In this presentation, we shared the difficulties we encountered and how to overcome them. We also talked about our modifications to the methodology, which allowed us to move faster and cover more ground quickly.

Transcript of RITE: Testing and Business Driver

Page 1: RITE: Testing and Business Driver

Jim KalbachCarola Weller

RITE

Testing and a Business Driver

Page 2: RITE: Testing and Business Driver

TEST: Are you enjoying Euro IA in Rome so far?

YES NO

Page 3: RITE: Testing and Business Driver

1. Do you consider yourself to be a good IA or UX designer?

YES NO

Page 4: RITE: Testing and Business Driver

2. Do you think the web provides a good UX most of the time?

YES NO

Page 5: RITE: Testing and Business Driver

So...why are there so many bad experiences out there?

Page 6: RITE: Testing and Business Driver

We feel boxed in...

http://www.mimenta.com/Mimenta/DigitalArts/Wallpapers.html

Page 7: RITE: Testing and Business Driver

...and we cry about it.

http://starwars.wikia.com/wiki/File:Luke_whining.jpg

Page 8: RITE: Testing and Business Driver

Great UX Design Great UX=≠

Page 9: RITE: Testing and Business Driver

Great UX Design

Great UXX+ =)(

Page 10: RITE: Testing and Business Driver

3. Do you complain about stakeholder decisions regarding UX

design?

YES NO

Page 11: RITE: Testing and Business Driver

4. Do you know the main cause of poor stakeholder decisions

regarding UX?

YES NO

Page 12: RITE: Testing and Business Driver

“They don’t get it!”

http://www.thepoke.co.uk/2011/09/19/billionaire-lost-track-of-exact-fortune-some-time-ago/

Page 13: RITE: Testing and Business Driver

http://mook23.files.wordpress.com/2011/06/scientist_in_lab.jpg

We’re focused on products

only

Page 14: RITE: Testing and Business Driver

https://picasaweb.google.com/lh/photo/ug22ef6HQ7HxdPGGZnWWOQ

Needed: Engagement

Page 15: RITE: Testing and Business Driver

Great UX Design

Great UX+ =)( Stakeholderengagement

Page 16: RITE: Testing and Business Driver

5. Do you know how to consistently get that

engagement?

YES NO

Page 17: RITE: Testing and Business Driver

RITE

Rapid Iterative Testing and Evaluation

Page 18: RITE: Testing and Business Driver

Quick History of User Testing

Pre 1980s No established user testing

Since 1980s Getting some feedback from users

Since 1990s Standard Usabilit yTesting

Product development Launch

Standard Usability Testing

Design Test

Run all interviews ChangesAnalysis and

Report

very

Page 19: RITE: Testing and Business Driver

Product development Launch

Concept Designs RITE

Approval

Standard Usability Test

Design Test

Run all interviews

Make changes

Analysis andReport

Day 1 Day 2 Day 3 Day 4 Day 5

Day 6

Test Sessions Test Sessions

Testing

Observation Observation

Mak

e ch

ange

s

Mak

e ch

ange

s

Evaluation

De-Briefing

Iterative

De-Briefing De-Briefing

Rapid

Improved product

with stakeholder

input

Test SessionsObservation

Page 20: RITE: Testing and Business Driver

Standard Usability Test vs. RITE Testing:

»A typical usability test focuses on the problems identified.

»The RITE methodology is inherently about the problems solved.

Long report

Long report

Page 21: RITE: Testing and Business Driver

UX Team Strategy

USER RESEARCH

BUSINESS

LEAD

MARKETING

PRODUCT MANAGEMENT

DESIGN

CONTENT STRATEGY

Who’s Who

HEAD OF CX

+ SENIOR MANAGEMENT

Page 22: RITE: Testing and Business Driver

Debriefings

DESIGNER

USER RESEARCHER

STAKEHOLDER

Page 23: RITE: Testing and Business Driver

What has gone wrong…

• No RITE Testing in the beginning

• No prioritization of errors with colour coded post-its

• We assumed stakeholders would know who to invite/approach

• Resource planning with designers and updates between sessions

• Room too small and not enough room for workshoping the solution

a little

Page 24: RITE: Testing and Business Driver

Tips for engagement

• Round-Robin to get to know everyone

• Go out for Lunch

• Active analysis with post-its

• Systematic and recurring schedule

• Simultaneous interpreter in the observation room

• Regular debriefings

• No long report two weeks later

Page 25: RITE: Testing and Business Driver

Great UX Design Great UX+ =)( Stakeholder

engagement

Page 26: RITE: Testing and Business Driver

But Wait – There’s More!

Page 27: RITE: Testing and Business Driver

Mutual Benefits

1.Avoid blind veteos and misunderstanding

2.Improve collaboration and efficiency

3.Hierarchy and expertise leveling

4.Influence policy and business attitude

Page 28: RITE: Testing and Business Driver

Great UX Design

Great UX+ =)( Stakeholderengagement

Impact on Business

Added

Benefit

+( )

Page 29: RITE: Testing and Business Driver

Once you’ve gone RITE,

it’s hard to go back!http://www.globetrotter-select.de/images/FallschirmSkyDive.jpg

Page 30: RITE: Testing and Business Driver

6. Will you use RITE on your next projects?

YES NO

Page 31: RITE: Testing and Business Driver

7. Do you think there are other methods for stakeholder

engagement?

YES NO

Page 32: RITE: Testing and Business Driver

By pushing for a

collaborative, cross-

functional process UX

designers are becoming

grassroots strategic players

... The organizational

perception of the UX

designer becomes more of a

design facilitator, a UX

leader and ultimately a

company leader.

JEFF GOTHELF

“Lean UX is Nothing New,” Johnny Holland: http://johnnyholland.org/2012/09/lean-ux-is-nothing-new/”