RITE: Testing and Business Driver

Post on 26-Jan-2015

107 views 1 download

Tags:

description

Presentation at Euro 2012, Rome, by Jim Kalbach and Carola Weller Topics such as “Agile Design“ and “Lean UX“ are all the rage these days. With these approaches, designers seek to prototype, test and revise their designs quickly and with little documentation. Rapid Iterative Testing and Evaluation, or RITE for short, is a specific method that fits into this canon. The key, we believe, is design collaboration—bringing stakeholders together. This does not just mean “design-by-committee,” where designers can easily get out-voted. On the contrary: putting designers, product managers and business stakeholders in the same room with the same stimuli gives designers a stronger voice in shaping the solution. Of course, there were also challenges to our approach. For instance, not all stakeholders from the various departments saw the need to attend or didn’t know what to expect at first. (But after several rounds of RITE, they didn’t want to be left out.) In this presentation, we shared the difficulties we encountered and how to overcome them. We also talked about our modifications to the methodology, which allowed us to move faster and cover more ground quickly.

Transcript of RITE: Testing and Business Driver

Jim KalbachCarola Weller

RITE

Testing and a Business Driver

TEST: Are you enjoying Euro IA in Rome so far?

YES NO

1. Do you consider yourself to be a good IA or UX designer?

YES NO

2. Do you think the web provides a good UX most of the time?

YES NO

So...why are there so many bad experiences out there?

We feel boxed in...

http://www.mimenta.com/Mimenta/DigitalArts/Wallpapers.html

...and we cry about it.

http://starwars.wikia.com/wiki/File:Luke_whining.jpg

Great UX Design Great UX=≠

Great UX Design

Great UXX+ =)(

3. Do you complain about stakeholder decisions regarding UX

design?

YES NO

4. Do you know the main cause of poor stakeholder decisions

regarding UX?

YES NO

“They don’t get it!”

http://www.thepoke.co.uk/2011/09/19/billionaire-lost-track-of-exact-fortune-some-time-ago/

http://mook23.files.wordpress.com/2011/06/scientist_in_lab.jpg

We’re focused on products

only

https://picasaweb.google.com/lh/photo/ug22ef6HQ7HxdPGGZnWWOQ

Needed: Engagement

Great UX Design

Great UX+ =)( Stakeholderengagement

5. Do you know how to consistently get that

engagement?

YES NO

RITE

Rapid Iterative Testing and Evaluation

Quick History of User Testing

Pre 1980s No established user testing

Since 1980s Getting some feedback from users

Since 1990s Standard Usabilit yTesting

Product development Launch

Standard Usability Testing

Design Test

Run all interviews ChangesAnalysis and

Report

very

Product development Launch

Concept Designs RITE

Approval

Standard Usability Test

Design Test

Run all interviews

Make changes

Analysis andReport

Day 1 Day 2 Day 3 Day 4 Day 5

Day 6

Test Sessions Test Sessions

Testing

Observation Observation

Mak

e ch

ange

s

Mak

e ch

ange

s

Evaluation

De-Briefing

Iterative

De-Briefing De-Briefing

Rapid

Improved product

with stakeholder

input

Test SessionsObservation

Standard Usability Test vs. RITE Testing:

»A typical usability test focuses on the problems identified.

»The RITE methodology is inherently about the problems solved.

Long report

Long report

UX Team Strategy

USER RESEARCH

BUSINESS

LEAD

MARKETING

PRODUCT MANAGEMENT

DESIGN

CONTENT STRATEGY

Who’s Who

HEAD OF CX

+ SENIOR MANAGEMENT

Debriefings

DESIGNER

USER RESEARCHER

STAKEHOLDER

What has gone wrong…

• No RITE Testing in the beginning

• No prioritization of errors with colour coded post-its

• We assumed stakeholders would know who to invite/approach

• Resource planning with designers and updates between sessions

• Room too small and not enough room for workshoping the solution

a little

Tips for engagement

• Round-Robin to get to know everyone

• Go out for Lunch

• Active analysis with post-its

• Systematic and recurring schedule

• Simultaneous interpreter in the observation room

• Regular debriefings

• No long report two weeks later

Great UX Design Great UX+ =)( Stakeholder

engagement

But Wait – There’s More!

Mutual Benefits

1.Avoid blind veteos and misunderstanding

2.Improve collaboration and efficiency

3.Hierarchy and expertise leveling

4.Influence policy and business attitude

Great UX Design

Great UX+ =)( Stakeholderengagement

Impact on Business

Added

Benefit

+( )

Once you’ve gone RITE,

it’s hard to go back!http://www.globetrotter-select.de/images/FallschirmSkyDive.jpg

6. Will you use RITE on your next projects?

YES NO

7. Do you think there are other methods for stakeholder

engagement?

YES NO

By pushing for a

collaborative, cross-

functional process UX

designers are becoming

grassroots strategic players

... The organizational

perception of the UX

designer becomes more of a

design facilitator, a UX

leader and ultimately a

company leader.

JEFF GOTHELF

“Lean UX is Nothing New,” Johnny Holland: http://johnnyholland.org/2012/09/lean-ux-is-nothing-new/”

Jim.Kalbach@gmail.com

Weller@Sirvaluse.de

DANKE SCHÖN