Winning at the Politics of Usability
description
Transcript of Winning at the Politics of Usability
1
Winning at the Politics of Usability John Sorflaten – Human Factors International Michael Rawlins – Open Solutions Jeff Sauro – Oracle; Measuring Usability Javier Broch – Columbia University Linda Chadwick – Duck Creek Technology
2
Politics Defined “The Buck Stops Here” – Harry Truman So…. Take ownership of political
problems.
3
Who has heard this?…. “We don’t have time for usability now” “We don’t need you right now…maybe
later.” “This project is almost done. Can you
check it out?” Others?
4
But….we’re here… Many organizations heard the message
and now have usability staff And trained them… And hope to use them… And… (gulp….) … you don’t get used….
5
The art of politics… “Politics moves mountains with mere
words.” -- anonymous
6
Here’s some words….
1. Speak credibly – John Sorflaten2. Have credentials – Michael Rawlins3. Talk the talk – Javier Bloch4. Be quantitative – Jeff Sauro5. Do the dew. Get moxie. – Linda
Chadwick
7
John: Speaking Credibly
Roadbump? You: “I think we should use a drop down
list here to make it easier to type the entry.”
Them: “That’s your opinion. Here’s my opinion….”
Guideline: avoid giving opinionsSee eleven more shock absorbers,
next…
8
Cite your Data (top 4 winners):
1. “Research indicates…” (e.g., www.usability.gov)
2. “Our usability testing shows…”3. “Our standards say…” (and they have
been tested for usability)4. “Best practices suggest that…”
(usability training, books, gurus…)
9
Do Gedanken Experiments (Einstein)
5. Cognitive task analysis: Identify loads… • Visual• IntellectualE.g., To select a radio button:
1. decide to use mouse (I); 2. look for mouse (V+Mo); 3. reach, grab (Mo); 4. re-position pointer (V+Mo); 5. select option (V, I, Me, Mo)
• Memory• Motor
10
Speak Objectively…
6. “I don’t know…we’ll run a usability test” (avoid speaking for all users)
7. “If I were to conduct a UT, I expect x% of subjects to have this problem…” (give reasons, too)
8. “If I were a UT subject, I would probably be puzzled by…”
11
Borrow Findings…
9. “Other UTs covered similar issues…” (and those results suggest we do x)
10. “Our interviews and observations showed end-users actually did x...”
11. “End-users said they thought x…” (collective mental model)
12
Now, “Speak Credibly”… Avoid opinion like “I think” or “I feel” Use your data (top 4 winners) Use thought experiments (VIMM) Speak objectively (If I were…) Borrow findings (other tests, interviews..)
13
Michael: Have Credentials
Roadbump? You: “I read that Jakob Nielsen said…” Them: “Yeah, but Jarrod Spool said…”
See 5 improved seats, next…
14
1. Get R-E-S-P-E-C-T (Thanks Aretha!)
If you’re a gatekeeper for usability, can you demonstrate earning that role?
Doctors get an M.D.; Executives get an MBA. Pilots get a license.
What’s your “white coat and stethoscope”?
PhD? MA? CUA? (Certified Usability Analyst); IIBA? (International Institute of Business Analysis certification)
15
2. Get Style Did you pass a driver’s license test? What did it mean? A credential validates our knowledge Self-confidence creates authority Self-efficacy shows up in our “style”
16
3. Be A Professional Professional-ism means membership,
peer review, demonstrated skills Passing a test means “initiation” “A Professional” means management
treats you with: Respect Allegiance Expectations
17
4. Network Your Community… Read and meet your peers… Meet the person next to you. Share your main political challenges. Share solutions, ideas. Share phone number and email. Follow up and network again. “What’s their personality type?”
18
5. Ethically Negotiate and Communicate Risks…
It’s not important to win every argument…
Allow people to reach the correct conclusion on their own time. Supply the kernels of knowledge.
Share the importance of open, direct communication.
Page 19
Index
Javier: Talk the Talk
Page 20
Political Steps - roadmap
1.Define Strategy & Interview stake holders
2.Usability budged
3.BAD GUY - external group to execute political
4.Committee & Tools
5.Fund one project
6.Train & Hire usability
Index
Page 21
Political (elevator) speech –I make technology easy to use
–Simplify things
–Tech. for my mom
–Humanize technology
–Lower the cognitive load
–Make things simpler to use
Page 22
Winning at Politics: ready to say? be unpopular?
– “My feedback does not count, I’m not the intended user”
– What your boss likes might not be what your users like
– Negative feedback
– Culture to satisfy the “board room” (not the user)
– Involve all the parties
Index
Page 23
Expected political obstacles and roadblocks
– The usability of Usability work
– ”I know what the user wants”
– The stakeholder “I like this…”
– “I like this type of web technology”
– “If I can find it, they could find it”
Index
Page 24
Why change the process?
• Ownership? Decentralization
• No usability $, No standards
• The wake up call. Nobody wants to do it
• Customer might only interact via web
• No inventory. Duplication Index
Page 25
Why change the process? (Cont.)
• No focus on user (UCD)
• Political design
• Every one has an opinion
• Every one wants a link
• The boss opinion
.. your reasons …
Index
Page 26
E-mail usability
Page 27
Page 28
Index
Page 29
Political gain … Collecting simple Usability Data
What ..
– are your …. user groups? …frequent tasks?
– key information do your users access the most?
– type of services?
– part of your site do users use the most?
Index
Page 30
Index
31
Measuring Usability
Politics of Quantitative Usability
Jeff Sauro
June 18th 2008
32
Quanta-Phobia
33
Lies,
Damn Lies
& Statistics
… and usability ?
34
You Can't Manage What You Don't Measure
Metrics allow for ROI of Usability
35
6/8 Complete
75% Completion Rate
What do you Report?
Completion Rates
36
75%
37
Release your inner Math Geek
38
What is the true Completion Rate ?6/8 Complete
0 10050
2.5% 2.5%
95% Confidence Interval (40%, 94%)
95%
39
Wide Margin of Error—Why Bother?
95% CI (40%, 94%) = 54 points
40
Use Benchmarks / Criteria
0 10050 70
91%
60%
6/8 Complete
60% Chance 70% of Users Can Complete
97.5%
40
41
Dealer’s Hand
Your Hand
60% Chance You Win
42
60% Chance of Rain
43
60% On Time Arrival
44
60% Chance of Successful Operation
45
1.Benchmarks—What is the min completion rate?
2.How sure do you need to be you’ve improved?
3.Quantify the unknown with CI’s
4.Work within the Limitations of Small Samples
Be brave and be quantitative
http://measuringusability.com/UPA
Calculators & Formula Online
46
Appendix
47
Sample size
Think-aloud Studies
Normality
Time on Task
48
Diagnosis /Comparisons in Think-Aloud
One dot does a lot
49
Managing Non-Normality
Log Transformation
50
Margin of Error for Task Time
Sample Size
Marg
in %
90
80
70
60
50
40
30
20
10
0
Cv
0.70
0.300.48
Margin % vs Sample Size for Typical CVs
Samples < 20 Have > 20% Margin of Error
51
Sample Size
Perc
ent
of Cri
teria
1101008060402015104
93
90
85
80
75
70
60
50
Sample Size Needed for % of Criteria to be SignificantCV of .48
Use Benchmarks / Criteria
How Long Should the task take?
5252
Linda: Do the Dew. Get Moxie.
Roadbump? You: “Why don’t we focus more on
usability?” Them: “But there’s so much to do, so
many other problems to solve.”
See 5 steering tips next…
5353
The Misperceptions …
5454
The Misperceptions …
5555
The Misperceptions …
5656
1. Be “Coordinator” vs. “Expert” Reduce “threat” to colleagues egos Respect and listen to opinions Avert resentment, foster team work Now they’ll listen to your ideas Now they’ll WANT “cool and usable” Make the system work for you
57
Change
"Our dilemma is that we hate change and love it at the same time; what we really want is for things to remain the same but get better”
-- Sydney J. Harris
57
5858
2. Use “Change Management” Check out this discipline, get a book Publish positive reports, experiences Give advance notice on changes Personal messages better than mass mail Update people on project progress
5959
3. Reward “Early Adoption” At meetings, praise individual usability
efforts Start positive feed-back loops Reinforce champion’s confidence in your
work Give your champion something to brag
about
6060
4. Spread the Usability Training Avoid energy-drain of endless questions Packaged training lets others see the
“secrets” You are the “usability consultant” to others “Word processing” now done by everyone Range of training: one-hourhalf daymore You’ll keep job security, amidst teaching
others
61
What are you called?
61
6262
5. Job Title Finesse Re-think “job title du jour” phenomenon Create a hierarchy of usability titles NOT a “dead-end” job (for tired people) Promote path for advancing usability careers Insure salary perks for increased skills/scope All this acknowledges: “career professional” Usability will never disappear Do the due. GET MOXIE!
63
John: Rapping Up Politics Doing the dew (due) means “politics” Who would like more moxie? Tell us your take-home rap…
! Wow… ! Sure… ! Love it… ! Goforit…
E-mail your ideas: [email protected]