UXPA 2015 Why & How to Include People with Disabilities (PWDs) in Your Usability Tests

23
Dana Douglas and Kristen Davis UserWorks, Inc. www.userworks.com @userworks

Transcript of UXPA 2015 Why & How to Include People with Disabilities (PWDs) in Your Usability Tests

  1. 1. D a n a D o u g l a s a n d K r i s te n D a v i s U s e r Wo r k s , I n c . w w w . u s e r w o r k s . c o m @ u s e r w o r k s
  2. 2. 2 U X PA I n t e r n a t i o n a l 2 0 1 5 W h y & H o w to I n c l u d e P e o p l e w i t h D i s a b i l i t i e s i n Yo u r U s a b i l i t y Te s t s J u n e 2 5 , 2 0 1 5 Gather data that more accurately represents whole user population Identify areas that interfere with any users ability to interact with a system Why include PWDs in testing?
  3. 3. 3 U X PA I n t e r n a t i o n a l 2 0 1 5 W h y & H o w to I n c l u d e P e o p l e w i t h D i s a b i l i t i e s i n Yo u r U s a b i l i t y Te s t s J u n e 2 5 , 2 0 1 5 Significant, expensive accessibility issues can be identified early It doesnt require much additional effort, budget, or time Only minor adjustments when: Recruiting participants Collecting data Analyzing data Why include PWDs in testing?
  4. 4. 4 U X PA I n t e r n a t i o n a l 2 0 1 5 W h y & H o w to I n c l u d e P e o p l e w i t h D i s a b i l i t i e s i n Yo u r U s a b i l i t y Te s t s J u n e 2 5 , 2 0 1 5
  5. 5. 5 U X PA I n t e r n a t i o n a l 2 0 1 5 W h y & H o w to I n c l u d e P e o p l e w i t h D i s a b i l i t i e s i n Yo u r U s a b i l i t y Te s t s J u n e 2 5 , 2 0 1 5 Consider your target audience Including just one or two PWDs will lead to informative findings Consider which disabilities could be most affected when using your product and make sure to include people who represent those needs Who to Recruit
  6. 6. 6 U X PA I n t e r n a t i o n a l 2 0 1 5 W h y & H o w to I n c l u d e P e o p l e w i t h D i s a b i l i t i e s i n Yo u r U s a b i l i t y Te s t s J u n e 2 5 , 2 0 1 5 Utilize existing resources (e.g., recruiting agencies) Use community resources Personal recommendations (i.e., word of mouth) Social media and forums Advocacy organizations Libraries Day centers, churches, schools Independent living centers How to Recruit
  7. 7. 7 U X PA I n t e r n a t i o n a l 2 0 1 5 W h y & H o w to I n c l u d e P e o p l e w i t h D i s a b i l i t i e s i n Yo u r U s a b i l i t y Te s t s J u n e 2 5 , 2 0 1 5 Make in-person accommodations Consider accessibility of your facility Identify transit options Cover transportation costs Offer remote sessions How to Recruit
  8. 8. 8 U X PA I n t e r n a t i o n a l 2 0 1 5 W h y & H o w to I n c l u d e P e o p l e w i t h D i s a b i l i t i e s i n Yo u r U s a b i l i t y Te s t s J u n e 2 5 , 2 0 1 5 Signature guide. Source: Washington Secretary of State website Send a text-based version of consent form in advance Provide options for signing Response via email Verbal agreement Online form or digital signature In-person signature guide How to Obtain Consent
  9. 9. 9 U X PA I n t e r n a t i o n a l 2 0 1 5 W h y & H o w to I n c l u d e P e o p l e w i t h D i s a b i l i t i e s i n Yo u r U s a b i l i t y Te s t s J u n e 2 5 , 2 0 1 5
  10. 10. 10 U X PA I n t e r n a t i o n a l 2 0 1 5 W h y & H o w to I n c l u d e P e o p l e w i t h D i s a b i l i t i e s i n Yo u r U s a b i l i t y Te s t s J u n e 2 5 , 2 0 1 5 Consider remote testing Avoids transportation issues Allows users to participate in a comfortable, familiar environment Use tools that the participant is already familiar with Loosen requirements for screen sharing or recording if they cause a barrier Provide Accommodations
  11. 11. 11 U X PA I n t e r n a t i o n a l 2 0 1 5 W h y & H o w to I n c l u d e P e o p l e w i t h D i s a b i l i t i e s i n Yo u r U s a b i l i t y Te s t s J u n e 2 5 , 2 0 1 5 Adjust equipment as needed (if in-person) Allow participants to use own devices Allow time to set up those devices Adjust recording method (microphone or camera setup) accordingly Print out or display tasks for easier reading Consider online chat for participants who are hearing impaired Provide Accommodations
  12. 12. 12 U X PA I n t e r n a t i o n a l 2 0 1 5 W h y & H o w to I n c l u d e P e o p l e w i t h D i s a b i l i t i e s i n Yo u r U s a b i l i t y Te s t s J u n e 2 5 , 2 0 1 5 Keep same tasks and general methodology, but: Allow more time to complete tasks Consider redefining what constitutes a successful task Do not require thinking aloud Avoid interrupting to ask probing questions; wait until later Be Flexible with Methods
  13. 13. 13 U X PA I n t e r n a t i o n a l 2 0 1 5 W h y & H o w to I n c l u d e P e o p l e w i t h D i s a b i l i t i e s i n Yo u r U s a b i l i t y Te s t s J u n e 2 5 , 2 0 1 5 Note any interesting methods used to overcome accessibility problems or obstacles Note any interesting customization settings Make Special Observations
  14. 14. 14 U X PA I n t e r n a t i o n a l 2 0 1 5 W h y & H o w to I n c l u d e P e o p l e w i t h D i s a b i l i t i e s i n Yo u r U s a b i l i t y Te s t s J u n e 2 5 , 2 0 1 5 Video Clip: Participant Not Using AT
  15. 15. 15 U X PA I n t e r n a t i o n a l 2 0 1 5 W h y & H o w to I n c l u d e P e o p l e w i t h D i s a b i l i t i e s i n Yo u r U s a b i l i t y Te s t s J u n e 2 5 , 2 0 1 5 Video Clip: Participant Using Screen Reader
  16. 16. 16 U X PA I n t e r n a t i o n a l 2 0 1 5 W h y & H o w to I n c l u d e P e o p l e w i t h D i s a b i l i t i e s i n Yo u r U s a b i l i t y Te s t s J u n e 2 5 , 2 0 1 5 Video Clip: Participant Using Speech Recognition
  17. 17. Findings from Sample Sessions Identified usability issues Discovered accessibility issues Revealed a more robust view of how various users might experience the site U X PA I n t e r n a t i o n a l 2 0 1 5 W h y & H o w to I n c l u d e P e o p l e w i t h D i s a b i l i t i e s i n Yo u r U s a b i l i t y Te s t s J u n e 2 5 , 2 0 1 5 17
  18. 18. 18 U X PA I n t e r n a t i o n a l 2 0 1 5 W h y & H o w to I n c l u d e P e o p l e w i t h D i s a b i l i t i e s i n Yo u r U s a b i l i t y Te s t s J u n e 2 5 , 2 0 1 5
  19. 19. 19 U X PA I n t e r n a t i o n a l 2 0 1 5 W h y & H o w to I n c l u d e P e o p l e w i t h D i s a b i l i t i e s i n Yo u r U s a b i l i t y Te s t s J u n e 2 5 , 2 0 1 5 Analyze data in aggregate Report accessibility issues alongside broader usability issues Use video clips to demonstrate issues How to Analyze the Data
  20. 20. Summary Gather a more accurate representation of the whole user population Be flexible with methods Identify issues that may not have been identified otherwise A little bit more effort can have a big impact on the user experience U X PA I n t e r n a t i o n a l 2 0 1 5 W h y & H o w to I n c l u d e P e o p l e w i t h D i s a b i l i t i e s i n Yo u r U s a b i l i t y Te s t s J u n e 2 5 , 2 0 1 5 20
  21. 21. 21 U X PA I n t e r n a t i o n a l 2 0 1 5 W h y & H o w to I n c l u d e P e o p l e w i t h D i s a b i l i t i e s i n Yo u r U s a b i l i t y Te s t s J u n e 2 5 , 2 0 1 5
  22. 22. 22 U X PA I n t e r n a t i o n a l 2 0 1 5 W h y & H o w to I n c l u d e P e o p l e w i t h D i s a b i l i t i e s i n Yo u r U s a b i l i t y Te s t s J u n e 2 5 , 2 0 1 5 Better Accessibility Through Your User Research Whitney Quesenbery, UIE Webinar DigitalGov articles: Usability Testing with People Who Have Vision Impairment Looking at User Experience through Two Lenses User Experience Impossible: The Line Between Accessibility and Usability Just Ask: Integrating Accessibility Throughout Design Shawn Lawton Henry, Book (Online version; Section on usability) Usability Testing by People with Disabilities: Some Guerrilla Tactics UX Magazine Resources: Usability Testing with PWDs
  23. 23. 23 U X PA I n t e r n a t i o n a l 2 0 1 5 W h y & H o w to I n c l u d e P e o p l e w i t h D i s a b i l i t i e s i n Yo u r U s a b i l i t y Te s t s J u n e 2 5 , 2 0 1 5 Kristen Davis Senior User Experience Specialist [email protected] Dana Douglas Senior User Experience Specialist [email protected] Questions or comments?