Whoa! Did You See That? Collaborative Data Collection and Analysis
-
Upload
kyle-soucy -
Category
Design
-
view
562 -
download
1
Transcript of Whoa! Did You See That? Collaborative Data Collection and Analysis
Collaborative Data Collection And Analysis
#UXPABOS15@KyleSoucy
UsableInterface.com
Whoa !Did you see that?
you don’t own the data
The team does
what’s at Risk?
Incomplete Data
Rashomon effect: Contradictory interpretations of the same event by different people.
Not everyone can attend every session
Image source: http://www.kramerelectronics.com/images/news/sap_labsimage1.jpg
1. Share Observations
2. Prioritize issues
observer debrief Goals
benefits
No massive generalizations
Immediate insights list
Usability Tes,ng
Report
Note taking
give assignments
"Usability testing is like getting a drink from a fire hydrant…" - Carolyn Snyder
observation, inference,
and opinion
Observation
Image source: https://benmelbourne.files.wordpress.com/2013/04/pop-up-mobile-usability-testing-lab-5.jpg
"The participant typed, ‘science fiction’
in the search box.”
Inference
Image source: https://benmelbourne.files.wordpress.com/2013/04/pop-up-mobile-usability-testing-lab-5.jpg
"The participant doesn’t like to use
the navigation.”
Opinion
Image source: https://benmelbourne.files.wordpress.com/2013/04/pop-up-mobile-usability-testing-lab-5.jpg
"The navigation is not noticeable.”
Ways to Take NotesEveryo
ne should
use the same tool
&/or method.
Notes Grid
Image source: https://benmelbourne.files.wordpress.com/2013/04/pop-up-mobile-usability-testing-lab-5.jpg
Why? Because this doesn’t work...
Image source: https://benmelbourne.files.wordpress.com/2013/04/pop-up-mobile-usability-testing-lab-5.jpg
And neither does this...
Image source: https://benmelbourne.files.wordpress.com/2013/04/pop-up-mobile-usability-testing-lab-5.jpg
Theme Analysis grid
Image source: https://benmelbourne.files.wordpress.com/2013/04/pop-up-mobile-usability-testing-lab-5.jpg
Or, rainbow spreadsheet
Image source: https://benmelbourne.files.wordpress.com/2013/04/pop-up-mobile-usability-testing-lab-5.jpgImage source: http://www.smashingmagazine.com/2013/04/11/rainbow-spreadsheet-collaborative-ux-research-tool/
Pick List
Image source: https://benmelbourne.files.wordpress.com/2013/04/pop-up-mobile-usability-testing-lab-5.jpg
Image source: https://benmelbourne.files.wordpress.com/2013/04/pop-up-mobile-usability-testing-lab-5.jpg
sticky notes
Image source: https://benmelbourne.files.wordpress.com/2013/04/pop-up-mobile-usability-testing-lab-5.jpg
Image source: https://benmelbourne.files.wordpress.com/2013/04/pop-up-mobile-usability-testing-lab-5.jpg
Live Shared
Note Taking
debriefing
when to debrief?
After every 3-6 sessions.
Don’t wait ‘til the end.
Prepare
Ways to debrief
round-robin or lead + additions
It’s not just about the findings...
implications matter
Wish for, how to, what if
H2 make these box entry areas clearer; H2 make it obvious they’re exclusive; Wif we only allowed one way to search for repair info?
Observation: The user didn’t realize they were notlogged in and couldn’t access documents they wanted.
Implications:
- “W4 a way the user can access documents without logging in.”
- “H2 make the log in link more visible.”
- “Wif we didn’t force the user to log in?”
Example
Blue sky thinking
“If we can really understand the problem, the answer will come out of it, because the answer is not separate from the problem.”
- Jiddu Krishnamurti
Affinity Diagraming
Affinity Diagraming
1. Put observations on post-its
2. Put post-its on the wall
3. Group similar items
4. Name each group
5. Vote on most important groups
Image source: http://www.dailymail.co.uk/femail/article-2344654/Carrie-Bradshaw-jealous-Man-uses-8-000-Post-notes-spring-surprise-wedding-proposal-girlfriend.html
“There is a good way to break up with someone, and it doesn’t involve a post-it!” - Carrie Bradshaw
observe
Kyle Soucy
So... can you believe that last person couldn’t find the ‘submit’ link.
Informal Discussion
key to complete
data collection and analysis...
Collaboration
Learn more...Book:
Paper Prototypingby Carolyn Snyder
Yes, really.
There’s an
amazing chapt
er
on analysis
!
Articles:
Making it easy to collect the data you want to collecthttp://usabilitytestinghowto.blogspot.com/2008/07/making-it-easy-to-collect-data-you-want.html
by Dana Chisnell
Making sense of the data: Collaborative data analysishttp://usabilitytestinghowto.blogspot.com/2010/04/making-sense-of-data-collaborative-data.html
by Dana Chisnell
Engaging Study Observers: An Overlooked Step in User Researchhttp://uxpamagazine.org/engaging-study-observers/
by Stephanie R. Fishel-Brown, Emily J. Schroeder
A Collaborative Lean UX Research Toolhttp://www.smashingmagazine.com/2013/04/11/rainbow-spreadsheet-collaborative-ux-research-tool/
by Tomer Sharon
The Road To Recommendationhttp://www.uie.com/articles/recommendation/
by Jared Spool
www.usableinterface.com
@kylesoucy
Thank you.
/usableinterface