Post on 20-Sep-2014
description
UXPA 2014 New Methods for Measuring Emotion | June 25, 2014 @andrewschall 1
New Methodsfor Measuring Emotional Engagement
Andrew Schall@andrewschall
UXPA 2014 New Methods for Measuring Emotion | June 25, 2014 @andrewschall
Andrew Schall.
Vice President of UX, SPARK Experience
Co-Author, Eye Tracking in User Experience Design
President, UXPA of Washington DC
UXPA 2014 New Methods for Measuring Emotion | June 25, 2014 @andrewschall
A workshop is meant to:
React to
Create
Refine
Ideas
UXPA 2014 New Methods for Measuring Emotion | June 25, 2014 @andrewschall 4
HOW DO WE EVALUATE EMOTION?What methods exist to understand how our users are feeling?
UXPA 2014 New Methods for Measuring Emotion | June 25, 2014 @andrewschall 5
You Can’t Accurately Ask About Emotions
Current methods for evaluating emotion are limited to what a user selectively self reports to the study facilitator.
UXPA 2014 New Methods for Measuring Emotion | June 25, 2014 @andrewschall 6
You Can’t Accurately Ask About Emotions
Emotion is not primarily a language-based experience; conscious effort is required to put experience into words.
UXPA 2014 New Methods for Measuring Emotion | June 25, 2014 @andrewschall 7
BIO/NEURO METRICSHow can UX researchers apply this technology to study emotions?
UXPA 2014 New Methods for Measuring Emotion | June 25, 2014 @andrewschall
Disclaimer: I am not a neuroscientist or human physiologist.
UXPA 2014 New Methods for Measuring Emotion | June 25, 2014 @andrewschall 9
EyeTracking.Eye Tracking is critical for any emotional analysis. Eye tracking can tell us:
Time & Location• Where they looked• When they looked
Engagement Level• How long they looked• How frequently they
looked
UXPA 2014 New Methods for Measuring Emotion | June 25, 2014 @andrewschall 1 0
EyeTracking.
UXPA 2014 New Methods for Measuring Emotion | June 25, 2014 @andrewschall 1 1
• HELPS YOU UNDERSTAND WHAT THE USER IS PAYING ATTENTION TO
• EASY DATA COLLECTION• SOFTWARE-GENERATED VISUALS
PROS
• TELLS YOU WHAT BUT NOT WHY
CONS
EyeTracking.
UXPA 2014 New Methods for Measuring Emotion | June 25, 2014 @andrewschall 1 2
BrainActivity.Electroencephalography is a way to measure brain activity with sensors on the head.
Brainwaves can be interpreted to understand core emotions:
• Happiness/Sadness• Excitement/Boredom• Frustration/Relaxation
UXPA 2014 New Methods for Measuring Emotion | June 25, 2014 @andrewschall 1 3
BrainActivity.
UXPA 2014 New Methods for Measuring Emotion | June 25, 2014 @andrewschall 1 4
BrainActivity.
• BROAD SPECTRUM OF EMOTIONS• ABILITY TO COLLECT VALENCE• RELATIVELY FAST & EASY TO
SETUP
PROS
• RAW DATA CAN BE NOISY• TIME-CONSUMING & COMPLEX
TO ANALYZE• DATA CAN BE MISINTERPRETED
CONS
UXPA 2014 New Methods for Measuring Emotion | June 25, 2014 @andrewschall 1 5
SkinConductivity.The sensor measures small changes in user’s skin conductance (GSR). These sweat gland changes are directly related to the Sympathetic Nervous System activation, also known as the fight or flight response.
UXPA 2014 New Methods for Measuring Emotion | June 25, 2014 @andrewschall 1 6
SkinConductivity.When a user becomes frustrated, excited, anxious, stressed, etc. their skin conductance will spike.
UXPA 2014 New Methods for Measuring Emotion | June 25, 2014 @andrewschall 1 7
SkinConductivity.
• EASY TO SETUP• MINIMALLY INTRUSIVE• DATA ANALYSIS LESS
COMPLEX• FOCUS ON AROUSAL &
STRESS
PROS
• DELAYED REACTION• LIMITED RANGE OF
EMOTIONS• CAN NOT MEASURE
VALIENCE
CONS
UXPA 2014 New Methods for Measuring Emotion | June 25, 2014 @andrewschall 1 8
PupilResponse.
http://www.scientificamerican.com/article/eye-opener-why-do-pupils-dialate/
Pupilametry is used to measure the real-time diameter of the changes in pupil size. This can be used to detect emotions:
• Mental workload• Frustration/Stress• Arousal/Interest
UXPA 2014 New Methods for Measuring Emotion | June 25, 2014 @andrewschall 1 9
PupilResponse.
Research shows that the worst time to interrupt anyone is when they have the highest memory load. Pupillometry studies have shown that interruptions during peak loads cause the biggest disruption.
Shamsi T. Iqbal, Xianjun Sam Zheng, and Brian P. Bailey. 2004. Task-evoked pupillary response to mental workload in human-computer interaction. In CHI '04 Extended Abstracts on Human Factors in Computing Systems
UXPA 2014 New Methods for Measuring Emotion | June 25, 2014 @andrewschall 2 0
PupilResponse.
• EYE TRACKER ALREADY COLLECTS IT
• STRAIGHTFORWARD ANALYSIS
• FOCUS ON AROUSAL & STRESS
PROS
• HIGHLY SUBJECT TO LIGHTING VARIABILITY
• CAN NOT DETECT VALENCE
CONS
UXPA 2014 New Methods for Measuring Emotion | June 25, 2014 @andrewschall 2 1
FacialAnalysis.
Facial expression recognition uses a simple webcam and software to identify facial expressions people display.
It can detect a wide range of emotions:
• Happiness• Sadness• Angry• Frustration• Confusion
UXPA 2014 New Methods for Measuring Emotion | June 25, 2014 @andrewschall 2 2
FacialAnalysis.
The software looks at facial action units that are then combined to identify specific emotions.
UXPA 2014 New Methods for Measuring Emotion | June 25, 2014 @andrewschall 2 3
FacialAnalysis.
• AUTOMATIC CODING OF FACIAL EXPRESSIONS
• CAN DETECT VALENCE• WORKS WITH ANY WEBCAM
PROS
• INCONSISTENT RESULTS• MAY REQUIRE LARGER
SAMPLE SIZE TO ACCOUNT FOR VARIANCES
CONS
UXPA 2014 New Methods for Measuring Emotion | June 25, 2014 @andrewschall 2 4
DataAnalysis.
iMotions Attention Tool Noldus Research Suite
UXPA 2014 New Methods for Measuring Emotion | June 25, 2014 @andrewschall 2 5
TakeAways.
Major opportunities to use bio/neurometrics to understand users’ emotions in the context of user experience.
Tools are rapidly improving in terms of easy of data collection and analysis…but still a long way to go.
Be aware of the current limitations and challenges of using this technology.
01 /
02 /
03 /
UXPA 2014 New Methods for Measuring Emotion | June 25, 2014 @andrewschall 2 6
YourVoice.
What are the best applications for biometric measurements in UX research?
What are the practical considerations/issues with using these tools for UX research?
How do we design an effective study to measure emotion for UX evaluation?
Is this the future of UX research?
01 /
02 /
03 /
04 /
UXPA 2014 New Methods for Measuring Emotion | June 25, 2014 @andrewschall 2 7
GROUP ACTIVITYWhat are the best applications for biometric measurements in UX research?
UXPA 2014 New Methods for Measuring Emotion | June 25, 2014 @andrewschall 2 8
GROUP ACTIVITYWhat are the practical considerations/issues with using these tools for UX research?
UXPA 2014 New Methods for Measuring Emotion | June 25, 2014 @andrewschall 2 9
GROUP ACTIVITY
How do we design an effective study to measure emotion for UX evaluation?
UXPA 2014 New Methods for Measuring Emotion | June 25, 2014 @andrewschall 3 0
GROUP ACTIVITY
Is this the future of UX research?
UXPA 2014 New Methods for Measuring Emotion | June 25, 2014 @andrewschall 3 1
OPEN FORUM
What are your ideas, questions, concerns about this kind of research?