Computing Emotions

Brian Mac Namee John Kelleher

Sarah Jane Delany

School of Computing

Dublin Institute of Technology

Applied Intelligence Research Center

Quantitative Models of Emotion

RecognisingEmotions

Interesting Questions

Simulating Emotions

1 2

3 4

QUANTITATIVE MODELS OF EMOTION

Lang Model

Arousal

Valence

astonished

delighted

glad

happy

content

satisfied

calmbored

frustrated

annoyed

angry

alarmed

sad

Plutchik’s Wheel

Ortony, Clore& Collins (OCC)

Ortony, Clore& Collins (OCC)

Ortony, Clore& Collins (OCC)

EMOTION RECOGNITION

Emotion Recognition

Emotion recognition has a wide range of uses:

– Call centre monitoring

– Automated tutors

– Music retrieval

– Market research

– Online sentiment analysis

– Law enforcement

Training Examples

PredictionModel

Machine Learning

Algorithm

Training Examples

PredictionModel

Machine Learning

Algorithm

DisgustHappy

SadAngry

Training Examples

PredictionModel

Machine Learning

Algorithm

Positive Negative

Training Examples

PredictionModel

Machine Learning

Algorithm

Anger

Surprise Sadness

Disgust

Fear

Happiness

IDFeature

1Feature

2Feature

3Feature

4Feature

5

100 3.6 85 34 22 74

PredictionModel

IDFeature

1Feature

2Feature

3Feature

4Feature

5

100 3.6 85 34 22 74

PredictionModel

Happiness

IDFeature

1Feature

2Feature

3Feature

4Feature

5

100 3.6 85 34 22 74

Emotion Recognition Examples

Sentiment Analysis

Facial Emotion

Recognitionhttp://www.youtube.com/watch?v=45eLpzk6N34

http://www.semantic-api.com/demo-statistical-sentiment-analysis.html

EMOTION SIMULATION

Emotion Simulation

Emotion simulation is required in applications

in which we need to simulate emotions:

– Robotics

– Automated speech systems

– Games/entertainment systems

There are two key parts to emotion simulation:

– A model of emotion generation

– A system for emotion realization

Lang Model

Hand-crafted rules

about how particular

actions lead to changes

on the dimensions

within the model

Very application specific

Arousal

Valence

Insult

Compliment

The OCC Model

The OCC model has a sophisticated logical

formalism for the generation of emotions

Fear equals hope plus anticipated possible

failure

Failure after hope leads to disappointment

Emotion Realisation Examples

Emotion Generation Examples

Kismet etc: http://www.youtube.com/watch?v=FE0zyCkhcbg

http://web.media.mit.edu/~cynthiab/index.html

Emotion Generation Examples

Façade: www.interactivestory.nethttp://www.youtube.com/watch?v=GmuLV9eMTkg

INTERESTING QUESTIONS

Interesting Questions

What emotions are worth recognising and simulating and when?

Are there models of human-human interaction from which lessons about the usefulness of emotion can be learned?

What are the impacts of better emotional recognition and simulation for long term human robot interactions?

Does it matter that the whole thing is a charade? What happens when users see behind the curtain?

Thank You

Brian Mac Namee John Kelleher

Sarah Jane Delany

School of Computing

Dublin Institute of Technology

Applied Intelligence Research Center