Personality Correlates for Digital Concert Program Notes

Marko Tkalčič, Bruce Ferwerda, David Hauger, Markus Schedl

marko.tkalcic@jku.at http://cp.jku.at

UMAP 2015, Dublin

[ SHORT PAPER ]

Presentation Outline

• Big Picture

• Problem statement

• Experiment

• Results

• Conclusion

2015-07-01 2 Tkalcic et al., Personality Correlations for

Digital Concert Program Notes

Big picture

• FP7 project Phenicx http://phenicx.upf.edu/

• Classical music concerts

– Audio analysis

– Mobile application

– User modeling

2015-07-01 Tkalcic et al., Personality Correlations for

Digital Concert Program Notes 3

Big picture

• FP7 project Phenicx http://phenicx.upf.edu/

• Classical music concerts

– Audio analysis

– Mobile application

– User modeling

2015-07-01 Tkalcic et al., Personality Correlations for

Digital Concert Program Notes 4

Big picture

• FP7 project Phenicx http://phenicx.upf.edu/

• Classical music concerts

– Audio analysis

– Mobile application

– User modeling

2015-07-01 Tkalcic et al., Personality Correlations for

Digital Concert Program Notes 5

Classical Music Concerts

• Classical music people are conservative (technology)

• Nevertheless, just as opera subtitles ...

2015-07-01 Tkalcic et al., Personality Correlations for

Digital Concert Program Notes 6

Classical Music Concerts

• Classical music people are conservative (technology)

• Nevertheless, just as opera subtitles ...

2015-07-01 Tkalcic et al., Personality Correlations for

Digital Concert Program Notes 7

Problem statement

• Personalized music information retrieval

• Problem:

• Concerts are rare

• Classical music lovers are knowledgeable

• They don‘t share informatoin online (massively)

2015-07-01

Tkalcic et al., Personality Correlations for Digital Concert Program Notes

8

CLASSICAL MUSIC CONCERT-GOERS KNOW EVERYTHING

Question

2015-07-01 Tkalcic et al., Personality Correlations for

Digital Concert Program Notes 9

WHAT IS THERE TO PERSONALIZE?

Answer

2015-07-01 Tkalcic et al., Personality Correlations for

Digital Concert Program Notes 10

PROGRAM NOTES

Answer

Automatically generated, tailor-made multimedia content offered to prospective audience members, introducing the concert that will take place with the purpose of informing,

educating and pre-engaging users, supporting concert anticipation.

2015-07-01 Tkalcic et al., Personality Correlations for

Digital Concert Program Notes 11

PROGRAM NOTES

Program notes

2015-07-01 Tkalcic et al., Personality Correlations for

Digital Concert Program Notes 12

Usage Scenario

2015-07-01 Tkalcic et al., Personality Correlations for

Digital Concert Program Notes 13

Login – social media account

Infer personal characteristics -

personality

Social media traces

Adapt content to the user

Supporting MM

material

Adapted content

Inference of personality

2015-07-01 Tkalcic et al., Personality Correlations for

Digital Concert Program Notes 14

Login – social media account

Infer personal characteristics -

personality

Social media traces

Adapt content to the user

Supporting MM

material

Adapted content

• Big5 personality model: • Openness • Conscientiousness • Extraversion • Agreeableness • Neuroticism

• Correlates with music preferences (Rentfrow et al., 2003)

Inference of personality

2015-07-01 Tkalcic et al., Personality Correlations for

Digital Concert Program Notes 15

Login – social media account

Infer personal characteristics -

personality

Social media traces

Adapt content to the user

Supporting MM

material

Adapted content

• Twitter (Quercia et al., 2011)

• Facebook (Kosinski et al., 2013)

• Instagram (Ferwerda et al., under review)

• Facebook disclosure (Ferwerda et al., under review)

Usage Scenario

2015-07-01 Tkalcic et al., Personality Correlations for

Digital Concert Program Notes 16

Login – social media account

Infer personal characteristics -

personality

Social media traces

Adapt content to the user

Supporting MM

material

Adapted content

Experiment

• Correlations between personality and content preferences • AMT online study: 165 participants (93 females, age MD 37,

SD 72), within subject design • Variables:

– IV: Musical background – IV: Personality – IV: Genre preferences – DV: Content ratings (consumption/interestingness/novelty)

• Content (14 combinations) - Debussy: La Mer – Text/audio/images – Long/short – Composer/performer/piece

2015-07-01 Tkalcic et al., Personality Correlations for

Digital Concert Program Notes 17

Results (1): personality vs. music background

2015-07-01 Tkalcic et al., Personality Correlations for

Digital Concert Program Notes 18

Results (2): personality vs. classical music

2015-07-01 Tkalcic et al., Personality Correlations for

Digital Concert Program Notes 19

Results (3)

• (O, C, A, E) positive correlation with (consumption, interestingness, novelty)

• N negative correlation with (consumption, interestingness, novelty)

• Music background positive correlation with (consumption, interestingness, novelty)

2015-07-01 Tkalcic et al., Personality Correlations for

Digital Concert Program Notes 20

Results (3): neuroticism vs. interestingness (performer-text-long)

2015-07-01 Tkalcic et al., Personality Correlations for

Digital Concert Program Notes 21

Results (3): openness vs. interestingness (piece-text-short)

2015-07-01 Tkalcic et al., Personality Correlations for

Digital Concert Program Notes 22

Conclusion

• Personality & musical background account for preverences variance

• Future work:

– Music background -> Goldsmiths MSI

– Automatic inference of MSI?

– ML for recommending content

2015-07-01 Tkalcic et al., Personality Correlations for

Digital Concert Program Notes 23

Thank you.

Marko Tkalčič, Bruce Ferwerda, David Hauger, Markus Schedl

marko.tkalcic@jku.at http://cp.jku.at

2015-07-01 Tkalcic et al., Personality Correlations for

Digital Concert Program Notes 24

Results (3): agreeableness vs. consumption (piece-audio-long)

2015-07-01 Tkalcic et al., Personality Correlations for

Digital Concert Program Notes 25

Results (3): conscientiousness vs. consumption (orchestra-text-long)

2015-07-01 Tkalcic et al., Personality Correlations for

Digital Concert Program Notes 26

Music background questionnaire

2015-07-01 Tkalcic et al., Personality Correlations for

Digital Concert Program Notes 27

Recommender system

2015-07-01 Tkalcic et al., Personality Correlates for

Digital Concert Program Notes 28

Openness vs. Music background

2015-07-01 Tkalcic et al., Personality Correlates for

Digital Concert Program Notes 29

Openness vs. Classical music genre

2015-07-01 Tkalcic et al., Personality Correlates for

Digital Concert Program Notes 30

Agreeableness/Openness Vs. religious

2015-07-01 Tkalcic et al., Personality Correlates for

Digital Concert Program Notes 31