From stream to structure: Topic Analysis of US Presidential tweets

17
m Stream to Structure: ng Topic Analysis to Segment Presidential Tw rew Jeavons – ted at the ESOMAR Berlin “Big Data” conference on November 15 th 2016.

Transcript of From stream to structure: Topic Analysis of US Presidential tweets

Page 1: From stream to structure: Topic Analysis of US Presidential tweets

From Stream to Structure:Using Topic Analysis to Segment Presidential Tweets

Andrew Jeavons –

Presented at the ESOMAR Berlin “Big Data” conference on November 15th 2016.

Page 2: From stream to structure: Topic Analysis of US Presidential tweets

Automated Topic Analysis of Tweets

Page 3: From stream to structure: Topic Analysis of US Presidential tweets

“I couldn’t forgive him or like him, but I saw that what he had done was, to him, entirely justified. It was all very careless and confused. They were careless people, Tom and Daisy — they smashed up things and creatures and then retreated back into their money or their vast carelessness, or whatever it was that kept them together, and let other people clean up the mess they had made. . . .”

forgive entirely justified careless confused careless creatures

retreated money vast carelessness people mess

Bag of Words Model

Page 4: From stream to structure: Topic Analysis of US Presidential tweets

Collected tweets from main Presidential contenders from March 1st 2016 onwards. Analysis performed August 14th 2016 and 7th November 2016.

Page 5: From stream to structure: Topic Analysis of US Presidential tweets

Topic Flow Diagram

14 topics extracted – sum topics of tweets over 3 day periods.

Each “stream” is a percentage of total tweets for that topic.

Topics labeled by “hand”.

Page 6: From stream to structure: Topic Analysis of US Presidential tweets

What is a Topic ?Latent structure of words.

May not be semantically meaningful but may be behaviorally meaningful.

Topic naming and analysis qual/quant process:

Page 7: From stream to structure: Topic Analysis of US Presidential tweets

Vote – Group 14

Stop Everyone – Group 4

Page 8: From stream to structure: Topic Analysis of US Presidential tweets

Group 4 Verbs

Group 14 Verbs

Page 9: From stream to structure: Topic Analysis of US Presidential tweets

Online displays shows:

Name of Topic.

Percentage of tweets of Topic for 3 day period.

Statistical significance of change in Topic tweet volume.

masscognition.com/esomar_berlin

Topic Flow Diagram

Page 10: From stream to structure: Topic Analysis of US Presidential tweets

Fight the Billionaires

Campaign, Vote, Poll

Political Revolution

I and I

Reactions to Loss of Nomination

Sanders

Cruz

Page 11: From stream to structure: Topic Analysis of US Presidential tweets

Clinton

Trump

Top Two Topics

Page 12: From stream to structure: Topic Analysis of US Presidential tweets

Clinton

Trump

Stop Everyone I and ITrump

Page 13: From stream to structure: Topic Analysis of US Presidential tweets

Who was the most consistent in terms of topics tweeted ?

Stay “on message” ?

Measure of Lability of topics.

Page 14: From stream to structure: Topic Analysis of US Presidential tweets

Developed metric for Lability of topics tweeted.

Higher the value the more change in topics tweeted over time.

Page 15: From stream to structure: Topic Analysis of US Presidential tweets

Clinton – 0.82 Lability. High: CommentaryLow: Political Revolution

Trump – 0.92 Lability. High: TrumpLow: Commentary

Page 16: From stream to structure: Topic Analysis of US Presidential tweets

Nomination Twitter Handover ?

Last PressConference

Trump

Page 17: From stream to structure: Topic Analysis of US Presidential tweets

Why Automated Topic Analysis ?