Detecting Newsworthy Topics in Twitter Steven Van Canneyt and Matthias Feys April 8 th , 2014

1

Detecting Newsworthy Topics in TwitterSteven Van Canneyt and Matthias FeysApril 8th, 2014

219/04/2023

Methodology

3

Input

time interval i

News publisher detection

4

Topic detection

time interval i

topic 1 topic 2

topic 3

1.

2.

3.

Topic ranking

5

Topic enrichment

1.

2.

3. topic 1

topic 2

topic 3headline 3, tweets, pictures…

headline 2, tweets, pictures…

headline 1, tweets, pictures…

time interval i

6


Bayesian Network Classifier Estimates probability that a user is a ‘news publisher’ Only use tweets from users with probability > α (0.04) Training set: 10,000 manually annotated users

which tweets contains newsworthy content?

which tweets are posted by users who mostly talk about newsworthy stories?

7


Textual featuresusername bag-of-words term frequencies of the words in the user namedescription bag-of-words term frequencies of the words in the user

descriptionMeta-data features

#followers number of followers#following number of following#followers/#following+1 number of followers in comparison to the number of following#tweets number of tweets the user posted#favorites number of tweets the user favorited#lists number of lists the user followsverified? is the user account verified or not?URL? contains the user profile an URL or not?

Features

8

Topic detection

DBSCAN clustering algorithm Cosine similarity Boosted tf-idf representation of the tweets

9

Topic detection

standard term frequency-inverse document frequency of word w

boosting of proper nouns and verbs (1.5)

boosting of bursty words during time interval i

10

Topic ranking

SVM Classifier Estimates probability that a topic is ‘newsworthy’ Only use topics with probability > β (0.5) Training set: 116 manually annotated topics retrieved

from the ‘2012 US elections’ training dataset

11

Topic ranking

Features Tweet features

eg. #tweets User features

eg. %users with ‘news publisher’ prob. > 0.9 Topical coherence

eg. %tweets containing most informative word in the cluster Non duplicate features

eg. highest cosine similarity between the cluster and the newsworthy topics detected in previous time intervals

12

Topic enrichment

Objective: enrich detected newsworthy topic s

Headline1. Split tweets in cluster s in sentences

2. Select sentence with highest cosine similarity with the center of the cluster

3. Rule based approach to clean sentence eg. removing URLs, emoticons, ‘#’-symbol, ‘@’-symbol

13

Topic enrichment

Keywords words in headline which are in the top 50% of the

most important words of topic s

14

Topic enrichment

Representative tweets1. Select all tweets posted during time interval i

Also tweets not posted by news publishers

2. Discard tweets with cosine similarity to the center of s < λ (0.6)

3. Sort obtained tweets based on their relevance to s relevance = cosine similarity between tweet en topic center,

multiplied by user_factor user_factor = 1.5 if user is ‘news publisher’, 1 otherwise

4. Remove near-duplicates ‘near-duplicate’ if cosine similarity > μ (0.7)

15

Topic enrichment

Representative pictures1. Select all tweets posted during time interval i

Also tweets not posted by news publishers

2. Discard tweets with cosine similarity to the center of s < λ (0.6)

3. Select picture URLs from the tweets

4. Sort picture URLs based on the sum of the relevance values of their associated tweets

16

Results

17

nr time interval headline1 26-02-14 09:15 Jubilant protesters driving military vehicle from a Kiev Museum

around Parliament building.2 26-02-14 09:15 Sofia monument's latest makeover provokes protest from Russia.3 26-02-14 09:30 I'm in Charge of Miltary Now, Ukraine's Interim President Says.4 26-02-14 09:30 GDP grew 0.7% in Q4, unrevised from preliminary estimate.5 26-02-14 09:30 Russia urges OSCE to condemn "neo-fascist" sentiment in west

Ukraine.6 26-02-14 09:30 The price of Bitcoin on MT. Gox is US $135.0000.7 26-02-14 09:30 Bitcoin Has Made A Really Impressive Recovery.8 26-02-14 09:45 Ukraine minister disbands Berkut riot police blamed for violence.9 26-02-14 09:45 Japanese Authorities Probing Collapsed Bitcoin Exchange.

10 26-02-14 09:45 How bitcoin can turn it around.11 26-02-14 09:45 Hezbollah says Israel bombed its positions near Syrian border 2

days ago, vows response.12 26-02-14 10:00 Russia's deputy finance minister says no multilateral talks on

financial aid to Ukraine are taking place.13 26-02-14 10:00 Japan donates $14 mil. for Syria weapons disposal.14 26-02-14 10:15 This is Beijing, less than three weeks apart.15 26-02-14 10:15 Your spring tweet has appeared in our latest Edition mag.16 26-02-14 10:15 Ukraine `set to unveil new government'.

18


around Parliament building.2 26-02-14 09:15 Sofia monument's latest makeover provokes protest from Russia.3 26-02-14 09:30 I'm in Charge of Miltary Now, Ukraine's Interim President Says.4 26-02-14 09:30 GDP grew 0.7% in Q4, unrevised from preliminary estimate.5 26-02-14 09:30 Russia urges OSCE to condemn \neo-fascist" sentiment in west





19


around Parliament building.2 26-02-14 09:15 Sofia monument's latest makeover provokes protest from Russia.3 26-02-14 09:30 I'm in Charge of Miltary Now, Ukraine's Interim President Says.4 26-02-14 09:30 GDP grew 0.7% in Q4, unrevised from preliminary estimate.5 26-02-14 09:30 Russia urges OSCE to condemn \neo-fascist" sentiment in west





20

nr time interval headline2 26-02-14 09:15 Sofia monument's latest makeover provokes protest from Russia.

Sofia, monument, makeover, provokes

Pro-Ukraine paint job - Sofia monument's latest makeover provokes protest from Russia http://bbc.in/1frf9UN

Kijow w Sofii. RT: @BBCWorld Pro-Ukraine paint job in Sofia provokes protest from Russia http://bbc.in/1frf9UN

Pro-#Ukraine paint job-Sofia monument's latest makeover provokes #protest from R http://bbc.in/1frf9UN via @BBCWorld

tags

tweets

21


around Parliament building.

Jubilant, protesters, driving, vehicle, Museum, Parliament

Jubilant protesters driving military vehicle from a Kiev Museum around Parliament building #Kiev #Ukraine

Another #Russia|n armored vehicles spotted in #Sevastopol in #Crimea. #Ukraine http://qn.quotidiano.net/esteri/2014...

tags

tweets

22


around Parliament building.

Jubilant, protesters, driving, vehicle, Museum, Parliament

Jubilant protesters driving military vehicle from a Kiev Museum around Parliament building #Kiev #Ukraine

Another #Russia|n armored vehicles spotted in #Sevastopol in #Crimea. #Ukraine http://qn.quotidiano.net/esteri/2014...

tags

tweets

23

[email protected]

Detecting Newsworthy Topics in Twitter Steven Van Canneyt and Matthias Feys April 8 th , 2014

Documents

Transcript of Detecting Newsworthy Topics in Twitter Steven Van Canneyt and Matthias Feys April 8 th , 2014