Structual Trend Analysis for Online Social Networks Ceren Budak Divyakant Agrawal Amr El Abbadi...

22
Structual Trend Analysis for Online Social Networks Ceren Budak Divyakant Agrawal Amr El Abbadi Science,UCSB SantaBarbara,USA Reporter: Qi Liu

Transcript of Structual Trend Analysis for Online Social Networks Ceren Budak Divyakant Agrawal Amr El Abbadi...

Page 1: Structual Trend Analysis for Online Social Networks Ceren Budak Divyakant Agrawal Amr El Abbadi Science,UCSB SantaBarbara,USA Reporter: Qi Liu.

Structual Trend Analysis for Online Social Networks

Ceren Budak Divyakant Agrawal Amr El AbbadiScience,UCSB SantaBarbara,USA

Reporter: Qi Liu

Page 2: Structual Trend Analysis for Online Social Networks Ceren Budak Divyakant Agrawal Amr El Abbadi Science,UCSB SantaBarbara,USA Reporter: Qi Liu.

What to do?

Trend

traditional

structural

coordinate

uncoordinate

Page 3: Structual Trend Analysis for Online Social Networks Ceren Budak Divyakant Agrawal Amr El Abbadi Science,UCSB SantaBarbara,USA Reporter: Qi Liu.

What’s new?

• Structural trend definition• Reducing to local triangles counting• Sampling tech for online detection

Page 4: Structual Trend Analysis for Online Social Networks Ceren Budak Divyakant Agrawal Amr El Abbadi Science,UCSB SantaBarbara,USA Reporter: Qi Liu.

From where?

• A temporal view• Using spatial properties• Counting, streaming and semi-streaming

Page 5: Structual Trend Analysis for Online Social Networks Ceren Budak Divyakant Agrawal Amr El Abbadi Science,UCSB SantaBarbara,USA Reporter: Qi Liu.

Define it!

• Directed G=(N,E)• ejiϵE => ni is one neighbor of nj

• ni mentions Tx => <ni, Tx>

Traditional:Coordinate: Uncoordinate:

Page 6: Structual Trend Analysis for Online Social Networks Ceren Budak Divyakant Agrawal Amr El Abbadi Science,UCSB SantaBarbara,USA Reporter: Qi Liu.

High scores for coordinated trend

• Large number of pairs of connected nodes• Large number of mentions• For a complete graph, favors a uniform

distribution• In a power law graph, biased toward

influential nodes

Page 7: Structual Trend Analysis for Online Social Networks Ceren Budak Divyakant Agrawal Amr El Abbadi Science,UCSB SantaBarbara,USA Reporter: Qi Liu.

Example for complete graph

f(Tx) = f(Ty) = 2Ng(Tx) = 3N(N-1) g(Ty) = 4N(N-1)

1

N+1

2

2

2 2

Tx Ty

1

1

Page 8: Structual Trend Analysis for Online Social Networks Ceren Budak Divyakant Agrawal Amr El Abbadi Science,UCSB SantaBarbara,USA Reporter: Qi Liu.

Example for power law graph

f(Tx) = f(Ty) = K+N-1g(Tx) = 2K(N-1) g(Ty) = 2K+2N-4

Tx

Ty

K

111

1

11K

Page 9: Structual Trend Analysis for Online Social Networks Ceren Budak Divyakant Agrawal Amr El Abbadi Science,UCSB SantaBarbara,USA Reporter: Qi Liu.

Significance Validation

• Model-Based Validation– Independent Trend Formation Model• pi,x: external influence

• qi,j,x: internal influence

– Nearest Neighbor model• u: probability from 2 to 1• k: pairs of connected nodes per step

• Analysis-Based Validation

Page 10: Structual Trend Analysis for Online Social Networks Ceren Budak Divyakant Agrawal Amr El Abbadi Science,UCSB SantaBarbara,USA Reporter: Qi Liu.

Coordinated differs from traditional

• Spearman rank correlation coefficient(SRCC)– – [-1, +1]

• Average precision–

• difference

Page 11: Structual Trend Analysis for Online Social Networks Ceren Budak Divyakant Agrawal Amr El Abbadi Science,UCSB SantaBarbara,USA Reporter: Qi Liu.

What topics detected?

• Vary p and q• Using different score functions• Results:

Page 12: Structual Trend Analysis for Online Social Networks Ceren Budak Divyakant Agrawal Amr El Abbadi Science,UCSB SantaBarbara,USA Reporter: Qi Liu.

App: Sybil Attack Detection

• Ranking of Ty: co>tr>un• Breakpoints may means attack• Small p,q and few Sybil nodes, big effect

Page 13: Structual Trend Analysis for Online Social Networks Ceren Budak Divyakant Agrawal Amr El Abbadi Science,UCSB SantaBarbara,USA Reporter: Qi Liu.

Analysis-Based Validation

• Twitter data: 467 million posts, 20 million users, spanning 7 months

• 230m posts, 2.7m users, 2960495 hashtags

Extraction

Page 14: Structual Trend Analysis for Online Social Networks Ceren Budak Divyakant Agrawal Amr El Abbadi Science,UCSB SantaBarbara,USA Reporter: Qi Liu.

Tr vs Co vs Un

Page 15: Structual Trend Analysis for Online Social Networks Ceren Budak Divyakant Agrawal Amr El Abbadi Science,UCSB SantaBarbara,USA Reporter: Qi Liu.

Something new about twitter data

• Choose 60th to 100th topics• Findings: – coordinated trend: 7694 users, 21.5 edges on

average; – uncoordinated trend: 21114 users, 8.6 edges

Page 16: Structual Trend Analysis for Online Social Networks Ceren Budak Divyakant Agrawal Amr El Abbadi Science,UCSB SantaBarbara,USA Reporter: Qi Liu.

Prefuse

Page 17: Structual Trend Analysis for Online Social Networks Ceren Budak Divyakant Agrawal Amr El Abbadi Science,UCSB SantaBarbara,USA Reporter: Qi Liu.

Hashtag categories effect

• 7 categories: political, technology, celebrity, games, idioms, movies, music and none

Page 18: Structual Trend Analysis for Online Social Networks Ceren Budak Divyakant Agrawal Amr El Abbadi Science,UCSB SantaBarbara,USA Reporter: Qi Liu.

Incremental Counting Algorithm

• For a coming <nl,Tx>

Page 19: Structual Trend Analysis for Online Social Networks Ceren Budak Divyakant Agrawal Amr El Abbadi Science,UCSB SantaBarbara,USA Reporter: Qi Liu.

Reducing to count local triangles

• A directed multi-graph G’ = (N’,E’)• N’ = T U N, E’ = Et U Ef

Page 20: Structual Trend Analysis for Online Social Networks Ceren Budak Divyakant Agrawal Amr El Abbadi Science,UCSB SantaBarbara,USA Reporter: Qi Liu.

Sampling tech

• How to work?• Correctness:–

– Xx = Countx / (ps)^2, : triangles sharing edges

Page 21: Structual Trend Analysis for Online Social Networks Ceren Budak Divyakant Agrawal Amr El Abbadi Science,UCSB SantaBarbara,USA Reporter: Qi Liu.

Conclusion

• Two trend definitons• A reduction• Sampling tech

Page 22: Structual Trend Analysis for Online Social Networks Ceren Budak Divyakant Agrawal Amr El Abbadi Science,UCSB SantaBarbara,USA Reporter: Qi Liu.

THE ENDTHANKS!