4. PREFERENTIAL ATTACHMENT The rich gets richer. Empirical evidences Many large networks are scale...

27
4. PREFERENTIAL ATTACHMENT The rich gets richer

Transcript of 4. PREFERENTIAL ATTACHMENT The rich gets richer. Empirical evidences Many large networks are scale...

Page 1: 4. PREFERENTIAL ATTACHMENT The rich gets richer. Empirical evidences Many large networks are scale free The degree distribution has a power-law behavior.

4. PREFERENTIAL ATTACHMENT

The rich gets richer

Page 2: 4. PREFERENTIAL ATTACHMENT The rich gets richer. Empirical evidences Many large networks are scale free The degree distribution has a power-law behavior.

Empirical evidences

Many large networks are scale freeThe degree distribution has a power-law behavior for large k (far from a Poisson distribution)Random graph theory and the Watts-Strogatz model cannor reproduce this feature

Page 3: 4. PREFERENTIAL ATTACHMENT The rich gets richer. Empirical evidences Many large networks are scale free The degree distribution has a power-law behavior.

We can construct power-law networks by handWhich is the mechanism that makes scale-free networks to emerge as they grow?Emphasis: network dynamics rather to construct a graph with given topological features

Page 4: 4. PREFERENTIAL ATTACHMENT The rich gets richer. Empirical evidences Many large networks are scale free The degree distribution has a power-law behavior.

Topology is a result of the dynamicsBut only a random growth? In this case the distribution is exponential!

Page 5: 4. PREFERENTIAL ATTACHMENT The rich gets richer. Empirical evidences Many large networks are scale free The degree distribution has a power-law behavior.

Barabasi-Albert model (1999)

Two generic mechanisms common in many real networks– Growth (www, research literature, ...)– Preferential attachment (idem): attractiveness of

popularity

The twotwo are necessary

Page 6: 4. PREFERENTIAL ATTACHMENT The rich gets richer. Empirical evidences Many large networks are scale free The degree distribution has a power-law behavior.

Growth

t=0, m0 nodes

Each time step we add a new node with m (m0) edges that link the new node to m different nodes already present in the system

Page 7: 4. PREFERENTIAL ATTACHMENT The rich gets richer. Empirical evidences Many large networks are scale free The degree distribution has a power-law behavior.

Preferential attachment

When choosingchoosing the nodes to which the new connects, the probability that a new node will be connected to node i depends on the degree ki of node i

( ) ii

jj

kk

k

Linear attachment (more general models)Sum over all existing nodes

Page 8: 4. PREFERENTIAL ATTACHMENT The rich gets richer. Empirical evidences Many large networks are scale free The degree distribution has a power-law behavior.

Numerical simulations

Power-law P(k)k- SF=3

The exponent does not depend on m (the only parameter of the model)

Page 9: 4. PREFERENTIAL ATTACHMENT The rich gets richer. Empirical evidences Many large networks are scale free The degree distribution has a power-law behavior.

=3. different m’s. P(k) changes. not

Page 10: 4. PREFERENTIAL ATTACHMENT The rich gets richer. Empirical evidences Many large networks are scale free The degree distribution has a power-law behavior.

Degree distribution

Handwritten notes

2 ( 1)( )

( 1)( 2)

m mP k

k k k

Page 11: 4. PREFERENTIAL ATTACHMENT The rich gets richer. Empirical evidences Many large networks are scale free The degree distribution has a power-law behavior.

Preferential attachment but no growth

t=0, N nodes, no links

Power-laws at early timesP(k) not stationary, all nodes get connectedki(t)=2t/N

( ) ii

jj

kk

k

Page 12: 4. PREFERENTIAL ATTACHMENT The rich gets richer. Empirical evidences Many large networks are scale free The degree distribution has a power-law behavior.
Page 13: 4. PREFERENTIAL ATTACHMENT The rich gets richer. Empirical evidences Many large networks are scale free The degree distribution has a power-law behavior.

Average shortest-path

just a fit

ln( )l A N B C

<k>=k SF model

Page 14: 4. PREFERENTIAL ATTACHMENT The rich gets richer. Empirical evidences Many large networks are scale free The degree distribution has a power-law behavior.

No theoretical stimations up to nowThe growth introduces nontrivial correctionsWhereas random graphs with a power-law degree distribution are uncorrelated

Page 15: 4. PREFERENTIAL ATTACHMENT The rich gets richer. Empirical evidences Many large networks are scale free The degree distribution has a power-law behavior.

Clustering coefficient

NO analytical prediction for the SF model

5 times larger

0.75SF

1RG

C N

C k N

SW: C is independent of N

Page 16: 4. PREFERENTIAL ATTACHMENT The rich gets richer. Empirical evidences Many large networks are scale free The degree distribution has a power-law behavior.

Scaling relations

Page 17: 4. PREFERENTIAL ATTACHMENT The rich gets richer. Empirical evidences Many large networks are scale free The degree distribution has a power-law behavior.

Spectrum

exponential decay around 0

power law decay for large ||

1/ 41 N

Page 18: 4. PREFERENTIAL ATTACHMENT The rich gets richer. Empirical evidences Many large networks are scale free The degree distribution has a power-law behavior.

Nonlinear preferantial attachment

Sublinear: stretch exponential P(k)Superlinear: winner-takes-all

Page 19: 4. PREFERENTIAL ATTACHMENT The rich gets richer. Empirical evidences Many large networks are scale free The degree distribution has a power-law behavior.

Nonlinear growth rates

Empirical observation: the number of links increases faster than the number of nodesAccelerated growthCrossover with two power-laws

Page 20: 4. PREFERENTIAL ATTACHMENT The rich gets richer. Empirical evidences Many large networks are scale free The degree distribution has a power-law behavior.

Growth constraints

Power-laws followed by exponential cutoffsModel: when a node– reaches a certain age (aging)– has more than a critical number of links (capacity)

– Explains the behavior

Page 21: 4. PREFERENTIAL ATTACHMENT The rich gets richer. Empirical evidences Many large networks are scale free The degree distribution has a power-law behavior.

Competition

Nodes compete for linksPower-law with a logarithmic correction

Page 22: 4. PREFERENTIAL ATTACHMENT The rich gets richer. Empirical evidences Many large networks are scale free The degree distribution has a power-law behavior.

The Simon model

H.A. Simon (1955) : a class of models to account empirical distributions following a power-law (words, publications, city populations, incomes, firm sizes, ...)

Page 23: 4. PREFERENTIAL ATTACHMENT The rich gets richer. Empirical evidences Many large networks are scale free The degree distribution has a power-law behavior.

Algorithm

Book that is being written up to N wordsfN(i) number of different words that each occurred exactly i times in the textContinue adding wordsWith probability p we add a new wordWith probability 1-p the word is already writtenThe probability that the (n+1)th word has already appeared i times is proportional to i fN(i) [the total number of words that have occurred i times]

Page 24: 4. PREFERENTIAL ATTACHMENT The rich gets richer. Empirical evidences Many large networks are scale free The degree distribution has a power-law behavior.

Mapping into a network model

With p a new node is addedWith 1-p a directed link is added. The starting point is randomly selected. The endpoint is selected such that the probability that a node belonging to the Nk nodes with k incoming links will be chosen is

(class) kkN

Page 25: 4. PREFERENTIAL ATTACHMENT The rich gets richer. Empirical evidences Many large networks are scale free The degree distribution has a power-law behavior.

Does not imply preferential attachmentClasses versus actual nodesNo topology

Page 26: 4. PREFERENTIAL ATTACHMENT The rich gets richer. Empirical evidences Many large networks are scale free The degree distribution has a power-law behavior.

Error and attack tolerance

High degree of tolerance against error Topological aspects of robustness, caused by edge and/or link removalTwo types of node removal:– Randomly selected nodes (errors!)– Most highly connected nodes are removed at each

step (this is an attack!)

Page 27: 4. PREFERENTIAL ATTACHMENT The rich gets richer. Empirical evidences Many large networks are scale free The degree distribution has a power-law behavior.

Removal of nodes

Squares: random

Circles: preferential