Power law and exponential decay Milan Vojnović Microsoft Research Cambridge Collaborators: T....

52
Power law and exponential decay Milan Vojnović Microsoft Research Cambridge borators: T. Karagiannis and J.-Y. Le Boudec colloquium series, University of Maryland, Mar 07 of inter contact times between mobile devices

Transcript of Power law and exponential decay Milan Vojnović Microsoft Research Cambridge Collaborators: T....

Page 1: Power law and exponential decay Milan Vojnović Microsoft Research Cambridge Collaborators: T. Karagiannis and J.-Y. Le Boudec Hynet colloquium series,

Power law and exponential decay

Milan VojnovićMicrosoft Research Cambridge

Collaborators: T. Karagiannis and J.-Y. Le Boudec

Hynet colloquium series, University of Maryland, Mar 07

of inter contact times between mobile devices

Page 2: Power law and exponential decay Milan Vojnović Microsoft Research Cambridge Collaborators: T. Karagiannis and J.-Y. Le Boudec Hynet colloquium series,

Abstract

2

We examine the fundamental properties that determine the basic performance metrics for opportunistic communications. We first consider the distribution of inter-contact times between mobile devices. Using a diverse set of measured mobility traces, we find as an invariant property that there is a characteristic time, order of half a day, beyond which the distribution decays exponentially. Up to this value, the distribution in many cases follows a power law, as shown in recent work. This power law finding was previously used to support the hypothesis that inter-contact time has a power law tail, and that common mobility models are not adequate. However, we observe that the time scale of interest for opportunistic forwarding may be of the same order as the characteristic time, and thus the exponential tail is important. We further show that already simple models such as random walk and random waypoint can exhibit the same dichotomy in the distribution of inter-contact times as in empirical traces. Finally, we perform an extensive analysis of several properties of human mobility patterns across several dimensions, and we present empirical evidence that the return time of a mobile device to its favorite location site may already explain the observed dichotomy. Our findings suggest that existing results on the performance of forwarding schemes based on power-law tails might be overly pessimistic.

Page 3: Power law and exponential decay Milan Vojnović Microsoft Research Cambridge Collaborators: T. Karagiannis and J.-Y. Le Boudec Hynet colloquium series,

Resources

• MSR technical report:

Power law and exponential decay of inter contact times between mobile devices, T. Karagiannis, J.-Y. Le Boudec, M. Vojnović, MSR-TR-2007-24, Mar 07

• Project website:

http://research.microsoft.com/~milanv/albatross.html

3

Page 4: Power law and exponential decay Milan Vojnović Microsoft Research Cambridge Collaborators: T. Karagiannis and J.-Y. Le Boudec Hynet colloquium series,

4

Opportunistic communications

Page 5: Power law and exponential decay Milan Vojnović Microsoft Research Cambridge Collaborators: T. Karagiannis and J.-Y. Le Boudec Hynet colloquium series,

Until 2006

• Various studies of mobile systems under hypothesis: – Distribution of inter-contact time between mobile devices

decays exponentially

• Examples:– Grossglauser and Tse (Infocom 01)– Bansal and Liu (Infocom 03)– El Gamal et al (Infocom 04)– Sharma et al (Infocom 06)

5

Page 6: Power law and exponential decay Milan Vojnović Microsoft Research Cambridge Collaborators: T. Karagiannis and J.-Y. Le Boudec Hynet colloquium series,

But in 2006…• Empirical evidence (Chaintreau et al, Infocom 06):

Distribution of inter-contact time between human carried devices exhibits power-law over a range from minute to half a day

• Suggested hypothesis:

Inter-contact time distribution has power-law tail

In sharp contrast to exponential decay

6

Page 7: Power law and exponential decay Milan Vojnović Microsoft Research Cambridge Collaborators: T. Karagiannis and J.-Y. Le Boudec Hynet colloquium series,

Why does it matter?• Implications on delay of opportunistic packet forwarding

– For sufficiently heavy tail, the expected packet delay infinite for any packet forwarding scheme

7

t

ttF 00 )( 0 ,0 0 tt

1

0)(

t

ttF 00 tt

CCDF = Complementary Cumulative Distribution Function

Chaintreau et al 06 assume a Pareto CCDF of inter-contact time (sampled at contact instant):

If < 1, expected packet forwarding delay infinite for any forwarding scheme

If > 1, CCDF of inter-contact time observed from an arbitrary time instant:

Page 8: Power law and exponential decay Milan Vojnović Microsoft Research Cambridge Collaborators: T. Karagiannis and J.-Y. Le Boudec Hynet colloquium series,

Why does it matter? (cont’d)

• Suggested to revisit current mobility models

– Claim: current mobility models do not feature power-law but exponential tail

8

Page 9: Power law and exponential decay Milan Vojnović Microsoft Research Cambridge Collaborators: T. Karagiannis and J.-Y. Le Boudec Hynet colloquium series,

This slide deck• Empirical evidence of dichotomy in distribution of

inter-contact time– Power-law up to a point (order half a day), exponential decay beyond– In sharp contrast to the power-law tail hypothesis

• Dichotomy supported by (simple) mobility models

• Return time and diversity of viewpoints– Empirical evidence that the dichotomy characterizes return time of a

device to a home location– Diversity of viewpoints

(aggregate vs device pair, time average vs time of day)

9

Page 10: Power law and exponential decay Milan Vojnović Microsoft Research Cambridge Collaborators: T. Karagiannis and J.-Y. Le Boudec Hynet colloquium series,

Outline

• Power-law exponential dichotomy

• Mobility models support the dichotomy

• Return time and diversity of viewpoints

• Conclusion

10

Page 11: Power law and exponential decay Milan Vojnović Microsoft Research Cambridge Collaborators: T. Karagiannis and J.-Y. Le Boudec Hynet colloquium series,

Datasets

11

• All but vehicular dataset are public and were used in earlier studies (see references in technical report)

• Vehicular is a private trace (thanks to Eric Hurwitz and John Krumm, Microsoft Research MSMLS project)

Page 12: Power law and exponential decay Milan Vojnović Microsoft Research Cambridge Collaborators: T. Karagiannis and J.-Y. Le Boudec Hynet colloquium series,

Power law

12

Page 13: Power law and exponential decay Milan Vojnović Microsoft Research Cambridge Collaborators: T. Karagiannis and J.-Y. Le Boudec Hynet colloquium series,

Power law (cont’d)

13

Page 14: Power law and exponential decay Milan Vojnović Microsoft Research Cambridge Collaborators: T. Karagiannis and J.-Y. Le Boudec Hynet colloquium series,

Exponential decay

14

Page 15: Power law and exponential decay Milan Vojnović Microsoft Research Cambridge Collaborators: T. Karagiannis and J.-Y. Le Boudec Hynet colloquium series,

Summary

• Empirical evidence suggest dichotomy in distribution of inter-contact time– Power-law up to a point, exponential decay beyond

15

Page 16: Power law and exponential decay Milan Vojnović Microsoft Research Cambridge Collaborators: T. Karagiannis and J.-Y. Le Boudec Hynet colloquium series,

Outline

• Power-law exponential dichotomy

• Mobility models support the dichotomy

• Return time and diversity of viewpoints

• Conclusion

16

Page 17: Power law and exponential decay Milan Vojnović Microsoft Research Cambridge Collaborators: T. Karagiannis and J.-Y. Le Boudec Hynet colloquium series,

Simple random walk on a circuit0

1m-1

2

01234

Page 18: Power law and exponential decay Milan Vojnović Microsoft Research Cambridge Collaborators: T. Karagiannis and J.-Y. Le Boudec Hynet colloquium series,

Return time to a site0

1m-1

2

012345678

R = 8

Page 19: Power law and exponential decay Milan Vojnović Microsoft Research Cambridge Collaborators: T. Karagiannis and J.-Y. Le Boudec Hynet colloquium series,

Return time to a site of a circuit• Expected return time:

• Power-law for infinite circuit:

• Exponentially decaying tail:

19

nn

nR large ,12

~)(P2/1

0, large ,)(~)(P nennR n

mR )(E

K

kkkkk nbnan

1

)]sin()cos([)( Trigonometric polynomialf(n) ~ g(n) means f(n)/g(n)

goes to 1 as n goes to infty

Page 20: Power law and exponential decay Milan Vojnović Microsoft Research Cambridge Collaborators: T. Karagiannis and J.-Y. Le Boudec Hynet colloquium series,

Proof sketch

• Expected return time

where ri = expected return time to site 0 starting from site i.

Standard analysis yields

20

11)(E rR

1,,1,0 ),( miimiri

Page 21: Power law and exponential decay Milan Vojnović Microsoft Research Cambridge Collaborators: T. Karagiannis and J.-Y. Le Boudec Hynet colloquium series,

Proof sketch (cont’d)• Z-transform

21

)(E)( 0 iXzzf Ri

1)()(0 zfzf m

11 )),()((2

1)( 11 ,m-,izfzfzzf iii

11 ,)11))(,(1()11)(,(

)(22

,m-,iz

zzmazzmazf

i

ii

i

mm

mm

zz

zzzma

)11()11(

)11(),(

22

2

Page 22: Power law and exponential decay Milan Vojnović Microsoft Research Cambridge Collaborators: T. Karagiannis and J.-Y. Le Boudec Hynet colloquium series,

Proof sketch (cont’d)

• For infinite circuit

22

1z0for ,0),( mzma

z

zzf

2

1

11)(

odd

12

1

)1(1)/2(n

1/2)(

n

nzzfn

nn

nR even 2/

2/1)(P

nnπ /

even large 12

~23

(Binomial Theorem)

(Stirling)

Page 23: Power law and exponential decay Milan Vojnović Microsoft Research Cambridge Collaborators: T. Karagiannis and J.-Y. Le Boudec Hynet colloquium series,

Return time for a finite state space Markov chain

• Let Xn be an irreducible Markov chain on a finite state space S.

• Let R be the return time to a strict subset of S.• The stationary distribution of R is such that

where > 0 and (n) is a trigonometric polynomial.

23

nennR n large ,)(~)(P

Proof: spectral analysis (see technical report)

Page 24: Power law and exponential decay Milan Vojnović Microsoft Research Cambridge Collaborators: T. Karagiannis and J.-Y. Le Boudec Hynet colloquium series,

Power law for 1-dim random walk

• Power law holds quite generally for 1-dim random walk

• For any irreducible aperiodic random walk in 1-dim with finite variance2

24

nn

σnR/

large ,12

~)(P21

(Spitzer, 64)

Page 25: Power law and exponential decay Milan Vojnović Microsoft Research Cambridge Collaborators: T. Karagiannis and J.-Y. Le Boudec Hynet colloquium series,

Inter-contact time0

1m-1

2

012345

T = 5

Page 26: Power law and exponential decay Milan Vojnović Microsoft Research Cambridge Collaborators: T. Karagiannis and J.-Y. Le Boudec Hynet colloquium series,

Inter-contact time on a circuit of 20 sites

• Power-law exponential dichotomy

26

Page 27: Power law and exponential decay Milan Vojnović Microsoft Research Cambridge Collaborators: T. Karagiannis and J.-Y. Le Boudec Hynet colloquium series,

Inter-contact time on a circuit of 100 sites

• Power-law exponential dichotomy

27

Page 28: Power law and exponential decay Milan Vojnović Microsoft Research Cambridge Collaborators: T. Karagiannis and J.-Y. Le Boudec Hynet colloquium series,

Inter-contact time on a circuit• Expected inter-contact time:

• Power-law for infinite circuit:

• Exponentially decaying tail:

28

nn

nT large ,12

~)(P2/1

0, large ,)(~)(P nennT n

1)(E mT

Qualitatively same as return time to a site

Page 29: Power law and exponential decay Milan Vojnović Microsoft Research Cambridge Collaborators: T. Karagiannis and J.-Y. Le Boudec Hynet colloquium series,

Proof sketch

29

m0

(-m/2,m/2)

- m

X2 (= location of device 2)

1/4

1/4 1/4

1/4 X1 (= location of device 1)

Hitting set := highlighted sites

Page 30: Power law and exponential decay Milan Vojnović Microsoft Research Cambridge Collaborators: T. Karagiannis and J.-Y. Le Boudec Hynet colloquium series,

Proof sketch (cont’d)• Reduction to simple random walk on a circuit

30

m/20

H

nnVT

1

1

Inter-contact timeNumber of verticals transitions between two successive horizontal transitions

Number of horizontal transitions until hitting

)2/1(Geo~ i.i.d., nn VV

))(E(E)(E 1 HVT zzz

)2/()(E 1 zzzV

)(E Hz = z-transform of return time to site 0 from site 1 on a circuit of m/2 sites

1/4

1/41/41/4

Page 31: Power law and exponential decay Milan Vojnović Microsoft Research Cambridge Collaborators: T. Karagiannis and J.-Y. Le Boudec Hynet colloquium series,

Random waypoint on a chain

0 1 m-12

012345

next waypoint

Page 32: Power law and exponential decay Milan Vojnović Microsoft Research Cambridge Collaborators: T. Karagiannis and J.-Y. Le Boudec Hynet colloquium series,

Random waypoint on a chain (cont’d)

32

Page 33: Power law and exponential decay Milan Vojnović Microsoft Research Cambridge Collaborators: T. Karagiannis and J.-Y. Le Boudec Hynet colloquium series,

Random waypoint on a chain (cont’d)

33

0 200 400 600 800 10000

200

400

600

800

1000

X1

X2

Device 1 location

Dev

ice

2 lo

catio

n

Long inter-contact time

Page 34: Power law and exponential decay Milan Vojnović Microsoft Research Cambridge Collaborators: T. Karagiannis and J.-Y. Le Boudec Hynet colloquium series,

Random waypoint on a chain (cont’d)

• Numerical results suggest distribution of inter-contact time exhibit power-law over a range

• Previous claim on exponential decay limited to special case RWP (Sharma and Mazumdar, 05)– Unit sphere– Fixed trip duration between waypoints

34

Page 35: Power law and exponential decay Milan Vojnović Microsoft Research Cambridge Collaborators: T. Karagiannis and J.-Y. Le Boudec Hynet colloquium series,

Manhattan street network• Does power-law characterize CCDF of

inter-contact time for simple random walk in 2-dim ?

– No

– Return time to a site R of an infinite lattice such that

35

nn

nR large ,)log(

~)(P

1/41/4

1/4

1/4

(Spitzer, 64)

Page 36: Power law and exponential decay Milan Vojnović Microsoft Research Cambridge Collaborators: T. Karagiannis and J.-Y. Le Boudec Hynet colloquium series,

Summary

• Simple random walk on a circuit– Return time of a device to a site and inter-contact

time between two devices feature the same power-law exponential dichotomy

• Random waypoint on a chain– Numerical results suggest power-law over a range

• Simple models can support power law distribution of inter-contact time over a range

36

Page 37: Power law and exponential decay Milan Vojnović Microsoft Research Cambridge Collaborators: T. Karagiannis and J.-Y. Le Boudec Hynet colloquium series,

Outline

• Power-law exponential dichotomy

• Mobility models support the dichotomy

• Return time and diversity of viewpoints

• Conclusion

37

Page 38: Power law and exponential decay Milan Vojnović Microsoft Research Cambridge Collaborators: T. Karagiannis and J.-Y. Le Boudec Hynet colloquium series,

Return time

• Power-law exponential dichotomy38

Page 39: Power law and exponential decay Milan Vojnović Microsoft Research Cambridge Collaborators: T. Karagiannis and J.-Y. Le Boudec Hynet colloquium series,

Devices in contact at a few sites

39

Page 40: Power law and exponential decay Milan Vojnović Microsoft Research Cambridge Collaborators: T. Karagiannis and J.-Y. Le Boudec Hynet colloquium series,

Aggregate inter-contact times• Inter-contact time

CCDF estimated by taking samples of inter-contact times – over an observation

time interval – over all device pairs

• Used in many studied

• Unbiased estimate if inter contacts for distinct device pairs statistically identical

40

Device pair 1 in contact

0

1

Device pair 2 in contact

0

1

Device pair K in contact

0

1

T

Inter-contact time

0

T

T

T

0

Page 41: Power law and exponential decay Milan Vojnović Microsoft Research Cambridge Collaborators: T. Karagiannis and J.-Y. Le Boudec Hynet colloquium series,

Aggregate viewpointstationary ergodic case

Contact instance viewpoint:

41

Pp

pp tFtF )()( 00

CCDF of inter-contact time“aggregate samples”

CCDF of inter-contact time for device pair p

Pp

p Expected number of contacts per unit time for device pair p

Arbitrary time viewpoint:

Pp

p tFP

tF )(||

1)(

CCDF of inter-contact time for device pair p

• Contact and arbitrary time viewpoints related by residual time formula:

t

dssFPtF )(|)|/()( 0

Page 42: Power law and exponential decay Milan Vojnović Microsoft Research Cambridge Collaborators: T. Karagiannis and J.-Y. Le Boudec Hynet colloquium series,

Aggregate viewpoint (cont’d)stationary ergodic case

42

• Aggregate and specific device pair viewpoints, in general, not the same • Same if device inter contacts statistically identical• Contact time viewpoint weighs device pairs

proportional to their rate of contacts• Arbitrary time viewpoint weighs device pairs equally

• What does CCDF of inter-contact times collected over an observation interval and over all device pairs tell me? …

Page 43: Power law and exponential decay Milan Vojnović Microsoft Research Cambridge Collaborators: T. Karagiannis and J.-Y. Le Boudec Hynet colloquium series,

Aggregate viewpoint (cont’d)• Using the CCDF of all pair inter-contact times

sampled at contact instances with residual time formula interpreted as:

– Pick a time t uniformly at random over the observation interval

– Pick a device pair p uniformly at random

– Observe the inter-contact time for pair p from time t

43

Averaging over time and over device pairs

Page 44: Power law and exponential decay Milan Vojnović Microsoft Research Cambridge Collaborators: T. Karagiannis and J.-Y. Le Boudec Hynet colloquium series,

Averaging over time and over device pairs

44

Pp

p tssTP

stF ))((1||

1),(ˆAveraging over device pairs

Averaging over time dsstFT

TtFT

),(ˆ1),(ˆ

0

Relation to aggregate CCDF )(),(ˆ||

)(),(ˆ 0 TedsTsF

TP

TNTtF

t

Time until next inter-contact for device pair p observed at time s

“Error term” due to boundaries of observation interval

Number of contacts over the observation interval over all device pairs

Empirical analogue of residual time formula

Fraction of device pair with residual inter-contact time > t at time s

Page 45: Power law and exponential decay Milan Vojnović Microsoft Research Cambridge Collaborators: T. Karagiannis and J.-Y. Le Boudec Hynet colloquium series,

Averaging over time and over device pairs (cont’d)

45

Relation of aggregate and device-pair CCDF ),(ˆ

)(

1)(),(ˆ 00 TtF

TN

TNTtF p

Pp

p

Pp

p TNTN )()(

1)(

1

0 )(11)(

1),(ˆ

TN

n

pn

pp

p

tTTN

TtF

Number of contacts of device pair p in [0,T]

nth inter-contact time of device pair p

Page 46: Power law and exponential decay Milan Vojnović Microsoft Research Cambridge Collaborators: T. Karagiannis and J.-Y. Le Boudec Hynet colloquium series,

Inter-contact time CCDF (sampled per contact)Aggregate vs per device pair

46

Page 47: Power law and exponential decay Milan Vojnović Microsoft Research Cambridge Collaborators: T. Karagiannis and J.-Y. Le Boudec Hynet colloquium series,

Time of day viewpoints

47

• Strong time-of-day dependence• Time-average viewpoint may deviate significantly from specific time-of-day viewpoint

Page 48: Power law and exponential decay Milan Vojnović Microsoft Research Cambridge Collaborators: T. Karagiannis and J.-Y. Le Boudec Hynet colloquium series,

Time of day viewpoints (cont’d)

• Dichotomy of contact durations (pass-by vs park-by) • Strong time-of-day dependence• Time-average viewpoint may deviate significantly from specific time-of-day viewpoint

48

Page 49: Power law and exponential decay Milan Vojnović Microsoft Research Cambridge Collaborators: T. Karagiannis and J.-Y. Le Boudec Hynet colloquium series,

Summary

• Empirical evidence suggest dichotomy in distribution of return time of a device to its favourite site

• Diversity of viewpoints– Aggregate vs specific device pair– Time average vs specific time of day– Relevant for packet forwarding delay

49

Page 50: Power law and exponential decay Milan Vojnović Microsoft Research Cambridge Collaborators: T. Karagiannis and J.-Y. Le Boudec Hynet colloquium series,

Outline

• Power-law exponential dichotomy

• Mobility models support the dichotomy

• Return time and diversity of viewpoints

• Conclusion

50

Page 51: Power law and exponential decay Milan Vojnović Microsoft Research Cambridge Collaborators: T. Karagiannis and J.-Y. Le Boudec Hynet colloquium series,

Conclusion• The dichotomy hypothesis for distribution of inter-contact time:

power law up to a point, exponential decay beyond– In sharp contrast to proposed power-law tail hypothesis– More optimistic view on delay of packet forwarding schemes

• Simple mobility models exhibit the same dichotomy– In sharp contrast to the claim that current mobility models are

inadequate

• Empirical evidence that return time of a device to its frequently visited site feature the same dichotomy– More elementary metric– Suggests explanation of power-law inter-contact time

• Diversity of viewpoints– Aggregate vs specific device pair– Time-average vs specific time

51

Page 52: Power law and exponential decay Milan Vojnović Microsoft Research Cambridge Collaborators: T. Karagiannis and J.-Y. Le Boudec Hynet colloquium series,

References• F. Spitzer, Principles of Random Walk, Springer, 2nd edt, 1964• M. Grossglauser and D. Tse, Mobility Increases the Capacity of Ad-

hoc Wireless Networks, IEEE Infocom 2001• N. Bansal and Z. Liu, Capacity, Delay and Mobility in Wireless Ad-

hoc Networks, IEEE Infocom 2003• A. El Gamal, J. Mammen, B. Prabhakar, D. Shah, Throughput-delay

Trade-off Wireless Networks, IEEE Infocom 2004• G. Sharma and R. Mazumdar, Delay and Capacity Trade-off in

Wireless Ad Hoc Networks with Random Waypoint Mobility, preprint, https://engineering.purdue.edu/people/gaurav.sharma.3, 2005

• A. Chaintreau, P. Hui, J. Crowcroft, C. Diot, R. Gass, and J. Scott, Impact of Human Mobility on the Design of Opportunistic Forwarding Algorithms, IEEE Infocom 2006

52