Community Structure in “Mulslice ” Networks

35
P. J. Mucha, T. Richardson, Kevin Macon, M. A. Porter, & J.‐P. Onnela, arXiv:0911.1824 (and an addi=onal paper in 2010 Nonlinear Science Gallery, to appear in Chaos) Community Structure in “Mul1slice” Networks (Community Structure in Time‐Dependent, Mul=scale, and Mul=plex Networks) Mason A. Porter Mathema=cal Ins=tute, University of Oxford

Transcript of Community Structure in “Mulslice ” Networks

Page 1: Community Structure in “Mulslice ” Networks

P.J.Mucha,T.Richardson,KevinMacon,M.A.Porter,&J.‐P.Onnela,arXiv:0911.1824(andanaddi=onalpaperin2010NonlinearScienceGallery,toappearinChaos)

CommunityStructurein“Mul1slice”Networks

(CommunityStructureinTime‐Dependent,Mul=scale,andMul=plexNetworks)

MasonA.PorterMathema=calIns=tute,UniversityofOxford

Page 2: Community Structure in “Mulslice ” Networks

Goal•  Extendquality‐op=miza=onmethodsofcommunitydetec=ontonetworkswiththefollowingfeatures:– Mul6scale:Considermul=pleresolu=onparametersatonce(withoutsweeping)

– Time‐Dependent:Nodesandedgescanchangein=me

– Mul6plex:Mul=pletypesofedges

Page 3: Community Structure in “Mulslice ” Networks

Outline•  Background:Communitystructureandcommunitydetec=on

• Mul=slicenetworks

•  Examples•  Conclusions

Page 4: Community Structure in “Mulslice ” Networks

CommunityStructurebyhand?:BaseballSteroidsNetworks

Page 5: Community Structure in “Mulslice ” Networks

ImagesfromA.Clauset,C.Moore,&M.E.J.Newman(Nature,2008)

Iden=fyingCommuni=esAlgorithmically

Page 6: Community Structure in “Mulslice ” Networks

“Thiswouldn’tbeacommunitydetec=ontalkwithouttheZacharyKarateClub.”

Thispar==onop=mizesmodularity,whichmeasuresthenumberofintra‐community=es(rela=vetorandomness)

Page 7: Community Structure in “Mulslice ” Networks

“NetworkScience”Coauthorship

Page 8: Community Structure in “Mulslice ” Networks

FacebookFriendshipNetworks

A.L.Traud,E.D.Kelsic,P.J.Mucha,&M.A.Porter,arXiv:0809.0960

Page 9: Community Structure in “Mulslice ” Networks

CongressionalCommi_ees(MAP,PJM,M.E.J.Newman,C.M.Warmbrand,&A.J.Friend)

Page 10: Community Structure in “Mulslice ” Networks

Preliminaries•  “Hard/rigid”versus“soc/fuzzy/overlapping”clustering

•  Acommunityshoulddescribea“cohesivegroup”ofnodes–  Tonsofalgorithmsavailable

•  Unifyingno=on:moreintra‐communityedgesthanonewouldexpectatrandom–  Butwhatdoes“atrandom”mean?

•  Reviewar=cles–  “Communi=esinNetworks,”M.A.Porter,J.‐P.Onnela&P.J.Mucha,No6cesoftheAmericanMathema6calSociety56,1082‐97&1164‐6(2009).

–  “CommunityDetec=oninGraphs,”S.Fortunato,PhysicsReports486,75‐174(2010).

Page 11: Community Structure in “Mulslice ” Networks

Quality/Modularity

•  Popularapproach:Usea“modularity”qualityfunc=on

•  GOAL:Assignnodestocommuni=estomaximizemodularity.

Page 12: Community Structure in “Mulslice ” Networks

CommunityDetec=on:NullModels

•  Erdös‐Rényi(Bernoulli) •  Newman‐Girvan*

•  Leicht‐Newman*(directed) •  Barber*(bipar=te)

*withresolu6onparametersγ

Page 13: Community Structure in “Mulslice ” Networks

CommunityDetec=on:Computa=onalHeuris=cs

•  Cannotguaranteeop=malqualitywithoutfullenumera=onofpossiblepar==ons– NP‐completeproblem– Manyalgorithmsavailable(simulatedannealing,etc.)– Needtopicknullmodelappropriatetoproblem–  Extremedegeneraciesingoodlocalop=maofQ

•  (B.H.Good,Y.‐A.deMontjoye,&A.Clauset,toappearinPRE;seeAaron’stalkonWednesday)

Page 14: Community Structure in “Mulslice ” Networks

Mul1sliceNetworks

•  Typicalformula=onforstudyingnetworks:Sta=cnetworks,withasinglekindof=e,par==onedatasinglespa=alresolu=on–  Alsopoten=allysweepovermul=pleresolu=ons(oroccasionally

mul=ple=mes)butinanadhocfashion•  Mul=sliceframework:dynamic,mul=plex,andwith

communi=esatmul=plescales•  Simpleidea:Gluecommonindividualsacross“slices”

Page 15: Community Structure in “Mulslice ” Networks

Whatistheappropriatenullmodel?

•  Eachsliceisanetwork(sta=c,singletype)withaspecifiedspa=alresolu=onofinterest

•  Differentslicescanmean:differentvalueofresolu=onparameter,different=mesnapshot,differenttypeofconnec=on

•  Havebothintra‐sliceedges&inter‐sliceedges•  Howtochooseanullmodel?

Page 16: Community Structure in “Mulslice ” Networks

QualityofPar==onvia“Stability”

•  Idea:useadynamicalprocessonanetworktolearnaboutnetworkstructure–  WebuildonworkofR.Lambio_e,J.‐C.Delvenne,&M.

Barahona[arXiv:0812.1770]•  Qualityofanetworkpar==onexpressedintermsofits

“stability”(autocovariancefunc=onofanergodicMarkovprocessonthenetwork):

–  P(C,t)=probability,foragivencommunityC,forarandomwalkertobeinthatcommunitybothini=allyandat=met

•  Stabilitymeasuresthequalityofapar==onintermsofthepersistenceofthedynamicsbygivingaposi=vecontribu=ontocommuni=esfromwhicharandomwalkerisunlikelytoescapewithagiven=met

Page 17: Community Structure in “Mulslice ” Networks

LaplacianDynamics(i.e.,randomwalks)

•  Lambio_e,Delvenne,&Barahona[arXiv:0812.1770]derivedmodularityfromnormalizedLaplaciandynamics

Expansionofmatrixexponen=altofirst‐orderintrecoversNewman‐Girvanmodularitywithresolu=onγ=1/t.

Ques6on:Howdoweapplythisideatomul6slicenetworks?

Page 18: Community Structure in “Mulslice ” Networks

GeneralizedLaplacianDynamics

a)  Calculate(tofirstorderint)theprobabilityofobservinga=ebetweennodesiandj,condi6onalonthetypeofconnec6onnecessarytomoveji

b)  Generalizedynamicstoincludemo=onalongdifferenttypesofedges

c)  Differentspreadingweightsondifferenttypesofedges

Page 19: Community Structure in “Mulslice ” Networks

Mul=sliceNetworks

Page 20: Community Structure in “Mulslice ” Networks

SpecialCase:Bipar=teNetworks

•  RecoverBarbernullmodelwithresolu=onparameter:

Page 21: Community Structure in “Mulslice ” Networks

SpecialCase:DirectedNetworks

•  RecoverLeicht‐Newmannullmodelwitharesolu=onparameter:

Page 22: Community Structure in “Mulslice ” Networks

SpecialCase:SignedNetworks

•  RecovernullmodelsofTraagetal.&Gomezetal.:

Page 23: Community Structure in “Mulslice ” Networks

Examples•  (Revengeofthe)ZacharyKarateClub– Mul=pleresolu=onparametervaluesatonce(“mul=scale”)

•  Tastes,Ties,&Time– Mul=plex(mul=pleedgetypes)

•  200yearsofrollcallvotesinU.S.Senate– Time‐dependent

Page 24: Community Structure in “Mulslice ” Networks

ZacharyKarateClub

Page 25: Community Structure in “Mulslice ” Networks

Tastes,Ties,&Time

•  DatafromLewisetal.2008•  “not‐Harvarddataset”

•  Firstwaveofprivatenortheasternschool

•  Edgetypes:•  Facebookfriends

•  Picturefriends

•  Roommates

•  HousingGroups

Page 26: Community Structure in “Mulslice ” Networks

RollCallVo=ngNetworks

•  A.S.Waugh,L.Pei,J.H.Fowler,P.J.Mucha,&M.A.Porter,arXiv:0907.3509(withoutmul=sliceformula=on)

•  Modularityasameasureofpolariza=on•  Modularityasapredictorofmajorityturnover(the“par=al

polariza=onhypothesis”)•  Onenetworksliceforeachtwo‐yearCongress

Page 27: Community Structure in “Mulslice ” Networks

110Senates(220years)

Page 28: Community Structure in “Mulslice ” Networks

110Senates

Grayareas:3communi=esexistatthesame=me(9communi=esintotal;ω=0.5)

Page 29: Community Structure in “Mulslice ” Networks

Arrangedbystate…

Page 30: Community Structure in “Mulslice ” Networks
Page 31: Community Structure in “Mulslice ” Networks
Page 32: Community Structure in “Mulslice ” Networks
Page 33: Community Structure in “Mulslice ” Networks
Page 34: Community Structure in “Mulslice ” Networks

Conclusions•  “Mul=slice”frameworkgeneralizestheinves=ga=onofcommmunitystructuretomorecomplicated,morerealis=c,andmuchmoreinteres=ngsitua=ons:dynamic/longitudinaldata,mul.plex=es,andcommuni=esacrossmul.plescales.

•  Visualiza=ontoolsforgraphsthatincorporatecommunitystructure:h_p://netwiki.amath.unc.edu/VisComms/VisComms

•  Currentefforts:Applymul=slicecommunitydetec=ontoepidemics,poli=cians,andbrains–  Otherideas:newnullmodels,choiceofinter‐slicecoupling,

generaliza=onsofclusteringcoefficientsandotherquan==estomul=slicenetworks,…

Page 35: Community Structure in “Mulslice ” Networks

BinaryTrees