Non-linear bayesian inference of cosmic felds in SDSS3 and...

37
Non-linear bayesian inference of cosmic felds in SDSS3 and 2M++ Guilhem Lavaux (IAP/CNRS) and Aquila Consortium Cosmo21 – Valencia 2018 Aquila consortium (https://aquila-consortium.org )

Transcript of Non-linear bayesian inference of cosmic felds in SDSS3 and...

Page 1: Non-linear bayesian inference of cosmic felds in SDSS3 and ...cosmo21.cosmostat.org/wp-content/uploads/2018/05/talk_Lavaux.pdf · Non-linear bayesian inference of cosmic felds in

Non-linear bayesian inference of cosmic felds in SDSS3 and 2M++

Guilhem Lavaux (IAP/CNRS)and Aquila Consortium

Cosmo21 – Valencia 2018

Aquila consortium (https://aquila-consortium.org)

Page 2: Non-linear bayesian inference of cosmic felds in SDSS3 and ...cosmo21.cosmostat.org/wp-content/uploads/2018/05/talk_Lavaux.pdf · Non-linear bayesian inference of cosmic felds in

OutlineOutline

The statistical framework

The 2M++ compilation(presentation, clusters, velocity felds, applications)

SDSS3 BOSS (more modeling challenges, density feld)

Conclusion

Page 3: Non-linear bayesian inference of cosmic felds in SDSS3 and ...cosmo21.cosmostat.org/wp-content/uploads/2018/05/talk_Lavaux.pdf · Non-linear bayesian inference of cosmic felds in

From theory to observations...From theory to observations...

Model Observations

PerfectComplete descriptionFull knowledge of physicsDid I say perfect ?

Great but messyWe do not understand the physicsSystematics not fully knownGood attempt by observers to seemingly make our life easier end up bad

Various hacking to make sense of data

Page 4: Non-linear bayesian inference of cosmic felds in SDSS3 and ...cosmo21.cosmostat.org/wp-content/uploads/2018/05/talk_Lavaux.pdf · Non-linear bayesian inference of cosmic felds in

From theory to observations...From theory to observations...

Model Observations

PerfectComplete descriptionFull knowledge of physicsDid I say perfect ?

Great but messyWe do not understand the physicsSystematics not fully knownGood attempt by observers to seemingly make our life easier end up bad

BORG3

Still far too perfect though… (see later)

Another perspective to automatically solve this problem: see Tom Charnock’s talk

Page 5: Non-linear bayesian inference of cosmic felds in SDSS3 and ...cosmo21.cosmostat.org/wp-content/uploads/2018/05/talk_Lavaux.pdf · Non-linear bayesian inference of cosmic felds in

The BORG3 inference frameworkThe BORG3 inference framework

Initial conditions

Jasche et al. (2010), Jasche & Wandelt (2013), Lavaux & Jasche (2016), Jasche & Lavaux (2017, 2018)

Page 6: Non-linear bayesian inference of cosmic felds in SDSS3 and ...cosmo21.cosmostat.org/wp-content/uploads/2018/05/talk_Lavaux.pdf · Non-linear bayesian inference of cosmic felds in

The BORG3 inference frameworkThe BORG3 inference framework

Total evolved matter density

Initial conditions

Jasche et al. (2010), Jasche & Wandelt (2013), Lavaux & Jasche (2016), Jasche & Lavaux (2017, 2018)

Page 7: Non-linear bayesian inference of cosmic felds in SDSS3 and ...cosmo21.cosmostat.org/wp-content/uploads/2018/05/talk_Lavaux.pdf · Non-linear bayesian inference of cosmic felds in

The BORG3 inference frameworkThe BORG3 inference framework

Total evolved matter density

Biased galaxy distribution

Selected/contaminated sample

Random extraction

Initial conditions

(Poisson, Negative binomial, ...)

Jasche et al. (2010), Jasche & Wandelt (2013), Lavaux & Jasche (2016), Jasche & Lavaux (2017, 2018)

Page 8: Non-linear bayesian inference of cosmic felds in SDSS3 and ...cosmo21.cosmostat.org/wp-content/uploads/2018/05/talk_Lavaux.pdf · Non-linear bayesian inference of cosmic felds in

The BORG3 inference frameworkThe BORG3 inference framework

Total evolved matter density

Biased galaxy distribution

Selected/contaminated sample

Random extraction

Initial conditions

(Poisson, Negative binomial, ...)

Jasche et al. (2010), Jasche & Wandelt (2013), Lavaux & Jasche (2016), Jasche & Lavaux (2017, 2018)

Forward and adjoint model

Page 9: Non-linear bayesian inference of cosmic felds in SDSS3 and ...cosmo21.cosmostat.org/wp-content/uploads/2018/05/talk_Lavaux.pdf · Non-linear bayesian inference of cosmic felds in

The BORG3 inference frameworkThe BORG3 inference framework

Total evolved matter density

Biased galaxy distribution

Selected/contaminated sample

Random extraction

Initial conditions

(Poisson, Negative binomial, ...)

Easily exchangeable to try your favorite differentiable model

Easily exchangeable to try your favorite differentiable model

Jasche et al. (2010), Jasche & Wandelt (2013), Lavaux & Jasche (2016), Jasche & Lavaux (2017, 2018)

Page 10: Non-linear bayesian inference of cosmic felds in SDSS3 and ...cosmo21.cosmostat.org/wp-content/uploads/2018/05/talk_Lavaux.pdf · Non-linear bayesian inference of cosmic felds in

The BORG3 inference frameworkThe BORG3 inference framework

Total evolved matter density

Biased galaxy distribution

Selected/contaminated sample

Random extraction

Initial conditions

(Poisson, Negative binomial, ...)

Encode survey systematic effects with expansions:Encode survey systematic effects with expansions:

Jasche et al. (2010), Jasche & Wandelt (2013), Lavaux & Jasche (2016), Jasche & Lavaux (2017, 2018)

Page 11: Non-linear bayesian inference of cosmic felds in SDSS3 and ...cosmo21.cosmostat.org/wp-content/uploads/2018/05/talk_Lavaux.pdf · Non-linear bayesian inference of cosmic felds in

Application to 2M++ galaxy compilation:Detailed dynamical modeling

Page 12: Non-linear bayesian inference of cosmic felds in SDSS3 and ...cosmo21.cosmostat.org/wp-content/uploads/2018/05/talk_Lavaux.pdf · Non-linear bayesian inference of cosmic felds in

The 2M++ galaxy compilationThe 2M++ galaxy compilation0 Mpc/h

Galaxy distributionSDSS

6dF

2MRS

250 Mpc/hRedshift completeness

Lavaux & Hudson (MNRAS, 2011)~70 000 galaxies

Page 13: Non-linear bayesian inference of cosmic felds in SDSS3 and ...cosmo21.cosmostat.org/wp-content/uploads/2018/05/talk_Lavaux.pdf · Non-linear bayesian inference of cosmic felds in

Inferred density fieldsInferred density fields

Void

Mean

Clusters

Higher error

Ensemble average density fields at z=0

Jasche & Lavaux (2018, in prep.)

Page 14: Non-linear bayesian inference of cosmic felds in SDSS3 and ...cosmo21.cosmostat.org/wp-content/uploads/2018/05/talk_Lavaux.pdf · Non-linear bayesian inference of cosmic felds in

Performance aspect (2): burninPerformance aspect (2): burnin

Jasche & Lavaux (2018, in prep.)

Page 15: Non-linear bayesian inference of cosmic felds in SDSS3 and ...cosmo21.cosmostat.org/wp-content/uploads/2018/05/talk_Lavaux.pdf · Non-linear bayesian inference of cosmic felds in

Initial condition powerspectrumInitial condition powerspectrumInitial conditions

Post PM simulation

Jasche & Lavaux (2018, in prep.)

Page 16: Non-linear bayesian inference of cosmic felds in SDSS3 and ...cosmo21.cosmostat.org/wp-content/uploads/2018/05/talk_Lavaux.pdf · Non-linear bayesian inference of cosmic felds in

Virgo clusterVirgo cluster

Virgo center

~30 Mpc/h

Jasche & Lavaux; Lavaux & Jasche; Peirani, Lavaux & Jasche (2018, in prep.)

Page 17: Non-linear bayesian inference of cosmic felds in SDSS3 and ...cosmo21.cosmostat.org/wp-content/uploads/2018/05/talk_Lavaux.pdf · Non-linear bayesian inference of cosmic felds in

Coma dynamical propertiesComa dynamical properties

Jasche & Lavaux; Lavaux & Jasche; Peirani, Lavaux & Jasche (2018, in prep.)

Coma center

Page 18: Non-linear bayesian inference of cosmic felds in SDSS3 and ...cosmo21.cosmostat.org/wp-content/uploads/2018/05/talk_Lavaux.pdf · Non-linear bayesian inference of cosmic felds in

Coma dynamical propertiesComa dynamical properties

Jasche & Lavaux; Lavaux & Jasche; Peirani, Lavaux & Jasche (2018, in prep.)

Zoom simulation on Coma (~250 Mpart in zoom)

Page 19: Non-linear bayesian inference of cosmic felds in SDSS3 and ...cosmo21.cosmostat.org/wp-content/uploads/2018/05/talk_Lavaux.pdf · Non-linear bayesian inference of cosmic felds in

Shapley concentrationShapley concentration

Lavaux & Jasche (2018, in prep.)

~60 Mpc/h

Shapley center

Single realisation density

Page 20: Non-linear bayesian inference of cosmic felds in SDSS3 and ...cosmo21.cosmostat.org/wp-content/uploads/2018/05/talk_Lavaux.pdf · Non-linear bayesian inference of cosmic felds in

Shapley concentrationShapley concentration

Lavaux & Jasche (2018, in prep.)

~60 Mpc/h

Shapley center

Ensemble average density

Page 21: Non-linear bayesian inference of cosmic felds in SDSS3 and ...cosmo21.cosmostat.org/wp-content/uploads/2018/05/talk_Lavaux.pdf · Non-linear bayesian inference of cosmic felds in

Inferred velocity fieldsInferred velocity fieldsH

igher error

0 km/s

800 km/s

Infall

Outfall

-400 km/s

+400 km/s

Jasche & Lavaux (2018, in prep.)

Page 22: Non-linear bayesian inference of cosmic felds in SDSS3 and ...cosmo21.cosmostat.org/wp-content/uploads/2018/05/talk_Lavaux.pdf · Non-linear bayesian inference of cosmic felds in

Velocity field and Hubble constant Velocity field and Hubble constant

Mean error on Hubble measurement using tracers from observed large scale structures

Jasche & Lavaux (2018, in prep.), Lavaux & Jasche (2018, in prep.)

TODO: Compare all the flow models

Page 23: Non-linear bayesian inference of cosmic felds in SDSS3 and ...cosmo21.cosmostat.org/wp-content/uploads/2018/05/talk_Lavaux.pdf · Non-linear bayesian inference of cosmic felds in

Application to Sloan Digital Sky Survey III:Deep cosmological application

Page 24: Non-linear bayesian inference of cosmic felds in SDSS3 and ...cosmo21.cosmostat.org/wp-content/uploads/2018/05/talk_Lavaux.pdf · Non-linear bayesian inference of cosmic felds in

SDSS3 dataSDSS3 data

Panstarrs

SDSS

SDSS DR12 galaxy sample

~1.6 millions of galaxies

Page 25: Non-linear bayesian inference of cosmic felds in SDSS3 and ...cosmo21.cosmostat.org/wp-content/uploads/2018/05/talk_Lavaux.pdf · Non-linear bayesian inference of cosmic felds in

Forward model becomes more complexForward model becomes more complexCosmic expansion

(see Doogesh’ poster)

Non-linear density remapping:

Cosmic growth of structures

Implemented so far for (2)LPT:

Kodi Ramanah, Lavaux, Jasche, Wandelt (2018, in prep.)

Page 26: Non-linear bayesian inference of cosmic felds in SDSS3 and ...cosmo21.cosmostat.org/wp-content/uploads/2018/05/talk_Lavaux.pdf · Non-linear bayesian inference of cosmic felds in

Forward model becomes more complexForward model becomes more complexCosmic expansion

(see Doogesh’ poster)

Lookback time

Kodi Ramanah, Lavaux, Jasche, Wandelt (2018, in prep.)

Page 27: Non-linear bayesian inference of cosmic felds in SDSS3 and ...cosmo21.cosmostat.org/wp-content/uploads/2018/05/talk_Lavaux.pdf · Non-linear bayesian inference of cosmic felds in

Forward model becomes more complexForward model becomes more complexCosmic expansion

(see Doogesh’ poster)

Lookback time

Kodi Ramanah, Lavaux, Jasche, Wandelt (2018, in prep.)

Page 28: Non-linear bayesian inference of cosmic felds in SDSS3 and ...cosmo21.cosmostat.org/wp-content/uploads/2018/05/talk_Lavaux.pdf · Non-linear bayesian inference of cosmic felds in

Forward model becomes more complexForward model becomes more complexCosmic growth of structures

Time

Cosmic expansion

(see Doogesh’ poster)

Lookback time

Kodi Ramanah, Lavaux, Jasche, Wandelt (2018, in prep.)

Page 29: Non-linear bayesian inference of cosmic felds in SDSS3 and ...cosmo21.cosmostat.org/wp-content/uploads/2018/05/talk_Lavaux.pdf · Non-linear bayesian inference of cosmic felds in

… … and systematic cleaning…and systematic cleaning…11 foregrounds (here only 8)… still much less than Leistedt & Peiris (2014) but improving

0

Star densities

Sky fluxes

DUST

psfWidth

...

...

Page 30: Non-linear bayesian inference of cosmic felds in SDSS3 and ...cosmo21.cosmostat.org/wp-content/uploads/2018/05/talk_Lavaux.pdf · Non-linear bayesian inference of cosmic felds in

Example fitted composite...Example fitted composite...11 foregrounds (here only 8)… still much less than Leistedt & Peiris (2014) but improving

0

Star densities

Sky fluxes

DUST

psfWidth

...

...Preliminary

Page 31: Non-linear bayesian inference of cosmic felds in SDSS3 and ...cosmo21.cosmostat.org/wp-content/uploads/2018/05/talk_Lavaux.pdf · Non-linear bayesian inference of cosmic felds in

Inferred density of SDSS3Inferred density of SDSS3

Ensemble density average Error estimate from ensemble variance

Main galaxy sample limit(not included)

LOWZ limit

CMASS limit

NGC

SGC

Preliminary

Page 32: Non-linear bayesian inference of cosmic felds in SDSS3 and ...cosmo21.cosmostat.org/wp-content/uploads/2018/05/talk_Lavaux.pdf · Non-linear bayesian inference of cosmic felds in

Sky densitySky density

Preliminary

Page 33: Non-linear bayesian inference of cosmic felds in SDSS3 and ...cosmo21.cosmostat.org/wp-content/uploads/2018/05/talk_Lavaux.pdf · Non-linear bayesian inference of cosmic felds in

Conclusion

Page 34: Non-linear bayesian inference of cosmic felds in SDSS3 and ...cosmo21.cosmostat.org/wp-content/uploads/2018/05/talk_Lavaux.pdf · Non-linear bayesian inference of cosmic felds in

The Aquila consortiumThe Aquila consortium

https://aquila-consortium.org/

● Founded in 2016● Gather people interested in working with each other on developing the Bayesian pipelines

and run analysis on data.

Page 35: Non-linear bayesian inference of cosmic felds in SDSS3 and ...cosmo21.cosmostat.org/wp-content/uploads/2018/05/talk_Lavaux.pdf · Non-linear bayesian inference of cosmic felds in

The Aquila consortiumThe Aquila consortium

https://aquila-consortium.org/

● Founded in 2016● Gather people interested in working with each other on developing the Bayesian pipelines

and run analysis on data.

Natalia Porqueres Minh Nguyen

A biased list of Aquilians… check the website!

Tom Charnock Florent Leclercq

Doogesh Kodi Ramanah

Page 36: Non-linear bayesian inference of cosmic felds in SDSS3 and ...cosmo21.cosmostat.org/wp-content/uploads/2018/05/talk_Lavaux.pdf · Non-linear bayesian inference of cosmic felds in

Conclusion: great futureConclusion: great future

2M++2M++ SDSSSDSS CosmicFlowsCosmicFlows LSST?LSST?

BORG3+BORG3+

Predictive cosmologyPredictive cosmology Cosmological measurementCosmological measurement

● Velocity field (also VIRBIUS with F. Fuhrer)● X-ray cluster emission● Kinetic Sunyaev Zel’dovich● Rees-Sciama● Dark matter ?

● Cosmic expansion (see Doogesh’s talk)● Power spectrum (and governing parameters)● Gaussianity tests of initial conditions● Direct probe of dynamics

Page 37: Non-linear bayesian inference of cosmic felds in SDSS3 and ...cosmo21.cosmostat.org/wp-content/uploads/2018/05/talk_Lavaux.pdf · Non-linear bayesian inference of cosmic felds in

● Cosmic expansion (see Doogesh’s talk)● Power spectrum (and governing parameters)● Gaussianity tests of initial conditions● Direct probe of dynamics

Conclusion: great future Conclusion: great future and challengesand challenges

2M++2M++ SDSSSDSS CosmicFlowsCosmicFlows LSST?LSST?

BORG3+BORG3+

Predictive cosmologyPredictive cosmology Cosmological measurementCosmological measurement

● Velocity field (also VIRBIUS with F. Fuhrer)● X-ray cluster emission● Kinetic Sunyaev Zel’dovich● Rees-Sciama● Dark matter ?

Galaxy formation: bias and likelihood

Instrument modeling

Galaxy formation: bias and likelihood

Instrument modeling