Marginal Likelihoods from Monte Carlo Markov Chains
Authors:
Alan Heavens,
Yabebal Fantaye,
Arrykrishna Mootoovaloo,
Hans Eggers,
Zafiirah Hosenie,
Steve Kroon,
Elena Sellentin
Abstract:
In this paper, we present a method for computing the marginal likelihood, also known as the model likelihood or Bayesian evidence, from Markov Chain Monte Carlo (MCMC), or other sampled posterior distributions. In order to do this, one needs to be able to estimate the density of points in parameter space, and this can be challenging in high numbers of dimensions. Here we present a Bayesian analysi…
▽ More
In this paper, we present a method for computing the marginal likelihood, also known as the model likelihood or Bayesian evidence, from Markov Chain Monte Carlo (MCMC), or other sampled posterior distributions. In order to do this, one needs to be able to estimate the density of points in parameter space, and this can be challenging in high numbers of dimensions. Here we present a Bayesian analysis, where we obtain the posterior for the marginal likelihood, using $k$th nearest-neighbour distances in parameter space, using the Mahalanobis distance metric, under the assumption that the points in the chain (thinned if required) are independent. We generalise the algorithm to apply to importance-sampled chains, where each point is assigned a weight. We illustrate this with an idealised posterior of known form with an analytic marginal likelihood, and show that for chains of length $\sim 10^5$ points, the technique is effective for parameter spaces with up to $\sim 20$ dimensions. We also argue that $k=1$ is the optimal choice, and discuss failure modes for the algorithm. In a companion paper (Heavens et al. 2017) we apply the technique to the main MCMC chains from the 2015 Planck analysis of cosmic background radiation data, to infer that quantitatively the simplest 6-parameter flat $Λ$CDM standard model of cosmology is preferred over all extensions considered.
△ Less
Submitted 11 April, 2017;
originally announced April 2017.
No evidence for extensions to the standard cosmological model
Authors:
Alan Heavens,
Yabebal Fantaye,
Elena Sellentin,
Hans Eggers,
Zafiirah Hosenie,
Steve Kroon,
Arrykrishna Mootoovaloo
Abstract:
We compute the Bayesian Evidence for models considered in the main analysis of Planck cosmic microwave background data. By utilising carefully-defined nearest-neighbour distances in parameter space, we reuse the Monte Carlo Markov Chains already produced for parameter inference to compute Bayes factors $B$ for many different model-dataset combinations. Standard 6-parameter flat $Λ$CDM model is fav…
▽ More
We compute the Bayesian Evidence for models considered in the main analysis of Planck cosmic microwave background data. By utilising carefully-defined nearest-neighbour distances in parameter space, we reuse the Monte Carlo Markov Chains already produced for parameter inference to compute Bayes factors $B$ for many different model-dataset combinations. Standard 6-parameter flat $Λ$CDM model is favoured over all other models considered, with curvature being mildly favoured only when CMB lensing is not included. Many alternative models are strongly disfavoured by the data, including primordial correlated isocurvature models ($\ln B=-7.8$), non-zero scalar-to-tensor ratio ($\ln B=-4.3$), running of the spectral index ($\ln B = -4.7$), curvature ($\ln B=-3.6$), non-standard numbers of neutrinos ($\ln B=-3.1$), non-standard neutrino masses ($\ln B=-3.2$), non-standard lensing potential ($\ln B=-4.6$), evolving dark energy ($\ln B=-3.2$), sterile neutrinos ($\ln B=-6.9$), and extra sterile neutrinos with a non-zero scalar-to-tensor ratio ($\ln B=-10.8$). Other models are less strongly disfavoured with respect to flat $Λ$CDM. As with all analyses based on Bayesian Evidence, the final numbers depend on the widths of the parameter priors. We adopt the priors used in the Planck analysis, while performing a prior sensitivity analysis. Our quantitative conclusion is that extensions beyond the standard cosmological model are disfavoured by Planck data. Only when newer Hubble constant measurements are included does $Λ$CDM become disfavoured, and only mildly, compared with a dynamical dark energy model ($\ln B\sim +2$).
△ Less
Submitted 9 August, 2017; v1 submitted 11 April, 2017;
originally announced April 2017.