-
Reducing nuisance prior sensitivity via non-linear reparameterization, with application to EFT analyses of large-scale structure
Authors:
S. Paradiso,
M. Bonici,
M. Chen,
W. J. Percival,
G. D'Amico,
H. Zhang,
G. McGee
Abstract:
Many physical models contain nuisance parameters that quantify unknown properties of an experiment that are not of primary relevance. Typically, these cannot be measured except by fitting the models to the data from the experiment, requiring simultaneous measurement of interesting parameters that are our target of inference and nuisance terms that are not directly of interest. A recent example of…
▽ More
Many physical models contain nuisance parameters that quantify unknown properties of an experiment that are not of primary relevance. Typically, these cannot be measured except by fitting the models to the data from the experiment, requiring simultaneous measurement of interesting parameters that are our target of inference and nuisance terms that are not directly of interest. A recent example of this is fitting Effective Field Theory (EFT) models to large-scale structure (LSS) data to make cosmological inferences. These models have a large number of nuisance parameters that are typically correlated with cosmological parameters in the posterior, leading to strong dependence on the nuisance parameter priors. We introduce a reparametrization method that leverages Generalized Additive Models (GAMs) to decorrelate nuisance parameters from the parameters of interest in the likelihood, even in the presence of non-linear relationships. This reparametrization forms a natural basis within which to define priors that are independent between nuisance and target parameters: the separation means that the marginal posterior for cosmological parameters does not depend on simple priors placed on nuisance terms. In application to EFT models using LSS data, we demonstrate that the proposed approach leads to robust cosmological inference.
△ Less
Submitted 21 May, 2025; v1 submitted 4 December, 2024;
originally announced December 2024.
-
LOO-PIT: A sensitive posterior test
Authors:
Alan B. H. Nguyen,
Marco Bonici,
Glen McGee,
Will J. Percival
Abstract:
With the advent of the next generation of astrophysics experiments, the volume of data available to researchers will be greater than ever. As these projects will significantly drive down statistical uncertainties in measurements, it is crucial to develop novel tools to assess the ability of our models to fit these data within the specified errors. We introduce to astronomy the Leave One Out-Probab…
▽ More
With the advent of the next generation of astrophysics experiments, the volume of data available to researchers will be greater than ever. As these projects will significantly drive down statistical uncertainties in measurements, it is crucial to develop novel tools to assess the ability of our models to fit these data within the specified errors. We introduce to astronomy the Leave One Out-Probability Integral Transform (LOO-PIT) technique. This first estimates the LOO posterior predictive distributions based on the model and likelihood distribution specified, then evaluates the quality of the match between the model and data by applying the PIT to each estimated distribution and data point, outputting a LOO-PIT distribution. Deviations between this output distribution and that expected can be characterised visually and with a standard Kolmogorov--Smirnov distribution test. We compare LOO-PIT and the more common $χ^2$ test using both a simplified model and a more realistic astrophysics problem, where we consider fitting Baryon Acoustic Oscillations in galaxy survey data with contamination from emission line interlopers. LOO-PIT and $χ^2$ tend to find different signals from the contaminants, and using these tests in conjunction increases the statistical power compared to using either test alone. We also show that LOO-PIT outperforms $χ^2$ in certain realistic test cases.
△ Less
Submitted 4 October, 2024;
originally announced October 2024.
-
Evaluating extensions to LCDM: an application of Bayesian model averaging and selection
Authors:
S. Paradiso,
G. McGee,
W. J. Percival
Abstract:
We employ Bayesian Model Averaging (BMA) as a powerful statistical framework to address key cosmological questions about the universe's fundamental properties. We explore extensions beyond the standard $Λ$CDM model, considering a varying curvature density parameter $Ω_{\rm k}$, a spectral index $\mathrm{n}_{\rm s}=1$ and a varying $n_{\rm run}$, a constant dark energy equation of state (EOS)…
▽ More
We employ Bayesian Model Averaging (BMA) as a powerful statistical framework to address key cosmological questions about the universe's fundamental properties. We explore extensions beyond the standard $Λ$CDM model, considering a varying curvature density parameter $Ω_{\rm k}$, a spectral index $\mathrm{n}_{\rm s}=1$ and a varying $n_{\rm run}$, a constant dark energy equation of state (EOS) $w_0$CDM and a time-dependent one $w_0w_a$CDM. We also test cosmological data against a varying effective number of neutrino species $N_{\rm eff}$. Data from different combinations of cosmic microwave background (CMB) data from the last Planck PR4 analysis, CMB lensing from Planck 2018, baryonic acoustic oscillations (BAO) and the Bicep-KECK 2018 results, are used. We find that the standard $Λ$CDM model is favoured when combining CMB data with CMB lensing, BAO and Bicep-KECK 2018 data against $K-Λ$CDM model $N_{\rm eff}-Λ$CDM with a probability $> 80\%$. When investigating the dark energy EOS, we find that this dataset is not able to express a strong preference between the standard $Λ$CDM model and the constant dark energy EOS model $w_0$CDM, with an approximately split model posterior probability of $\approx 60\%:40\%$ in favour of $Λ$CDM, whereas the time-varying dark energy EOS model is ruled out. Finally, we find that the CMB data alone show a strong preference for a model that includes the running of the spectral index $n_{\rm run}$, with a probability $\approx 90\%$, when compared to the $n_{\rm s}=1$ model and the standard $Λ$CDM. Overall, we find that including the model uncertainty in the considered cases does not significantly impact the Hubble tension.
△ Less
Submitted 5 July, 2024; v1 submitted 4 March, 2024;
originally announced March 2024.
-
A convenient approach to characterizing model uncertainty with application to early dark energy solutions of the Hubble tension
Authors:
S. Paradiso,
M. DiMarco,
M. Chen,
G. McGee,
W. J. Percival
Abstract:
Despite increasingly precise observations and sophisticated theoretical models, the discrepancy between measurements of H0 from the cosmic microwave background or from Baryon Acoustic Oscillations combined with Big-Bang Nucleosynthesis versus those from local distance ladder probes -- commonly known as the $H_0$ tension -- continues to perplex the scientific community. To address this tension, Ear…
▽ More
Despite increasingly precise observations and sophisticated theoretical models, the discrepancy between measurements of H0 from the cosmic microwave background or from Baryon Acoustic Oscillations combined with Big-Bang Nucleosynthesis versus those from local distance ladder probes -- commonly known as the $H_0$ tension -- continues to perplex the scientific community. To address this tension, Early Dark Energy (EDE) models have been proposed as alternatives to $Λ$CDM, as they can change the observed sound horizon and the inferred Hubble constant from measurements based on this. In this paper, we investigate the use of Bayesian Model Averaging (BMA) to evaluate EDE as a solution to the H0 tension. BMA consists of assigning a prior to the model and deriving a posterior as for any other unknown parameter in a Bayesian analysis. BMA can be computationally challenging in that one must approximate the joint posterior of both model and parameters. Here we present a computational strategy for BMA that exploits existing MCMC software and combines model-specific posteriors post-hoc. In application to a comprehensive analysis of cosmological datasets, we quantify the impact of EDE on the H0 discrepancy. We find an EDE model probability of $\sim$90% whenever we include the H0 measurement from Type Ia Supernovae in the analysis, whereas the other data show a strong preference for the standard cosmological model. We finally present constraints on common parameters marginalized over both cosmological models. For reasonable priors on models with and without EDE, the H0 tension is reduced by at least 20%.
△ Less
Submitted 8 January, 2024; v1 submitted 10 October, 2023;
originally announced October 2023.
