Bayesian Component Separation for DESI LAE Automated Spectroscopic Redshifts and Photometric Targeting
Authors:
Ana Sofía M. Uzsoy,
Andrew K. Saydjari,
Arjun Dey,
Anand Raichoor,
Douglas P. Finkbeiner,
Eric Gawiser,
Kyoung-Soo Lee,
Steven Ahlen,
Davide Bianchi,
David Brooks,
Todd Claybaugh,
Andrei Cuceu,
Axel de la Macorra,
Peter Doel,
Andreu Font-Ribera,
Jaime E. Forero-Romero,
Enrique Gaztañaga,
Satya Gontcho A Gontcho,
Gaston Gutierrez,
Mustapha Ishak,
Robert Kehoe,
David Kirkby,
Anthony Kremin,
Martin Landriau,
Laurent Le Guillou
, et al. (15 additional authors not shown)
Abstract:
Lyman Alpha Emitters (LAEs) are valuable high-redshift cosmological probes traditionally identified using specialized narrow-band photometric surveys. In ground-based spectroscopy, it can be difficult to distinguish the sharp LAE peak from residual sky emission lines using automated methods, leading to misclassified redshifts. We present a Bayesian spectral component separation technique to automa…
▽ More
Lyman Alpha Emitters (LAEs) are valuable high-redshift cosmological probes traditionally identified using specialized narrow-band photometric surveys. In ground-based spectroscopy, it can be difficult to distinguish the sharp LAE peak from residual sky emission lines using automated methods, leading to misclassified redshifts. We present a Bayesian spectral component separation technique to automatically determine spectroscopic redshifts for LAEs while marginalizing over sky residuals. We use visually inspected spectra of LAEs obtained using the Dark Energy Spectroscopic Instrument (DESI) to create a data-driven prior and can determine redshift by jointly inferring sky residual, LAE, and residual components for each individual spectrum. We demonstrate this method on 910 spectroscopically observed $z = 2-4$ DESI LAE candidate spectra and determine their redshifts with $>$90% accuracy when validated against visually inspected redshifts. Using the $Δχ^2$ value from our pipeline as a proxy for detection confidence, we then explore potential survey design choices and implications for targeting LAEs with medium-band photometry. This method allows for scalability and accuracy in determining redshifts from DESI spectra, and the results provide recommendations for LAE targeting in anticipation of future high-redshift spectroscopic surveys.
△ Less
Submitted 9 April, 2025;
originally announced April 2025.
Scalable Variational Bayes Inference for Dynamic Variable Selection
Authors:
Nicolas Bianco,
Mauro Bernardi,
Daniele Bianchi
Abstract:
We develop a variational Bayes approach for dynamic variable selection in high-dimensional regression models with time-varying parameters and predictors that exhibit a predefined group structure. Through comprehensive simulation studies, we demonstrate that our method yields more accurate parameter estimates than existing Bayesian static and dynamic variable selection approaches while maintaining…
▽ More
We develop a variational Bayes approach for dynamic variable selection in high-dimensional regression models with time-varying parameters and predictors that exhibit a predefined group structure. Through comprehensive simulation studies, we demonstrate that our method yields more accurate parameter estimates than existing Bayesian static and dynamic variable selection approaches while maintaining computational efficiency. We illustrate the performance of our approach within the context of a popular problem in economics: forecasting inflation based on a large set of macroeconomic predictors. Our approach demonstrates significant improvements in out-of-sample point and density forecasting accuracy. A retrospective analysis of the time-varying parameter estimates reveals economically interpretable patterns in inflation dynamics.
△ Less
Submitted 14 April, 2025; v1 submitted 14 April, 2023;
originally announced April 2023.
Large-Scale Dynamic Predictive Regressions
Authors:
Daniele Bianchi,
Kenichiro McAlinn
Abstract:
We develop a novel "decouple-recouple" dynamic predictive strategy and contribute to the literature on forecasting and economic decision making in a data-rich environment. Under this framework, clusters of predictors generate different latent states in the form of predictive densities that are later synthesized within an implied time-varying latent factor model. As a result, the latent inter-depen…
▽ More
We develop a novel "decouple-recouple" dynamic predictive strategy and contribute to the literature on forecasting and economic decision making in a data-rich environment. Under this framework, clusters of predictors generate different latent states in the form of predictive densities that are later synthesized within an implied time-varying latent factor model. As a result, the latent inter-dependencies across predictive densities and biases are sequentially learned and corrected. Unlike sparse modeling and variable selection procedures, we do not assume a priori that there is a given subset of active predictors, which characterize the predictive density of a quantity of interest. We test our procedure by investigating the predictive content of a large set of financial ratios and macroeconomic variables on both the equity premium across different industries and the inflation rate in the U.S., two contexts of topical interest in finance and macroeconomics. We find that our predictive synthesis framework generates both statistically and economically significant out-of-sample benefits while maintaining interpretability of the forecasting variables. In addition, the main empirical results highlight that our proposed framework outperforms both LASSO-type shrinkage regressions, factor based dimension reduction, sequential variable selection, and equal-weighted linear pooling methodologies.
△ Less
Submitted 18 March, 2018;
originally announced March 2018.
