-
Bayesian Component Separation for DESI LAE Automated Spectroscopic Redshifts and Photometric Targeting
Authors:
Ana Sofía M. Uzsoy,
Andrew K. Saydjari,
Arjun Dey,
Anand Raichoor,
Douglas P. Finkbeiner,
Eric Gawiser,
Kyoung-Soo Lee,
Steven Ahlen,
Davide Bianchi,
David Brooks,
Todd Claybaugh,
Andrei Cuceu,
Axel de la Macorra,
Peter Doel,
Andreu Font-Ribera,
Jaime E. Forero-Romero,
Enrique Gaztañaga,
Satya Gontcho A Gontcho,
Gaston Gutierrez,
Mustapha Ishak,
Robert Kehoe,
David Kirkby,
Anthony Kremin,
Martin Landriau,
Laurent Le Guillou
, et al. (15 additional authors not shown)
Abstract:
Lyman Alpha Emitters (LAEs) are valuable high-redshift cosmological probes traditionally identified using specialized narrow-band photometric surveys. In ground-based spectroscopy, it can be difficult to distinguish the sharp LAE peak from residual sky emission lines using automated methods, leading to misclassified redshifts. We present a Bayesian spectral component separation technique to automa…
▽ More
Lyman Alpha Emitters (LAEs) are valuable high-redshift cosmological probes traditionally identified using specialized narrow-band photometric surveys. In ground-based spectroscopy, it can be difficult to distinguish the sharp LAE peak from residual sky emission lines using automated methods, leading to misclassified redshifts. We present a Bayesian spectral component separation technique to automatically determine spectroscopic redshifts for LAEs while marginalizing over sky residuals. We use visually inspected spectra of LAEs obtained using the Dark Energy Spectroscopic Instrument (DESI) to create a data-driven prior and can determine redshift by jointly inferring sky residual, LAE, and residual components for each individual spectrum. We demonstrate this method on 910 spectroscopically observed $z = 2-4$ DESI LAE candidate spectra and determine their redshifts with $>$90% accuracy when validated against visually inspected redshifts. Using the $Δχ^2$ value from our pipeline as a proxy for detection confidence, we then explore potential survey design choices and implications for targeting LAEs with medium-band photometry. This method allows for scalability and accuracy in determining redshifts from DESI spectra, and the results provide recommendations for LAE targeting in anticipation of future high-redshift spectroscopic surveys.
△ Less
Submitted 9 April, 2025;
originally announced April 2025.
-
Benchmarks for Solar Radiation Time Series Forecasting
Authors:
Cyril Voyant,
Gilles Notton,
Jean-Laurent Duchaud,
Luis Antonio García Gutiérrez,
Jamie M. Bright,
Dazhi Yang
Abstract:
With an ever-increasing share of intermittent renewable energy in the world's energy mix,there is an increasing need for advanced solar power forecasting models to optimize the operation and control of solar power plants. In order to justify the need for more elaborate forecast modeling, one must compare the performance of advanced models with naive reference methods. On this point, a rigorous for…
▽ More
With an ever-increasing share of intermittent renewable energy in the world's energy mix,there is an increasing need for advanced solar power forecasting models to optimize the operation and control of solar power plants. In order to justify the need for more elaborate forecast modeling, one must compare the performance of advanced models with naive reference methods. On this point, a rigorous formalism using statistical tools, variational calculation and quantification of noise in the measurement is studied and five naive reference forecasting methods are considered, among which there is a newly proposed approach called ARTU (a particular autoregressive model of order two). These methods do not require any training phase nor demand any (or almost no) historical data. Additionally, motivated by the well-known benefits of ensemble forecasting, a combination of these models is considered, and then validated using data from multiple sites with diverse climatological characteristics, based on various error metrics, among which some are rarely used in the field of solar energy. The most appropriate benchmarking method depends on the salient features of the variable being forecast (e.g., seasonality, cyclicity, or conditional heteoroscedasity) as well as the forecast horizon. Hence, to ensure a fair benchmarking, forecasters should endeavor to discover the most appropriate naive reference method for their setup by testing all available options. Among the methods proposed in this paper, the combination and ARTU statistically offer the best results for the proposed study conditions.
△ Less
Submitted 18 March, 2022;
originally announced March 2022.
-
A general statistical model for waiting times until collapse of a system
Authors:
Vivianne Olguín-Arias,
Sergio Davis,
Gonzalo Gutiérrez
Abstract:
The distribution of waiting times until the occurrence of a critical event is a crucial statistical problem across several disciplines in Science. In this work we present a statistical model in which a relevant quantity X accumulates until overcoming a threshold X*, which defines the collapse. The obtained waiting time distribution is a mixture of gamma distributions, which in turn can be approxim…
▽ More
The distribution of waiting times until the occurrence of a critical event is a crucial statistical problem across several disciplines in Science. In this work we present a statistical model in which a relevant quantity X accumulates until overcoming a threshold X*, which defines the collapse. The obtained waiting time distribution is a mixture of gamma distributions, which in turn can be approximated as an effective gamma distribution.
△ Less
Submitted 27 December, 2019;
originally announced December 2019.
-
A maximum entropy model for opinions in social groups
Authors:
Sergio Davis,
Yasmín Navarrete,
Gonzalo Gutiérrez
Abstract:
We study how the opinions of a group of individuals determine their spatial distribution and connectivity, through an agent-based model. The interaction between agents is described by a Potts-like Hamiltonian in which agents are allowed to move freely without an underlying lattice (the average network topology connecting them is determined from the parameters). This kind of model was derived using…
▽ More
We study how the opinions of a group of individuals determine their spatial distribution and connectivity, through an agent-based model. The interaction between agents is described by a Potts-like Hamiltonian in which agents are allowed to move freely without an underlying lattice (the average network topology connecting them is determined from the parameters). This kind of model was derived using maximum entropy statistical inference under fixed expectation values of certain probabilities that (we propose) are relevant to social organization. Control parameters emerge as Lagrange multipliers of the maximum entropy problem, and they can be associated with the level of consequence between the personal beliefs and external opinions, and the tendency to socialize with peers of similar or opposing views. These parameters define a phase diagram for the social system, which we studied using Monte Carlo Metropolis simulations. Our model presents both first and second-order phase transitions, depending on the ratio between the internal consequence and the interaction with others. We have found a critical value for the level of internal consequence, below which the personal beliefs of the agents seem to be irrelevant.
△ Less
Submitted 26 February, 2014; v1 submitted 1 October, 2013;
originally announced October 2013.