Showing 1–2 of 2 results for author: Ireland, D
-
Data-driven Approach for Interpolation of Sparse Data
Authors:
R. F. Ferguson,
D. G. Ireland,
B. McKinnon
Abstract:
Studies of hadron resonances and their properties are limited by the accuracy and consistency of measured datasets, which can originate from many different experiments. We have used Gaussian Processes (GP) to build interpolated datasets, including quantification of uncertainties, so that data from different sources can be used in model fitting without the need for arbitrary weighting. GPs predict…
▽ More
Studies of hadron resonances and their properties are limited by the accuracy and consistency of measured datasets, which can originate from many different experiments. We have used Gaussian Processes (GP) to build interpolated datasets, including quantification of uncertainties, so that data from different sources can be used in model fitting without the need for arbitrary weighting. GPs predict values and uncertainties of observables at any kinematic point. Bayesian inference is used to optimise the hyperparameters of the GP model. We demonstrate that the GP successfully interpolates data with quantified uncertainties by comparison with generated pseudodata. We also show that this methodology can be used to investigate the consistency of data from different sources. GPs provide a robust, model-independent method for interpolating typical datasets used in hadron resonance studies, removing the limitations of arbitrary weighting in sparse datasets.
△ Less
Submitted 2 May, 2025;
originally announced May 2025.
-
An Investigation of Offline Reinforcement Learning in Factorisable Action Spaces
Authors:
Alex Beeson,
David Ireland,
Giovanni Montana
Abstract:
Expanding reinforcement learning (RL) to offline domains generates promising prospects, particularly in sectors where data collection poses substantial challenges or risks. Pivotal to the success of transferring RL offline is mitigating overestimation bias in value estimates for state-action pairs absent from data. Whilst numerous approaches have been proposed in recent years, these tend to focus…
▽ More
Expanding reinforcement learning (RL) to offline domains generates promising prospects, particularly in sectors where data collection poses substantial challenges or risks. Pivotal to the success of transferring RL offline is mitigating overestimation bias in value estimates for state-action pairs absent from data. Whilst numerous approaches have been proposed in recent years, these tend to focus primarily on continuous or small-scale discrete action spaces. Factorised discrete action spaces, on the other hand, have received relatively little attention, despite many real-world problems naturally having factorisable actions. In this work, we undertake a formative investigation into offline reinforcement learning in factorisable action spaces. Using value-decomposition as formulated in DecQN as a foundation, we present the case for a factorised approach and conduct an extensive empirical evaluation of several offline techniques adapted to the factorised setting. In the absence of established benchmarks, we introduce a suite of our own comprising datasets of varying quality and task complexity. Advocating for reproducible research and innovation, we make all datasets available for public use alongside our code base.
△ Less
Submitted 17 November, 2024;
originally announced November 2024.
