-
Learning to Reconstruct Quirky Tracks
Authors:
Qiyu Sha,
Daniel Murnane,
Max Fieg,
Shelley Tong,
Mark Zakharyan,
Yaquan Fang,
Daniel Whiteson
Abstract:
Analysis of data from particle physics experiments traditionally sacrifices some sensitivity to new particles for the sake of practical computability, effectively ignoring some potentially striking signatures. However, recent advances in ML-based tracking allow for new inroads into previously inaccessible territory, such as reconstruction of tracks which do not follow helical trajectories. This pa…
▽ More
Analysis of data from particle physics experiments traditionally sacrifices some sensitivity to new particles for the sake of practical computability, effectively ignoring some potentially striking signatures. However, recent advances in ML-based tracking allow for new inroads into previously inaccessible territory, such as reconstruction of tracks which do not follow helical trajectories. This paper presents a demonstration of the capacity of ML-based tracking to reconstruct the oscillating trajectories of quirks. The technique used is not specific to quirks, and opens the door to a program of searching for many kinds of non-standard tracks.
△ Less
Submitted 30 September, 2024;
originally announced October 2024.
-
A Language Model for Particle Tracking
Authors:
Andris Huang,
Yash Melkani,
Paolo Calafiura,
Alina Lazar,
Daniel Thomas Murnane,
Minh-Tuan Pham,
Xiangyang Ju
Abstract:
Particle tracking is crucial for almost all physics analysis programs at the Large Hadron Collider. Deep learning models are pervasively used in particle tracking related tasks. However, the current practice is to design and train one deep learning model for one task with supervised learning techniques. The trained models work well for tasks they are trained on but show no or little generalization…
▽ More
Particle tracking is crucial for almost all physics analysis programs at the Large Hadron Collider. Deep learning models are pervasively used in particle tracking related tasks. However, the current practice is to design and train one deep learning model for one task with supervised learning techniques. The trained models work well for tasks they are trained on but show no or little generalization capabilities. We propose to unify these models with a language model. In this paper, we present a tokenized detector representation that allows us to train a BERT model for particle tracking. The trained BERT model, namely TrackingBERT, offers latent detector module embedding that can be used for other tasks. This work represents the first step towards developing a foundational model for particle detector understanding.
△ Less
Submitted 14 February, 2024;
originally announced February 2024.
-
Graph Structure from Point Clouds: Geometric Attention is All You Need
Authors:
Daniel Murnane
Abstract:
The use of graph neural networks has produced significant advances in point cloud problems, such as those found in high energy physics. The question of how to produce a graph structure in these problems is usually treated as a matter of heuristics, employing fully connected graphs or K-nearest neighbors. In this work, we elevate this question to utmost importance as the Topology Problem. We propos…
▽ More
The use of graph neural networks has produced significant advances in point cloud problems, such as those found in high energy physics. The question of how to produce a graph structure in these problems is usually treated as a matter of heuristics, employing fully connected graphs or K-nearest neighbors. In this work, we elevate this question to utmost importance as the Topology Problem. We propose an attention mechanism that allows a graph to be constructed in a learned space that handles geometrically the flow of relevance, providing one solution to the Topology Problem. We test this architecture, called GravNetNorm, on the task of top jet tagging, and show that it is competitive in tagging accuracy, and uses far fewer computational resources than all other comparable models.
△ Less
Submitted 31 July, 2023;
originally announced July 2023.
-
Heterogeneous Graph Neural Network for Identifying Hadronically Decayed Tau Leptons at the High Luminosity LHC
Authors:
Andris Huang,
Xiangyang Ju,
Jacob Lyons,
Daniel Murnane,
Mariel Pettee,
Landon Reed
Abstract:
We present a new algorithm that identifies reconstructed jets originating from hadronic decays of tau leptons against those from quarks or gluons. No tau lepton reconstruction algorithm is used. Instead, the algorithm represents jets as heterogeneous graphs with tracks and energy clusters as nodes and trains a Graph Neural Network to identify tau jets from other jets. Different attributed graph re…
▽ More
We present a new algorithm that identifies reconstructed jets originating from hadronic decays of tau leptons against those from quarks or gluons. No tau lepton reconstruction algorithm is used. Instead, the algorithm represents jets as heterogeneous graphs with tracks and energy clusters as nodes and trains a Graph Neural Network to identify tau jets from other jets. Different attributed graph representations and different GNN architectures are explored. We propose to use differential track and energy cluster information as node features and a heterogeneous sequentially-biased encoding for the inputs to final graph-level classification.
△ Less
Submitted 27 June, 2023; v1 submitted 1 January, 2023;
originally announced January 2023.
-
Graph Neural Networks in Particle Physics: Implementations, Innovations, and Challenges
Authors:
Savannah Thais,
Paolo Calafiura,
Grigorios Chachamis,
Gage DeZoort,
Javier Duarte,
Sanmay Ganguly,
Michael Kagan,
Daniel Murnane,
Mark S. Neubauer,
Kazuhiro Terao
Abstract:
Many physical systems can be best understood as sets of discrete data with associated relationships. Where previously these sets of data have been formulated as series or image data to match the available machine learning architectures, with the advent of graph neural networks (GNNs), these systems can be learned natively as graphs. This allows a wide variety of high- and low-level physical featur…
▽ More
Many physical systems can be best understood as sets of discrete data with associated relationships. Where previously these sets of data have been formulated as series or image data to match the available machine learning architectures, with the advent of graph neural networks (GNNs), these systems can be learned natively as graphs. This allows a wide variety of high- and low-level physical features to be attached to measurements and, by the same token, a wide variety of HEP tasks to be accomplished by the same GNN architectures. GNNs have found powerful use-cases in reconstruction, tagging, generation and end-to-end analysis. With the wide-spread adoption of GNNs in industry, the HEP community is well-placed to benefit from rapid improvements in GNN latency and memory usage. However, industry use-cases are not perfectly aligned with HEP and much work needs to be done to best match unique GNN capabilities to unique HEP obstacles. We present here a range of these capabilities, predictions of which are currently being well-adopted in HEP communities, and which are still immature. We hope to capture the landscape of graph techniques in machine learning as well as point out the most significant gaps that are inhibiting potentially large leaps in research.
△ Less
Submitted 25 March, 2022; v1 submitted 23 March, 2022;
originally announced March 2022.
-
Reconstruction of Large Radius Tracks with the Exa.TrkX pipeline
Authors:
Chun-Yi Wang,
Xiangyang Ju,
Shih-Chieh Hsu,
Daniel Murnane,
Paolo Calafiura,
Steven Farrell,
Maria Spiropulu,
Jean-Roch Vlimant,
Adam Aurisano,
V Hewes,
Giuseppe Cerati,
Lindsey Gray,
Thomas Klijnsma,
Jim Kowalkowski,
Markus Atkinson,
Mark Neubauer,
Gage DeZoort,
Savannah Thais,
Alexandra Ballow,
Alina Lazar,
Sylvain Caillou,
Charline Rougier,
Jan Stark,
Alexis Vallier,
Jad Sardain
Abstract:
Particle tracking is a challenging pattern recognition task at the Large Hadron Collider (LHC) and the High Luminosity-LHC. Conventional algorithms, such as those based on the Kalman Filter, achieve excellent performance in reconstructing the prompt tracks from the collision points. However, they require dedicated configuration and additional computing time to efficiently reconstruct the large rad…
▽ More
Particle tracking is a challenging pattern recognition task at the Large Hadron Collider (LHC) and the High Luminosity-LHC. Conventional algorithms, such as those based on the Kalman Filter, achieve excellent performance in reconstructing the prompt tracks from the collision points. However, they require dedicated configuration and additional computing time to efficiently reconstruct the large radius tracks created away from the collision points. We developed an end-to-end machine learning-based track finding algorithm for the HL-LHC, the Exa.TrkX pipeline. The pipeline is designed so as to be agnostic about global track positions. In this work, we study the performance of the Exa.TrkX pipeline for finding large radius tracks. Trained with all tracks in the event, the pipeline simultaneously reconstructs prompt tracks and large radius tracks with high efficiencies. This new capability offered by the Exa.TrkX pipeline may enable us to search for new physics in real time.
△ Less
Submitted 14 March, 2022;
originally announced March 2022.
-
Symmetry Group Equivariant Architectures for Physics
Authors:
Alexander Bogatskiy,
Sanmay Ganguly,
Thomas Kipf,
Risi Kondor,
David W. Miller,
Daniel Murnane,
Jan T. Offermann,
Mariel Pettee,
Phiala Shanahan,
Chase Shimmin,
Savannah Thais
Abstract:
Physical theories grounded in mathematical symmetries are an essential component of our understanding of a wide range of properties of the universe. Similarly, in the domain of machine learning, an awareness of symmetries such as rotation or permutation invariance has driven impressive performance breakthroughs in computer vision, natural language processing, and other important applications. In t…
▽ More
Physical theories grounded in mathematical symmetries are an essential component of our understanding of a wide range of properties of the universe. Similarly, in the domain of machine learning, an awareness of symmetries such as rotation or permutation invariance has driven impressive performance breakthroughs in computer vision, natural language processing, and other important applications. In this report, we argue that both the physics community and the broader machine learning community have much to understand and potentially to gain from a deeper investment in research concerning symmetry group equivariant machine learning architectures. For some applications, the introduction of symmetries into the fundamental structural design can yield models that are more economical (i.e. contain fewer, but more expressive, learned parameters), interpretable (i.e. more explainable or directly mappable to physical quantities), and/or trainable (i.e. more efficient in both data and computational requirements). We discuss various figures of merit for evaluating these models as well as some potential benefits and limitations of these methods for a variety of physics applications. Research and investment into these approaches will lay the foundation for future architectures that are potentially more robust under new computational paradigms and will provide a richer description of the physical systems to which they are applied.
△ Less
Submitted 11 March, 2022;
originally announced March 2022.
-
Semi-Equivariant GNN Architectures for Jet Tagging
Authors:
Daniel Murnane,
Savannah Thais,
Jason Wong
Abstract:
Composing Graph Neural Networks (GNNs) of operations that respect physical symmetries has been suggested to give better model performance with a smaller number of learnable parameters. However, real-world applications, such as in high energy physics have not born this out. We present the novel architecture VecNet that combines both symmetry-respecting and unconstrained operations to study and tune…
▽ More
Composing Graph Neural Networks (GNNs) of operations that respect physical symmetries has been suggested to give better model performance with a smaller number of learnable parameters. However, real-world applications, such as in high energy physics have not born this out. We present the novel architecture VecNet that combines both symmetry-respecting and unconstrained operations to study and tune the degree of physics-informed GNNs. We introduce a novel metric, the \textit{ant factor}, to quantify the resource-efficiency of each configuration in the search-space. We find that a generalized architecture such as ours can deliver optimal performance in resource-constrained applications.
△ Less
Submitted 14 February, 2022;
originally announced February 2022.
-
Convergent Bayesian Global Fits of 4D Composite Higgs Models
Authors:
Ethan Carragher,
Will Handley,
Daniel Murnane,
Peter Stangl,
Wei Su,
Martin White,
Anthony G. Williams
Abstract:
Models in which the Higgs boson is a composite pseudo-Nambu-Goldstone boson offer attractive solutions to the Higgs mass naturalness problem. We consider three such models based on the minimal $SO(5) \rightarrow SO(4)$ symmetry breaking pattern, and perform convergent global fits on the models under a Bayesian framework in order to find the regions of their parameter spaces that best fit a wide ra…
▽ More
Models in which the Higgs boson is a composite pseudo-Nambu-Goldstone boson offer attractive solutions to the Higgs mass naturalness problem. We consider three such models based on the minimal $SO(5) \rightarrow SO(4)$ symmetry breaking pattern, and perform convergent global fits on the models under a Bayesian framework in order to find the regions of their parameter spaces that best fit a wide range of constraints, including recent Higgs measurements. We use a novel technique to analyse the fine-tuning of the models, quantifying the tuning as the Kullback-Leibler divergence from the prior to the posterior probability on the parameter space. Each model is found to be able to satisfy all constraints at the $3σ$ level simultaneously. As a by-product of the fits, we analyse the collider phenomenology of our models in these viable regions. In two of the three models, we find that the $g g \rightarrow H \rightarrow γγ$ cross section is less than ${\sim}90$% that predicted by the SM, which is already in slight tension with experiment and could potentially be ruled out in the future high-luminosity run of the LHC. In addition, the lightest fermions $F$ arising from the new strong dynamics in these models are seen in general to lie above ${\sim}1.1$ TeV, with the $F \rightarrow tW^{+}$ and $F \rightarrow \bar{b}W^{+}$ decays offering particularly promising channels for probing these models in future collider searches.
△ Less
Submitted 15 February, 2021; v1 submitted 2 January, 2021;
originally announced January 2021.
-
Minimal 4D Composite Higgs Models Under Current LHC Constraints
Authors:
Ethan Carragher,
Daniel Murnane,
Peter Stangl,
Wei Su,
Martin White,
Anthony G. Williams
Abstract:
We present preliminary results of the first convergent global fits of several minimal composite Higgs models. Our fits are performed using the differential evolution optimisation package $\texttt{Diver}$. A variety of physical constraints are taken into account, including a wide range of exclusion bounds on heavy resonance production from Run 2 of the LHC. As a by-product of the fits, we analyse t…
▽ More
We present preliminary results of the first convergent global fits of several minimal composite Higgs models. Our fits are performed using the differential evolution optimisation package $\texttt{Diver}$. A variety of physical constraints are taken into account, including a wide range of exclusion bounds on heavy resonance production from Run 2 of the LHC. As a by-product of the fits, we analyse the collider phenomenology of the lightest new up-type and down-type resonances in the viable regions of our models, finding some low-mass resonances that can be probed in future collider searches.
△ Less
Submitted 23 July, 2020;
originally announced July 2020.
-
Exploring Fine-tuning of the Next-to-Minimal Composite Higgs Model
Authors:
Daniel Murnane,
Martin J. White,
Anthony G. Williams
Abstract:
We perform a detailed study of the fine-tuning of the two-site, 4D, Next-to-Minimal Composite Higgs Model (NMCHM), based on the global symmetry breaking pattern $SO(6)\rightarrow SO(5)$. Using our previously-defined fine-tuning measure that correctly combines the effect of multiple sources of fine-tuning, we quantify the fine-tuning that is expected to result from future collider measurements of t…
▽ More
We perform a detailed study of the fine-tuning of the two-site, 4D, Next-to-Minimal Composite Higgs Model (NMCHM), based on the global symmetry breaking pattern $SO(6)\rightarrow SO(5)$. Using our previously-defined fine-tuning measure that correctly combines the effect of multiple sources of fine-tuning, we quantify the fine-tuning that is expected to result from future collider measurements of the Standard Model-like Higgs branching ratios, in addition to null searches for the new resonances in the model. We also perform a detailed comparison with the Minimal Composite Higgs Model, finding that there is in general little difference between the fine-tuning expected in the two scenarios, even after measurements at a high-luminosity, 1 TeV linear collider. Finally, we briefly consider the relationship between fine-tuning and the ability of the extra scalar in the NMCHM model to act as a dark matter candidate, finding that the realisation of a $Z_2$ symmetry that stabilises the scalar is amongst the most natural regions in the parameter space, regardless of future collider measurements.
△ Less
Submitted 7 March, 2019; v1 submitted 19 October, 2018;
originally announced October 2018.
-
ColliderBit: a GAMBIT module for the calculation of high-energy collider observables and likelihoods
Authors:
Csaba Balázs,
Andy Buckley,
Lars A. Dal,
Ben Farmer,
Paul Jackson,
Abram Krislock,
Anders Kvellestad,
Daniel Murnane,
Antje Putze,
Are Raklev,
Christopher Rogan,
Aldo Saavedra,
Pat Scott,
Christoph Weniger,
Martin White
Abstract:
We describe ColliderBit, a new code for the calculation of high energy collider observables in theories of physics beyond the Standard Model (BSM). ColliderBit features a generic interface to BSM models, a unique parallelised Monte Carlo event generation scheme suitable for large-scale supercomputer applications, and a number of LHC analyses, covering a reasonable range of the BSM signatures curre…
▽ More
We describe ColliderBit, a new code for the calculation of high energy collider observables in theories of physics beyond the Standard Model (BSM). ColliderBit features a generic interface to BSM models, a unique parallelised Monte Carlo event generation scheme suitable for large-scale supercomputer applications, and a number of LHC analyses, covering a reasonable range of the BSM signatures currently sought by ATLAS and CMS. ColliderBit also calculates likelihoods for Higgs sector observables, and LEP searches for BSM particles. These features are provided by a combination of new code unique to ColliderBit, and interfaces to existing state-of-the-art public codes. ColliderBit is both an important part of the GAMBIT framework for BSM inference, and a standalone tool for efficiently applying collider constraints to theories of new physics.
△ Less
Submitted 2 April, 2019; v1 submitted 22 May, 2017;
originally announced May 2017.
-
Constraining fine tuning in Composite Higgs Models with partially composite leptons
Authors:
James Barnard,
Daniel Murnane,
Martin White,
Anthony G. Williams
Abstract:
Minimal Composite Higgs Models (MCHM) have long provided a solution to the hierarchy problem of the Standard Model, yet suffer from various sources of fine tuning that are becoming increasingly problematic with the lack of new physics observations at the LHC. We develop a new fine tuning measure that accurately counts each contribution to fine tuning (single, double, triple, etc) that can occur in…
▽ More
Minimal Composite Higgs Models (MCHM) have long provided a solution to the hierarchy problem of the Standard Model, yet suffer from various sources of fine tuning that are becoming increasingly problematic with the lack of new physics observations at the LHC. We develop a new fine tuning measure that accurately counts each contribution to fine tuning (single, double, triple, etc) that can occur in a theory with $n_p$ parameters, that must reproduce $n_o$ observables. We then use a novel scanning procedure to perform a comprehensive study of three different two-site, 4D, $SO(5)\rightarrow SO(4)$ MCHMs with all third generation fermions included, distinguished by the choice of the lepton embeddings. These are the MCHM$^{\textbf{5-5-5}}_{\textbf{5-5-5}}$, MCHM$^{\textbf{5-5-5}}_{\textbf{14-14-10}}$ and MCHM$^{\textbf{5-5-5}}_{\textbf{14-1-10}}$, where MCHM$^{q-t-b}_{l-τ-ν}$ has the lepton doublet partner in representation $l$, tau partner in representation $τ$, and so on. We find that embedding at least one massive lepton in the symmetric $\textbf{14}$ of $SO(5)$ reduces the tuning for the case of low top partner masses (in line with previous results), but that this is balanced against the increased complexity of the model when one properly accounts for all sources of fine tuning. We study both the current relative fine-tuning of each scenario, and the future prospects. Noting that the different scenarios behave differently with respect to future improvements in collider measurements, we find that the MCHM$^{\textbf{5-5-5}}_{\textbf{14-1-10}}$ enjoys a relatively low increase in fine tuning even for a future lower bound on the top partner masses of 3.4 TeV (or equivalently a maximum Higgs-fermion or Higgs-gluon coupling deviation of 2%).
△ Less
Submitted 22 March, 2017;
originally announced March 2017.
