Showing 1–14 of 14 results for author: Heimel, T

Profile Likelihoods on ML-Steroids

Authors: Theo Heimel, Tilman Plehn, Nikita Schmal

Abstract: Profile likelihoods, for instance, describing global SMEFT analyses at the LHC are numerically expensive to construct and evaluate. Especially profiled likelihoods are notoriously unstable and noisy. We show how modern numerical tools, similar to neural importance sampling, lead to a huge numerical improvement and allow us to evaluate the complete SFitter SMEFT likelihood in five hours on a single… ▽ More Profile likelihoods, for instance, describing global SMEFT analyses at the LHC are numerically expensive to construct and evaluate. Especially profiled likelihoods are notoriously unstable and noisy. We show how modern numerical tools, similar to neural importance sampling, lead to a huge numerical improvement and allow us to evaluate the complete SFitter SMEFT likelihood in five hours on a single GPU. △ Less

Submitted 14 March, 2025; v1 submitted 1 November, 2024; originally announced November 2024.

Comments: 24 pages, 9 figures

Differentiable MadNIS-Lite

Authors: Theo Heimel, Olivier Mattelaer, Tilman Plehn, Ramon Winterhalder

Abstract: Differentiable programming opens exciting new avenues in particle physics, also affecting future event generators. These new techniques boost the performance of current and planned MadGraph implementations. Combining phase-space mappings with a set of very small learnable flow elements, MadNIS-Lite, can improve the sampling efficiency while being physically interpretable. This defines a third samp… ▽ More Differentiable programming opens exciting new avenues in particle physics, also affecting future event generators. These new techniques boost the performance of current and planned MadGraph implementations. Combining phase-space mappings with a set of very small learnable flow elements, MadNIS-Lite, can improve the sampling efficiency while being physically interpretable. This defines a third sampling strategy, complementing VEGAS and the full MadNIS. △ Less

Submitted 19 November, 2024; v1 submitted 2 August, 2024; originally announced August 2024.

Comments: 16 pages, 6 figures

Report number: IRMP-CP3-24-23

Journal ref: SciPost Phys. 18, 017 (2025)

The Landscape of Unfolding with Machine Learning

Authors: Nathan Huetsch, Javier Mariño Villadamigo, Alexander Shmakov, Sascha Diefenbacher, Vinicius Mikuni, Theo Heimel, Michael Fenton, Kevin Greif, Benjamin Nachman, Daniel Whiteson, Anja Butter, Tilman Plehn

Abstract: Recent innovations from machine learning allow for data unfolding, without binning and including correlations across many dimensions. We describe a set of known, upgraded, and new methods for ML-based unfolding. The performance of these approaches are evaluated on the same two datasets. We find that all techniques are capable of accurately reproducing the particle-level spectra across complex obse… ▽ More Recent innovations from machine learning allow for data unfolding, without binning and including correlations across many dimensions. We describe a set of known, upgraded, and new methods for ML-based unfolding. The performance of these approaches are evaluated on the same two datasets. We find that all techniques are capable of accurately reproducing the particle-level spectra across complex observables. Given that these approaches are conceptually diverse, they offer an exciting toolkit for a new class of measurements that can probe the Standard Model with an unprecedented level of detail and may enable sensitivity to new phenomena. △ Less

Submitted 17 May, 2024; v1 submitted 29 April, 2024; originally announced April 2024.

Journal ref: SciPost Phys. 18, 070 (2025)

The MadNIS Reloaded

Authors: Theo Heimel, Nathan Huetsch, Fabio Maltoni, Olivier Mattelaer, Tilman Plehn, Ramon Winterhalder

Abstract: In pursuit of precise and fast theory predictions for the LHC, we present an implementation of the MadNIS method in the MadGraph event generator. A series of improvements in MadNIS further enhance its efficiency and speed. We validate this implementation for realistic partonic processes and find significant gains from using modern machine learning in event generators. In pursuit of precise and fast theory predictions for the LHC, we present an implementation of the MadNIS method in the MadGraph event generator. A series of improvements in MadNIS further enhance its efficiency and speed. We validate this implementation for realistic partonic processes and find significant gains from using modern machine learning in event generators. △ Less

Submitted 31 May, 2024; v1 submitted 2 November, 2023; originally announced November 2023.

Comments: 15 pages, 6 figures, 2 tables; v3: updates incl. referee requests

Report number: IRMP-CP3-23-56, MCNET-23-12

Journal ref: SciPost Phys. 17, 023 (2024)

Precision-Machine Learning for the Matrix Element Method

Authors: Theo Heimel, Nathan Huetsch, Ramon Winterhalder, Tilman Plehn, Anja Butter

Abstract: The matrix element method is the LHC inference method of choice for limited statistics. We present a dedicated machine learning framework, based on efficient phase-space integration, a learned acceptance and transfer function. It is based on a choice of INN and diffusion networks, and a transformer to solve jet combinatorics. We showcase this setup for the CP-phase of the top Yukawa coupling in as… ▽ More The matrix element method is the LHC inference method of choice for limited statistics. We present a dedicated machine learning framework, based on efficient phase-space integration, a learned acceptance and transfer function. It is based on a choice of INN and diffusion networks, and a transformer to solve jet combinatorics. We showcase this setup for the CP-phase of the top Yukawa coupling in associated Higgs and single-top production. △ Less

Submitted 3 October, 2024; v1 submitted 11 October, 2023; originally announced October 2023.

Comments: 26 pages, 12 figures, v2: update references, v3: include evaluation on Herwig

Report number: IRMP-CP3-23-55

Journal ref: SciPost Phys. 17, 129 (2024)

Returning CP-Observables to The Frames They Belong

Authors: Jona Ackerschott, Rahool Kumar Barman, Dorival Gonçalves, Theo Heimel, Tilman Plehn

Abstract: Optimal kinematic observables are often defined in specific frames and then approximated at the reconstruction level. We show how multi-dimensional unfolding methods allow us to reconstruct these observables in their proper rest frame and in a probabilistically faithful way. We illustrate our approach with a measurement of a CP-phase in the top Yukawa coupling. Our method makes use of key advantag… ▽ More Optimal kinematic observables are often defined in specific frames and then approximated at the reconstruction level. We show how multi-dimensional unfolding methods allow us to reconstruct these observables in their proper rest frame and in a probabilistically faithful way. We illustrate our approach with a measurement of a CP-phase in the top Yukawa coupling. Our method makes use of key advantages of generative unfolding, but as a constructed observable it fits into standard LHC analysis frameworks. △ Less

Submitted 31 July, 2023; originally announced August 2023.

Comments: 25 pages, 7 figures

Journal ref: SciPost Phys. 17, 001 (2024)

How to Understand Limitations of Generative Networks

Authors: Ranit Das, Luigi Favaro, Theo Heimel, Claudius Krause, Tilman Plehn, David Shih

Abstract: Well-trained classifiers and their complete weight distributions provide us with a well-motivated and practicable method to test generative networks in particle physics. We illustrate their benefits for distribution-shifted jets, calorimeter showers, and reconstruction-level events. In all cases, the classifier weights make for a powerful test of the generative network, identify potential problems… ▽ More Well-trained classifiers and their complete weight distributions provide us with a well-motivated and practicable method to test generative networks in particle physics. We illustrate their benefits for distribution-shifted jets, calorimeter showers, and reconstruction-level events. In all cases, the classifier weights make for a powerful test of the generative network, identify potential problems in the density estimation, relate them to the underlying physics, and tie in with a comprehensive precision and uncertainty treatment for generative networks. △ Less

Submitted 7 December, 2023; v1 submitted 26 May, 2023; originally announced May 2023.

Comments: 32 pages, 19 figures

Journal ref: SciPost Phys. 16, 031 (2024)

MadNIS -- Neural Multi-Channel Importance Sampling

Authors: Theo Heimel, Ramon Winterhalder, Anja Butter, Joshua Isaacson, Claudius Krause, Fabio Maltoni, Olivier Mattelaer, Tilman Plehn

Abstract: Theory predictions for the LHC require precise numerical phase-space integration and generation of unweighted events. We combine machine-learned multi-channel weights with a normalizing flow for importance sampling, to improve classical methods for numerical integration. We develop an efficient bi-directional setup based on an invertible network, combining online and buffered training for potentia… ▽ More Theory predictions for the LHC require precise numerical phase-space integration and generation of unweighted events. We combine machine-learned multi-channel weights with a normalizing flow for importance sampling, to improve classical methods for numerical integration. We develop an efficient bi-directional setup based on an invertible network, combining online and buffered training for potentially expensive integrands. We illustrate our method for the Drell-Yan process with an additional narrow resonance. △ Less

Submitted 5 September, 2023; v1 submitted 12 December, 2022; originally announced December 2022.

Comments: 33 pages, 15 figures, minor fixes to v1

Report number: IRMP-CP3-22-56, MCNET-22-22, FERMILAB-PUB-22-915-T

Journal ref: SciPost Phys. 15, 141 (2023)

Modern Machine Learning for LHC Physicists

Authors: Tilman Plehn, Anja Butter, Barry Dillon, Theo Heimel, Claudius Krause, Ramon Winterhalder

Abstract: Depending on the point of view, modern machine learning is either providing an unprecedented boost to the numerical methods of particle physics, or it is transforming the way we do science with vast amounts of complex data. In any case, it is crucial for young researchers to stay on top of this development and apply cutting-edge methods and tools to all LHC physics tasks. These lecture notes lead… ▽ More Depending on the point of view, modern machine learning is either providing an unprecedented boost to the numerical methods of particle physics, or it is transforming the way we do science with vast amounts of complex data. In any case, it is crucial for young researchers to stay on top of this development and apply cutting-edge methods and tools to all LHC physics tasks. These lecture notes lead students with basic knowledge of particle physics and significant enthusiasm for machine learning to relevant applications. They start with an LHC-specific motivation and a non-standard introduction to neural networks and then cover classification, unsupervised classification, generative networks, data representations, and inverse problems. Three themes defining much of the discussion are statistically defined loss functions, uncertainties, and accuracy. To understand the applications, the notes include some aspects of theoretical LHC physics. All examples are chosen from particle physics publications of the last few years, and many of them come with corresponding tutorials. △ Less

Submitted 24 April, 2025; v1 submitted 2 November, 2022; originally announced November 2022.

Comments: Further expanded on uncertainties, representation learning, unfolding, etc

Two Invertible Networks for the Matrix Element Method

Authors: Anja Butter, Theo Heimel, Till Martini, Sascha Peitzsch, Tilman Plehn

Abstract: The matrix element method is widely considered the ultimate LHC inference tool for small event numbers. We show how a combination of two conditional generative neural networks encodes the QCD radiation and detector effects without any simplifying assumptions, while keeping the computation of likelihoods for individual events numerically efficient. We illustrate our approach for the CP-violating ph… ▽ More The matrix element method is widely considered the ultimate LHC inference tool for small event numbers. We show how a combination of two conditional generative neural networks encodes the QCD radiation and detector effects without any simplifying assumptions, while keeping the computation of likelihoods for individual events numerically efficient. We illustrate our approach for the CP-violating phase of the top Yukawa coupling in associated Higgs and single-top production. Currently, the limiting factor for the precision of our approach is jet combinatorics. △ Less

Submitted 21 June, 2023; v1 submitted 30 September, 2022; originally announced October 2022.

Comments: 25 pages, 13 figures

Journal ref: SciPost Phys. 15, 094 (2023)

Machine Learning and LHC Event Generation

Authors: Anja Butter, Tilman Plehn, Steffen Schumann, Simon Badger, Sascha Caron, Kyle Cranmer, Francesco Armando Di Bello, Etienne Dreyer, Stefano Forte, Sanmay Ganguly, Dorival Gonçalves, Eilam Gross, Theo Heimel, Gudrun Heinrich, Lukas Heinrich, Alexander Held, Stefan Höche, Jessica N. Howard, Philip Ilten, Joshua Isaacson, Timo Janßen, Stephen Jones, Marumi Kado, Michael Kagan, Gregor Kasieczka , et al. (26 additional authors not shown)

Abstract: First-principle simulations are at the heart of the high-energy physics research program. They link the vast data output of multi-purpose detectors with fundamental theory predictions and interpretation. This review illustrates a wide range of applications of modern machine learning to event generation and simulation-based inference, including conceptional developments driven by the specific requi… ▽ More First-principle simulations are at the heart of the high-energy physics research program. They link the vast data output of multi-purpose detectors with fundamental theory predictions and interpretation. This review illustrates a wide range of applications of modern machine learning to event generation and simulation-based inference, including conceptional developments driven by the specific requirements of particle physics. New ideas and tools developed at the interface of particle physics and machine learning will improve the speed and precision of forward simulations, handle the complexity of collision data, and enhance inference as an inverse simulation problem. △ Less

Submitted 28 December, 2022; v1 submitted 14 March, 2022; originally announced March 2022.

Comments: Review article based on a Snowmass 2021 contribution

Journal ref: SciPost Phys. 14, 079 (2023)

Generative Networks for Precision Enthusiasts

Authors: Anja Butter, Theo Heimel, Sander Hummerich, Tobias Krebs, Tilman Plehn, Armand Rousselot, Sophia Vent

Abstract: Generative networks are opening new avenues in fast event generation for the LHC. We show how generative flow networks can reach percent-level precision for kinematic distributions, how they can be trained jointly with a discriminator, and how this discriminator improves the generation. Our joint training relies on a novel coupling of the two networks which does not require a Nash equilibrium. We… ▽ More Generative networks are opening new avenues in fast event generation for the LHC. We show how generative flow networks can reach percent-level precision for kinematic distributions, how they can be trained jointly with a discriminator, and how this discriminator improves the generation. Our joint training relies on a novel coupling of the two networks which does not require a Nash equilibrium. We then estimate the generation uncertainties through a Bayesian network setup and through conditional data augmentation, while the discriminator ensures that there are no systematic inconsistencies compared to the training data. △ Less

Submitted 19 December, 2022; v1 submitted 22 October, 2021; originally announced October 2021.

Comments: 28 pages, 14 figures

Journal ref: SciPost Phys. 14, 078 (2023)

Measuring QCD Splittings with Invertible Networks

Authors: Sebastian Bieringer, Anja Butter, Theo Heimel, Stefan Höche, Ullrich Köthe, Tilman Plehn, Stefan T. Radev

Abstract: QCD splittings are among the most fundamental theory concepts at the LHC. We show how they can be studied systematically with the help of invertible neural networks. These networks work with sub-jet information to extract fundamental parameters from jet samples. Our approach expands the LEP measurements of QCD Casimirs to a systematic test of QCD properties based on low-level jet observables. Star… ▽ More QCD splittings are among the most fundamental theory concepts at the LHC. We show how they can be studied systematically with the help of invertible neural networks. These networks work with sub-jet information to extract fundamental parameters from jet samples. Our approach expands the LEP measurements of QCD Casimirs to a systematic test of QCD properties based on low-level jet observables. Starting with an toy example we study the effect of the full shower, hadronization, and detector effects in detail. △ Less

Submitted 9 March, 2021; v1 submitted 17 December, 2020; originally announced December 2020.

Comments: 25 pages, 11 figures

Report number: FERMILAB-PUB-20-665-T

Journal ref: SciPost Phys. 10, 126 (2021)

QCD or What?

Authors: Theo Heimel, Gregor Kasieczka, Tilman Plehn, Jennifer M Thompson

Abstract: Autoencoder networks, trained only on QCD jets, can be used to search for anomalies in jet-substructure. We show how, based either on images or on 4-vectors, they identify jets from decays of arbitrary heavy resonances. To control the backgrounds and the underlying systematics we can de-correlate the jet mass using an adversarial network. Such an adversarial autoencoder allows for a general and at… ▽ More Autoencoder networks, trained only on QCD jets, can be used to search for anomalies in jet-substructure. We show how, based either on images or on 4-vectors, they identify jets from decays of arbitrary heavy resonances. To control the backgrounds and the underlying systematics we can de-correlate the jet mass using an adversarial network. Such an adversarial autoencoder allows for a general and at the same time easily controllable search for new physics. Ideally, it can be trained and applied to data in the same phase space region, allowing us to efficiently search for new physics using un-supervised learning. △ Less

Submitted 14 January, 2019; v1 submitted 27 August, 2018; originally announced August 2018.

Comments: 11 figures, added references

Journal ref: SciPost Phys. 6, 030 (2019)