Consistent, multidimensional differential histogramming and summary statistics with YODA 2
Authors:
Andy Buckley,
Louie Corpe,
Matthew Filipovich,
Christian Gutschow,
Nick Rozinsky,
Simon Thor,
Yoran Yeh,
Jamie Yellen
Abstract:
Histogramming is often taken for granted, but the power and compactness of partially aggregated, multidimensional summary statistics, and their fundamental connection to differential and integral calculus make them formidable statistical objects, especially when very large data volumes are involved. But expressing these concepts robustly and efficiently in high-dimensional parameter spaces and for…
▽ More
Histogramming is often taken for granted, but the power and compactness of partially aggregated, multidimensional summary statistics, and their fundamental connection to differential and integral calculus make them formidable statistical objects, especially when very large data volumes are involved. But expressing these concepts robustly and efficiently in high-dimensional parameter spaces and for large data samples is a highly non-trivial challenge -- doubly so if the resulting library is to remain usable by scientists as opposed to software engineers. In this paper we summarise the core principles required for consistent generalised histogramming, and use them to motivate the design principles and implementation mechanics of the re-engineered YODA histogramming library, a key component of physics data-model comparison and statistical interpretation in collider physics.
△ Less
Submitted 10 November, 2024; v1 submitted 22 December, 2023;
originally announced December 2023.
Strength in numbers: optimal and scalable combination of LHC new-physics searches
Authors:
Jack Y. Araz,
Andy Buckley,
Benjamin Fuks,
Humberto Reyes-Gonzalez,
Wolfgang Waltenberger,
Sophie L. Williamson,
Jamie Yellen
Abstract:
To gain a comprehensive view of what the LHC tells us about physics beyond the Standard Model (BSM), it is crucial that different BSM-sensitive analyses can be combined. But in general, search analyses are not statistically orthogonal, so performing comprehensive combinations requires knowledge of the extent to which the same events co-populate multiple analyses' signal regions. We present a novel…
▽ More
To gain a comprehensive view of what the LHC tells us about physics beyond the Standard Model (BSM), it is crucial that different BSM-sensitive analyses can be combined. But in general, search analyses are not statistically orthogonal, so performing comprehensive combinations requires knowledge of the extent to which the same events co-populate multiple analyses' signal regions. We present a novel, stochastic method to determine this degree of overlap and a graph algorithm to efficiently find the combination of signal regions with no mutual overlap that optimises expected upper limits on BSM-model cross-sections. The gain in exclusion power relative to single-analysis limits is demonstrated with models with varying degrees of complexity, ranging from simplified models to a 19-dimensional supersymmetric model.
△ Less
Submitted 22 December, 2022; v1 submitted 31 August, 2022;
originally announced September 2022.