Anomaly Detection for Automated Data Quality Monitoring in the CMS Detector
Authors:
Andrew Brinkerhoff,
Chosila Sutantawibul,
Robert White,
Caio Daumann,
Chad Freer,
Indara Suarez,
Samuel May,
Vivan Nguyen,
Jonathan Guiang,
Bennett Marsh,
Darin Acosta,
Alex Aubuchon,
Emanuela Barberis,
Aaron Bundock,
Evan Collins,
Preston Epps,
Johannes Erdmann,
Henning Flaecher,
Junshen Huang,
Ryan Nie,
Sudarshan Paramesvaran,
John Rotter,
Kaitlin Salyer,
Siddhesh Sawant,
Tanvi Sheokand
, et al. (1 additional authors not shown)
Abstract:
Successful operation of large particle detectors like the Compact Muon Solenoid (CMS) at the CERN Large Hadron Collider requires rapid, in-depth assessment of data quality. We introduce the ``AutoDQM'' system for Automated Data Quality Monitoring using advanced statistical techniques and unsupervised machine learning. Anomaly detection algorithms based on the beta-binomial probability function, pr…
▽ More
Successful operation of large particle detectors like the Compact Muon Solenoid (CMS) at the CERN Large Hadron Collider requires rapid, in-depth assessment of data quality. We introduce the ``AutoDQM'' system for Automated Data Quality Monitoring using advanced statistical techniques and unsupervised machine learning. Anomaly detection algorithms based on the beta-binomial probability function, principal component analysis, and neural network autoencoder image evaluation are tested on the full set of proton-proton collision data collected by CMS in 2022. AutoDQM identifies anomalous ``bad'' data affected by significant detector malfunction at a rate 4 -- 6 times higher than ``good'' data, demonstrating its effectiveness as a general data quality monitoring tool.
△ Less
Submitted 23 January, 2025;
originally announced January 2025.
FPGA-based tracking for the CMS Level-1 trigger using the tracklet algorithm
Authors:
E. Bartz,
G. Boudoul,
R. Bucci,
J. Chaves,
E. Clement,
D. Cranshaw,
S. Dutta,
Y. Gershtein,
R. Glein,
K. Hahn,
E. Halkiadakis,
M. Hildreth,
S. Kyriacou,
K. Lannon,
A. Lefeld,
Y. Liu,
E. MacDonald,
N. Pozzobon,
A. Ryd,
K. Salyer,
P. Shields,
L. Skinnari,
K. Stenson,
R. Stone,
C. Strohman
, et al. (9 additional authors not shown)
Abstract:
The high instantaneous luminosities expected following the upgrade of the Large Hadron Collider (LHC) to the High Luminosity LHC (HL-LHC) pose major experimental challenges for the CMS experiment. A central component to allow efficient operation under these conditions is the reconstruction of charged particle trajectories and their inclusion in the hardware-based trigger system. There are many cha…
▽ More
The high instantaneous luminosities expected following the upgrade of the Large Hadron Collider (LHC) to the High Luminosity LHC (HL-LHC) pose major experimental challenges for the CMS experiment. A central component to allow efficient operation under these conditions is the reconstruction of charged particle trajectories and their inclusion in the hardware-based trigger system. There are many challenges involved in achieving this: a large input data rate of about 20--40 Tb/s; processing a new batch of input data every 25 ns, each consisting of about 15,000 precise position measurements and rough transverse momentum measurements of particles ("stubs''); performing the pattern recognition on these stubs to find the trajectories; and producing the list of trajectory parameters within 4 $μ\,$s. This paper describes a proposed solution to this problem, specifically, it presents a novel approach to pattern recognition and charged particle trajectory reconstruction using an all-FPGA solution. The results of an end-to-end demonstrator system, based on Xilinx Virtex-7 FPGAs, that meets timing and performance requirements are presented along with a further improved, optimized version of the algorithm together with its corresponding expected performance.
△ Less
Submitted 6 July, 2020; v1 submitted 22 October, 2019;
originally announced October 2019.
