SuperSONIC: Cloud-Native Infrastructure for ML Inferencing
Authors:
Dmitry Kondratyev,
Benedikt Riedel,
Yuan-Tang Chou,
Miles Cochran-Branson,
Noah Paladino,
David Schultz,
Mia Liu,
Javier Duarte,
Philip Harris,
Shih-Chieh Hsu
Abstract:
The increasing computational demand from growing data rates and complex machine learning (ML) algorithms in large-scale scientific experiments has driven the adoption of the Services for Optimized Network Inference on Coprocessors (SONIC) approach. SONIC accelerates ML inference by offloading it to local or remote coprocessors to optimize resource utilization. Leveraging its portability to differe…
▽ More
The increasing computational demand from growing data rates and complex machine learning (ML) algorithms in large-scale scientific experiments has driven the adoption of the Services for Optimized Network Inference on Coprocessors (SONIC) approach. SONIC accelerates ML inference by offloading it to local or remote coprocessors to optimize resource utilization. Leveraging its portability to different types of coprocessors, SONIC enhances data processing and model deployment efficiency for cutting-edge research in high energy physics (HEP) and multi-messenger astrophysics (MMA). We developed the SuperSONIC project, a scalable server infrastructure for SONIC, enabling the deployment of computationally intensive tasks to Kubernetes clusters equipped with graphics processing units (GPUs). Using NVIDIA Triton Inference Server, SuperSONIC decouples client workflows from server infrastructure, standardizing communication, optimizing throughput, load balancing, and monitoring. SuperSONIC has been successfully deployed for the CMS and ATLAS experiments at the CERN Large Hadron Collider (LHC), the IceCube Neutrino Observatory (IceCube), and the Laser Interferometer Gravitational-Wave Observatory (LIGO) and tested on Kubernetes clusters at Purdue University, the National Research Platform (NRP), and the University of Chicago. SuperSONIC addresses the challenges of the Cloud-native era by providing a reusable, configurable framework that enhances the efficiency of accelerator-based inference deployment across diverse scientific domains and industries.
△ Less
Submitted 25 June, 2025;
originally announced June 2025.
Performance measurements of the electromagnetic calorimeter and readout electronics system for the DarkQuest experiment
Authors:
Aram Apyan,
Christopher Cosby,
Yongbin Feng,
Alp Gelgen,
Stefania Gori,
Philip Harris,
Xinlong Liu,
Mia Liu,
Petar Maksimovic,
Cristina Mantilla-Suarez,
Ryan McLaughlin,
Catherine Miller,
Amitav Mitra,
Noah Paladino,
Arghya Ranjan Das,
Valdis Slokenbergs,
David Sperka,
Nhan Tran,
Zijie Wan
Abstract:
This paper presents performance measurements of a new readout electronics system based on silicon photomultipliers for the PHENIX electromagnetic calorimeter. Installation of the lead-scintillator Shashlik style calorimeter into the SeaQuest/SpinQuest spectrometer has been proposed to broaden the experiment's dark sector search program, an upgrade known as DarkQuest. The calorimeter and electronic…
▽ More
This paper presents performance measurements of a new readout electronics system based on silicon photomultipliers for the PHENIX electromagnetic calorimeter. Installation of the lead-scintillator Shashlik style calorimeter into the SeaQuest/SpinQuest spectrometer has been proposed to broaden the experiment's dark sector search program, an upgrade known as DarkQuest. The calorimeter and electronics system were subjected to testing and calibration at the Fermilab Test Beam Facility. Detailed studies of the energy response and resolution, as well as particle identification capabilities, were performed. The background rate in the actual experimental environment was also examined. The system is found to be well-suited for a dark sector search program on the Fermilab 120 GeV proton beamline.
△ Less
Submitted 10 July, 2025; v1 submitted 27 February, 2025;
originally announced February 2025.
