-
The LHCb upgrade I
Authors:
LHCb collaboration,
R. Aaij,
A. S. W. Abdelmotteleb,
C. Abellan Beteta,
F. Abudinén,
C. Achard,
T. Ackernley,
B. Adeva,
M. Adinolfi,
P. Adlarson,
H. Afsharnia,
C. Agapopoulou,
C. A. Aidala,
Z. Ajaltouni,
S. Akar,
K. Akiba,
P. Albicocco,
J. Albrecht,
F. Alessio,
M. Alexander,
A. Alfonso Albero,
Z. Aliouche,
P. Alvarez Cartelle,
R. Amalric,
S. Amato
, et al. (1298 additional authors not shown)
Abstract:
The LHCb upgrade represents a major change of the experiment. The detectors have been almost completely renewed to allow running at an instantaneous luminosity five times larger than that of the previous running periods. Readout of all detectors into an all-software trigger is central to the new design, facilitating the reconstruction of events at the maximum LHC interaction rate, and their select…
▽ More
The LHCb upgrade represents a major change of the experiment. The detectors have been almost completely renewed to allow running at an instantaneous luminosity five times larger than that of the previous running periods. Readout of all detectors into an all-software trigger is central to the new design, facilitating the reconstruction of events at the maximum LHC interaction rate, and their selection in real time. The experiment's tracking system has been completely upgraded with a new pixel vertex detector, a silicon tracker upstream of the dipole magnet and three scintillating fibre tracking stations downstream of the magnet. The whole photon detection system of the RICH detectors has been renewed and the readout electronics of the calorimeter and muon systems have been fully overhauled. The first stage of the all-software trigger is implemented on a GPU farm. The output of the trigger provides a combination of totally reconstructed physics objects, such as tracks and vertices, ready for final analysis, and of entire events which need further offline reprocessing. This scheme required a complete revision of the computing model and rewriting of the experiment's software.
△ Less
Submitted 10 September, 2024; v1 submitted 17 May, 2023;
originally announced May 2023.
-
Evolution of the energy efficiency of LHCb's real-time processing
Authors:
Roel Aaij,
Daniel Hugo Cámpora Pérez,
Tommaso Colombo,
Conor Fitzpatrick,
Vladimir Vava Gligorov,
Arthur Hennequin,
Niko Neufeld,
Niklas Nolte,
Rainer Schwemmer,
Dorothea Vom Bruch
Abstract:
The upgraded LHCb detector, due to start datataking in 2022, will have to process an average data rate of 4~TB/s in real time. Because LHCb's physics objectives require that the full detector information for every LHC bunch crossing is read out and made available for real-time processing, this bandwidth challenge is equivalent to that of the ATLAS and CMS HL-LHC software read-out, but deliverable…
▽ More
The upgraded LHCb detector, due to start datataking in 2022, will have to process an average data rate of 4~TB/s in real time. Because LHCb's physics objectives require that the full detector information for every LHC bunch crossing is read out and made available for real-time processing, this bandwidth challenge is equivalent to that of the ATLAS and CMS HL-LHC software read-out, but deliverable five years earlier. Over the past six years, the LHCb collaboration has undertaken a bottom-up rewrite of its software infrastructure, pattern recognition, and selection algorithms to make them better able to efficiently exploit modern highly parallel computing architectures. We review the impact of this reoptimization on the energy efficiency of the real-time processing software and hardware which will be used for the upgrade of the LHCb detector. We also review the impact of the decision to adopt a hybrid computing architecture consisting of GPUs and CPUs for the real-time part of LHCb's future data processing. We discuss the implications of these results on how LHCb's real-time power requirements may evolve in the future, particularly in the context of a planned second upgrade of the detector.
△ Less
Submitted 14 June, 2021;
originally announced June 2021.
-
A Comparison of CPU and GPU implementations for the LHCb Experiment Run 3 Trigger
Authors:
R. Aaij,
M. Adinolfi,
S. Aiola,
S. Akar,
J. Albrecht,
M. Alexander,
S. Amato,
Y. Amhis,
F. Archilli,
M. Bala,
G. Bassi,
L. Bian,
M. P. Blago,
T. Boettcher,
A. Boldyrev,
S. Borghi,
A. Brea Rodriguez,
L. Calefice,
M. Calvo Gomez,
D. H. Cámpora Pérez,
A. Cardini,
M. Cattaneo,
V. Chobanova,
G. Ciezarek,
X. Cid Vidal
, et al. (135 additional authors not shown)
Abstract:
The LHCb experiment at CERN is undergoing an upgrade in preparation for the Run 3 data taking period of the LHC. As part of this upgrade the trigger is moving to a fully software implementation operating at the LHC bunch crossing rate. We present an evaluation of a CPU-based and a GPU-based implementation of the first stage of the High Level Trigger. After a detailed comparison both options are fo…
▽ More
The LHCb experiment at CERN is undergoing an upgrade in preparation for the Run 3 data taking period of the LHC. As part of this upgrade the trigger is moving to a fully software implementation operating at the LHC bunch crossing rate. We present an evaluation of a CPU-based and a GPU-based implementation of the first stage of the High Level Trigger. After a detailed comparison both options are found to be viable. This document summarizes the performance and implementation details of these options, the outcome of which has led to the choice of the GPU-based implementation as the baseline.
△ Less
Submitted 4 January, 2022; v1 submitted 9 May, 2021;
originally announced May 2021.
-
Allen: A high level trigger on GPUs for LHCb
Authors:
R. Aaij,
J. Albrecht,
M. Belous,
P. Billoir,
T. Boettcher,
A. Brea Rodríguez,
D. vom Bruch,
D. H. Cámpora Pérez,
A. Casais Vidal,
D. C. Craik,
P. Fernandez Declara,
L. Funke,
V. V. Gligorov,
B. Jashal,
N. Kazeev,
D. Martínez Santos,
F. Pisani,
D. Pliushchenko,
S. Popov,
R. Quagliani,
M. Rangel,
F. Reiss,
C. Sánchez Mayordomo,
R. Schwemmer,
M. Sokoloff
, et al. (4 additional authors not shown)
Abstract:
We describe a fully GPU-based implementation of the first level trigger for the upgrade of the LHCb detector, due to start data taking in 2021. We demonstrate that our implementation, named Allen, can process the 40 Tbit/s data rate of the upgraded LHCb detector and perform a wide variety of pattern recognition tasks. These include finding the trajectories of charged particles, finding proton-prot…
▽ More
We describe a fully GPU-based implementation of the first level trigger for the upgrade of the LHCb detector, due to start data taking in 2021. We demonstrate that our implementation, named Allen, can process the 40 Tbit/s data rate of the upgraded LHCb detector and perform a wide variety of pattern recognition tasks. These include finding the trajectories of charged particles, finding proton-proton collision points, identifying particles as hadrons or muons, and finding the displaced decay vertices of long-lived particles. We further demonstrate that Allen can be implemented in around 500 scientific or consumer GPU cards, that it is not I/O bound, and can be operated at the full LHC collision rate of 30 MHz. Allen is the first complete high-throughput GPU trigger proposed for a HEP experiment.
△ Less
Submitted 12 May, 2020; v1 submitted 19 December, 2019;
originally announced December 2019.
-
Design and performance of the LHCb trigger and full real-time reconstruction in Run 2 of the LHC
Authors:
R. Aaij,
S. Akar,
J. Albrecht,
M. Alexander,
A. Alfonso Albero,
S. Amerio,
L. Anderlini,
P. d'Argent,
A. Baranov,
W. Barter,
S. Benson,
D. Bobulska,
T. Boettcher,
S. Borghi,
E. E. Bowen,
L. Brarda,
C. Burr,
J. -P. Cachemiche,
M. Calvo Gomez,
M. Cattaneo,
H. Chanal,
M. Chapman,
M. Chebbi,
M. Chefdeville,
P. Ciambrone
, et al. (116 additional authors not shown)
Abstract:
The LHCb collaboration has redesigned its trigger to enable the full offline detector reconstruction to be performed in real time. Together with the real-time alignment and calibration of the detector, and a software infrastructure to make persistent the high-level physics objects produced during real-time processing, this redesign enabled the widespread deployment of real-time analysis during Run…
▽ More
The LHCb collaboration has redesigned its trigger to enable the full offline detector reconstruction to be performed in real time. Together with the real-time alignment and calibration of the detector, and a software infrastructure to make persistent the high-level physics objects produced during real-time processing, this redesign enabled the widespread deployment of real-time analysis during Run 2. We describe the design of the Run 2 trigger and real-time reconstruction, and present data-driven performance measurements for a representative sample of LHCb's physics programme.
△ Less
Submitted 25 June, 2019; v1 submitted 27 December, 2018;
originally announced December 2018.
-
Improved performance of the LHCb Outer Tracker in LHC Run 2
Authors:
Ph. d'Argent,
L. Dufour,
L. Grillo,
J. A. de Vries,
A. Ukleja,
R. Aaij,
F. Archilli,
S. Bachmann,
D. Berninghoff,
A. Birnkraut,
J. Blouw,
M. de Cian,
G. Ciezarek,
Ch. Färber,
M. Demmer,
F. Dettori,
E. Gersabeck,
J. Grabowski,
W. D. Hulsbergen,
B. Khanji,
M. Kolpin,
M. Kucharczyk,
B. P. Malecki,
M. Merk,
M. Mulder
, et al. (14 additional authors not shown)
Abstract:
The LHCb Outer Tracker is a gaseous detector covering an area of $5\times 6 m^2$ with 12 double layers of straw tubes. The performance of the detector is presented based on data of the LHC Run 2 running period from 2015 and 2016. Occupancies and operational experience for data collected in $p p$, pPb and PbPb collisions are described. An updated study of the ageing effects is presented showing no…
▽ More
The LHCb Outer Tracker is a gaseous detector covering an area of $5\times 6 m^2$ with 12 double layers of straw tubes. The performance of the detector is presented based on data of the LHC Run 2 running period from 2015 and 2016. Occupancies and operational experience for data collected in $p p$, pPb and PbPb collisions are described. An updated study of the ageing effects is presented showing no signs of gain deterioration or other radiation damage effects. In addition several improvements with respect to LHC Run 1 data taking are introduced. A novel real-time calibration of the time-alignment of the detector and the alignment of the single monolayers composing detector modules are presented, improving the drift-time and position resolution of the detector by 20\%. Finally, a potential use of the improved resolution for the timing of charged tracks is described, showing the possibility to identify low-momentum hadrons with their time-of-flight.
△ Less
Submitted 2 February, 2018; v1 submitted 2 August, 2017;
originally announced August 2017.
-
Tesla : an application for real-time data analysis in High Energy Physics
Authors:
R. Aaij,
S. Amato,
L. Anderlini,
S. Benson,
M. Cattaneo,
M. Clemencic,
B. Couturier,
M. Frank,
V. V. Gligorov,
T. Head,
C. Jones,
I. Komarov,
O. Lupton,
R. Matev,
G. Raven,
B. Sciascia,
T. Skwarnicki,
P. Spradlin,
S. Stahl,
B. Storaci,
M. Vesterinen
Abstract:
Upgrades to the LHCb computing infrastructure in the first long shutdown of the LHC have allowed for high quality decay information to be calculated by the software trigger making a separate offline event reconstruction unnecessary. Furthermore, the storage space of the triggered candidate is an order of magnitude smaller than the entire raw event that would otherwise need to be persisted. Tesla,…
▽ More
Upgrades to the LHCb computing infrastructure in the first long shutdown of the LHC have allowed for high quality decay information to be calculated by the software trigger making a separate offline event reconstruction unnecessary. Furthermore, the storage space of the triggered candidate is an order of magnitude smaller than the entire raw event that would otherwise need to be persisted. Tesla, following the LHCb renowned physicist naming convention, is an application designed to process the information calculated by the trigger, with the resulting output used to directly perform physics measurements.
△ Less
Submitted 19 April, 2016;
originally announced April 2016.
-
Performance of the LHCb Vertex Locator
Authors:
LHCb VELO Group,
R. Aaij,
A. Affolder,
K. Akiba,
M. Alexander,
S. Ali,
R. B. Appleby,
M. Artuso,
A. Bates,
A. Bay,
O. Behrendt,
J. Benton,
M. van Beuzekom,
P. M. Bjørnstad,
G. Bogdanova,
S. Borghi,
A. Borgia,
T. J. V. Bowcock,
J. van den Brand,
H. Brown,
J. Buytaert,
O. Callot,
J. Carroll,
G. Casse,
P. Collins
, et al. (79 additional authors not shown)
Abstract:
The Vertex Locator (VELO) is a silicon microstrip detector that surrounds the proton-proton interaction region in the LHCb experiment. The performance of the detector during the first years of its physics operation is reviewed. The system is operated in vacuum, uses a bi-phase CO2 cooling system, and the sensors are moved to 7 mm from the LHC beam for physics data taking. The performance and stabi…
▽ More
The Vertex Locator (VELO) is a silicon microstrip detector that surrounds the proton-proton interaction region in the LHCb experiment. The performance of the detector during the first years of its physics operation is reviewed. The system is operated in vacuum, uses a bi-phase CO2 cooling system, and the sensors are moved to 7 mm from the LHC beam for physics data taking. The performance and stability of these characteristic features of the detector are described, and details of the material budget are given. The calibration of the timing and the data processing algorithms that are implemented in FPGAs are described. The system performance is fully characterised. The sensors have a signal to noise ratio of approximately 20 and a best hit resolution of 4 microns is achieved at the optimal track angle. The typical detector occupancy for minimum bias events in standard operating conditions in 2011 is around 0.5%, and the detector has less than 1% of faulty strips. The proximity of the detector to the beam means that the inner regions of the n+-on-n sensors have undergone space-charge sign inversion due to radiation damage. The VELO performance parameters that drive the experiment's physics sensitivity are also given. The track finding efficiency of the VELO is typically above 98% and the modules have been aligned to a precision of 1 micron for translations in the plane transverse to the beam. A primary vertex resolution of 13 microns in the transverse plane and 71 microns along the beam axis is achieved for vertices with 25 tracks. An impact parameter resolution of less than 35 microns is achieved for particles with transverse momentum greater than 1 GeV/c.
△ Less
Submitted 10 September, 2014; v1 submitted 30 May, 2014;
originally announced May 2014.
-
Absolute luminosity measurements with the LHCb detector at the LHC
Authors:
The LHCb Collaboration,
R. Aaij,
B. Adeva,
M. Adinolfi,
C. Adrover,
A. Affolder,
Z. Ajaltouni,
J. Albrecht,
F. Alessio,
M. Alexander,
G. Alkhazov,
P. Alvarez Cartelle,
A. A. Alves Jr,
S. Amato,
Y. Amhis,
J. Anderson,
R. B. Appleby,
O. Aquines Gutierrez,
F. Archilli,
L. Arrabito,
A. Artamonov,
M. Artuso,
E. Aslanides,
G. Auriemma,
S. Bachmann
, et al. (549 additional authors not shown)
Abstract:
Absolute luminosity measurements are of general interest for colliding-beam experiments at storage rings. These measurements are necessary to determine the absolute cross-sections of reaction processes and are valuable to quantify the performance of the accelerator. Using data taken in 2010, LHCb has applied two methods to determine the absolute scale of its luminosity measurements for proton-prot…
▽ More
Absolute luminosity measurements are of general interest for colliding-beam experiments at storage rings. These measurements are necessary to determine the absolute cross-sections of reaction processes and are valuable to quantify the performance of the accelerator. Using data taken in 2010, LHCb has applied two methods to determine the absolute scale of its luminosity measurements for proton-proton collisions at the LHC with a centre-of-mass energy of 7 TeV. In addition to the classic "van der Meer scan" method a novel technique has been developed which makes use of direct imaging of the individual beams using beam-gas and beam-beam interactions. This beam imaging method is made possible by the high resolution of the LHCb vertex detector and the close proximity of the detector to the beams, and allows beam parameters such as positions, angles and widths to be determined. The results of the two methods have comparable precision and are in good agreement. Combining the two methods, an overall precision of 3.5% in the absolute luminosity determination is reached. The techniques used to transport the absolute luminosity calibration to the full 2010 data-taking period are presented.
△ Less
Submitted 11 January, 2012; v1 submitted 13 October, 2011;
originally announced October 2011.