-
Microsecond-Latency Feedback at a Particle Accelerator by Online Reinforcement Learning on Hardware
Authors:
Luca Scomparin,
Michele Caselle,
Andrea Santamaria Garcia,
Chenran Xu,
Edmund Blomley,
Timo Dritschler,
Akira Mochihashi,
Marcel Schuh,
Johannes L. Steinmann,
Erik Bründermann,
Andreas Kopmann,
Jürgen Becker,
Anke-Susanne Müller,
Marc Weber
Abstract:
The commissioning and operation of future large-scale scientific experiments will challenge current tuning and control methods. Reinforcement learning (RL) algorithms are a promising solution thanks to their capability of autonomously tackling a control problem based on a task parameterized by a reward function. The conventionally utilized machine learning (ML) libraries are not intended for micro…
▽ More
The commissioning and operation of future large-scale scientific experiments will challenge current tuning and control methods. Reinforcement learning (RL) algorithms are a promising solution thanks to their capability of autonomously tackling a control problem based on a task parameterized by a reward function. The conventionally utilized machine learning (ML) libraries are not intended for microsecond latency applications, as they mostly optimize for throughput performance. On the other hand, most of the programmable logic implementations are meant for computation acceleration, not being intended to work in a real-time environment. To overcome these limitations of current implementations, RL needs to be deployed on-the-edge, i.e. on to the device gathering the training data. In this paper we present the design and deployment of an experience accumulator system in a particle accelerator. In this system deep-RL algorithms run using hardware acceleration and act within a few microseconds, enabling the use of RL for control of ultra-fast phenomena. The training is performed offline to reduce the number of operations carried out on the acceleration hardware. The proposed architecture was tested in real experimental conditions at the Karlsruhe research accelerator (KARA), serving also as a synchrotron light source, where the system was used to control induced horizontal betatron oscillations in real-time. The results showed a performance comparable to the commercial feedback system available at the accelerator, proving the viability and potential of this approach. Due to the self-learning and reconfiguration capability of this implementation, its seamless application to other control problems is possible. Applications range from particle accelerators to large-scale research and industrial facilities.
△ Less
Submitted 24 September, 2024;
originally announced September 2024.
-
Simulation of the impact of an additional corrugated structure impedance on the bursting dynamics in an electron storage ring
Authors:
Sebastian Maier,
Miriam Brosi,
Akira Mochihashi,
Michael J. Nasse,
Markus Schwarz,
Anke-Susanne Müller
Abstract:
In the case of single-digit picosecond bunch length, synchrotron light sources produce intense coherent radiation up to the THz range. The reduction of the bunch length by lowering the momentum compaction factor (low-$α$) gives rise to the micro-bunching instability, which is on one hand a crucial roadblock in the X-ray range during to the resulting effective bunch lengthening but on the other han…
▽ More
In the case of single-digit picosecond bunch length, synchrotron light sources produce intense coherent radiation up to the THz range. The reduction of the bunch length by lowering the momentum compaction factor (low-$α$) gives rise to the micro-bunching instability, which is on one hand a crucial roadblock in the X-ray range during to the resulting effective bunch lengthening but on the other hand also an opportunity for the generation of intense THz radiation if it can be controlled appropriately. In the KIT storage ring KARA (Karlsruhe Research Accelerator), two parallel plates with periodic rectangular corrugations are planned to be installed in an electron storage ring. These plates create an additional longitudinal impedance based on their geometry, which can affect the beam dynamics. The resulting impedance manipulation will be used to study and control the longitudinal electron beam dynamics and the emitted coherent synchrotron radiation (CSR). This paper presents the results of systematic studies in simulation of the impact of additional corrugated plate impedances on the longitudinal beam dynamics using the example of the KARA storage ring. If the periodicity of the wake function of the corrugated plates matches the size of the substructures in the longitudinal bunch profile, the instability threshold can be effectively manipulated. This extends intense THz radiation to different beam current regimes.
△ Less
Submitted 26 November, 2024; v1 submitted 8 July, 2024;
originally announced July 2024.
-
Bayesian Optimization of the Beam Injection Process into a Storage Ring
Authors:
Chenran Xu,
Tobias Boltz,
Akira Mochihashi,
Andrea Santamaria Garcia,
Marcel Schuh,
Anke-Susanne Müller
Abstract:
We have evaluated the data-efficient Bayesian optimization method for the specific task of injection tuning in a circular accelerator. In this paper, we describe the implementation of this method at the Karlsruhe Research Accelerator with up to nine tuning parameters, including the determination of the associated hyperparameters. We show that the Bayesian optimization method outperforms manual tun…
▽ More
We have evaluated the data-efficient Bayesian optimization method for the specific task of injection tuning in a circular accelerator. In this paper, we describe the implementation of this method at the Karlsruhe Research Accelerator with up to nine tuning parameters, including the determination of the associated hyperparameters. We show that the Bayesian optimization method outperforms manual tuning and the commonly used Nelder-Mead optimization algorithm both in simulation and experiment. The algorithm was also successfully used to ease the commissioning phase after the installation of new injection magnets and is regularly used during accelerator operations. We demonstrate that the introduction of context variables that include intra-bunch scattering effects, such as the Touschek effect, further improves the control and robustness of the injection process.
△ Less
Submitted 6 March, 2023; v1 submitted 17 November, 2022;
originally announced November 2022.
-
Detuning Properties of RF Phase Modulation in the Electron Storage Ring KARA
Authors:
Akira Mochihashi,
Sebastian Maier,
Edmund Blomley,
Marcel Schuh,
Erhard Huttel,
Tobias Boltz,
Benjamin Kehrer,
Anke-Susanne Müller,
Dmitry Teytelman
Abstract:
In electron storage rings, it is possible to increase the electron bunch length by applying a phase modulation on the radio frequency accelerating field by choosing appropriate parameters for the modulation. Such a bunch lengthening effect improves beam parameters such as the beam lifetime, which can help us to get better beam stability. The dependence of the bunch lengthening on the modulation fr…
▽ More
In electron storage rings, it is possible to increase the electron bunch length by applying a phase modulation on the radio frequency accelerating field by choosing appropriate parameters for the modulation. Such a bunch lengthening effect improves beam parameters such as the beam lifetime, which can help us to get better beam stability. The dependence of the bunch lengthening on the modulation frequency, the so-called detuning property, tends to have a peak with asymmetric slopes around it. The modulation amplitude and the beam current also affect the properties of the detuning condition of such bunch lengthening. We have investigated the detuning property with systematic measurements at the electron storage ring KARA. The experimental results agree with the theoretical model and the simulation results.
△ Less
Submitted 30 November, 2021;
originally announced November 2021.
-
Angular Momentum of Twisted Radiation from an Electron in Spiral Motion
Authors:
M. Katoh,
M. Fujimoto,
H. Kawaguchi,
K. Tsuchiya,
K. Ohmi,
T. Kaneyasu,
Y. Taira,
M. Hosaka,
A. Mochihashi,
Y. Takashima
Abstract:
We theoretically demonstrate for the first time that a single free electron in circular/spiral motion emits twisted photons carrying well defined orbital angular momentum along the axis of the electron circulation, in adding to spin angular momentum. We show that, when the electron velocity is relativistic, the radiation field contains harmonic components and the photons of l-th harmonic carry lhb…
▽ More
We theoretically demonstrate for the first time that a single free electron in circular/spiral motion emits twisted photons carrying well defined orbital angular momentum along the axis of the electron circulation, in adding to spin angular momentum. We show that, when the electron velocity is relativistic, the radiation field contains harmonic components and the photons of l-th harmonic carry lhbar total angular momentum for each. This work indicates that twisted photons are naturally emitted by free electrons and more ubiquitous in laboratories and in nature than ever been thought.
△ Less
Submitted 7 October, 2016;
originally announced October 2016.
-
Twisted Radiation by Electrons in Spiral Motion
Authors:
M. Katoh,
M. Fujimoto,
N. S. Mirian,
T. Konomi,
Y. Taira,
T. Kaneyasu,
M. Hosaka,
N. Yamamoto,
A. Mochihashi,
Y. Takashima,
K. Kuroda,
A. Miyamoto,
K. Miyamoto,
S. Sasaki
Abstract:
We theoretically show that a single free electron in circular/spiral motion radiates an electromagnetic wave possessing helical phase structure and carrying orbital angular momentum. We experimentally demonstrate it by double-slit diffraction on radiation from relativistic electrons in spiral motion. We show that twisted photons should be created naturally by cyclotron/synchrotron radiations or Co…
▽ More
We theoretically show that a single free electron in circular/spiral motion radiates an electromagnetic wave possessing helical phase structure and carrying orbital angular momentum. We experimentally demonstrate it by double-slit diffraction on radiation from relativistic electrons in spiral motion. We show that twisted photons should be created naturally by cyclotron/synchrotron radiations or Compton scatterings in various situations in cosmic space. We propose promising laboratory vortex photon sources in various wavelengths ranging from radio wave to gamma-rays.
△ Less
Submitted 15 September, 2016; v1 submitted 12 September, 2016;
originally announced September 2016.
