-
Hybrid Quantum-Classical Reinforcement Learning in Latent Observation Spaces
Authors:
Dániel T. R. Nagy,
Csaba Czabán,
Bence Bakó,
Péter Hága,
Zsófia Kallus,
Zoltán Zimborás
Abstract:
Recent progress in quantum machine learning has sparked interest in using quantum methods to tackle classical control problems via quantum reinforcement learning. However, the classical reinforcement learning environments often scale to high dimensional problem spaces, which represents a challenge for the limited and costly resources available for quantum agent implementations. We propose to solve…
▽ More
Recent progress in quantum machine learning has sparked interest in using quantum methods to tackle classical control problems via quantum reinforcement learning. However, the classical reinforcement learning environments often scale to high dimensional problem spaces, which represents a challenge for the limited and costly resources available for quantum agent implementations. We propose to solve this dimensionality challenge by a classical autoencoder and a quantum agent together, where a compressed representation of observations is jointly learned in a hybrid training loop. The latent representation of such an autoencoder will serve as a tailored observation space best suited for both the control problem and the QPU architecture, aligning with the agent's requirements. A series of numerical experiments are designed for a performance analysis of the latent-space learning method. Results are presented for different control problems and for both photonic (continuous-variable) and qubit-based agents, to show how the QNN learning process is improved by the joint training.
△ Less
Submitted 29 March, 2025; v1 submitted 23 October, 2024;
originally announced October 2024.
-
Suppressing photon detection errors in nondeterministic state preparation
Authors:
Csaba Czabán,
Zoltán Kolarovszki,
Márton Karácsony,
Zoltán Zimborás
Abstract:
Photonic quantum computing has recently emerged as a promising candidate for fault-tolerant quantum computing by photonic qubits. These protocols make use of nondeterministic gates, enabling universal quantum computation. However, the suggested solutions heavily use particle number resolving detectors (PNRDs), which are experimentally hard to realize and are usually biased in practice. We investig…
▽ More
Photonic quantum computing has recently emerged as a promising candidate for fault-tolerant quantum computing by photonic qubits. These protocols make use of nondeterministic gates, enabling universal quantum computation. However, the suggested solutions heavily use particle number resolving detectors (PNRDs), which are experimentally hard to realize and are usually biased in practice. We investigate the possibility of suppressing such errors caused by such photodetector imperfections by adjusting the optimal beamsplitter and phaseshifter angles in the interferometer corresponding to nondeterministic gates. Moreover, we devise an optimization method for determining the adjusted angles, which may achieve higher output state fidelities while controlling the success probabilities of the nondeterministic gates.
△ Less
Submitted 10 July, 2024;
originally announced July 2024.
-
Updates on the Columbia plot and its extended/alternative versions
Authors:
Francesca Cuteri,
Christopher Czaban,
Owe Philipsen,
Alessandro Sciarra
Abstract:
We report on the status of ongoing investigations aiming at locating the deconfinement critical point with standard Wilson fermions and $N_f=2$ flavors towards the continuum limit (standard Columbia plot); locating the tricritical masses at imaginary chemical potential with unimproved staggered fermions at $N_f=2$ (extended Columbia plot); identifying the order of the chiral phase transition at…
▽ More
We report on the status of ongoing investigations aiming at locating the deconfinement critical point with standard Wilson fermions and $N_f=2$ flavors towards the continuum limit (standard Columbia plot); locating the tricritical masses at imaginary chemical potential with unimproved staggered fermions at $N_f=2$ (extended Columbia plot); identifying the order of the chiral phase transition at $μ=0$ for $N_f=2$ via extrapolation from non integer $N_f$ (alternative Columbia plot).
△ Less
Submitted 25 October, 2017;
originally announced October 2017.
-
The QCD deconfinement critical point for $N_τ=8$ with $N_f=2$ flavours of unimproved Wilson fermions
Authors:
Christopher Czaban,
Owe Philipsen
Abstract:
QCD at zero baryon density in the limit of infinite quark mass undergoes a first order deconfinement phase transition at a critical temperature $T_c$ corresponding to the breaking of the global centre symmetry. In the presence of dynamical quarks this symmetry is explicitly broken. Lowering the quark mass the first order phase transition weakens and terminates in a second order Z(2) point. Beyond…
▽ More
QCD at zero baryon density in the limit of infinite quark mass undergoes a first order deconfinement phase transition at a critical temperature $T_c$ corresponding to the breaking of the global centre symmetry. In the presence of dynamical quarks this symmetry is explicitly broken. Lowering the quark mass the first order phase transition weakens and terminates in a second order Z(2) point. Beyond this line confined and deconfined regions are analytically connected by a crossover transition. As the continuum limit is approached (i.e. the lattice spacing is decreased) the region of first order transitions expands towards lower masses. We study the deconfinement critical point with standard Wilson fermions and $N_f=2$ flavours. To this end we simulate several kappa values on $N_τ=8$ and various aspect ratios in order to extrapolate to the thermodynamic limit, applying finite size scaling. We estimate if and when a continuuum extrapolation is possible.
△ Less
Submitted 19 September, 2016;
originally announced September 2016.
-
Interpreting Numerical Measurements in Fixed Topological Sectors
Authors:
Wolfgang Bietenholz,
Christopher Czaban,
Arthur Dromard,
Urs Gerber,
Christoph P. Hofmann,
Héctor Mejía-Díaz,
Marc Wagner
Abstract:
For quantum field theories with topological sectors, Monte Carlo simulations on fine lattices tend to be obstructed by an extremely long auto-correlation time with respect to the topological charge. Then reliable numerical measurements are feasible only within individual sectors. The challenge is to assemble such restricted measurements in a way that leads to a substantiated approximation to the f…
▽ More
For quantum field theories with topological sectors, Monte Carlo simulations on fine lattices tend to be obstructed by an extremely long auto-correlation time with respect to the topological charge. Then reliable numerical measurements are feasible only within individual sectors. The challenge is to assemble such restricted measurements in a way that leads to a substantiated approximation to the fully fledged result, which would correspond to the correct sampling over the entire set of configurations. We test an approach for such a topological summation, which was suggested by Brower, Chandrasekharan, Negele and Wiese. Under suitable conditions, energy levels and susceptibilities can be obtained to a good accuracy, as we demonstrate for O(N) models, SU(2) Yang-Mills theory, and for the Schwinger model.
△ Less
Submitted 30 June, 2016; v1 submitted 17 March, 2016;
originally announced March 2016.
-
Roberge-Weiss transition in $N_\text{f}=2$ QCD with Wilson fermions and $N_τ=6$
Authors:
Francesca Cuteri,
Christopher Pinke,
Alessandro Sciarra,
Christopher Czaban,
Owe Philipsen
Abstract:
QCD with imaginary chemical potential is free of the sign problem and exhibits a rich phase structure constraining the phase diagram at real chemical potential. We simulate the critical endpoint of the Roberge-Weiss (RW) transition at imaginary chemical potential for $N_\text{f}=2$ QCD on $N_τ=6$ lattices with standard Wilson fermions. As found on coarser lattices, the RW endpoint is a triple poin…
▽ More
QCD with imaginary chemical potential is free of the sign problem and exhibits a rich phase structure constraining the phase diagram at real chemical potential. We simulate the critical endpoint of the Roberge-Weiss (RW) transition at imaginary chemical potential for $N_\text{f}=2$ QCD on $N_τ=6$ lattices with standard Wilson fermions. As found on coarser lattices, the RW endpoint is a triple point connecting the deconfinement/chiral transitions in the heavy/light quark mass regions and changes to a second-order endpoint for intermediate masses. These regimes are separated by two tricritical values of the quark mass, which we determine by extracting the critical exponent $ν$ from a systematic finite size scaling analysis of the Binder cumulant of the imaginary part of the Polyakov loop. We are able to explain a previously observed finite size effect afflicting the scaling of the Binder cumulant in the regime of three-phase coexistence. Compared to $N_τ=4$ lattices, the tricritical masses are shifted towards smaller values. Exploratory results on $N_τ=8$ as well as comparison with staggered simulations suggest that significantly finer lattices are needed before a continuum extrapolation becomes feasible.
△ Less
Submitted 26 April, 2016; v1 submitted 22 December, 2015;
originally announced December 2015.
-
The nature of the Roberge-Weiss Transition in $N_f=2$ QCD with Wilson Fermions on $N_τ=6$ lattices
Authors:
Francesca Cuteri,
Christopher Czaban,
Owe Philipsen,
Christopher Pinke,
Alessandro Sciarra
Abstract:
The finite temperature chiral and deconfinement phase transitions at zero density for light and heavy quarks, respectively, have analytic continuations to imaginary chemical potential. At some critical imaginary chemical potential, they meet the Roberge-Weiss transition between adjacent $Z(3)$ sectors. For light and heavy quarks, where the chiral and deconfinement transitions are first order, the…
▽ More
The finite temperature chiral and deconfinement phase transitions at zero density for light and heavy quarks, respectively, have analytic continuations to imaginary chemical potential. At some critical imaginary chemical potential, they meet the Roberge-Weiss transition between adjacent $Z(3)$ sectors. For light and heavy quarks, where the chiral and deconfinement transitions are first order, the transition lines meet in a triple point. For intermediate masses chiral or deconfinement transitions are crossover and the Roberge-Weiss transition ends in a second order point. At the boundary between these regimes the junction is a tricritical point, as shown in studies with $N_f=2,3$ flavors of staggered and Wilson quarks on $N_τ=4$ lattices. Employing finite size scaling we investigate the nature of this point as a function of quark mass for $N_f=2$ flavors of Wilson fermions with a temporal lattice extent of $N_τ=6$. In particular we are interested in the change of the location of tricritical points compared to our ealier study on $N_τ=4$.
△ Less
Submitted 17 December, 2015; v1 submitted 10 November, 2015;
originally announced November 2015.
-
Hadron masses from fixed topology simulations: parity partners and SU(2) Yang-Mills results
Authors:
Arthur Dromard,
Christopher Czaban,
Marc Wagner
Abstract:
Lattice QCD simulations tend to get stuck in a single topological sector at fine lattice spacing, or when using chirally symmetric quarks. In such cases computed observables differ from their full QCD counterparts by finite size effects, which need to be understood on a quantitative level. We discuss extensions of existing relations from the literature between correlation functions at fixed topolo…
▽ More
Lattice QCD simulations tend to get stuck in a single topological sector at fine lattice spacing, or when using chirally symmetric quarks. In such cases computed observables differ from their full QCD counterparts by finite size effects, which need to be understood on a quantitative level. We discuss extensions of existing relations from the literature between correlation functions at fixed topology and hadron masses at unfixed topology. Particular focus is put on disentangling positive and negative parity states, which mix, when the topological charge is fixed. We also present numerical results for SU(2) Yang-Mills Theory.
△ Less
Submitted 20 October, 2014; v1 submitted 16 October, 2014;
originally announced October 2014.
-
Studying and removing effects of fixed topology
Authors:
Christopher Czaban,
Arthur Dromard,
Marc Wagner
Abstract:
At small lattice spacing, or when using overlap fermions, lattice QCD simulations tend to become stuck in a single topological sector. Physical observables, e.g.\ hadron masses, then differ from their full QCD counterparts by $1/V$ corrections, where $V$ is the spacetime volume. These corrections can be calculated order by order using the saddle point method. We calculate all corrections proportio…
▽ More
At small lattice spacing, or when using overlap fermions, lattice QCD simulations tend to become stuck in a single topological sector. Physical observables, e.g.\ hadron masses, then differ from their full QCD counterparts by $1/V$ corrections, where $V$ is the spacetime volume. These corrections can be calculated order by order using the saddle point method. We calculate all corrections proportional to $1/V^2$ and $1/V^3$ and test the resulting equations for several models: a quantum mechanical particle on a circle, the Schwinger model and SU(2) Yang-Mills theory.
△ Less
Submitted 14 April, 2014;
originally announced April 2014.
-
Lattice study of the Schwinger model at fixed topology
Authors:
Christopher Czaban,
Marc Wagner
Abstract:
At small lattice spacing QCD simulations are expected to become stuck in a single topological sector. Observables evaluated in a fixed topological sector differ from their counterparts in full QCD, i.e. at unfixed topology, by volume dependent corrections. We investigate these corrections in the two-flavor Schwinger model, which is in several aspects similar to QCD, using Wilson fermions. We also…
▽ More
At small lattice spacing QCD simulations are expected to become stuck in a single topological sector. Observables evaluated in a fixed topological sector differ from their counterparts in full QCD, i.e. at unfixed topology, by volume dependent corrections. We investigate these corrections in the two-flavor Schwinger model, which is in several aspects similar to QCD, using Wilson fermions. We also try to remove these corrections by suitable extrapolations to infinite volume.
△ Less
Submitted 19 October, 2013;
originally announced October 2013.
