-
Reinforcement learning with learned gadgets to tackle hard quantum problems on real hardware
Authors:
Akash Kundu,
Leopoldo Sarra
Abstract:
Designing quantum circuits for specific tasks is challenging due to the exponential growth of the state space. We introduce gadget reinforcement learning (GRL), which integrates reinforcement learning with program synthesis to automatically generate and incorporate composite gates (gadgets) into the action space. This enhances the exploration of parameterized quantum circuits (PQCs) for complex ta…
▽ More
Designing quantum circuits for specific tasks is challenging due to the exponential growth of the state space. We introduce gadget reinforcement learning (GRL), which integrates reinforcement learning with program synthesis to automatically generate and incorporate composite gates (gadgets) into the action space. This enhances the exploration of parameterized quantum circuits (PQCs) for complex tasks like approximating ground states of quantum Hamiltonians, an NP-hard problem. We evaluate GRL using the transverse field Ising model under typical computational budgets (e.g., 2- 3 days of GPU runtime). Our results show improved accuracy, hardware compatibility and scalability. GRL exhibits robust performance as the size and complexity of the problem increases, even with constrained computational resources. By integrating gadget extraction, GRL facilitates the discovery of reusable circuit components tailored for specific hardware, bridging the gap between algorithmic design and practical implementation. This makes GRL a versatile framework for optimizing quantum circuits with applications in hardware-specific optimizations and variational quantum algorithms. The code is available at: https://github.com/Aqasch/Gadget_RL
△ Less
Submitted 2 May, 2025; v1 submitted 31 October, 2024;
originally announced November 2024.
-
Deep Bayesian Experimental Design for Quantum Many-Body Systems
Authors:
Leopoldo Sarra,
Florian Marquardt
Abstract:
Bayesian experimental design is a technique that allows to efficiently select measurements to characterize a physical system by maximizing the expected information gain. Recent developments in deep neural networks and normalizing flows allow for a more efficient approximation of the posterior and thus the extension of this technique to complex high-dimensional situations. In this paper, we show ho…
▽ More
Bayesian experimental design is a technique that allows to efficiently select measurements to characterize a physical system by maximizing the expected information gain. Recent developments in deep neural networks and normalizing flows allow for a more efficient approximation of the posterior and thus the extension of this technique to complex high-dimensional situations. In this paper, we show how this approach holds promise for adaptive measurement strategies to characterize present-day quantum technology platforms. In particular, we focus on arrays of coupled cavities and qubit arrays. Both represent model systems of high relevance for modern applications, like quantum simulations and computing, and both have been realized in platforms where measurement and control can be exploited to characterize and counteract unavoidable disorder. Thus, they represent ideal targets for applications of Bayesian experimental design.
△ Less
Submitted 26 June, 2023;
originally announced June 2023.
-
Discovering Quantum Circuit Components with Program Synthesis
Authors:
Leopoldo Sarra,
Kevin Ellis,
Florian Marquardt
Abstract:
Despite rapid progress in the field, it is still challenging to discover new ways to take advantage of quantum computation: all quantum algorithms need to be designed by hand, and quantum mechanics is notoriously counterintuitive. In this paper, we study how artificial intelligence, in the form of program synthesis, may help to overcome some of these difficulties, by showing how a computer can inc…
▽ More
Despite rapid progress in the field, it is still challenging to discover new ways to take advantage of quantum computation: all quantum algorithms need to be designed by hand, and quantum mechanics is notoriously counterintuitive. In this paper, we study how artificial intelligence, in the form of program synthesis, may help to overcome some of these difficulties, by showing how a computer can incrementally learn concepts relevant for quantum circuit synthesis with experience, and reuse them in unseen tasks. In particular, we focus on the decomposition of unitary matrices into quantum circuits, and we show how, starting from a set of elementary gates, we can automatically discover a library of new useful composite gates and use them to decompose more and more complicated unitaries.
△ Less
Submitted 2 May, 2023;
originally announced May 2023.
-
Experimental device-independent tests of quantum channels
Authors:
Iris Agresti,
Davide Poderini,
Gonzalo Carvacho,
Leopoldo Sarra,
Rafael Chaves,
Francesco Buscemi,
Michele Dall'Arno,
Fabio Sciarrino
Abstract:
Quantum tomography is currently the mainly employed method to assess the information of a system and therefore plays a fundamental role when trying to characterize the action of a particular channel. Nonetheless, quantum tomography requires the trust that the devices used in the laboratory perform state generation and measurements correctly. This work is based on the theoretical framework for the…
▽ More
Quantum tomography is currently the mainly employed method to assess the information of a system and therefore plays a fundamental role when trying to characterize the action of a particular channel. Nonetheless, quantum tomography requires the trust that the devices used in the laboratory perform state generation and measurements correctly. This work is based on the theoretical framework for the device-independent inference of quantum channels that was recently developed and experimentally implemented with superconducting qubits in [Dall'Arno, Buscemi, Vedral, arXiv:1805.01159] and [Dall'Arno, Brandsen, Buscemi, PRSA 473, 20160721 (2017)]. Here, we present a complete experimental test on a photonic setup of two device-independent quantum channels falsification and characterization protocols to analyze, validate, and enhance the results obtained by conventional quantum process tomography. This framework has fundamental implications in quantum information processing and may also lead to the development of new methods removing the assumptions typically taken for granted in all the previous protocols.
△ Less
Submitted 1 June, 2018;
originally announced June 2018.
