-
Application of machine learning to experimental design in quantum mechanics
Authors:
Federico Belliardo,
Fabio Zoratti,
Vittorio Giovannetti
Abstract:
The recent advances in machine learning hold great promise for the fields of quantum sensing and metrology. With the help of reinforcement learning, we can tame the complexity of quantum systems and solve the problem of optimal experimental design. Reinforcement learning is a powerful model-free technique that allows an agent, typically a neural network, to learn the best strategy to reach a certa…
▽ More
The recent advances in machine learning hold great promise for the fields of quantum sensing and metrology. With the help of reinforcement learning, we can tame the complexity of quantum systems and solve the problem of optimal experimental design. Reinforcement learning is a powerful model-free technique that allows an agent, typically a neural network, to learn the best strategy to reach a certain goal in a completely a priori unknown environment. However, in general, we know something about the quantum system with which the agent is interacting, at least that it follows the rules of quantum mechanics. In quantum metrology, we typically have a model for the system, and only some parameters of the evolution or the initial state are unknown. We present here a general machine learning technique that can optimize the precision of quantum sensors, exploiting the knowledge we have on the system through model-aware reinforcement learning. This framework has been implemented in the Python package qsensoropt, which is able to optimize a broad class of problems found in quantum metrology and quantum parameter estimation. The agent learns an optimal adaptive strategy that, based on previous outcomes, decides the next measurements to perform. We have explored some applications of this technique to NV centers and photonic circuits. So far, we have been able to certify better results than the current state-of-the-art controls for many cases. The machine learning technique developed here can be applied in all scenarios where the quantum system is well-characterized and relatively simple and small. In these cases, we can extract every last bit of information from a quantum sensor by appropriately controlling it with a trained neural network. The qsensoropt software is available on PyPI and can be installed with pip.
△ Less
Submitted 15 March, 2024;
originally announced March 2024.
-
Applications of model-aware reinforcement learning in Bayesian quantum metrology
Authors:
Federico Belliardo,
Fabio Zoratti,
Vittorio Giovannetti
Abstract:
An important practical problem in the field of quantum metrology and sensors is to find the optimal sequences of controls for the quantum probe that realize optimal adaptive estimation. In Belliardo et al., arXiv:2312.16985 (2023), we solved this problem in general, by introducing a procedure capable of optimizing a wide range of tasks in quantum metrology and estimation by combining model-aware r…
▽ More
An important practical problem in the field of quantum metrology and sensors is to find the optimal sequences of controls for the quantum probe that realize optimal adaptive estimation. In Belliardo et al., arXiv:2312.16985 (2023), we solved this problem in general, by introducing a procedure capable of optimizing a wide range of tasks in quantum metrology and estimation by combining model-aware reinforcement learning with Bayesian inference. We take a model-based approach to the optimisation where the physics describing the system is explicitly taken into account in the training through automatic differentiation. In this follow-up paper we present some applications of the framework. The first family of examples concerns the estimation of magnetic fields, hyperfine interactions, and decoherence times for electronic spins in diamond. For these examples, we perform multiple Ramsey measurements on the spin. The second family of applications concerns the estimation of phases and coherent states on photonic circuits, without squeezing elements, where the bosonic lines are measured by photon counters. This exposition showcases the broad applicability of the method, which has been implemented in the qsensoropt library released on PyPI, which can be installed with pip.
△ Less
Submitted 8 March, 2024;
originally announced March 2024.
-
Model-aware reinforcement learning for high-performance Bayesian experimental design in quantum metrology
Authors:
Federico Belliardo,
Fabio Zoratti,
Florian Marquardt,
Vittorio Giovannetti
Abstract:
Quantum sensors offer control flexibility during estimation by allowing manipulation by the experimenter across various parameters. For each sensing platform, pinpointing the optimal controls to enhance the sensor's precision remains a challenging task. While an analytical solution might be out of reach, machine learning offers a promising avenue for many systems of interest, especially given the…
▽ More
Quantum sensors offer control flexibility during estimation by allowing manipulation by the experimenter across various parameters. For each sensing platform, pinpointing the optimal controls to enhance the sensor's precision remains a challenging task. While an analytical solution might be out of reach, machine learning offers a promising avenue for many systems of interest, especially given the capabilities of contemporary hardware. We have introduced a versatile procedure capable of optimizing a wide range of problems in quantum metrology, estimation, and hypothesis testing by combining model-aware reinforcement learning (RL) with Bayesian estimation based on particle filtering. To achieve this, we had to address the challenge of incorporating the many non-differentiable steps of the estimation in the training process, such as measurements and the resampling of the particle filter. Model-aware RL is a gradient-based method, where the derivatives of the sensor's precision are obtained through automatic differentiation (AD) in the simulation of the experiment. Our approach is suitable for optimizing both non-adaptive and adaptive strategies, using neural networks or other agents. We provide an implementation of this technique in the form of a Python library called qsensoropt, alongside several pre-made applications for relevant physical platforms, namely NV centers, photonic circuits, and optical cavities. This library will be released soon on PyPI. Leveraging our method, we've achieved results for many examples that surpass the current state-of-the-art in experimental design. In addition to Bayesian estimation, leveraging model-aware RL, it is also possible to find optimal controls for the minimization of the Cramér-Rao bound, based on Fisher information.
△ Less
Submitted 3 December, 2024; v1 submitted 28 December, 2023;
originally announced December 2023.
-
Improving the speed of variational quantum algorithms for quantum error correction
Authors:
Fabio Zoratti,
Giacomo De Palma,
Bobak Kiani,
Quynh T. Nguyen,
Milad Marvian,
Seth Lloyd,
Vittorio Giovannetti
Abstract:
We consider the problem of devising a suitable Quantum Error Correction (QEC) procedures for a generic quantum noise acting on a quantum circuit. In general, there is no analytic universal procedure to obtain the encoding and correction unitary gates, and the problem is even harder if the noise is unknown and has to be reconstructed. The existing procedures rely on Variational Quantum Algorithms (…
▽ More
We consider the problem of devising a suitable Quantum Error Correction (QEC) procedures for a generic quantum noise acting on a quantum circuit. In general, there is no analytic universal procedure to obtain the encoding and correction unitary gates, and the problem is even harder if the noise is unknown and has to be reconstructed. The existing procedures rely on Variational Quantum Algorithms (VQAs) and are very difficult to train since the size of the gradient of the cost function decays exponentially with the number of qubits. We address this problem using a cost function based on the Quantum Wasserstein distance of order 1 ($QW_1$). At variance with other quantum distances typically adopted in quantum information processing, $QW_1$ lacks the unitary invariance property which makes it a suitable tool to avoid to get trapped in local minima. Focusing on a simple noise model for which an exact QEC solution is known and can be used as a theoretical benchmark, we run a series of numerical tests that show how, guiding the VQA search through the $QW_1$, can indeed significantly increase both the probability of a successful training and the fidelity of the recovered state, with respect to the results one obtains when using conventional approaches.
△ Less
Submitted 25 August, 2023; v1 submitted 12 January, 2023;
originally announced January 2023.
-
An agnostic-Dolinar receiver for coherent states classification
Authors:
Fabio Zoratti,
Nicola Dalla Pozza,
Marco Fanizza,
Vittorio Giovannetti
Abstract:
We consider the problem of discriminating quantum states, where the task is to distinguish two different quantum states with a complete classical knowledge about them, and the problem of classifying quantum states, where the task is to distinguish two classes of quantum states where no prior classical information is available but a finite number of physical copies of each classes are given. In the…
▽ More
We consider the problem of discriminating quantum states, where the task is to distinguish two different quantum states with a complete classical knowledge about them, and the problem of classifying quantum states, where the task is to distinguish two classes of quantum states where no prior classical information is available but a finite number of physical copies of each classes are given. In the case the quantum states are represented by coherent states of light, we identify intermediate scenarios where partial prior information is available. We evaluate an analytical expression for the minimum error when the quantum states are opposite and a prior on the amplitudes is known. Such a threshold is attained by complex POVM that involve highly non-linear optical procedure. A suboptimal procedure that can be implemented with current technology is presented that is based on a modification of the conventional Dolinar receiver. We study and compare the performance of the scheme under different assumptions on the prior information available.
△ Less
Submitted 22 June, 2021;
originally announced June 2021.
