-
Modern applications of machine learning in quantum sciences
Authors:
Anna Dawid,
Julian Arnold,
Borja Requena,
Alexander Gresch,
Marcin Płodzień,
Kaelan Donatella,
Kim A. Nicoli,
Paolo Stornati,
Rouven Koch,
Miriam Büttner,
Robert Okuła,
Gorka Muñoz-Gil,
Rodrigo A. Vargas-Hernández,
Alba Cervera-Lierta,
Juan Carrasquilla,
Vedran Dunjko,
Marylou Gabrié,
Patrick Huembeli,
Evert van Nieuwenburg,
Filippo Vicentini,
Lei Wang,
Sebastian J. Wetzel,
Giuseppe Carleo,
Eliška Greplová,
Roman Krems
, et al. (4 additional authors not shown)
Abstract:
In this book, we provide a comprehensive introduction to the most recent advances in the application of machine learning methods in quantum sciences. We cover the use of deep learning and kernel methods in supervised, unsupervised, and reinforcement learning algorithms for phase classification, representation of many-body quantum states, quantum feedback control, and quantum circuits optimization.…
▽ More
In this book, we provide a comprehensive introduction to the most recent advances in the application of machine learning methods in quantum sciences. We cover the use of deep learning and kernel methods in supervised, unsupervised, and reinforcement learning algorithms for phase classification, representation of many-body quantum states, quantum feedback control, and quantum circuits optimization. Moreover, we introduce and discuss more specialized topics such as differentiable programming, generative models, statistical approach to machine learning, and quantum machine learning.
△ Less
Submitted 7 June, 2025; v1 submitted 8 April, 2022;
originally announced April 2022.
-
Hessian-based toolbox for reliable and interpretable machine learning in physics
Authors:
Anna Dawid,
Patrick Huembeli,
Michał Tomza,
Maciej Lewenstein,
Alexandre Dauphin
Abstract:
Machine learning (ML) techniques applied to quantum many-body physics have emerged as a new research field. While the numerical power of this approach is undeniable, the most expressive ML algorithms, such as neural networks, are black boxes: The user does neither know the logic behind the model predictions nor the uncertainty of the model predictions. In this work, we present a toolbox for interp…
▽ More
Machine learning (ML) techniques applied to quantum many-body physics have emerged as a new research field. While the numerical power of this approach is undeniable, the most expressive ML algorithms, such as neural networks, are black boxes: The user does neither know the logic behind the model predictions nor the uncertainty of the model predictions. In this work, we present a toolbox for interpretability and reliability, agnostic of the model architecture. In particular, it provides a notion of the influence of the input data on the prediction at a given test point, an estimation of the uncertainty of the model predictions, and an extrapolation score for the model predictions. Such a toolbox only requires a single computation of the Hessian of the training loss function. Our work opens the road to the systematic use of interpretability and reliability methods in ML applied to physics and, more generally, science.
△ Less
Submitted 4 August, 2021;
originally announced August 2021.
-
Phase Detection with Neural Networks: Interpreting the Black Box
Authors:
Anna Dawid,
Patrick Huembeli,
Michał Tomza,
Maciej Lewenstein,
Alexandre Dauphin
Abstract:
Neural networks (NNs) usually hinder any insight into the reasoning behind their predictions. We demonstrate how influence functions can unravel the black box of NN when trained to predict the phases of the one-dimensional extended spinless Fermi-Hubbard model at half-filling. Results provide strong evidence that the NN correctly learns an order parameter describing the quantum transition in this…
▽ More
Neural networks (NNs) usually hinder any insight into the reasoning behind their predictions. We demonstrate how influence functions can unravel the black box of NN when trained to predict the phases of the one-dimensional extended spinless Fermi-Hubbard model at half-filling. Results provide strong evidence that the NN correctly learns an order parameter describing the quantum transition in this model. We demonstrate that influence functions allow to check that the network, trained to recognize known quantum phases, can predict new unknown ones within the data set. Moreover, we show they can guide physicists in understanding patterns responsible for the phase transition. This method requires no a priori knowledge on the order parameter, has no dependence on the NN's architecture or the underlying physical model, and is therefore applicable to a broad class of physical models or experimental data.
△ Less
Submitted 12 November, 2020; v1 submitted 9 April, 2020;
originally announced April 2020.
-
Unsupervised phase discovery with deep anomaly detection
Authors:
Korbinian Kottmann,
Patrick Huembeli,
Maciej Lewenstein,
Antonio Acin
Abstract:
We demonstrate how to explore phase diagrams with automated and unsupervised machine learning to find regions of interest for possible new phases. In contrast to supervised learning, where data is classified using predetermined labels, we here perform anomaly detection, where the task is to differentiate a normal data set, composed of one or several classes, from anomalous data. Asa paradigmatic e…
▽ More
We demonstrate how to explore phase diagrams with automated and unsupervised machine learning to find regions of interest for possible new phases. In contrast to supervised learning, where data is classified using predetermined labels, we here perform anomaly detection, where the task is to differentiate a normal data set, composed of one or several classes, from anomalous data. Asa paradigmatic example, we explore the phase diagram of the extended Bose Hubbard model in one dimension at exact integer filling and employ deep neural networks to determine the entire phase diagram in a completely unsupervised and automated fashion. As input data for learning, we first use the entanglement spectra and central tensors derived from tensor-networks algorithms for ground-state computation and later we extend our method and use experimentally accessible data such as low-order correlation functions as inputs. Our method allows us to reveal a phase-separated region between supersolid and superfluid parts with unexpected properties, which appears in the system in addition to the standard superfluid, Mott insulator, Haldane-insulating, and density wave phases.
△ Less
Submitted 18 March, 2021; v1 submitted 22 March, 2020;
originally announced March 2020.
-
QuCumber: wavefunction reconstruction with neural networks
Authors:
Matthew J. S. Beach,
Isaac De Vlugt,
Anna Golubeva,
Patrick Huembeli,
Bohdan Kulchytskyy,
Xiuzhe Luo,
Roger G. Melko,
Ejaaz Merali,
Giacomo Torlai
Abstract:
As we enter a new era of quantum technology, it is increasingly important to develop methods to aid in the accurate preparation of quantum states for a variety of materials, matter, and devices. Computational techniques can be used to reconstruct a state from data, however the growing number of qubits demands ongoing algorithmic advances in order to keep pace with experiments. In this paper, we pr…
▽ More
As we enter a new era of quantum technology, it is increasingly important to develop methods to aid in the accurate preparation of quantum states for a variety of materials, matter, and devices. Computational techniques can be used to reconstruct a state from data, however the growing number of qubits demands ongoing algorithmic advances in order to keep pace with experiments. In this paper, we present an open-source software package called QuCumber that uses machine learning to reconstruct a quantum state consistent with a set of projective measurements. QuCumber uses a restricted Boltzmann machine to efficiently represent the quantum wavefunction for a large number of qubits. New measurements can be generated from the machine to obtain physical observables not easily accessible from the original data.
△ Less
Submitted 16 May, 2019; v1 submitted 21 December, 2018;
originally announced December 2018.
-
Automated discovery of characteristic features of phase transitions in many-body localization
Authors:
Patrick Huembeli,
Alexandre Dauphin,
Peter Wittek,
Christian Gogolin
Abstract:
We identify a new "order parameter" for the disorder driven many-body localization (MBL) transition by leveraging artificial intelligence. This allows us to pin down the transition, as the point at which the physics changes qualitatively, from vastly fewer disorder realizations and in an objective and cleaner way than is possible with the existing zoo of quantities. Contrary to previous studies, o…
▽ More
We identify a new "order parameter" for the disorder driven many-body localization (MBL) transition by leveraging artificial intelligence. This allows us to pin down the transition, as the point at which the physics changes qualitatively, from vastly fewer disorder realizations and in an objective and cleaner way than is possible with the existing zoo of quantities. Contrary to previous studies, our method is almost entirely unsupervised. A game theoretic process between neural networks defines an adversarial setup with conflicting objectives to identify what characteristic features to base efficient predictions on. This reduces the numerical effort for mapping out the phase diagram by a factor of ~100x. This approach of automated discovery is applicable specifically to poorly understood phase transitions and exemplifies the potential of machine learning assisted research in physics.
△ Less
Submitted 18 November, 2019; v1 submitted 1 June, 2018;
originally announced June 2018.
-
Identifying Quantum Phase Transitions with Adversarial Neural Networks
Authors:
Patrick Huembeli,
Alexandre Dauphin,
Peter Wittek
Abstract:
The identification of phases of matter is a challenging task, especially in quantum mechanics, where the complexity of the ground state appears to grow exponentially with the size of the system. We address this problem with state-of-the-art deep learning techniques: adversarial domain adaptation. We derive the phase diagram of the whole parameter space starting from a fixed and known subspace usin…
▽ More
The identification of phases of matter is a challenging task, especially in quantum mechanics, where the complexity of the ground state appears to grow exponentially with the size of the system. We address this problem with state-of-the-art deep learning techniques: adversarial domain adaptation. We derive the phase diagram of the whole parameter space starting from a fixed and known subspace using unsupervised learning. The input data set contains both labeled and unlabeled data instances. The first kind is a system that admits an accurate analytical or numerical solution, and one can recover its phase diagram. The second type is the physical system with an unknown phase diagram. Adversarial domain adaptation uses both types of data to create invariant feature extracting layers in a deep learning architecture. Once these layers are trained, we can attach an unsupervised learner to the network to find phase transitions. We show the success of this technique by applying it on several paradigmatic models: the Ising model with different temperatures, the Bose-Hubbard model, and the SSH model with disorder. The input is the ground state without any manual feature engineering, and the dimension of the parameter space is unrestricted. The method finds unknown transitions successfully and predicts transition points in close agreement with standard methods. This study opens the door to the classification of physical systems where the phases boundaries are complex such as the many-body localization problem or the Bose glass phase.
△ Less
Submitted 31 March, 2018; v1 submitted 11 October, 2017;
originally announced October 2017.
