-
Quantum-inspired Embeddings Projection and Similarity Metrics for Representation Learning
Authors:
Ivan Kankeu,
Stefan Gerd Fritsch,
Gunnar Schönhoff,
Elie Mounzer,
Paul Lukowicz,
Maximilian Kiefer-Emmanouilidis
Abstract:
Over the last decade, representation learning, which embeds complex information extracted from large amounts of data into dense vector spaces, has emerged as a key technique in machine learning. Among other applications, it has been a key building block for large language models and advanced computer vision systems based on contrastive learning. A core component of representation learning systems…
▽ More
Over the last decade, representation learning, which embeds complex information extracted from large amounts of data into dense vector spaces, has emerged as a key technique in machine learning. Among other applications, it has been a key building block for large language models and advanced computer vision systems based on contrastive learning. A core component of representation learning systems is the projection head, which maps the original embeddings into different, often compressed spaces, while preserving the similarity relationship between vectors.
In this paper, we propose a quantum-inspired projection head that includes a corresponding quantum-inspired similarity metric. Specifically, we map classical embeddings onto quantum states in Hilbert space and introduce a quantum circuit-based projection head to reduce embedding dimensionality. To evaluate the effectiveness of this approach, we extended the BERT language model by integrating our projection head for embedding compression. We compared the performance of embeddings, which were compressed using our quantum-inspired projection head, with those compressed using a classical projection head on information retrieval tasks using the TREC 2019 and TREC 2020 Deep Learning benchmarks. The results demonstrate that our quantum-inspired method achieves competitive performance relative to the classical method while utilizing 32 times fewer parameters. Furthermore, when trained from scratch, it notably excels, particularly on smaller datasets. This work not only highlights the effectiveness of the quantum-inspired approach but also emphasizes the utility of efficient, ad hoc low-entanglement circuit simulations within neural networks as a powerful quantum-inspired technique.
△ Less
Submitted 8 January, 2025;
originally announced January 2025.
-
Benefiting from Quantum? A Comparative Study of Q-Seg, Quantum-Inspired Techniques, and U-Net for Crack Segmentation
Authors:
Akshaya Srinivasan,
Alexander Geng,
Antonio Macaluso,
Maximilian Kiefer-Emmanouilidis,
Ali Moghiseh
Abstract:
Exploring the potential of quantum hardware for enhancing classical and real-world applications is an ongoing challenge. This study evaluates the performance of quantum and quantum-inspired methods compared to classical models for crack segmentation. Using annotated gray-scale image patches of concrete samples, we benchmark a classical mean Gaussian mixture technique, a quantum-inspired fermion-ba…
▽ More
Exploring the potential of quantum hardware for enhancing classical and real-world applications is an ongoing challenge. This study evaluates the performance of quantum and quantum-inspired methods compared to classical models for crack segmentation. Using annotated gray-scale image patches of concrete samples, we benchmark a classical mean Gaussian mixture technique, a quantum-inspired fermion-based method, Q-Seg a quantum annealing-based method, and a U-Net deep learning architecture. Our results indicate that quantum-inspired and quantum methods offer a promising alternative for image segmentation, particularly for complex crack patterns, and could be applied in near-future applications.
△ Less
Submitted 14 October, 2024;
originally announced October 2024.
-
DisQu: Investigating the Impact of Disorder in Quantum Generative Models
Authors:
Yannick Werner,
Jasmin Frkatovic,
Vitor Fortes Rey,
Matthias Tschöpe,
Sungho Suh,
Paul Lukowicz,
Nikolaos Palaiodimopoulos,
Maximilian Kiefer-Emmanouilidis
Abstract:
Disordered Quantum many-body Systems (DQS) and Quantum Neural Networks (QNN) have many structural features in common. However, a DQS is essentially an initialized QNN with random weights, often leading to non-random outcomes. In this work, we emphasize the possibilities of random processes being a deceptive quantum-generating model effectively hidden in a QNN. When we choose weights in a QNN rando…
▽ More
Disordered Quantum many-body Systems (DQS) and Quantum Neural Networks (QNN) have many structural features in common. However, a DQS is essentially an initialized QNN with random weights, often leading to non-random outcomes. In this work, we emphasize the possibilities of random processes being a deceptive quantum-generating model effectively hidden in a QNN. When we choose weights in a QNN randomly the unitarity property of quantum gates is unchanged. As we show, this can lead to memory effects with multiple consequences on the learnability and trainability of QNN one would not expect from a classical neural network with random weights. This phenomenon may lead to a fundamental misunderstanding of the capabilities of common quantum generative models, where the generation of new samples is essentially averaging over random outputs. While we suggest that DQS can be effectively used for tasks like image augmentation, we draw the attention that overly simple datasets are often used to show the generative capabilities of quantum models, potentially leading to overestimation of their effectiveness.
△ Less
Submitted 17 February, 2025; v1 submitted 24 September, 2024;
originally announced September 2024.
-
Stabilizing an ultracold Fermi gas against Fermi acceleration to superdiffusion through localization
Authors:
Sian Barbosa,
Maximilian Kiefer-Emmanouilidis,
Felix Lang,
Jennifer Koch,
Artur Widera
Abstract:
Anderson localization, i.e., destructive quantum interference of multiple-scattering paths, halts transport entirely. Contrarily, time-dependent random forces expedite transport via Fermi acceleration, proposed as a mechanism for high-energy cosmic rays. Their competition creates interesting dynamics, but experimental observations are scarce. Here, we experimentally study the expansion of an ultra…
▽ More
Anderson localization, i.e., destructive quantum interference of multiple-scattering paths, halts transport entirely. Contrarily, time-dependent random forces expedite transport via Fermi acceleration, proposed as a mechanism for high-energy cosmic rays. Their competition creates interesting dynamics, but experimental observations are scarce. Here, we experimentally study the expansion of an ultracold Fermi gas inside time-dependent disorder and observe distinct regimes from sub- to superdiffusion. Unexpectedly, quantum interference counteracts acceleration in strong disorder. Our system enables the investigation of Fermi acceleration in the quantum-transport regime.
△ Less
Submitted 14 May, 2024; v1 submitted 14 November, 2023;
originally announced November 2023.
-
What can we learn from diffusion about Anderson localization of a degenerate Fermi gas?
Authors:
Sian Barbosa,
Maximilian Kiefer-Emmanouilidis,
Felix Lang,
Jennifer Koch,
Artur Widera
Abstract:
Disorder can fundamentally modify the transport properties of a system. A striking example is Anderson localization, suppressing transport due to destructive interference of propagation paths. In inhomogeneous many-body systems, not all particles are localized for finite-strength disorder, and the system can become partially diffusive. Unravelling the intricate signatures of localization from such…
▽ More
Disorder can fundamentally modify the transport properties of a system. A striking example is Anderson localization, suppressing transport due to destructive interference of propagation paths. In inhomogeneous many-body systems, not all particles are localized for finite-strength disorder, and the system can become partially diffusive. Unravelling the intricate signatures of localization from such observed diffusion is a long-standing problem. Here, we experimentally study a degenerate, spin-polarized Fermi gas in a disorder potential formed by an optical speckle pattern. We record the diffusion in the disordered potential upon release from an external confining potential. We compare different methods to analyze the resulting density distributions, including a new method to capture particle dynamics by evaluating absorption-image statistics. Using standard observables, such as diffusion exponent and coefficient, localized fraction, or localization length, we find that some show signatures for a transition to localization above a critical disorder strength, while others show a smooth crossover to a modified diffusion regime. In laterally displaced disorder, we spatially resolve different transport regimes simultaneously which allows us to extract the subdiffusion exponent expected for weak localization. Our work emphasizes that the transition toward localization can be investigated by closely analyzing the system's diffusion, offering ways of revealing localization effects beyond the signature of exponentially decaying density distribution.
△ Less
Submitted 23 February, 2024; v1 submitted 13 November, 2023;
originally announced November 2023.
-
Quantum inspired image augmentation applicable to waveguides and optical image transfer via Anderson Localization
Authors:
Nikolaos E. Palaiodimopoulos,
Vitor Fortes Rey,
Matthias Tschöpe,
Christina Jörg,
Paul Lukowicz,
Maximilian Kiefer-Emmanouilidis
Abstract:
We present a quantum inspired image augmentation protocol which is applicable to classical images and, in principle, due to its known quantum formulation applicable to quantum systems and quantum machine learning in the future. The augmentation technique relies on the phenomenon Anderson localization. As we will illustrate by numerical examples the technique changes classical wave properties by in…
▽ More
We present a quantum inspired image augmentation protocol which is applicable to classical images and, in principle, due to its known quantum formulation applicable to quantum systems and quantum machine learning in the future. The augmentation technique relies on the phenomenon Anderson localization. As we will illustrate by numerical examples the technique changes classical wave properties by interference effects resulting from scatterings at impurities in the material. We explain that the augmentation can be understood as multiplicative noise, which counter-intuitively averages out, by sampling over disorder realizations. Furthermore, we show how the augmentation can be implemented in arrays of disordered waveguides with direct implications for an efficient optical image transfer.
△ Less
Submitted 20 February, 2023;
originally announced February 2023.
-
Comment on "Resonance-induced growth of number entropy in strongly disordered systems"
Authors:
Maximilian Kiefer-Emmanouilidis,
Razmik Unanyan,
Michael Fleischhauer,
Jesko Sirker
Abstract:
We comment on the recent paper by Ghosh and Žnidarič (Phys. Rev. B 105, 144203 (2022)) which studies the growth of the number entropy $S_N$ in the Heisenberg model with random magnetic fields after a quantum quench. The authors present arguments for an intermediate power-law growth in time $t$ and a sub-ergodic saturation value, claiming consistency of their results with many-body localization (MB…
▽ More
We comment on the recent paper by Ghosh and Žnidarič (Phys. Rev. B 105, 144203 (2022)) which studies the growth of the number entropy $S_N$ in the Heisenberg model with random magnetic fields after a quantum quench. The authors present arguments for an intermediate power-law growth in time $t$ and a sub-ergodic saturation value, claiming consistency of their results with many-body localization (MBL) for strong disorder. We show that these interpretations are inconsistent with other recent studies and discuss specific issues with the analysis of the numerical data. We point out, in particular, that (i) the saturation values $\widetilde{S}_N(L,W)$ for fixed length $L$ are only bounded from above by 'the ergodic value' and are already far below this value for $W\ll 1$. Furthermore, the saturation values can show non-monotonic scaling with $L$. (ii) Power-law fits $S_N(t)\sim 1/t^α$ -- with $α=1$ expected based on the resonance model described in the paper -- yield a system-size dependent exponent $α$ while fits $S_N\sim \frac{1}{W^3}\ln\ln t$ do hold independent of system size and over several orders of magnitude in time. (iii) We also argue that for the cases where the effective resonance model works best and predicts a saturation of the number entropy, the same applies to the von-Neumann entropy, i.e.~the dynamics at the considered scales is of single particle type and unrelated to MBL.
△ Less
Submitted 20 June, 2022; v1 submitted 13 March, 2022;
originally announced March 2022.
-
Quantum spin liquids of Rydberg excitations in a honeycomb lattice induced by density-dependent Peierls phases
Authors:
Simon Ohler,
Maximilian Kiefer-Emmanouilidis,
Michael Fleischhauer
Abstract:
We show that the nonlinear transport of bosonic excitations in a two-dimensional honeycomb lattice of spin-orbit coupled Rydberg atoms gives rise to disordered quantum phases which are candidates for quantum spin liquids. As recently demonstrated in [Lienhard et al. Phys. Rev. X, 10, 021031 (2020)] the spin-orbit coupling breaks time-reversal and chiral symmetries and leads to a tunable density-de…
▽ More
We show that the nonlinear transport of bosonic excitations in a two-dimensional honeycomb lattice of spin-orbit coupled Rydberg atoms gives rise to disordered quantum phases which are candidates for quantum spin liquids. As recently demonstrated in [Lienhard et al. Phys. Rev. X, 10, 021031 (2020)] the spin-orbit coupling breaks time-reversal and chiral symmetries and leads to a tunable density-dependent complex hopping of the hard-core bosons or equivalently to complex XY spin interactions. Using exact diagonalization (ED) we numerically investigate the phase diagram resulting from the competition between density-dependent and direct transport terms. In mean-field approximation there is a phase transition from a quasi-condensate to a 120° phase when the amplitude of the complex hopping exceeds that of the direct one. In the full model a new phase with a finite spin gap emerges close to the mean-field critical point as a result of quantum fluctuations induced by the density-dependence of the complex hopping. We show that this phase is a genuine disordered one, has a non-vanishing spin chirality and is characterized by a non-trivial many-body Chern number. ED simulations of small lattices with up to 28 lattice sites point to a non-degenerate ground state and thus to a bosonic integer-quantum Hall (BIQH) phase, protected by U(1) symmetry. The Chern number of C = 1, which is robust to disorder, is however different from the even Chern numbers found in BIQH phases. For very strong, nonlinear hoppings of opposite sign we find another disordered regime with vanishing spin gap. This phase also has a large spin chirality and could be a gapless spin-liquid but lies outside the parameter regime accessible in the Rydberg system.
△ Less
Submitted 1 March, 2023; v1 submitted 7 February, 2022;
originally announced February 2022.
-
Self-generated quantum gauge fields in arrays of Rydberg atoms
Authors:
Simon Ohler,
Maximilian Kiefer-Emmanouilidis,
Antoine Browaeys,
Hans Peter Büchler,
Michael Fleischhauer
Abstract:
As shown in recent experiments [V. Lienhard et al., Phys. Rev. X 10, 021031 (2020)], spin-orbit coupling in systems of Rydberg atoms can give rise to density-dependent Peierls Phases in second-order hoppings of Rydberg spin excitations and nearest-neighbor (NN) repulsion. We here study theoretically a one-dimensional zig-zag ladder system of such spin-orbit coupled Rydberg atoms at half filling. T…
▽ More
As shown in recent experiments [V. Lienhard et al., Phys. Rev. X 10, 021031 (2020)], spin-orbit coupling in systems of Rydberg atoms can give rise to density-dependent Peierls Phases in second-order hoppings of Rydberg spin excitations and nearest-neighbor (NN) repulsion. We here study theoretically a one-dimensional zig-zag ladder system of such spin-orbit coupled Rydberg atoms at half filling. The second-order hopping is shown to be associated with an effective gauge field, which in mean-field approximation is static and homogeneous. Beyond the mean-field level the gauge potential attains a transverse quantum component whose amplitude is dynamical and linked to density modulations. We here study the effects of this to the possible ground-state phases of the system. In a phase where strong repulsion leads to a density wave, we find that as a consequence of the induced quantum gauge field a regular pattern of current vortices is formed. However also in the absence of density-density interactions the quantum gauge field attains a non-vanishing amplitude. Above a certain critical strength of the second-order hopping the energy gain due to gauge-field induced transport overcomes the energy cost from the associated build-up of density modulations leading to a spontaneous generation of the quantum gauge field.
△ Less
Submitted 31 August, 2021;
originally announced August 2021.
-
Particle fluctuations and the failure of simple effective models for many-body localized phases
Authors:
Maximilian Kiefer-Emmanouilidis,
Razmik Unanyan,
Michael Fleischhauer,
Jesko Sirker
Abstract:
We investigate and compare the particle number fluctuations in the putative many-body localized (MBL) phase of a spinless fermion model with potential disorder and nearest-neighbor interactions with those in the non-interacting case (Anderson localization) and in effective models where only interaction terms diagonal in the Anderson basis are kept. We demonstrate that these types of simple effecti…
▽ More
We investigate and compare the particle number fluctuations in the putative many-body localized (MBL) phase of a spinless fermion model with potential disorder and nearest-neighbor interactions with those in the non-interacting case (Anderson localization) and in effective models where only interaction terms diagonal in the Anderson basis are kept. We demonstrate that these types of simple effective models cannot account for the particle number fluctuations observed in the MBL phase of the microscopic model. This implies that assisted and pair hopping terms---generated when transforming the microscopic Hamiltonian into the Anderson basis---cannot be neglected. As a consequence, it appears questionable if the microscopic model possesses an exponential number of exactly conserved local charges. If such exactly conserved local charges do not exist, then particles are expected to ultimately delocalize for any finite disorder strength.
△ Less
Submitted 6 August, 2021;
originally announced August 2021.
-
Unlimited growth of particle fluctuations in many-body localized phases
Authors:
M. Kiefer-Emmanouilidis,
R. Unanyan,
M. Fleischhauer,
J. Sirker
Abstract:
We study quench dynamics in a t-V chain of spinless fermions (equivalent to the spin-1/2 Heisenberg chain) with strong potential disorder. For this prototypical model of many-body localization we have recently argued that -- contrary to the established picture -- particles do not become fully localized. Here we summarize and expand on our previous results for various entanglement measures such as…
▽ More
We study quench dynamics in a t-V chain of spinless fermions (equivalent to the spin-1/2 Heisenberg chain) with strong potential disorder. For this prototypical model of many-body localization we have recently argued that -- contrary to the established picture -- particles do not become fully localized. Here we summarize and expand on our previous results for various entanglement measures such as the number and the Hartley number entropy. We investigate, in particular, possible alternative interpretations of our numerical data. We find that none of these alternative interpretations appears to hold and, in the process, discover further strong evidence for the absence of localization. Furthermore, we obtain more insights into the entanglement dynamics and the particle fluctuations by comparing with non-interacting systems where we derive several strict bounds. We find that renormalized versions of these bounds also hold in the interacting case where they provide support for numerically discovered scaling relations between number and entanglement entropies.
△ Less
Submitted 22 December, 2020;
originally announced December 2020.
-
Absence of true localization in many-body localized phases
Authors:
Maximilian Kiefer-Emmanouilidis,
Razmik Unanyan,
Michael Fleischhauer,
Jesko Sirker
Abstract:
We have recently shown that the logarithmic growth of the entanglement entropy following a quantum quench in a many-body localized (MBL) phase is accompanied by a slow growth of the number entropy, $S_N\sim\ln\ln t$. Here we provide an in-depth numerical study of $S_N(t)$ for the disordered Heisenberg chain and show that this behavior is not transient and persists even for very strong disorder. Ca…
▽ More
We have recently shown that the logarithmic growth of the entanglement entropy following a quantum quench in a many-body localized (MBL) phase is accompanied by a slow growth of the number entropy, $S_N\sim\ln\ln t$. Here we provide an in-depth numerical study of $S_N(t)$ for the disordered Heisenberg chain and show that this behavior is not transient and persists even for very strong disorder. Calculating the truncated Rényi number entropy $S_N^{(α)}(t)=(1-α)^{-1}\ln\sum_n p^α(n)$ for $α\ll 1$ and $p(n)>p_c$ -- which is sensitive to large number fluctuations occurring with low probability -- we demonstrate that the particle number distribution $p(n)$ in one half of the system has a continuously growing tail. This indicates a slow but steady increase of the number of particles crossing between the partitions in the interacting case, and is in sharp contrast to Anderson localization, for which we show that $S_N^{(α\to 0)}(t)$ saturates for any cutoff $p_c>0$. We show, furthermore, that the growth of $S_N$ is $\mathit not$ the consequence of rare states or rare regions but rather represents typical behavior. These findings provide strong evidence that the interacting system is never fully localized even for very strong but finite disorder.
△ Less
Submitted 12 December, 2020; v1 submitted 1 October, 2020;
originally announced October 2020.
-
Evidence for unbounded growth of the number entropy in many-body localized phases
Authors:
Maximilian Kiefer-Emmanouilidis,
Razmik Unanyan,
Michael Fleischhauer,
Jesko Sirker
Abstract:
We investigate the number entropy $S_N$---which characterizes particle-number fluctuations between subsystems---following a quench in one-dimensional interacting many-body systems with potential disorder. We find evidence that in the regime which is expected to show many-body localization (MBL) and where the entanglement entropy grows as $S\sim \ln t$ as function of time $t$, the number entropy gr…
▽ More
We investigate the number entropy $S_N$---which characterizes particle-number fluctuations between subsystems---following a quench in one-dimensional interacting many-body systems with potential disorder. We find evidence that in the regime which is expected to show many-body localization (MBL) and where the entanglement entropy grows as $S\sim \ln t$ as function of time $t$, the number entropy grows as $S_N\sim\ln\ln t$, indicating continuing particle transport at a very slow rate. We demonstrate that this growth is consistent with a relation between entanglement and number entropy recently established for non-interacting systems.
△ Less
Submitted 23 March, 2020; v1 submitted 10 March, 2020;
originally announced March 2020.
-
Bounds on the entanglement entropy by the number entropy in non-interacting fermionic systems
Authors:
Maximilian Kiefer-Emmanouilidis,
Razmik Unanyan,
Jesko Sirker,
Michael Fleischhauer
Abstract:
Entanglement in a pure state of a many-body system can be characterized by the Rényi entropies $S^{(α)}=\ln\textrm{tr}(ρ^α)/(1-α)$ of the reduced density matrix $ρ$ of a subsystem. These entropies are, however, difficult to access experimentally and can typically be determined for small systems only. Here we show that for free fermionic systems in a Gaussian state and with particle number conserva…
▽ More
Entanglement in a pure state of a many-body system can be characterized by the Rényi entropies $S^{(α)}=\ln\textrm{tr}(ρ^α)/(1-α)$ of the reduced density matrix $ρ$ of a subsystem. These entropies are, however, difficult to access experimentally and can typically be determined for small systems only. Here we show that for free fermionic systems in a Gaussian state and with particle number conservation, $\ln S^{(2)}$ can be tightly bound by the much easier accessible Rényi number entropy $S^{(2)}_N=-\ln \sum_n p^2(n)$ which is a function of the probability distribution $p(n)$ of the total particle number in the considered subsystem only. A dynamical growth in entanglement, in particular, is therefore always accompanied by a growth---albeit logarithmically slower---of the number entropy. We illustrate this relation by presenting numerical results for quenches in non-interacting one-dimensional lattice models including disorder-free, Anderson-localized, and critical systems with off-diagonal disorder.
△ Less
Submitted 6 March, 2020;
originally announced March 2020.
-
Finite-temperature topological invariant for interacting systems
Authors:
Razmik Unanyan,
Maximilian Kiefer-Emmanouilidis,
Michael Fleischhauer
Abstract:
We generalize the Ensemble Geometric Phase (EGP), recently introduced to classify the topology of density matrices, to finite-temperature states of interacting systems in one spatial dimension (1D). This includes cases where the gapped ground state has a fractional filling and is degenerate. At zero temperature the corresponding topological invariant agrees with the well-known invariant of Niu, Th…
▽ More
We generalize the Ensemble Geometric Phase (EGP), recently introduced to classify the topology of density matrices, to finite-temperature states of interacting systems in one spatial dimension (1D). This includes cases where the gapped ground state has a fractional filling and is degenerate. At zero temperature the corresponding topological invariant agrees with the well-known invariant of Niu, Thouless and Wu. We show that its value at finite temperatures is identical to that of the ground state below some critical temperature $T_c$ larger than the many-body gap. We illustrate our result with numerical simulations of the 1D extended super-lattice Bose-Hubbard model at quarter filling. Here a cyclic change of parameters in the ground state leads to a topological charge pump with fractional winding $ν=1/2$. The particle transport is no longer quantized when the temperature becomes comparable to the many-body gap, yet the winding of the generalized EGP is.
△ Less
Submitted 16 December, 2021; v1 submitted 27 June, 2019;
originally announced June 2019.
-
Current reversals and metastable states in the infinite Bose-Hubbard chain with local particle loss
Authors:
M. Kiefer-Emmanouilidis,
J. Sirker
Abstract:
We present an algorithm which combines the quantum trajectory approach to open quantum systems with a density-matrix renormalization group scheme for infinite one-dimensional lattice systems. We apply this method to investigate the long-time dynamics in the Bose-Hubbard model with local particle loss starting from a Mott-insulating initial state with one boson per site. While the short-time dynami…
▽ More
We present an algorithm which combines the quantum trajectory approach to open quantum systems with a density-matrix renormalization group scheme for infinite one-dimensional lattice systems. We apply this method to investigate the long-time dynamics in the Bose-Hubbard model with local particle loss starting from a Mott-insulating initial state with one boson per site. While the short-time dynamics can be described even quantitatively by an equation of motion (EOM) approach at the mean-field level, many-body interactions lead to unexpected effects at intermediate and long times: local particle currents far away from the dissipative site start to reverse direction ultimately leading to a metastable state with a total particle current pointing away from the lossy site. An alternative EOM approach based on an effective fermion model shows that the reversal of currents can be understood qualitatively by the creation of holon-doublon pairs at the edge of the region of reduced particle density. The doublons are then able to escape while the holes move towards the dissipative site, a process reminiscent---in a loose sense---of Hawking radiation.
△ Less
Submitted 16 September, 2017;
originally announced September 2017.
