-
Phase Transitions in the Output Distribution of Large Language Models
Authors:
Julian Arnold,
Flemming Holtorf,
Frank Schäfer,
Niels Lörch
Abstract:
In a physical system, changing parameters such as temperature can induce a phase transition: an abrupt change from one state of matter to another. Analogous phenomena have recently been observed in large language models. Typically, the task of identifying phase transitions requires human analysis and some prior understanding of the system to narrow down which low-dimensional properties to monitor…
▽ More
In a physical system, changing parameters such as temperature can induce a phase transition: an abrupt change from one state of matter to another. Analogous phenomena have recently been observed in large language models. Typically, the task of identifying phase transitions requires human analysis and some prior understanding of the system to narrow down which low-dimensional properties to monitor and analyze. Statistical methods for the automated detection of phase transitions from data have recently been proposed within the physics community. These methods are largely system agnostic and, as shown here, can be adapted to study the behavior of large language models. In particular, we quantify distributional changes in the generated output via statistical distances, which can be efficiently estimated with access to the probability distribution over next-tokens. This versatile approach is capable of discovering new phases of behavior and unexplored transitions -- an ability that is particularly exciting in light of the rapid development of language models and their emergent capabilities.
△ Less
Submitted 27 May, 2024;
originally announced May 2024.
-
Machine learning phase transitions: Connections to the Fisher information
Authors:
Julian Arnold,
Niels Lörch,
Flemming Holtorf,
Frank Schäfer
Abstract:
Despite the widespread use and success of machine-learning techniques for detecting phase transitions from data, their working principle and fundamental limits remain elusive. Here, we explain the inner workings and identify potential failure modes of these techniques by rooting popular machine-learning indicators of phase transitions in information-theoretic concepts. Using tools from information…
▽ More
Despite the widespread use and success of machine-learning techniques for detecting phase transitions from data, their working principle and fundamental limits remain elusive. Here, we explain the inner workings and identify potential failure modes of these techniques by rooting popular machine-learning indicators of phase transitions in information-theoretic concepts. Using tools from information geometry, we prove that several machine-learning indicators of phase transitions approximate the square root of the system's (quantum) Fisher information from below -- a quantity that is known to indicate phase transitions but is often difficult to compute from data. We numerically demonstrate the quality of these bounds for phase transitions in classical and quantum systems.
△ Less
Submitted 17 November, 2023;
originally announced November 2023.
-
Fast Detection of Phase Transitions with Multi-Task Learning-by-Confusion
Authors:
Julian Arnold,
Frank Schäfer,
Niels Lörch
Abstract:
Machine learning has been successfully used to study phase transitions. One of the most popular approaches to identifying critical points from data without prior knowledge of the underlying phases is the learning-by-confusion scheme. As input, it requires system samples drawn from a grid of the parameter whose change is associated with potential phase transitions. Up to now, the scheme required tr…
▽ More
Machine learning has been successfully used to study phase transitions. One of the most popular approaches to identifying critical points from data without prior knowledge of the underlying phases is the learning-by-confusion scheme. As input, it requires system samples drawn from a grid of the parameter whose change is associated with potential phase transitions. Up to now, the scheme required training a distinct binary classifier for each possible splitting of the grid into two sides, resulting in a computational cost that scales linearly with the number of grid points. In this work, we propose and showcase an alternative implementation that only requires the training of a single multi-class classifier. Ideally, such multi-task learning eliminates the scaling with respect to the number of grid points. In applications to the Ising model and an image dataset generated with Stable Diffusion, we find significant speedups that closely correspond to the ideal case, with only minor deviations.
△ Less
Submitted 15 November, 2023;
originally announced November 2023.
-
A differentiable programming method for quantum control
Authors:
Frank Schäfer,
Michal Kloc,
Christoph Bruder,
Niels Lörch
Abstract:
Optimal control is highly desirable in many current quantum systems, especially to realize tasks in quantum information processing. We introduce a method based on differentiable programming to leverage explicit knowledge of the differential equations governing the dynamics of the system. In particular, a control agent is represented as a neural network that maps the state of the system at a given…
▽ More
Optimal control is highly desirable in many current quantum systems, especially to realize tasks in quantum information processing. We introduce a method based on differentiable programming to leverage explicit knowledge of the differential equations governing the dynamics of the system. In particular, a control agent is represented as a neural network that maps the state of the system at a given time to a control pulse. The parameters of this agent are optimized via gradient information obtained by direct differentiation through both the neural network \emph{and} the differential equation of the system. This fully differentiable reinforcement learning approach ultimately yields time-dependent control parameters optimizing a desired figure of merit. We demonstrate the method's viability and robustness to noise in eigenstate preparation tasks for three systems: a~single qubit, a~chain of qubits, and a quantum parametric oscillator.
△ Less
Submitted 19 February, 2020;
originally announced February 2020.
-
Unsupervised identification of topological order using predictive models
Authors:
Eliska Greplova,
Agnes Valenti,
Gregor Boschung,
Frank Schäfer,
Niels Lörch,
Sebastian Huber
Abstract:
Machine-learning driven models have proven to be powerful tools for the identification of phases of matter. In particular, unsupervised methods hold the promise to help discover new phases of matter without the need for any prior theoretical knowledge. While for phases characterized by a broken symmetry, the use of unsupervised methods has proven to be successful, topological phases without a loca…
▽ More
Machine-learning driven models have proven to be powerful tools for the identification of phases of matter. In particular, unsupervised methods hold the promise to help discover new phases of matter without the need for any prior theoretical knowledge. While for phases characterized by a broken symmetry, the use of unsupervised methods has proven to be successful, topological phases without a local order parameter seem to be much harder to identify without supervision. Here, we use an unsupervised approach to identify topological phases and transitions out of them. We train artificial neural nets to relate configurational data or measurement outcomes to quantities like temperature or tuning parameters in the Hamiltonian. The accuracy of these predictive models can then serve as an indicator for phase transitions. We successfully illustrate this approach on both the classical Ising gauge theory as well as on the quantum ground state of a generalized toric code.
△ Less
Submitted 22 October, 2019;
originally announced October 2019.
-
Heralded dissipative preparation of nonclassical states in a Kerr oscillator
Authors:
Martin Koppenhöfer,
Christoph Bruder,
Niels Lörch
Abstract:
We present a heralded state preparation scheme for driven nonlinear open quantum systems. The protocol is based on a continuous photon counting measurement of the system's decay channel. When no photons are detected for a period of time, the system has relaxed to a measurement-induced pseudo-steady state. We illustrate the protocol by the creation of states with a negative Wigner function in a Ker…
▽ More
We present a heralded state preparation scheme for driven nonlinear open quantum systems. The protocol is based on a continuous photon counting measurement of the system's decay channel. When no photons are detected for a period of time, the system has relaxed to a measurement-induced pseudo-steady state. We illustrate the protocol by the creation of states with a negative Wigner function in a Kerr oscillator, a system whose unconditional steady state is strictly positive.
△ Less
Submitted 7 February, 2020; v1 submitted 12 June, 2019;
originally announced June 2019.
-
Quantum state preparation for coupled period tripling oscillators
Authors:
Niels Lörch,
Yaxing Zhang,
Christoph Bruder,
M. I. Dykman
Abstract:
We investigate the quantum transition to a correlated state of coupled oscillators in the regime where they display period tripling in response to a drive at triple the eigenfrequency. Correlations are formed between the discrete oscillation phases of individual oscillators. The evolution toward the ordered state is accompanied by the transient breaking of the symmetry between seemingly equivalent…
▽ More
We investigate the quantum transition to a correlated state of coupled oscillators in the regime where they display period tripling in response to a drive at triple the eigenfrequency. Correlations are formed between the discrete oscillation phases of individual oscillators. The evolution toward the ordered state is accompanied by the transient breaking of the symmetry between seemingly equivalent configurations. We attribute this to the nontrivial geometric phase that characterizes period tripling. We also show that the Wigner distribution of a single damped quantum oscillator can display a minimum at the classically stable zero-amplitude state.
△ Less
Submitted 21 April, 2019;
originally announced April 2019.
-
Divergence of predictive model output as indication of phase transitions
Authors:
Frank Schäfer,
Niels Lörch
Abstract:
We introduce a new method to identify phase boundaries in physical systems. It is based on training a predictive model such as a neural network to infer a physical system's parameters from its state. The deviation of the inferred parameters from the underlying correct parameters will be most susceptible and diverge maximally in the vicinity of phase boundaries. Therefore, peaks in the divergence o…
▽ More
We introduce a new method to identify phase boundaries in physical systems. It is based on training a predictive model such as a neural network to infer a physical system's parameters from its state. The deviation of the inferred parameters from the underlying correct parameters will be most susceptible and diverge maximally in the vicinity of phase boundaries. Therefore, peaks in the divergence of the model's predictions are used as indication of phase transitions. Our method is applicable for phase diagrams of arbitrary parameter dimension and without prior information about the phases. Application to both the two-dimensional Ising model and the dissipative Kuramoto-Hopf model show promising results.
△ Less
Submitted 3 December, 2018;
originally announced December 2018.
-
Interaction-induced time-symmetry breaking in driven quantum oscillators
Authors:
M. I. Dykman,
Christoph Bruder,
Niels Lörch,
Yaxing Zhang
Abstract:
We study parametrically driven quantum oscillators and show that, even for weak coupling between the oscillators, they can exhibit various many-body states with broken time-translation symmetry. In the quantum-coherent regime, the symmetry breaking occurs via a nonequilibrium quantum phase transition. For dissipative oscillators, the main effect of the weak coupling is to make the switching rate o…
▽ More
We study parametrically driven quantum oscillators and show that, even for weak coupling between the oscillators, they can exhibit various many-body states with broken time-translation symmetry. In the quantum-coherent regime, the symmetry breaking occurs via a nonequilibrium quantum phase transition. For dissipative oscillators, the main effect of the weak coupling is to make the switching rate of an oscillator between its period-2 states dependent on the states of other oscillators. This allows mapping the oscillators onto a system of coupled spins. Away from the bifurcation parameter values where the period-2 states emerge, the stationary state corresponds to having a microscopic current in the spin system, in the presence of disorder. In the vicinity of the bifurcation point or for identical oscillators, the stationary state can be mapped on that of the Ising model with an effective temperature $\propto \hbar$, for low temperature. Closer to the bifurcation point the coupling can not be considered weak and the system maps onto coupled overdamped Brownian particles performing quantum diffusion in a potential landscape.
△ Less
Submitted 31 May, 2018;
originally announced May 2018.
-
Unraveling nonclassicality in the optomechanical instability
Authors:
Martin Koppenhöfer,
Christoph Bruder,
Niels Lörch
Abstract:
Conditional dynamics due to continuous optical measurements has successfully been applied for state reconstruction and feedback cooling in optomechanical systems. In this article, we show that the same measurement techniques can be used to unravel nonclassicality in optomechanical limit cycles. In contrast to unconditional dynamics, our approach gives rise to nonclassical limit cycles even in the…
▽ More
Conditional dynamics due to continuous optical measurements has successfully been applied for state reconstruction and feedback cooling in optomechanical systems. In this article, we show that the same measurement techniques can be used to unravel nonclassicality in optomechanical limit cycles. In contrast to unconditional dynamics, our approach gives rise to nonclassical limit cycles even in the sideband-unresolved regime, where the cavity decay rate exceeds the mechanical frequency. We predict a significant reduction of the mechanical amplitude fluctuations for realistic experimental parameters.
△ Less
Submitted 8 June, 2018; v1 submitted 16 May, 2018;
originally announced May 2018.
-
Optimal work extraction from quantum states by photo-assisted Cooper pair tunneling
Authors:
Niels Lörch,
Christoph Bruder,
Nicolas Brunner,
Patrick P. Hofer
Abstract:
The theory of quantum thermodynamics predicts fundamental bounds on work extraction from quantum states. As these bounds are derived in a very general and abstract setting, it is unclear how relevant they are in an experimental context, where control is typically limited. Here we address this question by showing that optimal work extraction is possible for a realistic engine. The latter consists o…
▽ More
The theory of quantum thermodynamics predicts fundamental bounds on work extraction from quantum states. As these bounds are derived in a very general and abstract setting, it is unclear how relevant they are in an experimental context, where control is typically limited. Here we address this question by showing that optimal work extraction is possible for a realistic engine. The latter consists of a superconducting circuit, where a LC-resonator is coupled to a Josephson junction. The oscillator state fuels the engine, providing energy absorbed by Cooper pairs, thus producing work in the form of an electrical current against an external voltage bias. We show that this machine can extract the maximal amount of work from all Gaussian and Fock states. Furthermore, we consider work extraction from a continuously stabilized oscillator state. In both scenarios, coherence between energy eigenstates is beneficial, increasing the power output of the machine. This is possible because the phase difference across the Josephson junction provides a phase reference.
△ Less
Submitted 12 July, 2018; v1 submitted 28 February, 2018;
originally announced February 2018.
-
Quantum effects in amplitude death of coupled anharmonic self-oscillators
Authors:
Ehud Amitai,
Martin Koppenhöfer,
Niels Lörch,
Christoph Bruder
Abstract:
Coupling two or more self-oscillating systems may stabilize their zero-amplitude rest-state, therefore quenching their oscillation. This phenomenon is termed "amplitude death". Well-known and studied in classical self-oscillators, amplitude death was only recently investigated in quantum self-oscillators [Ishibashi et al., Phys. Rev. E 96, 052210]. Quantitative differences between the classical an…
▽ More
Coupling two or more self-oscillating systems may stabilize their zero-amplitude rest-state, therefore quenching their oscillation. This phenomenon is termed "amplitude death". Well-known and studied in classical self-oscillators, amplitude death was only recently investigated in quantum self-oscillators [Ishibashi et al., Phys. Rev. E 96, 052210]. Quantitative differences between the classical and quantum descriptions were found. Here, we demonstrate that for quantum self-oscillators with anharmonicity in their energy spectrum, multiple resonances in the mean phonon number can be observed. This is a result of the discrete energy spectrum of these oscillators, and is not present in the corresponding classical model. Experiments can be realized with current technology and would demonstrate these genuine quantum effects in the amplitude death phenomenon.
△ Less
Submitted 11 June, 2018; v1 submitted 13 February, 2018;
originally announced February 2018.
-
Quantum Synchronization Blockade: Energy Quantization hinders Synchronization of Identical Oscillators
Authors:
Niels Lörch,
Simon E. Nigg,
Andreas Nunnenkamp,
Rakesh P. Tiwari,
Christoph Bruder
Abstract:
Classically, the tendency towards spontaneous synchronization is strongest if the natural frequencies of the self-oscillators are as close as possible. We show that this wisdom fails in the deep quantum regime, where the uncertainty of amplitude narrows down to the level of single quanta. Under these circumstances identical self-oscillators cannot synchronize and detuning their frequencies can act…
▽ More
Classically, the tendency towards spontaneous synchronization is strongest if the natural frequencies of the self-oscillators are as close as possible. We show that this wisdom fails in the deep quantum regime, where the uncertainty of amplitude narrows down to the level of single quanta. Under these circumstances identical self-oscillators cannot synchronize and detuning their frequencies can actually help synchronization. The effect can be understood in a simple picture: Interaction requires an exchange of energy. In the quantum regime, the possible quanta of energy are discrete. If the extractable energy of one oscillator does not exactly match the amount the second oscillator may absorb, interaction, and thereby synchronization is blocked. We demon- strate this effect, which we coin quantum synchronization blockade, in the minimal example of two Kerr-type self-oscillators and predict consequences for small oscillator networks, where synchronization between blocked oscillators can be mediated via a detuned oscillator. We also propose concrete implementations with super- conducting circuits and trapped ions. This paves the way for investigations of new quantum synchronization phenomena in oscillator networks both theoretically and experimentally.
△ Less
Submitted 22 June, 2017; v1 submitted 14 March, 2017;
originally announced March 2017.
-
Synchronization of an optomechanical system to an external drive
Authors:
Ehud Amitai,
Niels Lörch,
Andreas Nunnenkamp,
Stefan Walter,
Christoph Bruder
Abstract:
Optomechanical systems driven by an effective blue detuned laser can exhibit self-sustained oscillations of the mechanical oscillator. These self-oscillations are a prerequisite for the observation of synchronization. Here, we study the synchronization of the mechanical oscillations to an external reference drive. We study two cases of reference drives: (1) An additional laser applied to the optic…
▽ More
Optomechanical systems driven by an effective blue detuned laser can exhibit self-sustained oscillations of the mechanical oscillator. These self-oscillations are a prerequisite for the observation of synchronization. Here, we study the synchronization of the mechanical oscillations to an external reference drive. We study two cases of reference drives: (1) An additional laser applied to the optical cavity; (2) A mechanical drive applied directly to the mechanical oscillator. Starting from a master equation description, we derive a microscopic Adler equation for both cases, valid in the classical regime in which the quantum shot noise of the mechanical self-oscillator does not play a role. Furthermore, we numerically show that, in both cases, synchronization arises also in the quantum regime. The optomechanical system is therefore a good candidate for the study of quantum synchronization.
△ Less
Submitted 25 May, 2017; v1 submitted 13 March, 2017;
originally announced March 2017.
-
Optomechanical Self-Oscillations in an Anharmonic Potential: Engineering a Nonclassical Steady State
Authors:
Manuel Grimm,
Christoph Bruder,
Niels Lörch
Abstract:
We study self-oscillations of an optomechanical system, where coherent mechanical oscillations are induced by a driven optical or microwave cavity, for the case of an anharmonic mechanical oscillator potential. A semiclassical analytical model is developed to characterize the limit cycle for large mechanical amplitudes corresponding to a weak nonlinearity. As a result, we predict conditions to ach…
▽ More
We study self-oscillations of an optomechanical system, where coherent mechanical oscillations are induced by a driven optical or microwave cavity, for the case of an anharmonic mechanical oscillator potential. A semiclassical analytical model is developed to characterize the limit cycle for large mechanical amplitudes corresponding to a weak nonlinearity. As a result, we predict conditions to achieve subpoissonian phonon statistics in the steady state, indicating classically forbidden behavior. We compare with numerical simulations and find very good agreement. Our model is quite general and can be applied to other physical systems such as trapped ions or superconducting circuits.
△ Less
Submitted 3 June, 2016;
originally announced June 2016.
-
Genuine quantum signatures in synchronization of anharmonic self-oscillators
Authors:
Niels Lörch,
Ehud Amitai,
Andreas Nunnenkamp,
Christoph Bruder
Abstract:
We study the synchronization of a van der Pol self-oscillator with Kerr anharmonicity to an external drive. We demonstrate that the anharmonic, discrete energy spectrum of the quantum oscillator leads to multiple resonances in both phase locking and frequency entrainment not present in the corresponding classical system. Strong driving close to these resonances leads to nonclassical steady-state…
▽ More
We study the synchronization of a van der Pol self-oscillator with Kerr anharmonicity to an external drive. We demonstrate that the anharmonic, discrete energy spectrum of the quantum oscillator leads to multiple resonances in both phase locking and frequency entrainment not present in the corresponding classical system. Strong driving close to these resonances leads to nonclassical steady-state Wigner distributions. Experimental realizations of these genuine quantum signatures can be implemented with current technology.
△ Less
Submitted 10 August, 2016; v1 submitted 4 March, 2016;
originally announced March 2016.
-
Sub-Poissonian Phonon Lasing in Three-Mode Optomechanics
Authors:
Niels Lörch,
Klemens Hammerer
Abstract:
We propose to use the resonant enhancement of the parametric instability in an optomechanical system of two optical modes coupled to a mechanical oscillator to prepare mechanical states with sub-Poissonian phonon statistics. Strong single photon coupling is not required. The requirements regarding sideband resolution, circulating cavity power and environmental temperature are in reach with state o…
▽ More
We propose to use the resonant enhancement of the parametric instability in an optomechanical system of two optical modes coupled to a mechanical oscillator to prepare mechanical states with sub-Poissonian phonon statistics. Strong single photon coupling is not required. The requirements regarding sideband resolution, circulating cavity power and environmental temperature are in reach with state of the art parameters of optomechanical crystals. Phonon antibunching can be verfied in a Hanburry-Brown-Twiss measurement on the output field of the optomechanical cavity.
△ Less
Submitted 13 February, 2015;
originally announced February 2015.
-
Laser Theory for Optomechanics: Limit Cycles in the Quantum Regime
Authors:
Niels Lörch,
Jiang Qian,
Aashish Clerk,
Florian Marquardt,
Klemens Hammerer
Abstract:
Optomechanical systems can exhibit self-sustained limit cycles where the quantum state of the mechanical resonator possesses nonclassical characteristics such as a strongly negative Wigner density, as was shown recently in a numerical study by Qian et al. [Physical Review Letters, 109, 253601 (2012)]. Here we derive a Fokker-Planck equation describing mechanical limit cycles in the quantum regime…
▽ More
Optomechanical systems can exhibit self-sustained limit cycles where the quantum state of the mechanical resonator possesses nonclassical characteristics such as a strongly negative Wigner density, as was shown recently in a numerical study by Qian et al. [Physical Review Letters, 109, 253601 (2012)]. Here we derive a Fokker-Planck equation describing mechanical limit cycles in the quantum regime which correctly reproduces the numerically observed nonclassical features. The derivation starts from the standard optomechanical master equation, and is based on techniques borrowed from the laser theory due to Haake's and Lewenstein. We compare our analytical model with numerical solutions of the master equation based on Monte-Carlo simulations, and find very good agreement over a wide and so far unexplored regime of system parameters. As one main conclusion, we predict negative Wigner functions to be observable even for surprisingly classical parameters, i.e. outside the single-photon strong coupling regime, for strong cavity drive, and rather large limit cycle amplitudes. The general approach taken here provides a natural starting point for further studies of quantum effects in optomechanics.
△ Less
Submitted 10 February, 2014; v1 submitted 4 October, 2013;
originally announced October 2013.
-
Wave Function Renormalization Effects in Resonantly Enhanced Tunneling
Authors:
N. Lörch,
F. V. Pepe,
H. Lignier,
D. Ciampini,
R. Mannella,
O. Morsch,
E. Arimondo,
P. Facchi,
G. Florio,
S. Pascazio,
S. Wimberger
Abstract:
We study the time evolution of ultra-cold atoms in an accelerated optical lattice. For a Bose- Einstein condensate with a narrow quasi-momentum distribution in a shallow optical lattice the decay of the survival probability in the ground band has a step-like structure. In this regime we establish a connection between the wave function renormalization parameter Z introduced in [Phys. Rev. Lett. 86,…
▽ More
We study the time evolution of ultra-cold atoms in an accelerated optical lattice. For a Bose- Einstein condensate with a narrow quasi-momentum distribution in a shallow optical lattice the decay of the survival probability in the ground band has a step-like structure. In this regime we establish a connection between the wave function renormalization parameter Z introduced in [Phys. Rev. Lett. 86, 2699 (2001)] to characterize non-exponential decay and the phenomenon of resonantly enhanced tunneling, where the decay rate is peaked for particular values of the lattice depth and the accelerating force.
△ Less
Submitted 30 January, 2012;
originally announced January 2012.
-
Time-resolved measurement of Landau--Zener tunneling in different bases
Authors:
G. Tayebirad,
A. Zenesini,
D. Ciampini,
R. Mannella,
O. Morsch,
E. Arimondo,
N. Lörch,
S. Wimberger
Abstract:
A comprehensive study of the tunneling dynamics of a Bose--Einstein condensate in a tilted periodic potential is presented. We report numerical and experimental results on time-resolved measurements of the Landau--Zener tunneling of ultracold atoms introduced by the tilt, which experimentally is realized by accelerating the lattice. The use of different protocols enables us to access the tunneling…
▽ More
A comprehensive study of the tunneling dynamics of a Bose--Einstein condensate in a tilted periodic potential is presented. We report numerical and experimental results on time-resolved measurements of the Landau--Zener tunneling of ultracold atoms introduced by the tilt, which experimentally is realized by accelerating the lattice. The use of different protocols enables us to access the tunneling probability, numerically as well as experimentally, in two different bases, namely, the adiabatic basis and the diabatic basis. The adiabatic basis corresponds to the eigenstates of the lattice, and the diabatic one to the free-particle momentum eigenstates. Our numerical and experimental results are compared with existing two-state Landau--Zener models.
△ Less
Submitted 8 July, 2010;
originally announced July 2010.