-
Cascades on Constrained Multiplex Networks
Authors:
Christian Kluge,
Christian Kuehn
Abstract:
We consider a version of the Watts cascade model on directed multiplex configuration model networks, and present a detailed analysis of the cascade size, single-seed cascade probability and cascade condition. We then introduce a smaller class of network models that we call constrained multiplex networks, which allows us to induce patterns in the node activity, i.e. in the participation of nodes on…
▽ More
We consider a version of the Watts cascade model on directed multiplex configuration model networks, and present a detailed analysis of the cascade size, single-seed cascade probability and cascade condition. We then introduce a smaller class of network models that we call constrained multiplex networks, which allows us to induce patterns in the node activity, i.e. in the participation of nodes on different layers. We find that the choice of induced patterns affects the phase transitions of the cascade model in a variety of ways.
△ Less
Submitted 30 May, 2025;
originally announced May 2025.
-
Chaotic Kramers' Law: Hasselmann's Program and AMOC Tipping
Authors:
Jakob Deser,
Raphael Römer,
Niklas Boers,
Christian Kuehn
Abstract:
In bistable dynamical systems driven by Wiener processes, the widely used Kramers' law relates the strength of the noise forcing to the average time it takes to see a noise-induced transition from one attractor to the other. We extend this law to bistable systems forced with fast chaotic dynamics, which we argue to be a more realistic modeling approach than unbounded noise forcing in some cases. W…
▽ More
In bistable dynamical systems driven by Wiener processes, the widely used Kramers' law relates the strength of the noise forcing to the average time it takes to see a noise-induced transition from one attractor to the other. We extend this law to bistable systems forced with fast chaotic dynamics, which we argue to be a more realistic modeling approach than unbounded noise forcing in some cases. We test our results numerically in a reduced-order model of the Atlantic Meridional Overturning Circulation (AMOC) and discuss the limits of the chaotic Kramers' law as well as its surprisingly wide parameter range of applicability. Hereby, we show in detail how to apply Hasselmann's program in practice and give a possible explanation for recent findings of AMOC collapse and recovery in complex climate models.
△ Less
Submitted 24 May, 2025;
originally announced May 2025.
-
The Influence of the Memory Capacity of Neural DDEs on the Universal Approximation Property
Authors:
Christian Kuehn,
Sara-Viola Kuntz
Abstract:
Neural Ordinary Differential Equations (Neural ODEs), which are the continuous-time analog of Residual Neural Networks (ResNets), have gained significant attention in recent years. Similarly, Neural Delay Differential Equations (Neural DDEs) can be interpreted as an infinite depth limit of Densely Connected Residual Neural Networks (DenseResNets). In contrast to traditional ResNet architectures, D…
▽ More
Neural Ordinary Differential Equations (Neural ODEs), which are the continuous-time analog of Residual Neural Networks (ResNets), have gained significant attention in recent years. Similarly, Neural Delay Differential Equations (Neural DDEs) can be interpreted as an infinite depth limit of Densely Connected Residual Neural Networks (DenseResNets). In contrast to traditional ResNet architectures, DenseResNets are feed-forward networks that allow for shortcut connections across all layers. These additional connections introduce memory in the network architecture, as typical in many modern architectures. In this work, we explore how the memory capacity in neural DDEs influences the universal approximation property. The key parameter for studying the memory capacity is the product $K τ$ of the Lipschitz constant and the delay of the DDE. In the case of non-augmented architectures, where the network width is not larger than the input and output dimensions, neural ODEs and classical feed-forward neural networks cannot have the universal approximation property. We show that if the memory capacity $Kτ$ is sufficiently small, the dynamics of the neural DDE can be approximated by a neural ODE. Consequently, non-augmented neural DDEs with a small memory capacity also lack the universal approximation property. In contrast, if the memory capacity $Kτ$ is sufficiently large, we can establish the universal approximation property of neural DDEs for continuous functions. If the neural DDE architecture is augmented, we can expand the parameter regions in which universal approximation is possible. Overall, our results show that by increasing the memory capacity $Kτ$, the infinite-dimensional phase space of DDEs with positive delay $τ>0$ is not sufficient to guarantee a direct jump transition to universal approximation, but only after a certain memory threshold, universal approximation holds.
△ Less
Submitted 12 May, 2025;
originally announced May 2025.
-
Critical Slowing Down in Bifurcating Stochastic Partial Differential Equations with Red Noise
Authors:
Paolo Bernuzzi,
Christian Kuehn,
Andreas Morr
Abstract:
The phenomenon of critical slowing down (CSD) has played a key role in the search for reliable precursors of catastrophic regime shifts. This is caused by its presence in a generic class of bifurcating dynamical systems. Simple time-series statistics such as variance or autocorrelation can be taken as proxies for the phenomenon, making their increase a useful early warning signal (EWS) for catastr…
▽ More
The phenomenon of critical slowing down (CSD) has played a key role in the search for reliable precursors of catastrophic regime shifts. This is caused by its presence in a generic class of bifurcating dynamical systems. Simple time-series statistics such as variance or autocorrelation can be taken as proxies for the phenomenon, making their increase a useful early warning signal (EWS) for catastrophic regime shifts. However, the modelling basis justifying the use of these EWSs is usually a finite-dimensional stochastic ordinary differential equation, where a mathematical proof for the aptness is possible. Only recently has the phenomenon of CSD been proven to exist in infinite-dimensional stochastic partial differential equations (SPDEs), which are more appropriate to model real-world spatial systems. In this context, we provide an essential extension of the results for SPDEs under a specific noise forcing, often referred to as red noise. This type of time-correlated noise is omnipresent in many physical systems, such as climate and ecology. We approach the question with a mathematical proof and a numerical analysis for the linearised problem. We find that also under red noise forcing, the aptness of EWSs persists, supporting their employment in a wide range of applications. However, we also find that false or muted warnings are possible if the noise correlations are non-stationary. We thereby extend a previously known complication with respect to red noise and EWSs from finite-dimensional dynamics to the more complex and realistic setting of SPDEs.
△ Less
Submitted 8 April, 2025;
originally announced April 2025.
-
Mathematical Models for Self-Adaptive Response to Cancer Dynamics
Authors:
Christian Kuehn
Abstract:
We consider two minimal mathematical models for cancer dynamics and self-adaptation. We aim to capture the interplay between the rapid progression of cancer growth and the possibility to leverage and enhance self-adaptive defense mechanisms of an organism, e.g., motivated by immunotherapy. Yet, our two models are more abstract and generic encapsulating the essence of competition between rapid canc…
▽ More
We consider two minimal mathematical models for cancer dynamics and self-adaptation. We aim to capture the interplay between the rapid progression of cancer growth and the possibility to leverage and enhance self-adaptive defense mechanisms of an organism, e.g., motivated by immunotherapy. Yet, our two models are more abstract and generic encapsulating the essence of competition between rapid cancer growth and the speed of adaptation. First, we propose a four-dimensional ordinary differential equation model on a macroscopic level. The model has three main parameter regimes and its most important features can be studied analytically. At small external stimulation of adaptation, cancer progresses to a deadly level. At intermediate external input, a bifurcation is observed leaving behind only a locally stable cancer-free steady state. Unfortunately, in a large parameter regime after the bifurcation, a transient cancer density spike is observed. Only for a combination of external input and speeding up adaptation, cancer does not reach critical levels. To study the adaptation speed-up in the initial dynamics phase, we switch to a microscopic probabilistic model, which we study numerically. The microscopic model undergoes a sharp transition under variation of the self-adaptation probability. It is shown that a combination of temporal memory and rare stochastic positive adaptation events is crucial to move the sharp transition point to a desired regime. Despite their extreme simplicity, the two models already provide remarkably deep insight into the challenges one has to overcome to leverage/enhance the self-adaptation of an organism in fighting cancer.
△ Less
Submitted 26 March, 2025;
originally announced March 2025.
-
End-to-End Human Pose Reconstruction from Wearable Sensors for 6G Extended Reality Systems
Authors:
Nguyen Quang Hieu,
Dinh Thai Hoang,
Diep N. Nguyen,
Mohammad Abu Alsheikh,
Carlos C. N. Kuhn,
Yibeltal F. Alem,
Ibrahim Radwan
Abstract:
Full 3D human pose reconstruction is a critical enabler for extended reality (XR) applications in future sixth generation (6G) networks, supporting immersive interactions in gaming, virtual meetings, and remote collaboration. However, achieving accurate pose reconstruction over wireless networks remains challenging due to channel impairments, bit errors, and quantization effects. Existing approach…
▽ More
Full 3D human pose reconstruction is a critical enabler for extended reality (XR) applications in future sixth generation (6G) networks, supporting immersive interactions in gaming, virtual meetings, and remote collaboration. However, achieving accurate pose reconstruction over wireless networks remains challenging due to channel impairments, bit errors, and quantization effects. Existing approaches often assume error-free transmission in indoor settings, limiting their applicability to real-world scenarios. To address these challenges, we propose a novel deep learning-based framework for human pose reconstruction over orthogonal frequency-division multiplexing (OFDM) systems. The framework introduces a two-stage deep learning receiver: the first stage jointly estimates the wireless channel and decodes OFDM symbols, and the second stage maps the received sensor signals to full 3D body poses. Simulation results demonstrate that the proposed neural receiver reduces bit error rate (BER), thus gaining a 5 dB gap at $10^{-4}$ BER, compared to the baseline method that employs separate signal detection steps, i.e., least squares channel estimation and linear minimum mean square error equalization. Additionally, our empirical findings show that 8-bit quantization is sufficient for accurate pose reconstruction, achieving a mean squared error of $5\times10^{-4}$ for reconstructed sensor signals, and reducing joint angular error by 37\% for the reconstructed human poses compared to the baseline.
△ Less
Submitted 6 March, 2025;
originally announced March 2025.
-
Probability of Transition to Turbulence in a Reduced Stochastic Model of Pipe Flow
Authors:
Paolo Bernuzzi,
Christian Kuehn
Abstract:
We study the phenomenon of turbulence initiation in pipe flow under different noise structures by estimating the probability of initiating metastable transitions. We establish lower bounds on turbulence transition probabilities using linearized models with multiplicative noise near the laminar state. First, we consider the case of stochastic perturbations by Itô white noise; then, through the Stra…
▽ More
We study the phenomenon of turbulence initiation in pipe flow under different noise structures by estimating the probability of initiating metastable transitions. We establish lower bounds on turbulence transition probabilities using linearized models with multiplicative noise near the laminar state. First, we consider the case of stochastic perturbations by Itô white noise; then, through the Stratonovich interpretation, we extend the analysis to noise types such as white and red noise in time. Our findings demonstrate the viability of detecting the onset of turbulence as rare events under diverse noise assumptions. The results also contribute to applied SPDE theory and offer valuable methodologies for understanding turbulence across application areas.
△ Less
Submitted 2 March, 2025;
originally announced March 2025.
-
Stability of N-front and N-back solutions in the Barkley model
Authors:
Christian Kuehn,
Pascal Sedlmeier
Abstract:
In this paper we establish for an intermediate Reynolds number domain the stability of N-front and N-back solutions for each N > 1 corresponding to traveling waves, in an experimentally validated model for the transition to turbulence in pipe flow proposed in [Barkley et al., Nature 526(7574):550-553, 2015]. We base our work on the existence analysis of a heteroclinic loop between a turbulent and…
▽ More
In this paper we establish for an intermediate Reynolds number domain the stability of N-front and N-back solutions for each N > 1 corresponding to traveling waves, in an experimentally validated model for the transition to turbulence in pipe flow proposed in [Barkley et al., Nature 526(7574):550-553, 2015]. We base our work on the existence analysis of a heteroclinic loop between a turbulent and a laminar equilibrium proved by Engel, Kuehn and de Rijk in [Engel, Kuehn, de Rijk, Nonlinearity 35:5903, 2022], as well as some results from this work. The stability proof follows the verification of a set of abstract stability hypotheses stated by Sandstede in [SIAM Journal on Mathematical Analysis 29.1 (1998), pp. 183-207] for traveling waves motivated by the FitzHugh-Nagumo equations. In particular, this completes the first detailed analysis of Engel, Kuehn and de Rijk in [Engel, Kuehn, de Rijk, Nonlinearity 35:5903, 2022] leading to a complete existence and stability statement that nicely fits within the abstract framework of waves generated by twisted heteroclinic loops.
△ Less
Submitted 12 February, 2025;
originally announced February 2025.
-
Large Language Model Guided Self-Debugging Code Generation
Authors:
Muntasir Adnan,
Zhiwei Xu,
Carlos C. N. Kuhn
Abstract:
Automated code generation is gaining significant importance in intelligent computer programming and system deployment. However, current approaches often face challenges in computational efficiency and lack robust mechanisms for code parsing and error correction. In this work, we propose a novel framework, PyCapsule, with a simple yet effective two-agent pipeline and efficient self-debugging module…
▽ More
Automated code generation is gaining significant importance in intelligent computer programming and system deployment. However, current approaches often face challenges in computational efficiency and lack robust mechanisms for code parsing and error correction. In this work, we propose a novel framework, PyCapsule, with a simple yet effective two-agent pipeline and efficient self-debugging modules for Python code generation. PyCapsule features sophisticated prompt inference, iterative error handling, and case testing, ensuring high generation stability, safety, and correctness. Empirically, PyCapsule achieves up to 5.7% improvement of success rate on HumanEval, 10.3% on HumanEval-ET, and 24.4% on BigCodeBench compared to the state-of-art methods. We also observe a decrease in normalized success rate given more self-debugging attempts, potentially affected by limited and noisy error feedback in retention. PyCapsule demonstrates broader impacts on advancing lightweight and efficient code generation for artificial intelligence systems.
△ Less
Submitted 5 February, 2025;
originally announced February 2025.
-
Approximate Slow Manifolds in the Fokker-Planck Equation
Authors:
Christian Kuehn,
Jan-Eric Sulzbach
Abstract:
In this paper we study the dynamics of a fast-slow Fokker-Planck partial differential equation (PDE) viewed as the evolution equation for the density of a multiscale planar stochastic differential equation (SDE). Our key focus is on the existence of a slow manifold on the PDE level, which is a crucial tool from the geometric singular perturbation theory allowing the reduction of the system to a lo…
▽ More
In this paper we study the dynamics of a fast-slow Fokker-Planck partial differential equation (PDE) viewed as the evolution equation for the density of a multiscale planar stochastic differential equation (SDE). Our key focus is on the existence of a slow manifold on the PDE level, which is a crucial tool from the geometric singular perturbation theory allowing the reduction of the system to a lower dimensional slowly evolving equation. In particular, we use a projection approach based upon a Sturm- Liouville eigenbasis to convert the Fokker-Planck PDE to an infinite system of PDEs that can be truncated/approximated to any order. Based upon this truncation, we can employ the recently developed theory for geometric singular perturbation theory for slow manifolds for infinite-dimensional evolution equations. This strategy presents a new perspective on the dynamics of multiple time-scale SDEs as it combines ideas from several previously disjoint reduction methods.
△ Less
Submitted 31 January, 2025;
originally announced January 2025.
-
Slow Manifolds for PDE with Fast Reactions and Small Cross Diffusion
Authors:
Laurent Desvillettes,
Christian Kuehn,
Jan-Eric Sulzbach,
Bao Quoc Tang,
Bao-Ngoc Tran
Abstract:
Multiple time scales problems are investigated by combining geometrical and analytical approaches. More precisely, for fast-slow reaction-diffusion systems, we first prove the existence of slow manifolds for the abstract problem under the assumption that cross diffusion is small. This is done by extending the Fenichel theory to an infinite dimensional setting, where a main idea is to introduce a s…
▽ More
Multiple time scales problems are investigated by combining geometrical and analytical approaches. More precisely, for fast-slow reaction-diffusion systems, we first prove the existence of slow manifolds for the abstract problem under the assumption that cross diffusion is small. This is done by extending the Fenichel theory to an infinite dimensional setting, where a main idea is to introduce a suitable space splitting corresponding to a small parameter, which controls additional fast contributions of the slow variable. These results require a strong convergence in $L^\infty(0,T;H^2(Ω))$, which is the subtle analytical issue in fast reaction problems in comparison to previous works. By considering a nonlinear fast reversible reaction in one dimension, we successfully prove this convergence and therefore obtain the slow manifold for a PDE with fast reactions. Moreover, the obtained convergence also shows the influence of the cross diffusion term and illuminates the role of the initial layer. Explicit approximations of the slow manifold are also carried out in the case of linear systems.
△ Less
Submitted 28 January, 2025;
originally announced January 2025.
-
Synchronization by noise for traveling pulses
Authors:
Christian Kuehn,
Joris van Winden
Abstract:
We consider synchronization by noise for stochastic partial differential equations which support traveling pulse solutions, such as the FitzHugh-Nagumo equation. We show that any two pulse-like solutions which start from different positions but are forced by the same realization of a multiplicative noise, converge to each other in probability on a time scale $σ^{-2} \ll t \ll \exp(σ^{-2})$, where…
▽ More
We consider synchronization by noise for stochastic partial differential equations which support traveling pulse solutions, such as the FitzHugh-Nagumo equation. We show that any two pulse-like solutions which start from different positions but are forced by the same realization of a multiplicative noise, converge to each other in probability on a time scale $σ^{-2} \ll t \ll \exp(σ^{-2})$, where $σ$ is the noise amplitude. The noise is assumed to be Gaussian, white in time, colored and periodic in space, and non-degenerate only in the lowest Fourier mode. The proof uses the method of phase reduction, which allows one to describe the dynamics of the stochastic pulse only in terms of its position. The position is shown to synchronize building upon existing results, and the validity of the phase reduction allows us to transfer the synchronization back to the full solution.
△ Less
Submitted 23 January, 2025;
originally announced January 2025.
-
Characterising exchange of stability in scalar reaction-diffusion equations via geometric blow-up
Authors:
Samuel Jelbart,
Christian Kuehn,
Alejandro Martínez Sánchez
Abstract:
We study the exchange of stability in scalar reaction-diffusion equations which feature a slow passage through transcritical and pitchfork type singularities in the reaction term, using a novel adaptation of the geometric blow-up method. Our results are consistent with known results on bounded spatial domains which were obtained by Butuzov, Nefedov & Schneider using comparison principles like uppe…
▽ More
We study the exchange of stability in scalar reaction-diffusion equations which feature a slow passage through transcritical and pitchfork type singularities in the reaction term, using a novel adaptation of the geometric blow-up method. Our results are consistent with known results on bounded spatial domains which were obtained by Butuzov, Nefedov & Schneider using comparison principles like upper and lower solutions in [7], however, from a methodological point of view, the approach is motivated by the analysis of closely related ODE problems using geometric blow-up presented by Krupa & Szmolyan in [34]. After applying the blow-up transformation, we obtain a system of PDEs which can be studied in local coordinate charts. Importantly, the blow-up procedure resolves a spectral degeneracy in which continuous spectrum along the entire negative real axis is 'pushed back' so as to create a spectral gap in the linearisation about particular steady states which arise within the so-called entry and exit charts. This makes it possible to extend slow-type invariant manifolds into and out of a neighbourhood of the singular point using center manifold theory, in a manner which is conceptually analogous to the established approach in the ODE setting. We expect that the approach can be adapted and applied to the study of dynamic bifurcations in PDEs in a wide variety of different contexts.
△ Less
Submitted 20 November, 2024;
originally announced November 2024.
-
Prospective report of the French QCD community to the ESPPU 2025 with respect to the program of the LHC Run 5 and beyond and future colliders at CERN
Authors:
Carolina Arata,
François Arleo,
Benjamin Audurier,
Alberto Baldisseri,
Nicole Bastid,
Guillaume Batigne,
Iouri Belikov,
Marcus Bluhm,
Francesco Bossu,
Hervé Borel,
Renaud Boussarie,
Javier Castillo Castellanos,
Paul Caucal,
Cvetan Cheshkov,
Gustavo Conesa Balbastre,
Zaida Conesa del Valle,
Maurice Coquet,
Imanol Corredoira Fernandez,
Philippe Crochet,
Bruno Espagnon,
Julien Faivre,
Andrea Ferrero,
Audrey Francisco,
Frédéric Fleuret,
Chris Flett
, et al. (37 additional authors not shown)
Abstract:
This document summarizes the prospective physics plans of the French QCD and Heavy-Ion community, including the experimental programs at the LHC Run 5 and beyond and future colliders at CERN, within the context of the French contribution to the update of the European Strategy in Particle Physics (ESPPU 2025), as discussed in the workshop on European Strategy for Particle Physics Update 2025 organi…
▽ More
This document summarizes the prospective physics plans of the French QCD and Heavy-Ion community, including the experimental programs at the LHC Run 5 and beyond and future colliders at CERN, within the context of the French contribution to the update of the European Strategy in Particle Physics (ESPPU 2025), as discussed in the workshop on European Strategy for Particle Physics Update 2025 organised by the QCD GdR in Oct. 2024.
△ Less
Submitted 12 March, 2025; v1 submitted 18 November, 2024;
originally announced November 2024.
-
Phase transitions for polyadic epidemic and voter models with multiscale groups
Authors:
Pia Steinmeyer,
Jan Mölter,
Christian Kuehn
Abstract:
Polyadic (or higher-order) interactions can significantly impact the dynamics of interacting particle systems. However, so far, the group size interactions have been relatively small. In this work, we examine the influence of multiscale polyadic group interactions, where some groups are small and others very large. We consider two paradigmatic examples, an SIS-epidemic and the adaptive voter model…
▽ More
Polyadic (or higher-order) interactions can significantly impact the dynamics of interacting particle systems. However, so far, the group size interactions have been relatively small. In this work, we examine the influence of multiscale polyadic group interactions, where some groups are small and others very large. We consider two paradigmatic examples, an SIS-epidemic and the adaptive voter model. On the level of the mean field, we specifically discuss the impact of the multiscale polyadic interactions on equilibrium dynamics and phase transitions. For the SIS-epidemic model, we find a region of bistability that protects the disease-free state over a wide range beyond the classical epidemic threshold from a significant outbreak. For the adaptive voter model, we show that multiscale polyadic interactions can stabilize the network or increase the convergence rate to an unbiased equilibrium.
△ Less
Submitted 16 October, 2024;
originally announced October 2024.
-
On the transition between autonomous and nonautonomous systems: the case of FitzHugh-Nagumo's model
Authors:
Iacopo P. Longo,
Elena Queirolo,
Christian Kuehn
Abstract:
This work deals with a parametric linear interpolation between an autonomous FitzHugh-Nagumo model and a nonautonomous skewed-problem with the same fundamental structure. This paradigmatic example allows to construct a family of nonautonomous dynamical systems with an attracting integral manifold and a hyperbolic repelling trajectory located within the nonautonomous set enclosed by the integral ma…
▽ More
This work deals with a parametric linear interpolation between an autonomous FitzHugh-Nagumo model and a nonautonomous skewed-problem with the same fundamental structure. This paradigmatic example allows to construct a family of nonautonomous dynamical systems with an attracting integral manifold and a hyperbolic repelling trajectory located within the nonautonomous set enclosed by the integral manifold. Upon the variation of the parameter the integral manifold collapses, the hyperbolic repelling solution disappears and a unique globally attracting hyperbolic solution arises in what could be considered yet another nonautonomous Hopf bifurcation pattern. Interestingly, the three phenomena do not happen at the same critical value of the parameter, yielding thus an example of a nonautonomous bifurcation in two steps. We provide a mathematical description of the dynamical objects at play and analyze the periodically forced case via rigorously validated continuation.
△ Less
Submitted 22 August, 2024;
originally announced August 2024.
-
Unleashing Artificial Cognition: Integrating Multiple AI Systems
Authors:
Muntasir Adnan,
Buddhi Gamage,
Zhiwei Xu,
Damith Herath,
Carlos C. N. Kuhn
Abstract:
In this study, we present an innovative fusion of language models and query analysis techniques to unlock cognition in artificial intelligence. The introduced open-source AI system seamlessly integrates a Chess engine with a language model, enabling it to predict moves and provide strategic explanations. Leveraging a vector database to achieve retrievable answer generation, our AI system elucidate…
▽ More
In this study, we present an innovative fusion of language models and query analysis techniques to unlock cognition in artificial intelligence. The introduced open-source AI system seamlessly integrates a Chess engine with a language model, enabling it to predict moves and provide strategic explanations. Leveraging a vector database to achieve retrievable answer generation, our AI system elucidates its decision-making process, bridging the gap between raw computation and human-like understanding. Our choice of Chess as the demonstration environment underscores the versatility of our approach. Beyond Chess, our system holds promise for diverse applications, from medical diagnostics to financial forecasting. Our AI system is available at https://github.com/TheOpenSI/CoSMIC.git
△ Less
Submitted 17 October, 2024; v1 submitted 9 August, 2024;
originally announced August 2024.
-
Networks of Pendula with Diffusive Interactions
Authors:
Riccardo Bonetto,
Hildeberto Jardón-Kojakhmetov,
Christian Kuehn
Abstract:
We study a system of coupled pendula with diffusive interactions, which could depend both on positions and on momenta. The coupling structure is defined by an undirected network, while the dynamic equations are derived from a Hamiltonian; as such, the energy is conserved. We provide sufficient conditions on the energy for bounded motion, identifying the oscillatory regime. We also describe the bif…
▽ More
We study a system of coupled pendula with diffusive interactions, which could depend both on positions and on momenta. The coupling structure is defined by an undirected network, while the dynamic equations are derived from a Hamiltonian; as such, the energy is conserved. We provide sufficient conditions on the energy for bounded motion, identifying the oscillatory regime. We also describe the bifurcations of synchronised states, exploiting the quantities related to the network structure. Moreover, we consider patterns of anti-synchrony arising from the specific properties of the model. Such patterns can be linked to global properties of the system by looking at motion of the centre of mass. Nonetheless, the anti-synchrony patterns play also a relevant role in the bifurcation analysis. For the case of graphs with a large number of nodes, we characterise the parameter range in which the bifurcations occur. We complement the analysis with some numerical simulations showing the interplay between bifurcations of the origin and transitions to chaos of nearby orbits. A key feature is that the observed chaotic regime emerges at low energies.
△ Less
Submitted 5 August, 2024;
originally announced August 2024.
-
Resilience of the Atlantic Meridional Overturning Circulation
Authors:
Valérian Jacques-Dumas,
Henk A. Dijkstra,
Christian Kuehn
Abstract:
We address the issue of resilience of the Atlantic Meridional Overturning Circulation (AMOC) given the many indications that this dynamical system is in a multi-stable regime. A novel approach to resilience based on rare event techniques is presented which leads to a measure capturing `resistance to change` and `ability to return' aspects in a probabilistic way. The application of this measure to…
▽ More
We address the issue of resilience of the Atlantic Meridional Overturning Circulation (AMOC) given the many indications that this dynamical system is in a multi-stable regime. A novel approach to resilience based on rare event techniques is presented which leads to a measure capturing `resistance to change` and `ability to return' aspects in a probabilistic way. The application of this measure to a conceptual model demonstrates its suitability for assessing AMOC resilience but also shows its potential use in many other non-autonomous dynamical systems. This framework is then extended to compute the probability that the AMOC undergoes a transition conditioned on an external forcing. Such conditional probability can be estimated by exploiting the information available when computing the resilience of this system. This allows us to provide a probabilistic view on safe operating spaces by defining a conditional safe operating space as a subset of the parameter space of the (possibly transient) imposed forcing.
△ Less
Submitted 2 July, 2024;
originally announced July 2024.
-
Warning Signs for Boundary Noise and their Application to an Ocean Boussinesq Model
Authors:
Paolo Bernuzzi,
Henk A. Dijkstra,
Christian Kuehn
Abstract:
In this paper, we construct and discuss early-warning signs of the approach of a parameter to a deterministic bifurcation on a stochastic partial differential equation (SPDE) model with Gaussian white-noise on the boundary. We specifically focus on the qualitative behaviour of the time-asymptotic autocovariance and autocorrelation of the solutions of the linearized system. We also discuss the reli…
▽ More
In this paper, we construct and discuss early-warning signs of the approach of a parameter to a deterministic bifurcation on a stochastic partial differential equation (SPDE) model with Gaussian white-noise on the boundary. We specifically focus on the qualitative behaviour of the time-asymptotic autocovariance and autocorrelation of the solutions of the linearized system. We also discuss the reliability of the tools from an analytic perspective and through various examples. Among those, the application of the early-warning signs for an ocean Boussinesq model is explored through numerical simulations. The analytic results obtained expand on previous work and present valuable early-warning signs for various applications.
△ Less
Submitted 22 May, 2024;
originally announced May 2024.
-
Analysis of the Geometric Structure of Neural Networks and Neural ODEs via Morse Functions
Authors:
Christian Kuehn,
Sara-Viola Kuntz
Abstract:
Besides classical feed-forward neural networks, also neural ordinary differential equations (neural ODEs) have gained particular interest in recent years. Neural ODEs can be interpreted as an infinite depth limit of feed-forward or residual neural networks. We study the input-output dynamics of finite and infinite depth neural networks with scalar output. In the finite depth case, the input is a s…
▽ More
Besides classical feed-forward neural networks, also neural ordinary differential equations (neural ODEs) have gained particular interest in recent years. Neural ODEs can be interpreted as an infinite depth limit of feed-forward or residual neural networks. We study the input-output dynamics of finite and infinite depth neural networks with scalar output. In the finite depth case, the input is a state associated with a finite number of nodes, which maps under multiple non-linear transformations to the state of one output node. In analogy, a neural ODE maps an affine linear transformation of the input to an affine linear transformation of its time-$T$ map. We show that depending on the specific structure of the network, the input-output map has different properties regarding the existence and regularity of critical points, which can be characterized via Morse functions. We prove that critical points cannot exist if the dimension of the hidden layer is monotonically decreasing or the dimension of the phase space is smaller or equal to the input dimension. In the case that critical points exist, we classify their regularity depending on the specific architecture of the network. We show that except for a Lebesgue measure zero set in the weight space, each critical point is non-degenerate, if for finite depth neural networks the underlying graph has no bottleneck, and if for neural ODEs, the affine linear transformations used have full rank. For each type of architecture, the proven properties are comparable in the finite and the infinite depth case. The established theorems allow us to formulate results on universal embedding, i.e., on the exact representation of maps by neural networks and neural ODEs. Our dynamical systems viewpoint on the geometric structure of the input-output map provides a fundamental understanding of why certain architectures perform better than others.
△ Less
Submitted 4 February, 2025; v1 submitted 15 May, 2024;
originally announced May 2024.
-
Infinite dimensional Slow Manifolds for a Linear Fast-Reaction System
Authors:
Christian Kuehn,
Pascal Lehner,
Jan-Eric Sulzbach
Abstract:
The aim of this expository paper is twofold. We start with a concise overview of the theory of invariant slow manifolds for fast-slow dynamical systems starting with the work by Tikhonov and Fenichel to the most recent works on infinite-dimensional fast-slow systems. The main part focuses on a class of linear fast-reaction PDE, which are particular forms of fast-reaction systems. The first result…
▽ More
The aim of this expository paper is twofold. We start with a concise overview of the theory of invariant slow manifolds for fast-slow dynamical systems starting with the work by Tikhonov and Fenichel to the most recent works on infinite-dimensional fast-slow systems. The main part focuses on a class of linear fast-reaction PDE, which are particular forms of fast-reaction systems. The first result shows the convergence of solutions of the linear system to the limit system as the time-scale parameter $\varepsilon$ goes to zero. Moreover, from the explicit solutions the slow manifold is constructed and the convergence to the critical manifold is proven. The subsequent result, then, states a generalized version of the Fenichel-Tikhonov theorem for linear fast-reaction systems.
△ Less
Submitted 26 April, 2024;
originally announced April 2024.
-
Adjoint-Based Projections for Uncertainty Quantification near Stochastically Perturbed Limit Cycles and Tori
Authors:
Zaid Ahsan,
Harry Dankowicz,
Christian Kuehn
Abstract:
This paper presents a new boundary-value problem formulation for quantifying uncertainty induced by the presence of small Brownian noise near transversally stable periodic orbits (limit cycles) and quasiperiodic invariant tori of the deterministic dynamical systems obtained in the absence of noise. The formulation uses adjoints to construct a continuous family of transversal hyperplanes that are i…
▽ More
This paper presents a new boundary-value problem formulation for quantifying uncertainty induced by the presence of small Brownian noise near transversally stable periodic orbits (limit cycles) and quasiperiodic invariant tori of the deterministic dynamical systems obtained in the absence of noise. The formulation uses adjoints to construct a continuous family of transversal hyperplanes that are invariant under the linearized deterministic flow near the limit cycle or quasiperiodic invariant torus. The intersections with each hyperplane of stochastic trajectories that remain near the deterministic cycle or torus over intermediate times may be approximated by a Gaussian distribution whose covariance matrix can be obtained from the solution to the corresponding boundary-value problem. In the case of limit cycles, the analysis improves upon results in the literature through the explicit use of state-space projections, transversality constraints, and symmetry-breaking parameters that ensure uniqueness of the solution despite the lack of hyperbolicity along the limit cycle. These same innovations are then generalized to the case of a quasiperiodic invariant torus of arbitrary dimension. In each case, a closed-form solution to the covariance boundary-value problem is found in terms of a convergent series. The methodology is validated against the results of numerical integration for two examples of stochastically perturbed limit cycles and one example of a stochastically perturbed two-dimensional quasiperiodic invariant torus. Finally, an implementation of the covariance boundary-value problem in the numerical continuation package coco is applied to analyze the small-noise limit near a two-dimensional quasiperiodic invariant torus in a nonlinear deterministic dynamical system in $\mathbb{R}^4$ that does not support closed-form analysis.
△ Less
Submitted 20 April, 2024;
originally announced April 2024.
-
Uncertainty quantification analysis of bifurcations of the Allen--Cahn equation with random coefficients
Authors:
Christian Kuehn,
Chiara Piazzola,
Elisabeth Ullmann
Abstract:
In this work we consider the Allen--Cahn equation, a prototypical model problem in nonlinear dynamics that exhibits bifurcations corresponding to variations of a deterministic bifurcation parameter. Going beyond the state-of-the-art, we introduce a random coefficient in the linear reaction part of the equation, thereby accounting for random, spatially-heterogeneous effects. Importantly, we assume…
▽ More
In this work we consider the Allen--Cahn equation, a prototypical model problem in nonlinear dynamics that exhibits bifurcations corresponding to variations of a deterministic bifurcation parameter. Going beyond the state-of-the-art, we introduce a random coefficient in the linear reaction part of the equation, thereby accounting for random, spatially-heterogeneous effects. Importantly, we assume a spatially constant, deterministic mean value of the random coefficient. We show that this mean value is in fact a bifurcation parameter in the Allen--Cahn equation with random coefficients. Moreover, we show that the bifurcation points and bifurcation curves become random objects. We consider two distinct modelling situations: (i) for a spatially homogeneous coefficient we derive analytical expressions for the distribution of the bifurcation points and show that the bifurcation curves are random shifts of a fixed reference curve; (ii) for a spatially heterogeneous coefficient we employ a generalized polynomial chaos expansion to approximate the statistical properties of the random bifurcation points and bifurcation curves. We present numerical examples in 1D physical space, where we combine the popular software package Continuation Core and Toolboxes (CoCo) for numerical continuation and the Sparse Grids Matlab Kit for the polynomial chaos expansion. Our exposition addresses both, dynamical systems and uncertainty quantification, highlighting how analytical and numerical tools from both areas can be combined efficiently for the challenging uncertainty quantification analysis of bifurcations in random differential equations.
△ Less
Submitted 13 August, 2024; v1 submitted 6 April, 2024;
originally announced April 2024.
-
Mean-Field Limits for Stochastic Interacting Particles on Digraph Measures
Authors:
Christian Kuehn,
Carlos Pulido
Abstract:
Many natural phenomena are effectively described by interacting particle systems, which can be modeled using either deterministic or stochastic differential equations (SDEs). In this study, we specifically investigate particle systems modeled by SDEs, wherein the mean field limit converges to a Vlasov-Fokker-Planck-type equation. Departing from conventional approaches in stochastic analysis, we ex…
▽ More
Many natural phenomena are effectively described by interacting particle systems, which can be modeled using either deterministic or stochastic differential equations (SDEs). In this study, we specifically investigate particle systems modeled by SDEs, wherein the mean field limit converges to a Vlasov-Fokker-Planck-type equation. Departing from conventional approaches in stochastic analysis, we explore the network connectivity between particles using diagraph measures (DGMs). DGMs are one possible tool to capture sparse, intermediate and dense network/graph interactions in the mean-field thereby going beyond more classical approaches such as graphons. Since the main goal is to capture large classes of mean-field limits, we set up our approach using measure-theoretic arguments and combine them with suitable moment estimates to ensure approximation results for the mean-field.
△ Less
Submitted 29 March, 2024;
originally announced March 2024.
-
The Amplitude Equation for the Space-Fractional Swift-Hohenberg Equation
Authors:
Christian Kuehn,
Sebastian Throm
Abstract:
Non-local reaction-diffusion partial differential equations (PDEs) involving the fractional Laplacian have arisen in a wide variety of applications. One common tool to analyse the dynamics of classical local PDEs near instability is to derive local amplitude/modulation approximations, which provide local normal forms classifying a wide variety of pattern-formation phenomena. In this work, we study…
▽ More
Non-local reaction-diffusion partial differential equations (PDEs) involving the fractional Laplacian have arisen in a wide variety of applications. One common tool to analyse the dynamics of classical local PDEs near instability is to derive local amplitude/modulation approximations, which provide local normal forms classifying a wide variety of pattern-formation phenomena. In this work, we study amplitude equations for the space-fractional Swift-Hohenberg equation. The Swift-Hohenberg equation is a basic model problem motivated by pattern formation in fluid dynamics and has served as one of the main PDEs to develop general techniques to derive amplitude equations. We prove that there exists near the first bifurcation point an approximation by a (real) Ginzburg-Landau equation. Interestingly, this Ginzburg-Landau equation is a local PDE, which provides a rigorous justification of the physical conjecture that suitably localized unstable modes can out-compete superdiffusion and re-localize a PDE near instability. Our main technical contributions are to provide a suitable function space setting for the approximation problem, and to then bound the residual between the original PDE and its amplitude equation.
△ Less
Submitted 5 March, 2024;
originally announced March 2024.
-
Ergodicity in planar slow-fast systems through slow relation functions
Authors:
Renato Huzak,
Hildeberto Jardón-Kojakhmetov,
Christian Kuehn
Abstract:
In this paper, we study ergodic properties of the slow relation function (or entry-exit function) in planar slow-fast systems. It is well known that zeros of the slow divergence integral associated with canard limit periodic sets give candidates for limit cycles. We present a new approach to detect the zeros of the slow divergence integral by studying the structure of the set of all probability me…
▽ More
In this paper, we study ergodic properties of the slow relation function (or entry-exit function) in planar slow-fast systems. It is well known that zeros of the slow divergence integral associated with canard limit periodic sets give candidates for limit cycles. We present a new approach to detect the zeros of the slow divergence integral by studying the structure of the set of all probability measures invariant under the corresponding slow relation function. Using the slow relation function, we also show how to estimate (in terms of weak convergence) the transformation of families of probability measures that describe initial point distribution of canard orbits during the passage near a slow-fast Hopf point (or a more general turning point). We provide formulas to compute exit densities for given entry densities and the slow relation function. We apply our results to slow-fast Liénard equations.
△ Less
Submitted 22 October, 2024; v1 submitted 26 February, 2024;
originally announced February 2024.
-
Global stability for McKean-Vlasov equations on large networks
Authors:
Christian Kuehn,
Tobias Wöhrer
Abstract:
We investigate the mean-field dynamics of stochastic McKean differential equations with heterogeneous particle interactions described by large network structures. To express a wide range of graphs, from dense to sparse structures, we incorporate the recently developed graph limit theory of graphops into the limiting McKean--Vlasov equations. Global stability of the splay steady state is proven via…
▽ More
We investigate the mean-field dynamics of stochastic McKean differential equations with heterogeneous particle interactions described by large network structures. To express a wide range of graphs, from dense to sparse structures, we incorporate the recently developed graph limit theory of graphops into the limiting McKean--Vlasov equations. Global stability of the splay steady state is proven via a generalized entropy method, leading to explicit graph-structure dependent decay rates. We highlight the robustness of the entropy approach by extending the results to the closely related Sakaguchi-Kuramoto model with intrinsic frequency distribution. We also present central examples of random graphs, such as power law graphs and the spherical graphop, and analyze the limitations of the applied methodology.
△ Less
Submitted 17 September, 2024; v1 submitted 23 December, 2023;
originally announced December 2023.
-
Fractional Dissipative PDEs
Authors:
Franz Achleitner,
Goro Akagi,
Christian Kuehn,
Jens Markus Melenk,
Jens D. M. Rademacher,
Cinzia Soresina,
Jichen Yang
Abstract:
In this chapter we provide an introduction to fractional dissipative partial differential equations (PDEs) with a focus on trying to understand their dynamics. The class of PDEs we focus on are reaction-diffusion equations but we also provide an outlook on closely related classes of PDEs. To simplify the exposition, we only discuss the cases of fractional time derivatives and fractional space deri…
▽ More
In this chapter we provide an introduction to fractional dissipative partial differential equations (PDEs) with a focus on trying to understand their dynamics. The class of PDEs we focus on are reaction-diffusion equations but we also provide an outlook on closely related classes of PDEs. To simplify the exposition, we only discuss the cases of fractional time derivatives and fractional space derivatives in the PDE separately. As our main tools, we describe analytical as well as numerical methods, which are generically necessary to study nonlinear dynamics. We start with the analytical study of steady states and local linear stability for fractional time derivatives. Then we extend this view to a global perspective and consider time-fractional PDEs and gradient flows. Next, we continue to steady states, linear stability analysis and bifurcations for space-fractional PDEs. As a final analytical consideration we discuss existence and stability of traveling waves for space-fractional PDEs. In the last parts, we provide numerical discretization schemes for fractional (dissipative) PDEs and we utilize these techniques within numerical continuation in applied examples of fractional reaction-diffusion PDEs. We conclude with a brief summary and outlook on open questions in the field.
△ Less
Submitted 9 December, 2023;
originally announced December 2023.
-
Insider trading in discrete time Kyle games
Authors:
Christoph Kühn,
Christopher Lorenz
Abstract:
We present a new discrete time version of Kyle's (1985) classic model of insider trading, formulated as a generalised extensive form game. The model has three kinds of traders: an insider, random noise traders, and a market maker. The insider aims to exploit her informational advantage and maximise expected profits while the market maker observes the total order flow and sets prices accordingly.…
▽ More
We present a new discrete time version of Kyle's (1985) classic model of insider trading, formulated as a generalised extensive form game. The model has three kinds of traders: an insider, random noise traders, and a market maker. The insider aims to exploit her informational advantage and maximise expected profits while the market maker observes the total order flow and sets prices accordingly.
First, we show how the multi-period model with finitely many pure strategies can be reduced to a (static) social system in the sense of Debreu (1952) and prove the existence of a sequential Kyle equilibrium, following Kreps and Wilson (1982). This works for any probability distribution with finite support of the noise trader's demand and the true value, and for any finite information flow of the insider. In contrast to Kyle (1985) with normal distributions, equilibria exist in general only in mixed strategies and not in pure strategies.
In the single-period model we establish bounds for the insider's strategy in equilibrium. Finally, we prove the existence of an equilibrium for the game with a continuum of actions, by considering an approximating sequence of games with finitely many actions. Because of the lack of compactness of the set of measurable price functions, standard infinite-dimensional fixed point theorems are not applicable.
△ Less
Submitted 1 July, 2024; v1 submitted 1 December, 2023;
originally announced December 2023.
-
Early warning signs of critical transitions -- The $α$-stable case
Authors:
Lucia S. Layritz,
Ilya Pavlyukevich,
Anja Rammig,
Christian Kuehn
Abstract:
Statistical early warning signs can be used to identify an approaching bifurcation in stochastic dynamical systems and are now regularly employed in applications concerned with the identification of potential rapid, non-linear change or tipping points. However, the reliability of these early warning signs relies on a number of key mathematical assumptions, most notably the presence of Gaussian noi…
▽ More
Statistical early warning signs can be used to identify an approaching bifurcation in stochastic dynamical systems and are now regularly employed in applications concerned with the identification of potential rapid, non-linear change or tipping points. However, the reliability of these early warning signs relies on a number of key mathematical assumptions, most notably the presence of Gaussian noise. We here show that for systems driven by non-Gaussian, $α$-stable noise, the classical early warning signs of rising variance and autocorrelation are not supported by mathematical theory and their use poses the danger of spurious, false-positive results. To address this, we provide a generalized approach by introduce the scaling factor $γ_X$ as an alternative early warning sign. We show that in the case of the Ornstein-Uhlenbeck process, there exists a direct inverse relationship between $γ_{X}$ and the bifurcation parameter, telling us that $γ_{X}$ will increase as we approach the bifurcation. Our numerical simulations confirm theoretical results and show that our findings generalize well to non-linear, non-equilibrium systems. We thus provide a generalized, robust and applicable statistical early warning sign for systems driven by Gaussian and non-Gaussian $α$-stable noise.
△ Less
Submitted 27 November, 2023;
originally announced November 2023.
-
Enabling Acoustic Audience Feedback in Large Virtual Events
Authors:
Tamay Aykut,
Markus Hofbauer,
Christopher Kuhn,
Eckehard Steinbach,
Bernd Girod
Abstract:
The COVID-19 pandemic shifted many events in our daily lives into the virtual domain. While virtual conference systems provide an alternative to physical meetings, larger events require a muted audience to avoid an accumulation of background noise and distorted audio. However, performing artists strongly rely on the feedback of their audience. We propose a concept for a virtual audience framework…
▽ More
The COVID-19 pandemic shifted many events in our daily lives into the virtual domain. While virtual conference systems provide an alternative to physical meetings, larger events require a muted audience to avoid an accumulation of background noise and distorted audio. However, performing artists strongly rely on the feedback of their audience. We propose a concept for a virtual audience framework which supports all participants with the ambience of a real audience. Audience feedback is collected locally, allowing users to express enthusiasm or discontent by selecting means such as clapping, whistling, booing, and laughter. This feedback is sent as abstract information to a virtual audience server. We broadcast the combined virtual audience feedback information to all participants, which can be synthesized as a single acoustic feedback by the client. The synthesis can be done by turning the collective audience feedback into a prompt that is fed to state-of-the-art models such as AudioGen. This way, each user hears a single acoustic feedback sound of the entire virtual event, without requiring to unmute or risk hearing distorted, unsynchronized feedback.
△ Less
Submitted 27 October, 2023;
originally announced October 2023.
-
On network dynamical systems with a nilpotent singularity
Authors:
Hildeberto Jardón-Kojakhmetov,
Christian Kuehn
Abstract:
Network dynamics is nowadays of extreme relevance to model and analyze complex systems. From a dynamical systems perspective, understanding the local behavior near equilibria is of utmost importance. In particular, equilibria with at least one zero eigenvalue play a crucial role in bifurcation analysis. In this paper, we want to shed some light on nilpotent equilibria of network dynamical systems.…
▽ More
Network dynamics is nowadays of extreme relevance to model and analyze complex systems. From a dynamical systems perspective, understanding the local behavior near equilibria is of utmost importance. In particular, equilibria with at least one zero eigenvalue play a crucial role in bifurcation analysis. In this paper, we want to shed some light on nilpotent equilibria of network dynamical systems. As a main result, we show that the blow-up technique, which has proven to be extremely useful in understanding degenerate singularities in low-dimensional ordinary differential equations, is also suitable in the framework of network dynamical systems. Most importantly, we show that the blow-up technique preserves the network structure. The further usefulness of the blow-up technique, especially with regard to the desingularization of a nilpotent point, is showcased through several examples including linear diffusive systems, systems with nilpotent internal dynamics, and an adaptive network of Kuramoto oscillators.
△ Less
Submitted 13 October, 2023;
originally announced October 2023.
-
Extending Discrete Geometric Singular Perturbation Theory to Non-Hyperbolic Points
Authors:
Samuel Jelbart,
Christian Kuehn
Abstract:
We extend the recently developed discrete geometric singular perturbation theory to the non-normally hyperbolic regime. Our primary tool is the Takens embedding theorem, which provides a means of approximating the dynamics of particular maps with the time-1 map of a formal vector field. First, we show that the so-called reduced map, which governs the slow dynamics near slow manifolds in the normal…
▽ More
We extend the recently developed discrete geometric singular perturbation theory to the non-normally hyperbolic regime. Our primary tool is the Takens embedding theorem, which provides a means of approximating the dynamics of particular maps with the time-1 map of a formal vector field. First, we show that the so-called reduced map, which governs the slow dynamics near slow manifolds in the normally hyperbolic regime, can be locally approximated by the time-one map of the reduced vector field which appears in continuous-time geometric singular perturbation theory. In the non-normally hyperbolic regime, we show that the dynamics of fast-slow maps with a unipotent linear part can be locally approximated by the time-1 map induced by a fast-slow vector field in the same dimension, which has a nilpotent singularity of the corresponding type. The latter result is used to describe (i) the local dynamics of two-dimensional fast-slow maps with non-normally singularities of regular fold, transcritical and pitchfork type, and (ii) dynamics on a (potentially high dimensional) local center manifold in $n$-dimensional fast-slow maps with regular contact or fold submanifolds of the critical manifold. In general, our results show that the dynamics near a large and important class of singularities in fast-slow maps can be described via the use of formal embedding theorems which allow for their approximation by the time-1 map of a fast-slow vector field featuring a loss of normal hyperbolicity.
△ Less
Submitted 12 August, 2024; v1 submitted 11 August, 2023;
originally announced August 2023.
-
Polyadic Opinion Formation: The Adaptive Voter Model on a Hypergraph
Authors:
Anastasia Golovin,
Jan Mölter,
Christian Kuehn
Abstract:
The adaptive voter model is widely used to model opinion dynamics in social complex networks. However, existing adaptive voter models are limited to only pairwise interactions and fail to capture the intricate social dynamics that arises in groups. This paper extends the adaptive voter model to hypergraphs to explore how forces of peer pressure influence collective decision-making. The model consi…
▽ More
The adaptive voter model is widely used to model opinion dynamics in social complex networks. However, existing adaptive voter models are limited to only pairwise interactions and fail to capture the intricate social dynamics that arises in groups. This paper extends the adaptive voter model to hypergraphs to explore how forces of peer pressure influence collective decision-making. The model consists of two processes: individuals can either consult the group and change their opinion or leave the group and join a different one. The interplay between those two processes gives rise to a two-phase dynamics. In the initial phase, the topology of the hypergraph quickly reaches a new stable state. In the subsequent phase, opinion dynamics plays out on the new topology depending on the mechanism by which opinions spread. If the group always follows the majority, the network rapidly converges to fragmented communities. In contrast, if individuals choose an opinion proportionally to its representation in the group, the system remains in a metastable state for an extended period of time. The results are supported both by stochastic simulations and an analytical mean-field description in terms of hypergraph moments with a moment closure at the pair level.
△ Less
Submitted 31 January, 2025; v1 submitted 7 August, 2023;
originally announced August 2023.
-
Embedding Capabilities of Neural ODEs
Authors:
Christian Kuehn,
Sara-Viola Kuntz
Abstract:
A class of neural networks that gained particular interest in the last years are neural ordinary differential equations (neural ODEs). We study input-output relations of neural ODEs using dynamical systems theory and prove several results about the exact embedding of maps in different neural ODE architectures in low and high dimension. The embedding capability of a neural ODE architecture can be i…
▽ More
A class of neural networks that gained particular interest in the last years are neural ordinary differential equations (neural ODEs). We study input-output relations of neural ODEs using dynamical systems theory and prove several results about the exact embedding of maps in different neural ODE architectures in low and high dimension. The embedding capability of a neural ODE architecture can be increased by adding, for example, a linear layer, or augmenting the phase space. Yet, there is currently no systematic theory available and our work contributes towards this goal by developing various embedding results as well as identifying situations, where no embedding is possible. The mathematical techniques used include as main components iterative functional equations, Morse functions and suspension flows, as well as several further ideas from analysis. Although practically, mainly universal approximation theorems are used, our geometric dynamical systems viewpoint on universal embedding provides a fundamental understanding, why certain neural ODE architectures perform better than others.
△ Less
Submitted 28 September, 2023; v1 submitted 2 August, 2023;
originally announced August 2023.
-
Early-Warning Signs for SPDEs with Continuous Spectrum
Authors:
Paolo Bernuzzi,
Antonia Düx,
Christian Kühn
Abstract:
In this work, we study early-warning signs for stochastic partial differential equations (SPDEs), where the linearization around a steady state has continuous spectrum. The studied warning sign takes the form of qualitative changes in the variance as a deterministic bifurcation threshold is approached via parameter variation. Specifically, we focus on the scaling law of the variance near the trans…
▽ More
In this work, we study early-warning signs for stochastic partial differential equations (SPDEs), where the linearization around a steady state has continuous spectrum. The studied warning sign takes the form of qualitative changes in the variance as a deterministic bifurcation threshold is approached via parameter variation. Specifically, we focus on the scaling law of the variance near the transition. Since we are dealing here, in contrast to previous studies, with the case of continuous spectrum and quantitative scaling laws, it is natural to start with linearizations that are multiplication operators defined by analytic functions. For a one-dimensional spatial domain we obtain precise rates of divergence. In the case of the two- and three-dimensional domains an upper bound to the rate of the early-warning sign is proven. These results are cross-validated by numerical simulations. Our theory can be generically useful for several applications, where stochastic and spatial aspects are important in combination with continuous spectrum bifurcations.
△ Less
Submitted 26 July, 2023;
originally announced July 2023.
-
Preserving Bifurcations through Moment Closures
Authors:
Christian Kuehn,
Jan Mölter
Abstract:
Moment systems arise in a wide range of contexts and applications, e.g. in network modeling of complex systems. Since moment systems consist of a high or even infinite number of coupled equations, an indispensable step in obtaining a low-dimensional representation that is amenable to further analysis is, in many cases, to select a moment closure. A moment closure consists of a set of approximation…
▽ More
Moment systems arise in a wide range of contexts and applications, e.g. in network modeling of complex systems. Since moment systems consist of a high or even infinite number of coupled equations, an indispensable step in obtaining a low-dimensional representation that is amenable to further analysis is, in many cases, to select a moment closure. A moment closure consists of a set of approximations that express certain higher-order moments in terms of lower-order ones, so that applying those leads to a closed system of equations for only the lower-order moments. Closures are frequently found drawing on intuition and heuristics to come up with quantitatively good approximations. In contrast to that, we propose an alternative approach where we instead focus on closures giving rise to certain qualitative features, such as bifurcations. Importantly, this fundamental change of perspective provides one with the possibility of classifying moment closures rigorously in regard to these features. This makes the design and selection of closures more algorithmic, precise, and reliable. In this work, we carefully study the moment systems that arise in the mean-field descriptions of two widely known network dynamical systems, the SIS epidemic and the adaptive voter model. We derive conditions that any moment closure has to satisfy so that the corresponding closed systems exhibit the transcritical bifurcation that one expects in these systems coming from the stochastic particle model.
△ Less
Submitted 15 March, 2024; v1 submitted 7 July, 2023;
originally announced July 2023.
-
The fundamental theorem of asset pricing with and without transaction costs
Authors:
Christoph Kühn
Abstract:
We prove a version of the fundamental theorem of asset pricing (FTAP) in continuous time that is based on the strict no-arbitrage condition and that is applicable to both frictionless markets and markets with proportional transaction costs. We consider a market with a single risky asset whose ask price process is higher than or equal to its bid price process. Neither the concatenation property of…
▽ More
We prove a version of the fundamental theorem of asset pricing (FTAP) in continuous time that is based on the strict no-arbitrage condition and that is applicable to both frictionless markets and markets with proportional transaction costs. We consider a market with a single risky asset whose ask price process is higher than or equal to its bid price process. Neither the concatenation property of the set of wealth processes, that is used in the proof of the frictionless FTAP, nor some boundedness property of the trading volume of admissible strategies usually argued with in models with a nonvanishing bid-ask spread need to be satisfied in our model.
△ Less
Submitted 10 August, 2024; v1 submitted 2 July, 2023;
originally announced July 2023.
-
Stability and Fluctuations in Complex Ecological Systems
Authors:
Eric Forgoston,
Sarah Day,
Peter C. de Ruiter,
Arjen Doelman,
Nienke Hartemink,
Alan Hastings,
Lia Hemerik,
Alexandru Hening,
Josef Hofbauer,
Sonia Kefi,
David A. Kessler,
Toni Klauschies,
Christian Kuehn,
Xiaoxiao Li,
John C. Moore,
Elly Morrien,
Anje-Margriet Neutel,
Jelena Pantel,
Sebastian J. Schreiber,
Leah B. Shaw,
Nadav Shnerb,
Eric Siero,
Laura S. Storch,
Michael A. S. Thorne,
Ingrid van de Leemput
, et al. (2 additional authors not shown)
Abstract:
From 08-12 August, 2022, 32 individuals participated in a workshop, Stability and Fluctuations in Complex Ecological Systems, at the Lorentz Center, located in Leiden, The Netherlands. An interdisciplinary dialogue between ecologists, mathematicians, and physicists provided a foundation of important problems to consider over the next 5-10 years. This paper outlines eight areas including (1) improv…
▽ More
From 08-12 August, 2022, 32 individuals participated in a workshop, Stability and Fluctuations in Complex Ecological Systems, at the Lorentz Center, located in Leiden, The Netherlands. An interdisciplinary dialogue between ecologists, mathematicians, and physicists provided a foundation of important problems to consider over the next 5-10 years. This paper outlines eight areas including (1) improving our understanding of the effect of scale, both temporal and spatial, for both deterministic and stochastic problems; (2) clarifying the different terminologies and definitions used in different scientific fields; (3) developing a comprehensive set of data analysis techniques arising from different fields but which can be used together to improve our understanding of existing data sets; (4) having theoreticians/computational scientists collaborate closely with empirical ecologists to determine what new data should be collected; (5) improving our knowledge of how to protect and/or restore ecosystems; (6) incorporating socio-economic effects into models of ecosystems; (7) improving our understanding of the role of deterministic and stochastic fluctuations; (8) studying the current state of biodiversity at the functional level, taxa level and genome level.
△ Less
Submitted 12 June, 2023;
originally announced June 2023.
-
Panini -- Anonymous Anycast and an Instantiation
Authors:
Christoph Coijanovic,
Christiane Kuhn,
Thorsten Strufe
Abstract:
Anycast messaging (i.e., sending a message to an unspecified receiver) has long been neglected by the anonymous communication community. An anonymous anycast prevents senders from learning who the receiver of their message is, allowing for greater privacy in areas such as political activism and whistleblowing. While there have been some protocol ideas proposed, formal treatment of the problem is a…
▽ More
Anycast messaging (i.e., sending a message to an unspecified receiver) has long been neglected by the anonymous communication community. An anonymous anycast prevents senders from learning who the receiver of their message is, allowing for greater privacy in areas such as political activism and whistleblowing. While there have been some protocol ideas proposed, formal treatment of the problem is absent. Formal definitions of what constitutes anonymous anycast and privacy in this context are however a requirement for constructing protocols with provable guarantees. In this work, we define the anycast functionality and use a game-based approach to formalize its privacy and security goals. We further propose Panini, the first anonymous anycast protocol that only requires readily available infrastructure. We show that Panini allows the actual receiver of the anycast message to remain anonymous, even in the presence of an honest but curious sender. In an empirical evaluation, we find that Panini adds only minimal overhead over regular unicast: Sending a message anonymously to one of eight possible receivers results in an end-to-end latency of 0.76s.
△ Less
Submitted 26 September, 2023; v1 submitted 26 May, 2023;
originally announced May 2023.
-
Persistent synchronization of heterogeneous networks with time-dependent linear diffusive coupling
Authors:
Hildeberto Jardón-Kojakhmetov,
Christian Kuehn,
Iacopo P. Longo
Abstract:
We study synchronization for linearly coupled temporal networks of heterogeneous time-dependent nonlinear agents via the convergence of attracting trajectories of each node. The results are obtained by constructing and studying the stability of a suitable linear nonautonomous problem bounding the evolution of the synchronization errors. Both, the case of the entire network and only a cluster, are…
▽ More
We study synchronization for linearly coupled temporal networks of heterogeneous time-dependent nonlinear agents via the convergence of attracting trajectories of each node. The results are obtained by constructing and studying the stability of a suitable linear nonautonomous problem bounding the evolution of the synchronization errors. Both, the case of the entire network and only a cluster, are addressed and the persistence of the obtained synchronization against perturbation is also discussed. Furthermore, a sufficient condition for the existence of attracting trajectories of each node is given. In all cases, the considered dependence on time requires only local integrability, which is a very mild regularity assumption. Moreover, our results mainly depend on the network structure and its properties, and achieve synchronization up to a constant in finite time. Hence they are quite suitable for applications. The applicability of the results is showcased via several examples: coupled van-der-Pol/FitzHugh-Nagumo oscillators, weighted/signed opinion dynamics, and coupled Lorenz systems.
△ Less
Submitted 22 October, 2024; v1 submitted 9 May, 2023;
originally announced May 2023.
-
Higher-Order Network Interactions through Phase Reduction for Oscillators with Phase-Dependent Amplitude
Authors:
Christian Bick,
Tobias Böhle,
Christian Kuehn
Abstract:
Coupled oscillator networks provide mathematical models for interacting periodic processes. If the coupling is weak, phase reduction -- the reduction of the dynamics onto an invariant torus -- captures the emergence of collective dynamical phenomena, such as synchronization. While a first-order approximation of the dynamics on the torus may be appropriate in some situations, higher-order phase red…
▽ More
Coupled oscillator networks provide mathematical models for interacting periodic processes. If the coupling is weak, phase reduction -- the reduction of the dynamics onto an invariant torus -- captures the emergence of collective dynamical phenomena, such as synchronization. While a first-order approximation of the dynamics on the torus may be appropriate in some situations, higher-order phase reductions become necessary, for example, when the coupling strength increases. However, these are generally hard to compute and thus they have only been derived in special cases: This includes globally coupled Stuart--Landau oscillators, where the limit cycle of the uncoupled nonlinear oscillator is circular as the amplitude is independent of the phase. We go beyond this restriction and derive second-order phase reductions for coupled oscillators for arbitrary networks of coupled nonlinear oscillators with phase-dependent amplitude, a scenario more reminiscent of real-world oscillations. We analyze how the deformation of the limit cycle affects the stability of important dynamical states, such as full synchrony and splay states. By identifying higher-order phase interaction terms with hyperedges of a hypergraph, we obtain natural classes of coupled phase oscillator dynamics on hypergraphs that adequately capture the dynamics of coupled limit cycle oscillators.
△ Less
Submitted 26 January, 2024; v1 submitted 7 May, 2023;
originally announced May 2023.
-
Cross-diffusion induced instability on networks
Authors:
Christian Kuehn,
Cinzia Soresina
Abstract:
The concept of Turing instability, namely that diffusion can destabilize the uniform steady state, is well known either in the context of partial differential equations (PDEs) or in networks of dynamical systems. Recently reaction-diffusion equations with cross-diffusion terms have been investigated, showing an analogous effect called cross-diffusion induced instability. In this paper, we extend t…
▽ More
The concept of Turing instability, namely that diffusion can destabilize the uniform steady state, is well known either in the context of partial differential equations (PDEs) or in networks of dynamical systems. Recently reaction-diffusion equations with cross-diffusion terms have been investigated, showing an analogous effect called cross-diffusion induced instability. In this paper, we extend this concept to networks of dynamical systems, showing that the spectrum of the graph Laplacian determines the instability appearance, as well as the spectrum of the Laplace operator in reaction-diffusion equations. We extend to network dynamics a particular network model for competing species, coming from the PDEs context. In particular, the influence of different topology structures on the cross-diffusion induced instability is highlighted, considering regular rings and lattices, and also small-world, Erdős-Réyni, and Barabási-Albert networks.
△ Less
Submitted 7 August, 2023; v1 submitted 24 April, 2023;
originally announced April 2023.
-
Adaptive Dynamical Networks
Authors:
Rico Berner,
Thilo Gross,
Christian Kuehn,
Jürgen Kurths,
Serhiy Yanchuk
Abstract:
It is a fundamental challenge to understand how the function of a network is related to its structural organization. Adaptive dynamical networks represent a broad class of systems that can change their connectivity over time depending on their dynamical state. The most important feature of such systems is that their function depends on their structure and vice versa. While the properties of static…
▽ More
It is a fundamental challenge to understand how the function of a network is related to its structural organization. Adaptive dynamical networks represent a broad class of systems that can change their connectivity over time depending on their dynamical state. The most important feature of such systems is that their function depends on their structure and vice versa. While the properties of static networks have been extensively investigated in the past, the study of adaptive networks is much more challenging. Moreover, adaptive dynamical networks are of tremendous importance for various application fields, in particular, for the models for neuronal synaptic plasticity, adaptive networks in chemical, epidemic, biological, transport, and social systems, to name a few. In this review, we provide a detailed description of adaptive dynamical networks, show their applications in various areas of research, highlight their dynamical features and describe the arising dynamical phenomena, and give an overview of the available mathematical methods developed for understanding adaptive dynamical networks.
△ Less
Submitted 12 April, 2023;
originally announced April 2023.
-
Integer linear programming supporting portfolio design
Authors:
C. C. N. Kuhn,
G. Calbert,
I. Garanovich,
T. Weir
Abstract:
In large organisations and companies, making investment decisions is a complex and challenging task. In the Australian Department of Defence (Defence), the complexity is even higher because defence capabilities are public goods and do not have a financial return \textit{per se}. In this work we mathematically define Defence's investment portfolio problem as a Set-Union Knapsack Problem (SUKP). We…
▽ More
In large organisations and companies, making investment decisions is a complex and challenging task. In the Australian Department of Defence (Defence), the complexity is even higher because defence capabilities are public goods and do not have a financial return \textit{per se}. In this work we mathematically define Defence's investment portfolio problem as a Set-Union Knapsack Problem (SUKP). We present a practical way to linearise the model as an Integer Linear Programming (ILP) problem. This linear model was developed as the optimisation engine of the New Investments to Risked Options (NITRO) portfolio selection tool developed by the Defence Science \& Technology Group (DSTG) for Defence force design activities in 2021. The model is implemented in the Python package called PuLP which can call several linear solver's Application Programming Interface (API), such as GLPK, COIN CLP/CBC, IBM CPLEX, and Gurobi. After comparing the performance of several solvers, we chose Gurobi in the production server. The implementation of the new model and solver enables the rapid execution of exact solutions to the Defence investment portfolio problem.
△ Less
Submitted 25 March, 2023;
originally announced March 2023.
-
Large-Scale Collaborative Writing: Technical Challenges and Recommendations
Authors:
Markus Hofbauer,
Christoph Bachhuber,
Christopher Kuhn,
Sebastian Schwarz,
Bart Kroon,
Eckehard Steinbach
Abstract:
Collaborative writing is essential for teams that create documents together. Creating documents in large-scale collaborations is a challenging task that requires an efficient workflow. The design of such a workflow has received comparatively little attention. Conventional solutions such as working on a single Microsoft Word document or a shared online document are still widely used. In this paper,…
▽ More
Collaborative writing is essential for teams that create documents together. Creating documents in large-scale collaborations is a challenging task that requires an efficient workflow. The design of such a workflow has received comparatively little attention. Conventional solutions such as working on a single Microsoft Word document or a shared online document are still widely used. In this paper, we propose a new workflow consisting of a combination of the lightweight markup language AsciiDoc together with the state-of-the-art version control system Git. The proposed process makes use of well-established workflows in the field of software development that have grown over decades. We present a detailed comparison of the proposed markup + Git workflow to Word and Word for the Web as the most prominent examples for conventional approaches.We argue that the proposed approach provides significant benefits regarding scalability, flexibility, and structuring of most collaborative writing tasks, both in academia and industry.
△ Less
Submitted 17 March, 2023;
originally announced March 2023.
-
Combined effects of STDP and homeostatic structural plasticity on coherence resonance
Authors:
Marius E. Yamakou,
Christian Kuehn
Abstract:
Efficient processing and transfer of information in neurons have been linked to noise-induced resonance phenomena such as coherence resonance (CR), and adaptive rules in neural networks have been mostly linked to two prevalent mechanisms: spike-timing-dependent plasticity (STDP) and homeostatic structural plasticity (HSP). Thus, this paper investigates CR in small-world and random adaptive network…
▽ More
Efficient processing and transfer of information in neurons have been linked to noise-induced resonance phenomena such as coherence resonance (CR), and adaptive rules in neural networks have been mostly linked to two prevalent mechanisms: spike-timing-dependent plasticity (STDP) and homeostatic structural plasticity (HSP). Thus, this paper investigates CR in small-world and random adaptive networks of Hodgkin-Huxley neurons driven by STDP and HSP. Our numerical study indicates that the degree of CR strongly depends, and in different ways, on the adjusting rate parameter $P$, which controls STDP, on the characteristic rewiring frequency parameter $F$, which controls HSP, and on the parameters of the network topology. In particular, we found two robust behaviors: (i) Decreasing $P$ (which enhances the weakening effect of STDP on synaptic weights) and decreasing $F$ (which slows down the swapping rate of synapses between neurons) always leads to higher degrees of CR in small-world and random networks, provided that the synaptic time delay parameter $τ_c$ has some appropriate values. (ii) Increasing the synaptic time delay $τ_c$ induces multiple CR (MCR) -- the occurrence of multiple peaks in the degree of coherence as $τ_c$ changes -- in small-world and random networks, with MCR becoming more pronounced at smaller values of $P$ and $F$. Our results imply that STDP and HSP can jointly play an essential role in enhancing the time precision of firing necessary for optimal information processing and transfer in neural systems and could thus have applications in designing networks of noisy artificial neural circuits engineered to use CR to optimize information processing and transfer.
△ Less
Submitted 22 March, 2023; v1 submitted 15 March, 2023;
originally announced March 2023.
-
Dynamic Simplex: Balancing Safety and Performance in Autonomous Cyber Physical Systems
Authors:
Baiting Luo,
Shreyas Ramakrishna,
Ava Pettet,
Christopher Kuhn,
Gabor Karsai,
Ayan Mukhopadhyay
Abstract:
Learning Enabled Components (LEC) have greatly assisted cyber-physical systems in achieving higher levels of autonomy. However, LEC's susceptibility to dynamic and uncertain operating conditions is a critical challenge for the safety of these systems. Redundant controller architectures have been widely adopted for safety assurance in such contexts. These architectures augment LEC "performant" cont…
▽ More
Learning Enabled Components (LEC) have greatly assisted cyber-physical systems in achieving higher levels of autonomy. However, LEC's susceptibility to dynamic and uncertain operating conditions is a critical challenge for the safety of these systems. Redundant controller architectures have been widely adopted for safety assurance in such contexts. These architectures augment LEC "performant" controllers that are difficult to verify with "safety" controllers and the decision logic to switch between them. While these architectures ensure safety, we point out two limitations. First, they are trained offline to learn a conservative policy of always selecting a controller that maintains the system's safety, which limits the system's adaptability to dynamic and non-stationary environments. Second, they do not support reverse switching from the safety controller to the performant controller, even when the threat to safety is no longer present. To address these limitations, we propose a dynamic simplex strategy with an online controller switching logic that allows two-way switching. We consider switching as a sequential decision-making problem and model it as a semi-Markov decision process. We leverage a combination of a myopic selector using surrogate models (for the forward switch) and a non-myopic planner (for the reverse switch) to balance safety and performance. We evaluate this approach using an autonomous vehicle case study in the CARLA simulator using different driving conditions, locations, and component failures. We show that the proposed approach results in fewer collisions and higher performance than state-of-the-art alternatives.
△ Less
Submitted 19 February, 2023;
originally announced February 2023.
-
A Formal Geometric Blow-up Method for Pattern Forming Systems
Authors:
Samuel Jelbart,
Christian Kuehn
Abstract:
We extend and apply a recently developed approach to the study of dynamic bifurcations in PDEs based on the geometric blow-up method. We show that this approach, which has so far only been applied to study a dynamic Turing bifurcation in a cubic Swift-Hohenberg equation, can be coupled with a fast-slow extension of the method of multiple scales. This leads to a formal but systematic method, which…
▽ More
We extend and apply a recently developed approach to the study of dynamic bifurcations in PDEs based on the geometric blow-up method. We show that this approach, which has so far only been applied to study a dynamic Turing bifurcation in a cubic Swift-Hohenberg equation, can be coupled with a fast-slow extension of the method of multiple scales. This leads to a formal but systematic method, which can be viewed as a fast-slow generalisation of the formal part of classical modulation theory. We demonstrate the utility and versatility of this method by using it to derive modulation equations, i.e. simpler closed form equations which govern the dynamics of the formal approximations near the underlying bifurcation point, in the context of model equations with dynamic bifurcations of (i) Turing, (ii) Hopf, (iii) Turing-Hopf, and (iv) stationary long-wave type. The modulation equations have a familiar form: They are of real Ginzburg-Landau (GL), complex GL, coupled complex GL and Cahn-Hilliard type respectively. In contrast to the modulation equations derived in classical modulation theory, however, they have time-dependent coefficients induced by the slow parameter drift, they depend on spatial and temporal scales which scale in a dependent and non-trivial way, and the geometry of the space in which they are posed is non-trivial due to the blow-up transformation. The formal derivation of the modulation equations provides the first steps toward the rigorous treatment of these challenging problems, which remains for future work.
△ Less
Submitted 13 February, 2023;
originally announced February 2023.