-
Novel Generic Models for Differentiating Stem Cells Reveal Oscillatory Mechanisms
Authors:
Saeed Farjami,
Karen Camargo Sosa,
Jonathan H. P. Dawes,
Robert N. Kelsh,
Andrea Rocco
Abstract:
Understanding cell fate selection remains a central challenge in developmental biology. We present a class of simple yet biologically-motivated mathematical models for cell differentiation that generically generate oscillations and hence suggest alternatives to the standard framework based on Waddington's epigenetic landscape. The models allow us to suggest two generic dynamical scenarios that des…
▽ More
Understanding cell fate selection remains a central challenge in developmental biology. We present a class of simple yet biologically-motivated mathematical models for cell differentiation that generically generate oscillations and hence suggest alternatives to the standard framework based on Waddington's epigenetic landscape. The models allow us to suggest two generic dynamical scenarios that describe the differentiation process. In the first scenario gradual variation of a single control parameter is responsible for both entering and exiting the oscillatory regime. In the second scenario two control parameters vary: one responsible for entering, and the other for exiting the oscillatory regime. We analyse the standard repressilator and four variants of it and show the dynamical behaviours associated with each scenario. We present a thorough analysis of the associated bifurcations and argue that gene regulatory networks with these repressilator-like characteristics are promising candidates to describe cell fate selection through an oscillatory process.
△ Less
Submitted 22 July, 2021; v1 submitted 28 May, 2021;
originally announced May 2021.
-
Using Echo State Networks to Approximate Value Functions for Control
Authors:
Allen G. Hart,
Kevin R. Olding,
A. M. G. Cox,
Olga Isupova,
J. H. P. Dawes
Abstract:
An Echo State Network (ESN) is a type of single-layer recurrent neural network with randomly-chosen internal weights and a trainable output layer. We prove under mild conditions that a sufficiently large Echo State Network can approximate the value function of a broad class of stochastic and deterministic control problems. Such control problems are generally non-Markovian.
We describe how the ES…
▽ More
An Echo State Network (ESN) is a type of single-layer recurrent neural network with randomly-chosen internal weights and a trainable output layer. We prove under mild conditions that a sufficiently large Echo State Network can approximate the value function of a broad class of stochastic and deterministic control problems. Such control problems are generally non-Markovian.
We describe how the ESN can form the basis for novel and computationally efficient reinforcement learning algorithms in a non-Markovian framework. We demonstrate this theory with two examples. In the first, we use an ESN to solve a deterministic, partially observed, control problem which is a simple game we call `Bee World'. In the second example, we consider a stochastic control problem inspired by a market making problem in mathematical finance. In both cases we can compare the dynamics of the algorithms with analytic solutions to show that even after only a single reinforcement policy iteration the algorithms arrive at a good policy.
△ Less
Submitted 25 June, 2021; v1 submitted 11 February, 2021;
originally announced February 2021.
-
Echo State Networks trained by Tikhonov least squares are L2(μ) approximators of ergodic dynamical systems
Authors:
Allen G Hart,
James L Hook,
Jonathan H P Dawes
Abstract:
Echo State Networks (ESNs) are a class of single-layer recurrent neural networks with randomly generated internal weights, and a single layer of tuneable outer weights, which are usually trained by regularised linear least squares regression. Remarkably, ESNs still enjoy the universal approximation property despite the training procedure being entirely linear. In this paper, we prove that an ESN t…
▽ More
Echo State Networks (ESNs) are a class of single-layer recurrent neural networks with randomly generated internal weights, and a single layer of tuneable outer weights, which are usually trained by regularised linear least squares regression. Remarkably, ESNs still enjoy the universal approximation property despite the training procedure being entirely linear. In this paper, we prove that an ESN trained on a sequence of observations from an ergodic dynamical system (with invariant measure $μ$) using Tikhonov least squares regression against a set of targets, will approximate the target function in the $L^2(μ)$ norm. In the special case that the targets are future observations, the ESN is learning the next step map, which allows time series forecasting. We demonstrate the theory numerically by training an ESN using Tikhonov least squares on a sequence of scalar observations of the Lorenz system.
△ Less
Submitted 18 February, 2021; v1 submitted 14 May, 2020;
originally announced May 2020.
-
Embedding and Approximation Theorems for Echo State Networks
Authors:
Allen G Hart,
James L Hook,
Jonathan H P Dawes
Abstract:
Echo State Networks (ESNs) are a class of single layer recurrent neural networks that have enjoyed recent attention. In this paper we prove that a suitable ESN, trained on a series of measurements of an invertible dynamical system, induces a C1 map from the dynamical system's phase space to the ESN's reservoir space. We call this the Echo State Map. We then prove that the Echo State Map is generic…
▽ More
Echo State Networks (ESNs) are a class of single layer recurrent neural networks that have enjoyed recent attention. In this paper we prove that a suitable ESN, trained on a series of measurements of an invertible dynamical system, induces a C1 map from the dynamical system's phase space to the ESN's reservoir space. We call this the Echo State Map. We then prove that the Echo State Map is generically an embedding with positive probability. Under additional mild assumptions, we further conjecture that the Echo State Map is almost surely an embedding. For sufficiently large, and specially structured, but still randomly generated ESNs, we prove that there exists a linear readout layer that allows the ESN to predict the next observation of a dynamical system arbitrarily well. Consequently, if the dynamical system under observation is structurally stable then the trained ESN will exhibit dynamics that are topologically conjugate to the future behaviour of the observed dynamical system. Our theoretical results connect the theory of ESNs to the delay-embedding literature for dynamical systems, and are supported by numerical evidence from simulations of the traditional Lorenz equations. The simulations confirm that, from a one dimensional observation function, an ESN can accurately infer a range of geometric and topological features of the dynamics such as the eigenvalues of equilibrium points, Lyapunov exponents and homology groups.
△ Less
Submitted 18 May, 2020; v1 submitted 14 August, 2019;
originally announced August 2019.
-
Demographic noise slows down cycles of dominance
Authors:
Qian Yang,
Tim Rogers,
Jonathan H P Dawes
Abstract:
We study the phenomenon of cyclic dominance in the paradigmatic Rock--Paper--Scissors model, as occurring in both stochastic individual-based models of finite populations and in the deterministic replicator equations. The mean-field replicator equations are valid in the limit of large populations and, in the presence of mutation and unbalanced payoffs, they exhibit an attracting limit cycle. The p…
▽ More
We study the phenomenon of cyclic dominance in the paradigmatic Rock--Paper--Scissors model, as occurring in both stochastic individual-based models of finite populations and in the deterministic replicator equations. The mean-field replicator equations are valid in the limit of large populations and, in the presence of mutation and unbalanced payoffs, they exhibit an attracting limit cycle. The period of this cycle depends on the rate of mutation; specifically, the period grows logarithmically as the mutation rate tends to zero. We find that this behaviour is not reproduced in stochastic simulations with a fixed finite population size. Instead, demographic noise present in the individual-based model dramatically slows down the progress of the limit cycle, with the typical period growing as the reciprocal of the mutation rate. Here we develop a theory that explains these scaling regimes and delineates them in terms of population size and mutation rate. We identify a further intermediate regime in which we construct a stochastic differential equation model describing the transition between stochastically-dominated and mean-field behaviour.
△ Less
Submitted 2 August, 2017;
originally announced August 2017.
-
The Swift-Hohenberg equation with a nonlocal nonlinearity
Authors:
David Morgan,
Jonathan H. P. Dawes
Abstract:
It is well known that aspects of the formation of localised states in a one-dimensional Swift--Hohenberg equation can be described by Ginzburg--Landau-type envelope equations. This paper extends these multiple scales analyses to cases where an additional nonlinear integral term, in the form of a convolution, is present. The presence of a kernel function introduces a new lengthscale into the proble…
▽ More
It is well known that aspects of the formation of localised states in a one-dimensional Swift--Hohenberg equation can be described by Ginzburg--Landau-type envelope equations. This paper extends these multiple scales analyses to cases where an additional nonlinear integral term, in the form of a convolution, is present. The presence of a kernel function introduces a new lengthscale into the problem, and this results in additional complexity in both the derivation of envelope equations and in the bifurcation structure.
When the kernel is short-range, weakly nonlinear analysis results in envelope equations of standard type but whose coefficients are modified in complicated ways by the nonlinear nonlocal term. Nevertheless, these computations can be formulated quite generally in terms of properties of the Fourier transform of the kernel function. When the lengthscale associated with the kernel is longer, our method leads naturally to the derivation of two different, novel, envelope equations that describe aspects of the dynamics in these new regimes. The first of these contains additional bifurcations, and unexpected loops in the bifurcation diagram. The second of these captures the stretched-out nature of the homoclinic snaking curves that arises due to the nonlocal term.
△ Less
Submitted 20 December, 2013;
originally announced December 2013.
-
Variational approximation and the use of collective coordinates
Authors:
J. H. P. Dawes,
H. Susanto
Abstract:
We consider propagating, spatially localised waves in a class of equations that contain variational and non-variational terms. The dynamics of the waves is analysed through a collective coordinate approach. Motivated by the variational approximation, we show that there is a natural choice of projection onto collective variables for reducing the governing (nonlinear) partial differential equation (…
▽ More
We consider propagating, spatially localised waves in a class of equations that contain variational and non-variational terms. The dynamics of the waves is analysed through a collective coordinate approach. Motivated by the variational approximation, we show that there is a natural choice of projection onto collective variables for reducing the governing (nonlinear) partial differential equation (PDE) to coupled ordinary differential equations (ODEs). This projection produces ODEs whose solutions are exactly the stationary states of the effective Lagrangian that would be considered from applying the variational approximation method. We illustrate our approach by applying it to a modified Fisher equation for a travelling front, containing a non-constant-coefficient nonlinear term. We present numerical results that show that our proposed projection captures both the equilibria and the dynamics of the PDE much more closely than previously proposed projections.
△ Less
Submitted 19 May, 2013;
originally announced May 2013.
-
Localised states in an extended Swift-Hohenberg equation
Authors:
John Burke,
Jonathan H. P. Dawes
Abstract:
Recent work on the behaviour of localised states in pattern forming partial differential equations has focused on the traditional model Swift-Hohenberg equation which, as a result of its simplicity, has additional structure --- it is variational in time and conservative in space. In this paper we investigate an extended Swift-Hohenberg equation in which non-variational and non-conservative effects…
▽ More
Recent work on the behaviour of localised states in pattern forming partial differential equations has focused on the traditional model Swift-Hohenberg equation which, as a result of its simplicity, has additional structure --- it is variational in time and conservative in space. In this paper we investigate an extended Swift-Hohenberg equation in which non-variational and non-conservative effects play a key role. Our work concentrates on aspects of this much more complicated problem. Firstly we carry out the normal form analysis of the initial pattern forming instability that leads to small-amplitude localised states. Next we examine the bifurcation structure of the large-amplitude localised states. Finally we investigate the temporal stability of one-peak localised states. Throughout, we compare the localised states in the extended Swift-Hohenberg equation with the analogous solutions to the usual Swift-Hohenberg equation.
△ Less
Submitted 9 August, 2011;
originally announced August 2011.
-
Turbulent transition in a truncated one-dimensional model for shear flow
Authors:
J. H. P. Dawes,
W. J. Giles
Abstract:
We present a reduced model for the transition to turbulence in shear flow that is simple enough to admit a thorough numerical investigation while allowing spatio-temporal dynamics that are substantially more complex than those allowed in previous modal truncations. Our model allows a comparison of the dynamics resulting from initial perturbations that are localised in the spanwise direction with t…
▽ More
We present a reduced model for the transition to turbulence in shear flow that is simple enough to admit a thorough numerical investigation while allowing spatio-temporal dynamics that are substantially more complex than those allowed in previous modal truncations. Our model allows a comparison of the dynamics resulting from initial perturbations that are localised in the spanwise direction with those resulting from sinusoidal perturbations. For spanwise-localised initial conditions the subcritical transition to a `turbulent' state (i) takes place more abruptly, with a boundary between laminar and `turbulent' flow that is appears to be much less `structured' and (ii) results in a spatiotemporally chaotic regime within which the lifetimes of spatiotemporally complicated transients are longer, and are even more sensitive to initial conditions. The minimum initial energy $E_0$ required for a spanwise-localised initial perturbation to excite a chaotic transient has a power-law scaling with Reynolds number $E_0 \sim Re^p$ with $p \approx -4.3$. The exponent $p$ depends only weakly on the width of the localised perturbation and is lower than that commonly observed in previous low-dimensional models where typically $p \approx -2$. The distributions of lifetimes of chaotic transients at fixed Reynolds number are found to be consistent with exponential distributions.
△ Less
Submitted 4 July, 2011;
originally announced July 2011.
-
Snaking and isolas of localised states in bistable discrete lattices
Authors:
Chris Taylor,
Jonathan H. P. Dawes
Abstract:
We consider localised states in a discrete bistable Allen-Cahn equation. This model equation combines bistability and local cell-to-cell coupling in the simplest possible way. The existence of stable localised states is made possible by pinning to the underlying lattice; they do not exist in the equivalent continuum equation. In particular we address the existence of 'isolas': closed curves of sol…
▽ More
We consider localised states in a discrete bistable Allen-Cahn equation. This model equation combines bistability and local cell-to-cell coupling in the simplest possible way. The existence of stable localised states is made possible by pinning to the underlying lattice; they do not exist in the equivalent continuum equation. In particular we address the existence of 'isolas': closed curves of solutions in the bifurcation diagram. Isolas appear for some non-periodic boundary conditions in one spatial dimension but seem to appear generically in two dimensions. We point out how features of the bifurcation diagram in 1D help to explain some (unintuitive) features of the bifurcation diagram in 2D.
△ Less
Submitted 1 November, 2010;
originally announced November 2010.
-
Snaking and isolas of localized states in bistable discrete lattices
Authors:
Christopher R. N. Taylor,
Jonathan H. P. Dawes
Abstract:
We consider localized states in a discrete bistable Allen-Cahn equation. This model equation combines bistability and local cell-to-cell coupling in the simplest possible way. The existence of stable localized states is made possible by pinning to the underlying lattice; they do not exist in the equivalent continuum equation.
In particular we address the existence of 'isolas': closed curves of…
▽ More
We consider localized states in a discrete bistable Allen-Cahn equation. This model equation combines bistability and local cell-to-cell coupling in the simplest possible way. The existence of stable localized states is made possible by pinning to the underlying lattice; they do not exist in the equivalent continuum equation.
In particular we address the existence of 'isolas': closed curves of solutions in the bifurcation diagram. Isolas appear for some non-periodic boundary conditions in one spatial dimension but seem to appear generically in two dimensions. We point out how features of the bifurcation diagram in 1D help to explain some (unintuitive) features of the bifurcation diagram in 2D.
△ Less
Submitted 2 October, 2009;
originally announced October 2009.
-
Resonance bifurcations from robust homoclinic cycles
Authors:
Claire M Postlethwaite,
Jonathan H P Dawes
Abstract:
We present two calculations for a class of robust homoclinic cycles with symmetry Z_n x Z_2^n, for which the sufficient conditions for asymptotic stability given by Krupa and Melbourne are not optimal.
Firstly, we compute optimal conditions for asymptotic stability using transition matrix techniques which make explicit use of the geometry of the group action.
Secondly, through an explicit co…
▽ More
We present two calculations for a class of robust homoclinic cycles with symmetry Z_n x Z_2^n, for which the sufficient conditions for asymptotic stability given by Krupa and Melbourne are not optimal.
Firstly, we compute optimal conditions for asymptotic stability using transition matrix techniques which make explicit use of the geometry of the group action.
Secondly, through an explicit computation of the global parts of the Poincare map near the cycle we show that, generically, the resonance bifurcations from the cycles are supercritical: a unique branch of asymptotically stable period orbits emerges from the resonance bifurcation and exists for coefficient values where the cycle has lost stability. This calculation is the first to explicitly compute the criticality of a resonance bifurcation, and answers a conjecture of Field and Swift in a particular limiting case. Moreover, we are able to obtain an asymptotically-correct analytic expression for the period of the bifurcating orbit, with no adjustable parameters, which has not proved possible previously. We show that the asymptotic analysis compares very favourably with numerical results.
△ Less
Submitted 24 June, 2009;
originally announced June 2009.
-
The meandering instability of a viscous thread
Authors:
Stephen W. Morris,
Jonathan H. P. Dawes,
Neil M. Ribe,
John R. Lister
Abstract:
A viscous thread falling from a nozzle onto a surface exhibits the famous rope-coiling effect, in which the thread buckles to form loops. If the surface is replaced by a belt moving with speed $U$, the rotational symmetry of the buckling instability is broken and a wealth of interesting states are observed [See S. Chiu-Webster and J. R. Lister, J. Fluid Mech., {\bf 569}, 89 (2006)]. We experimen…
▽ More
A viscous thread falling from a nozzle onto a surface exhibits the famous rope-coiling effect, in which the thread buckles to form loops. If the surface is replaced by a belt moving with speed $U$, the rotational symmetry of the buckling instability is broken and a wealth of interesting states are observed [See S. Chiu-Webster and J. R. Lister, J. Fluid Mech., {\bf 569}, 89 (2006)]. We experimentally studied this "fluid mechanical sewing machine" in a new, more precise apparatus. As $U$ is reduced, the steady catenary thread bifurcates into a meandering state in which the thread displacements are only transverse to the motion of the belt. We measured the amplitude and frequency $ω$ of the meandering close to the bifurcation. For smaller $U$, single-frequency meandering bifurcates to a two-frequency "figure eight" state, which contains a significant $2ω$ component and parallel as well as transverse displacements. This eventually reverts to single-frequency coiling at still smaller $U$. More complex, highly hysteretic states with additional frequencies are observed for larger nozzle heights. We propose to understand this zoology in terms of the generic amplitude equations appropriate for resonant interactions between two oscillatory modes with frequencies $ω$ and $2ω$. The form of the amplitude equations captures both the axisymmetry of the U=0 coiling state and the symmetry-breaking effects induced by the moving belt.
△ Less
Submitted 21 May, 2008; v1 submitted 24 November, 2007;
originally announced November 2007.
-
Instabilities induced by a weak breaking of a strong spatial resonance
Authors:
J. H. P. Dawes,
C. M. Postlethwaite,
M. R. E. Proctor
Abstract:
Through multiple-scales and symmetry arguments we derive a model set of amplitude equations describing the interaction of two steady-state pattern-forming instabilities, in the case that the wavelengths of the instabilities are nearly in the ratio 1:2. In the case of exact 1:2 resonance the amplitude equations are ODEs; here they are PDEs.
We discuss the stability of spatially-periodic solutio…
▽ More
Through multiple-scales and symmetry arguments we derive a model set of amplitude equations describing the interaction of two steady-state pattern-forming instabilities, in the case that the wavelengths of the instabilities are nearly in the ratio 1:2. In the case of exact 1:2 resonance the amplitude equations are ODEs; here they are PDEs.
We discuss the stability of spatially-periodic solutions to long-wavelength disturbances. By including these modulational effects we are able to explore the relevance of the exact 1:2 results to spatially-extended physical systems for parameter values near to this codimension-two bifurcation point. These new instabilities can be described in terms of reduced `normal form' PDEs near various secondary codimension-two points. The robust heteroclinic cycle in the ODEs is destabilised by long-wavelength perturbations and a stable periodic orbit is generated that lies close to the cycle. An analytic expression giving the approximate period of this orbit is derived.
△ Less
Submitted 21 November, 2003;
originally announced November 2003.