-
Generalised Synchronisations, Embeddings, and Approximations for Continuous Time Reservoir Computers
Authors:
Allen G Hart
Abstract:
We establish conditions under which a continuous time reservoir computer, such as a leaky integrator echo state network, admits a generalised synchronisation $f$ between between the source dynamics and reservoir dynamics. We show that multiple generalised synchronisations can exist simultaneously, and connect this to the multi-Echo-State-Property (multi-ESP). In the special case of a linear reserv…
▽ More
We establish conditions under which a continuous time reservoir computer, such as a leaky integrator echo state network, admits a generalised synchronisation $f$ between between the source dynamics and reservoir dynamics. We show that multiple generalised synchronisations can exist simultaneously, and connect this to the multi-Echo-State-Property (multi-ESP). In the special case of a linear reservoir computer, we derive a closed form expression for the generalised synchronisation $f$. Furthermore, we establish conditions under which $f$ is of class $C^1$, and conditions under which $f$ is a topological embedding on the fixed points of the source system. This embedding result is closely related to Takens' embedding Theorem.
We also prove that the embedding of fixed points occurs almost surely for randomly generated linear reservoir systems. With an embedding achieved, we discuss how the universal approximation theorem makes it possible to forecast the future dynamics of the source system and replicate its topological properties. We illustrate the theory by embedding a fixed point of the Lorenz-63 system into the reservoir space using numerical methods. Finally, we show that if the observations are perturbed by white noise, the GS is preserved up to a perturbation by an Ornstein-Uhlenbeck process.
△ Less
Submitted 26 October, 2023; v1 submitted 17 November, 2022;
originally announced November 2022.
-
(Thesis) Reservoir Computing With Dynamical Systems
Authors:
Allen G Hart
Abstract:
A reservoir computer is a special type of neural network, where most of the weights are randomly fixed and only a subset are trained.
In this thesis we prove results about reservoir computers trained on deterministic dynamical systems, and stochastic processes. We focus mostly on a special type of reservoir computer called an Echo State Network (ESN).
In the deterministic case, we prove (under…
▽ More
A reservoir computer is a special type of neural network, where most of the weights are randomly fixed and only a subset are trained.
In this thesis we prove results about reservoir computers trained on deterministic dynamical systems, and stochastic processes. We focus mostly on a special type of reservoir computer called an Echo State Network (ESN).
In the deterministic case, we prove (under some assumptions) that if a reservoir computer has the Echo State Property (ESP), then there is a C1 generalised synchronisation between the input dynamical system and the dynamics in the reservoir space. Furthermore, we prove that a reservoir computer with the local ESP in several disjoint subsets of the reservoir space will admit several distinct generalised synchronisations. In the special case that the reservoir map is linear, and has the ESP, we prove that the generalised synchronisation is generically an embedding. This result admits Takens' embedding Theorem as a special case.
We go to show that ESNs trained on scalar observations of an ergodic dynamical system can approximate an arbitrary target function, including the next step map used in time series forecasting. This universal approximation property holds despite the training process being entirely linear.
We prove analogous results for ESNs trained on observations of a stochastic process, which are not be Markovian in general. We use these results to develop supervised learning, and reinforcement learning algorithms supported by an ESN.
In the penultimate chapter of this thesis, we use a reservoir computer to numerically solve linear PDEs. In the final chapter, we conclude and discuss directions for future work.
△ Less
Submitted 24 December, 2021; v1 submitted 28 November, 2021;
originally announced November 2021.
-
Using Echo State Networks to Approximate Value Functions for Control
Authors:
Allen G. Hart,
Kevin R. Olding,
A. M. G. Cox,
Olga Isupova,
J. H. P. Dawes
Abstract:
An Echo State Network (ESN) is a type of single-layer recurrent neural network with randomly-chosen internal weights and a trainable output layer. We prove under mild conditions that a sufficiently large Echo State Network can approximate the value function of a broad class of stochastic and deterministic control problems. Such control problems are generally non-Markovian.
We describe how the ES…
▽ More
An Echo State Network (ESN) is a type of single-layer recurrent neural network with randomly-chosen internal weights and a trainable output layer. We prove under mild conditions that a sufficiently large Echo State Network can approximate the value function of a broad class of stochastic and deterministic control problems. Such control problems are generally non-Markovian.
We describe how the ESN can form the basis for novel and computationally efficient reinforcement learning algorithms in a non-Markovian framework. We demonstrate this theory with two examples. In the first, we use an ESN to solve a deterministic, partially observed, control problem which is a simple game we call `Bee World'. In the second example, we consider a stochastic control problem inspired by a market making problem in mathematical finance. In both cases we can compare the dynamics of the algorithms with analytic solutions to show that even after only a single reinforcement policy iteration the algorithms arrive at a good policy.
△ Less
Submitted 25 June, 2021; v1 submitted 11 February, 2021;
originally announced February 2021.
-
Echo State Networks trained by Tikhonov least squares are L2(μ) approximators of ergodic dynamical systems
Authors:
Allen G Hart,
James L Hook,
Jonathan H P Dawes
Abstract:
Echo State Networks (ESNs) are a class of single-layer recurrent neural networks with randomly generated internal weights, and a single layer of tuneable outer weights, which are usually trained by regularised linear least squares regression. Remarkably, ESNs still enjoy the universal approximation property despite the training procedure being entirely linear. In this paper, we prove that an ESN t…
▽ More
Echo State Networks (ESNs) are a class of single-layer recurrent neural networks with randomly generated internal weights, and a single layer of tuneable outer weights, which are usually trained by regularised linear least squares regression. Remarkably, ESNs still enjoy the universal approximation property despite the training procedure being entirely linear. In this paper, we prove that an ESN trained on a sequence of observations from an ergodic dynamical system (with invariant measure $μ$) using Tikhonov least squares regression against a set of targets, will approximate the target function in the $L^2(μ)$ norm. In the special case that the targets are future observations, the ESN is learning the next step map, which allows time series forecasting. We demonstrate the theory numerically by training an ESN using Tikhonov least squares on a sequence of scalar observations of the Lorenz system.
△ Less
Submitted 18 February, 2021; v1 submitted 14 May, 2020;
originally announced May 2020.
-
Embedding and Approximation Theorems for Echo State Networks
Authors:
Allen G Hart,
James L Hook,
Jonathan H P Dawes
Abstract:
Echo State Networks (ESNs) are a class of single layer recurrent neural networks that have enjoyed recent attention. In this paper we prove that a suitable ESN, trained on a series of measurements of an invertible dynamical system, induces a C1 map from the dynamical system's phase space to the ESN's reservoir space. We call this the Echo State Map. We then prove that the Echo State Map is generic…
▽ More
Echo State Networks (ESNs) are a class of single layer recurrent neural networks that have enjoyed recent attention. In this paper we prove that a suitable ESN, trained on a series of measurements of an invertible dynamical system, induces a C1 map from the dynamical system's phase space to the ESN's reservoir space. We call this the Echo State Map. We then prove that the Echo State Map is generically an embedding with positive probability. Under additional mild assumptions, we further conjecture that the Echo State Map is almost surely an embedding. For sufficiently large, and specially structured, but still randomly generated ESNs, we prove that there exists a linear readout layer that allows the ESN to predict the next observation of a dynamical system arbitrarily well. Consequently, if the dynamical system under observation is structurally stable then the trained ESN will exhibit dynamics that are topologically conjugate to the future behaviour of the observed dynamical system. Our theoretical results connect the theory of ESNs to the delay-embedding literature for dynamical systems, and are supported by numerical evidence from simulations of the traditional Lorenz equations. The simulations confirm that, from a one dimensional observation function, an ESN can accurately infer a range of geometric and topological features of the dynamics such as the eigenvalues of equilibrium points, Lyapunov exponents and homology groups.
△ Less
Submitted 18 May, 2020; v1 submitted 14 August, 2019;
originally announced August 2019.
-
A Markovian genomic concatenation model guided by persymmetric matrices
Authors:
Andrew G. Hart,
M. Sobottka
Abstract:
The aim of this work is to provide a rigorous mathematical analysis of a stochastic concatenation model presented by Sobottka and Hart (2011) which allows approximation of the first-order stochastic structure in bacterial DNA by means of a stationary Markov chain. Two probabilistic constructions that rigorously formalize the model are presented. Necessary and sufficient conditions for a Markov cha…
▽ More
The aim of this work is to provide a rigorous mathematical analysis of a stochastic concatenation model presented by Sobottka and Hart (2011) which allows approximation of the first-order stochastic structure in bacterial DNA by means of a stationary Markov chain. Two probabilistic constructions that rigorously formalize the model are presented. Necessary and sufficient conditions for a Markov chain to be generated by the model are given, as well as the theoretical background needed for designing new algorithms for statistical analyses of real bacterial genomes. It is shown that the model encompasses the Markov chains satisfying intra-strand parity, a property observed in most DNA sequences.
△ Less
Submitted 26 November, 2019; v1 submitted 6 May, 2018;
originally announced May 2018.
