-
Toggling a Genetic Switch Using Reinforcement Learning
Authors:
Aivar Sootla,
Natalja Strelkowa,
Damien Ernst,
Mauricio Barahona,
Guy-Bart Stan
Abstract:
In this paper, we consider the problem of optimal exogenous control of gene regulatory networks. Our approach consists in adapting an established reinforcement learning algorithm called the fitted Q iteration. This algorithm infers the control law directly from the measurements of the system's response to external control inputs without the use of a mathematical model of the system. The measuremen…
▽ More
In this paper, we consider the problem of optimal exogenous control of gene regulatory networks. Our approach consists in adapting an established reinforcement learning algorithm called the fitted Q iteration. This algorithm infers the control law directly from the measurements of the system's response to external control inputs without the use of a mathematical model of the system. The measurement data set can either be collected from wet-lab experiments or artificially created by computer simulations of dynamical models of the system. The algorithm is applicable to a wide range of biological systems due to its ability to deal with nonlinear and stochastic system dynamics. To illustrate the application of the algorithm to a gene regulatory network, the regulation of the toggle switch system is considered. The control objective of this problem is to drive the concentrations of two specific proteins to a target region in the state space.
△ Less
Submitted 25 February, 2015; v1 submitted 12 March, 2013;
originally announced March 2013.
-
Transient dynamics around unstable periodic orbits in the generalized repressilator model
Authors:
Natalja Strelkowa,
Mauricio Barahona
Abstract:
We study the spatio-temporal dynamics of the generalized repressilator, a system of coupled repressing genes arranged in a directed ring topology, and give analytical conditions for the emergence of a cascade of unstable periodic orbits (UPOs) that lead to reachable long-lived oscillating transients. Such transients dominate the finite time horizon dynamics that is relevant in confined, noisy envi…
▽ More
We study the spatio-temporal dynamics of the generalized repressilator, a system of coupled repressing genes arranged in a directed ring topology, and give analytical conditions for the emergence of a cascade of unstable periodic orbits (UPOs) that lead to reachable long-lived oscillating transients. Such transients dominate the finite time horizon dynamics that is relevant in confined, noisy environments such as bacterial cells (see our previous work [Strelkowa and Barahona, 2010]) and are therefore of interest for bioengineering and synthetic biology. We show that the family of unstable orbits possesses spatial symmetries and can also be understood in terms of traveling wave solutions of kink-like topological defects. The long-lived oscillatory transients correspond to the propagation of quasistable two-kink configurations that unravel over a long time. We also assess the similarities between the generalized repressilator model and other unidirectionally coupled electronic systems, such as magnetic flux gates, which have been implemented experimentally.
△ Less
Submitted 17 December, 2010;
originally announced December 2010.
-
Switchable Genetic Oscillator Operating in Quasi-Stable Mode
Authors:
Natalja Strelkowa,
Mauricio Barahona
Abstract:
Ring topologies of repressing genes have qualitatively different long-term dynamics if the number of genes is odd (they oscillate) or even (they exhibit bistability). However, these attractors may not fully explain the observed behavior in transient and stochastic environments such as the cell. We show here that even repressilators possess quasi-stable, travelling-wave periodic solutions that ar…
▽ More
Ring topologies of repressing genes have qualitatively different long-term dynamics if the number of genes is odd (they oscillate) or even (they exhibit bistability). However, these attractors may not fully explain the observed behavior in transient and stochastic environments such as the cell. We show here that even repressilators possess quasi-stable, travelling-wave periodic solutions that are reachable, long-lived and robust to parameter changes. These solutions underlie the sustained oscillations observed in even rings in the stochastic regime, even if these circuits are expected to behave as switches. The existence of such solutions can also be exploited for control purposes: operation of the system around the quasi-stable orbit allows us to turn on and off the oscillations reliably and on demand. We illustrate these ideas with a simple protocol based on optical interference that can induce oscillations robustly both in the stochastic and deterministic regimes.
△ Less
Submitted 19 November, 2009; v1 submitted 10 September, 2009;
originally announced September 2009.
