-
Guaranteed optimal reachability control of reaction-diffusion equations using one-sided Lipschitz constants and model reduction
Authors:
Adrien Le Coënt,
Laurent Fribourg
Abstract:
We show that, for any spatially discretized system of reaction-diffusion, the approximate solution given by the explicit Euler time-discretization scheme converges to the exact time-continuous solution, provided that diffusion coefficient be sufficiently large. By "sufficiently large", we mean that the diffusion coefficient value makes the one-sided Lipschitz constant of the reaction-diffusion sys…
▽ More
We show that, for any spatially discretized system of reaction-diffusion, the approximate solution given by the explicit Euler time-discretization scheme converges to the exact time-continuous solution, provided that diffusion coefficient be sufficiently large. By "sufficiently large", we mean that the diffusion coefficient value makes the one-sided Lipschitz constant of the reaction-diffusion system negative. We apply this result to solve a finite horizon control problem for a 1D reaction-diffusion example. We also explain how to perform model reduction in order to improve the efficiency of the method.
△ Less
Submitted 11 December, 2019; v1 submitted 25 July, 2019;
originally announced July 2019.
-
SOS: Safe, Optimal and Small Strategies for Hybrid Markov Decision Processes
Authors:
Pranav Ashok,
Jan Křetínský,
Kim Guldstrand Larsen,
Adrien Le Coënt,
Jakob Haahr Taankvist,
Maximilian Weininger
Abstract:
For hybrid Markov decision processes, UPPAAL Stratego can compute strategies that are safe for a given safety property and (in the limit) optimal for a given cost function. Unfortunately, these strategies cannot be exported easily since they are computed as a very long list. In this paper, we demonstrate methods to learn compact representations of the strategies in the form of decision trees. Thes…
▽ More
For hybrid Markov decision processes, UPPAAL Stratego can compute strategies that are safe for a given safety property and (in the limit) optimal for a given cost function. Unfortunately, these strategies cannot be exported easily since they are computed as a very long list. In this paper, we demonstrate methods to learn compact representations of the strategies in the form of decision trees. These decision trees are much smaller, more understandable, and can easily be exported as code that can be loaded into embedded systems. Despite the size compression and actual differences to the original strategy, we provide guarantees on both safety and optimality of the decision-tree strategy. On the top, we show how to obtain yet smaller representations, which are still guaranteed safe, but achieve a desired trade-off between size and optimality.
△ Less
Submitted 25 June, 2019;
originally announced June 2019.
-
Controlled Recurrence of a Biped with Torso
Authors:
Adrien Le Coënt,
Laurent Fribourg
Abstract:
We have recently used a symbolic reachability method for controlling the stability of special hybrid systems called 'sampled switched systems'. We show here how the method can be extended in order to control the stability of more general hybrid systems with guard conditions and state resets. We illustrate the method through the example of a biped robot with 6 state variables, using a proportional-…
▽ More
We have recently used a symbolic reachability method for controlling the stability of special hybrid systems called 'sampled switched systems'. We show here how the method can be extended in order to control the stability of more general hybrid systems with guard conditions and state resets. We illustrate the method through the example of a biped robot with 6 state variables, using a proportional-derivative (PD) controller. More specifically, we isolate a state region R such that, starting from a state located in R just after a footstep, the PD-control makes the robot state return to R at the end of the following footstep.
△ Less
Submitted 26 March, 2019;
originally announced March 2019.
-
Guaranteed Control of Sampled Switched Systems using Semi-Lagrangian Schemes and One-Sided Lipschitz Constants
Authors:
Adrien Le Coënt,
Laurent Fribourg
Abstract:
In this paper, we propose a new method for ensuring formally that a controlled trajectory stay inside a given safety set S for a given duration T. Using a finite gridding X of S, we first synthesize, for a subset of initial nodes x of X , an admissible control for which the Euler-based approximate trajectories lie in S at t $\in$ [0,T]. We then give sufficient conditions which ensure that the exac…
▽ More
In this paper, we propose a new method for ensuring formally that a controlled trajectory stay inside a given safety set S for a given duration T. Using a finite gridding X of S, we first synthesize, for a subset of initial nodes x of X , an admissible control for which the Euler-based approximate trajectories lie in S at t $\in$ [0,T]. We then give sufficient conditions which ensure that the exact trajectories, under the same control, also lie in S for t $\in$ [0,T], when starting at initial points 'close' to nodes x. The statement of such conditions relies on results giving estimates of the deviation of Euler-based approximate trajectories, using one-sided Lipschitz constants. We illustrate the interest of the method on several examples, including a stochastic one.
△ Less
Submitted 14 March, 2019;
originally announced March 2019.
-
Control Synthesis of Nonlinear Sampled Switched Systems using Euler's Method
Authors:
Adrien Le Coënt,
Florian De Vuyst,
Ludovic Chamoin,
Laurent Fribourg
Abstract:
In this paper, we propose a symbolic control synthesis method for nonlinear sampled switched systems whose vector fields are one-sided Lipschitz. The main idea is to use an approximate model obtained from the forward Euler method to build a guaranteed control. The benefit of this method is that the error introduced by symbolic modeling is bounded by choosing suitable time and space discretizations…
▽ More
In this paper, we propose a symbolic control synthesis method for nonlinear sampled switched systems whose vector fields are one-sided Lipschitz. The main idea is to use an approximate model obtained from the forward Euler method to build a guaranteed control. The benefit of this method is that the error introduced by symbolic modeling is bounded by choosing suitable time and space discretizations. The method is implemented in the interpreted language Octave. Several examples of the literature are performed and the results are compared with results obtained with a previous method based on the Runge-Kutta integration method.
△ Less
Submitted 10 April, 2017;
originally announced April 2017.
-
Control of nonlinear switched systems based on validated simulation
Authors:
Adrien Le Coënt,
Julien Alexandre Dit Sandretto,
Alexandre Chapoutot,
Laurent Fribourg
Abstract:
We present an algorithm of control synthesis for nonlinear switched systems, based on an existing procedure of state-space bisection and made available for nonlinear systems with the help of validated simulation. The use of validated simulation also permits to take bounded perturbations and varying parameters into account. It is particularly interesting for safety critical applications, such as in…
▽ More
We present an algorithm of control synthesis for nonlinear switched systems, based on an existing procedure of state-space bisection and made available for nonlinear systems with the help of validated simulation. The use of validated simulation also permits to take bounded perturbations and varying parameters into account. It is particularly interesting for safety critical applications, such as in aeronautical, military or medical fields. The whole approach is entirely guaranteed and the induced controllers are correct-by-design.
△ Less
Submitted 21 November, 2016;
originally announced November 2016.
-
Distributed Synthesis of State-Dependent Switching Control
Authors:
Adrien Le Coënt,
Laurent Fribourg,
Nicolas Markey,
Florian De Vuyst,
Ludovic Chamoin
Abstract:
We present a correct-by-design method of state-dependent control synthesis for linear discrete-time switching systems. Given an objective region R of the state space, the method builds a capture set S and a control which steers any element of S into R. The method works by iterated backward reachability from R. More precisely, S is given as a parametric extension of R, and the maximum value of the…
▽ More
We present a correct-by-design method of state-dependent control synthesis for linear discrete-time switching systems. Given an objective region R of the state space, the method builds a capture set S and a control which steers any element of S into R. The method works by iterated backward reachability from R. More precisely, S is given as a parametric extension of R, and the maximum value of the parameter is solved by linear programming. The method can also be used to synthesize a stability control which maintains indefinitely within R all the states starting at R. We explain how the synthesis method can be performed in a distributed manner. The method has been implemented and successfully applied to the synthesis of a distributed control of a concrete floor heating system with 11 rooms and 2^11 = 2048 switching modes.
△ Less
Submitted 6 April, 2016;
originally announced April 2016.
