-
Learning-based Homothetic Tube MPC
Authors:
Yulong Gao,
Shuhao Yan,
Jian Zhou,
Mark Cannon
Abstract:
In this paper, we study homothetic tube model predictive control (MPC) of discrete-time linear systems subject to bounded additive disturbance and mixed constraints on the state and input. Different from most existing work on robust MPC, we assume that the true disturbance set is unknown but a conservative surrogate is available a priori. Leveraging the real-time data, we develop an online learnin…
▽ More
In this paper, we study homothetic tube model predictive control (MPC) of discrete-time linear systems subject to bounded additive disturbance and mixed constraints on the state and input. Different from most existing work on robust MPC, we assume that the true disturbance set is unknown but a conservative surrogate is available a priori. Leveraging the real-time data, we develop an online learning algorithm to approximate the true disturbance set. This approximation and the corresponding constraints in the MPC optimisation are updated online using computationally convenient linear programs. We provide statistical gaps between the true and learned disturbance sets, based on which, probabilistic recursive feasibility of homothetic tube MPC problems is discussed. Numerical simulations are provided to demonstrate the efficacy of our proposed algorithm and compare with state-of-the-art MPC algorithms.
△ Less
Submitted 6 May, 2025;
originally announced May 2025.
-
Robust targeted exploration for systems with non-stochastic disturbances
Authors:
Janani Venkatasubramanian,
Johannes Köhler,
Mark Cannon,
Frank Allgöwer
Abstract:
In this paper, we introduce a novel targeted exploration strategy designed specifically for uncertain linear time-invariant systems with energy-bounded disturbances, i.e., without making any assumptions on the distribution of the disturbances. We use classical results characterizing the set of non-falsified parameters consistent with energy-bounded disturbances. We derive a semidefinite program wh…
▽ More
In this paper, we introduce a novel targeted exploration strategy designed specifically for uncertain linear time-invariant systems with energy-bounded disturbances, i.e., without making any assumptions on the distribution of the disturbances. We use classical results characterizing the set of non-falsified parameters consistent with energy-bounded disturbances. We derive a semidefinite program which computes an exploration strategy that guarantees a desired accuracy of the parameter estimate. This design is based on sufficient conditions on the spectral content of the exploration data that robustly accounts for initial parametric uncertainty. Finally, we highlight the applicability of the exploration strategy through a numerical example involving an unmodeled nonlinearity.
△ Less
Submitted 29 December, 2024;
originally announced December 2024.
-
Analog fast Fourier transforms for scalable and efficient signal processing
Authors:
T. Patrick Xiao,
Ben Feinberg,
David K. Richardson,
Matthew Cannon,
Harsha Medu,
Vineet Agrawal,
Matthew J. Marinella,
Sapan Agarwal,
Christopher H. Bennett
Abstract:
Edge devices are being deployed at increasing volumes to sense and act on information from the physical world. The discrete Fourier transform (DFT) is often necessary to make this sensed data suitable for further processing $\unicode{x2013}$ such as by artificial intelligence (AI) algorithms $\unicode{x2013}$ and for transmission over communication networks. Analog in-memory computing has been sho…
▽ More
Edge devices are being deployed at increasing volumes to sense and act on information from the physical world. The discrete Fourier transform (DFT) is often necessary to make this sensed data suitable for further processing $\unicode{x2013}$ such as by artificial intelligence (AI) algorithms $\unicode{x2013}$ and for transmission over communication networks. Analog in-memory computing has been shown to be a fast and energy-efficient solution for processing edge AI workloads, but not for Fourier transforms. This is because of the existence of the fast Fourier transform (FFT) algorithm, which enormously reduces the complexity of the DFT but has so far belonged only to digital processors. Here, we show that the FFT can be mapped to analog in-memory computing systems, enabling them to efficiently scale to arbitrarily large Fourier transforms without requiring large sizes or large numbers of non-volatile memory arrays. We experimentally demonstrate analog FFTs on 1D audio and 2D image signals, using a large-scale charge-trapping memory array with precisely tunable, low-conductance analog states. The scalability of both the new analog FFT approach and the charge-trapping memory device is leveraged to compute a 65,536-point analog DFT, a scale that is otherwise inaccessible by analog systems and which is $>$1000$\times$ larger than any previous analog DFT demonstration. The analog FFT also provides more numerically precise DFTs with greater tolerance to device and circuit non-idealities than a direct matrix-vector multiplication approach. We show that the extension of the FFT algorithm to analog in-memory processors leads to design considerations that differ markedly from digital implementations, and that analog Fourier transforms have a substantial power efficiency advantage at all size scales over FFTs implemented on state-of-the-art digital hardware.
△ Less
Submitted 27 September, 2024;
originally announced September 2024.
-
Towards targeted exploration for non-stochastic disturbances
Authors:
Janani Venkatasubramanian,
Johannes Köhler,
Mark Cannon,
Frank Allgöwer
Abstract:
We present a novel targeted exploration strategy for linear time-invariant systems without stochastic assumptions on the noise, i.e., without requiring independence or zero mean, allowing for deterministic model misspecifications. This work utilizes classical data-dependent uncertainty bounds on the least-squares parameter estimates in the presence of energy-bounded noise. We provide a sufficient…
▽ More
We present a novel targeted exploration strategy for linear time-invariant systems without stochastic assumptions on the noise, i.e., without requiring independence or zero mean, allowing for deterministic model misspecifications. This work utilizes classical data-dependent uncertainty bounds on the least-squares parameter estimates in the presence of energy-bounded noise. We provide a sufficient condition on the exploration data that ensures a desired error bound on the estimated parameter. Using common approximations, we derive a semidefinite program to compute the optimal sinusoidal input excitation. Finally, we highlight the differences and commonalities between the developed non-stochastic targeted exploration strategy and conventional exploration strategies based on classical identification bounds through a numerical example.
△ Less
Submitted 26 July, 2024; v1 submitted 10 December, 2023;
originally announced December 2023.
-
Data-driven robust MPC of tiltwing VTOL aircraft
Authors:
Martin Doff-Sotta,
Mark Cannon,
Marko Bacic
Abstract:
This paper investigates robust tube-based Model Predictive Control (MPC) of a tiltwing Vertical Take-Off and Landing (VTOL) aircraft subject to wind disturbances and model uncertainty. Our approach is based on a Difference of Convex (DC) function decomposition of the dynamics to develop a computationally tractable optimisation with robust tubes for the system trajectories. We consider a case study…
▽ More
This paper investigates robust tube-based Model Predictive Control (MPC) of a tiltwing Vertical Take-Off and Landing (VTOL) aircraft subject to wind disturbances and model uncertainty. Our approach is based on a Difference of Convex (DC) function decomposition of the dynamics to develop a computationally tractable optimisation with robust tubes for the system trajectories. We consider a case study of a VTOL aircraft subject to wind gusts and whose aerodynamics is defined from data.
△ Less
Submitted 7 August, 2023;
originally announced August 2023.
-
Learning-based Rigid Tube Model Predictive Control
Authors:
Yulong Gao,
Shuhao Yan,
Jian Zhou,
Mark Cannon,
Alessandro Abate,
Karl H. Johansson
Abstract:
This paper is concerned with model predictive control (MPC) of discrete-time linear systems subject to bounded additive disturbance and mixed constraints on the state and input, whereas the true disturbance set is unknown. Unlike most existing work on robust MPC, we propose an algorithm incorporating online learning that builds on prior knowledge of the disturbance, i.e., a known but conservative…
▽ More
This paper is concerned with model predictive control (MPC) of discrete-time linear systems subject to bounded additive disturbance and mixed constraints on the state and input, whereas the true disturbance set is unknown. Unlike most existing work on robust MPC, we propose an algorithm incorporating online learning that builds on prior knowledge of the disturbance, i.e., a known but conservative disturbance set. We approximate the true disturbance set at each time step with a parameterised set, which is referred to as a quantified disturbance set, using disturbance realisations. A key novelty is that the parameterisation of these quantified disturbance sets enjoys desirable properties such that the quantified disturbance set and its corresponding rigid tube bounding disturbance propagation can be efficiently updated online. We provide statistical gaps between the true and quantified disturbance sets, based on which, probabilistic recursive feasibility of MPC optimisation problems is discussed. Numerical simulations are provided to demonstrate the effectiveness of our proposed algorithm and compare with conventional robust MPC algorithms.
△ Less
Submitted 21 May, 2024; v1 submitted 11 April, 2023;
originally announced April 2023.
-
Robust trajectory optimisation for transitions of tiltwing VTOL aircraft
Authors:
Martin Doff-Sotta,
Mark Cannon,
Marko Bacic
Abstract:
We propose a method to generate robust and optimal trajectories for the transition of a tiltwing Vertical Take-Off and Landing (VTOL) aircraft leveraging concepts from convex optimisation, tube-based nonlinear Model Predictive Control (MPC) and Difference of Convex (DC) functions decomposition.
The approach relies on computing DC decompositions of dynamic models in order to exploit convexity pro…
▽ More
We propose a method to generate robust and optimal trajectories for the transition of a tiltwing Vertical Take-Off and Landing (VTOL) aircraft leveraging concepts from convex optimisation, tube-based nonlinear Model Predictive Control (MPC) and Difference of Convex (DC) functions decomposition.
The approach relies on computing DC decompositions of dynamic models in order to exploit convexity properties and develop a tractable robust optimisation that solves a sequence of convex programs converging to a local optimum of the trajectory generation problem.
The algorithm developed is applied to an Urban Air Mobility case study. The resulting solutions are robust to approximation errors in dynamic models and provide safe trajectories for aggressive transition manoeuvres at constant altitude.
△ Less
Submitted 8 February, 2023;
originally announced February 2023.
-
A Multirate Variational Approach to Nonlinear MPC
Authors:
Yana Lishkova,
Mark Cannon,
Sina Ober-Blöbaum
Abstract:
A multirate nonlinear model predictive control (NMPC) strategy is proposed for systems with dynamics and control inputs evolving on different timescales. The proposed multirate formulation of the system model and receding horizon optimal control problem allows larger time steps in the prediction horizon compared to single-rate schemes, providing computational savings while ensuring recursive feasi…
▽ More
A multirate nonlinear model predictive control (NMPC) strategy is proposed for systems with dynamics and control inputs evolving on different timescales. The proposed multirate formulation of the system model and receding horizon optimal control problem allows larger time steps in the prediction horizon compared to single-rate schemes, providing computational savings while ensuring recursive feasibility. A multirate variational model is used with a tube-based successive linearization NMPC strategy. This allows either Jacobian linearization or linearization using quadratic and linear Taylor series approximations of the Lagrangian and generalized forces respectively, providing alternative means for computing linearization error bounds. The two approaches are shown to be equivalent for a specific choice of approximation points and their structure-preserving properties are investigated. Numerical examples are provided to illustrate the multirate approach, its conservation properties and computational savings.
△ Less
Submitted 3 July, 2022; v1 submitted 8 November, 2021;
originally announced November 2021.
-
Fast optimal trajectory generation for a tiltwing VTOL aircraft with application to urban air mobility
Authors:
Martin Doff-Sotta,
Mark Cannon,
Marko Bacic
Abstract:
We solve the minimum-thrust optimal trajectory generation problem for the transition of a tiltwing Vertical Take-Off and Landing (VTOL) aircraft using convex optimisation. The method is based on a change of differential operator that allows us to express the simplified point-mass dynamics along a prescribed path and formulate the original nonlinear problem in terms of a pair of convex programs. A…
▽ More
We solve the minimum-thrust optimal trajectory generation problem for the transition of a tiltwing Vertical Take-Off and Landing (VTOL) aircraft using convex optimisation. The method is based on a change of differential operator that allows us to express the simplified point-mass dynamics along a prescribed path and formulate the original nonlinear problem in terms of a pair of convex programs. A case study involving the Airbus A3 Vahana VTOL aircraft is considered for forward and backward transitions. The presented approach provides a fast method to generate a safe optimal transition for a tiltwing VTOL aircraft that can further be leveraged online for control, and guidance purposes.
△ Less
Submitted 28 September, 2021;
originally announced September 2021.
-
Stochastic output feedback MPC with intermittent observations
Authors:
Shuhao Yan,
Mark Cannon,
Paul J. Goulart
Abstract:
This paper designs a model predictive control (MPC) law for constrained linear systems with stochastic additive disturbances and noisy measurements, minimising a discounted cost subject to a discounted expectation constraint. It is assumed that sensor data is lost with a known probability. Taking into account the data losses modelled by a Bernoulli process, we parameterise the predicted control po…
▽ More
This paper designs a model predictive control (MPC) law for constrained linear systems with stochastic additive disturbances and noisy measurements, minimising a discounted cost subject to a discounted expectation constraint. It is assumed that sensor data is lost with a known probability. Taking into account the data losses modelled by a Bernoulli process, we parameterise the predicted control policy as an affine function of future observations and obtain a convex linear-quadratic optimal control problem. Constraint satisfaction and a discounted cost bound are ensured without imposing bounds on the distributions of the disturbance and noise inputs. In addition, the average long-run undiscounted closed loop cost is shown to be finite if the discount factor takes appropriate values. We analyse robustness of the proposed control law with respect to possible uncertainties in the arrival probability of sensor data and we bound the impact of these uncertainties on constraint satisfaction and the discounted cost. Numerical simulations are provided to illustrate these results.
△ Less
Submitted 1 March, 2022; v1 submitted 21 September, 2020;
originally announced September 2020.
-
A multirate variational approach to simulation and optimal control for flexible spacecraft
Authors:
Yana Lishkova,
Sina Ober-Blöbaum,
Mark Cannon,
Sigrid Leyendecker
Abstract:
We propose an optimal control method for simultaneous slewing and vibration control of flexible spacecraft. Considering dynamics on different time scales, the optimal control problem is discretized on micro and macro time grids using a multirate variational approach. The description of the system and the necessary optimality conditions are derived through the discrete Lagrange-d'Alembert principle…
▽ More
We propose an optimal control method for simultaneous slewing and vibration control of flexible spacecraft. Considering dynamics on different time scales, the optimal control problem is discretized on micro and macro time grids using a multirate variational approach. The description of the system and the necessary optimality conditions are derived through the discrete Lagrange-d'Alembert principle. The discrete problem retains the conservation properties of the continuous model and achieves high fidelity simulation at a reduced computational cost. Simulation results for a single-axis rotational maneuver demonstrate vibration suppression and achieve the same accuracy as the single rate method at reduced computational cost.
△ Less
Submitted 30 October, 2020; v1 submitted 12 September, 2020;
originally announced September 2020.
-
Stochastic MPC with Dynamic Feedback Gain Selection and Discounted Probabilistic Constraints
Authors:
Shuhao Yan,
Paul J. Goulart,
Mark Cannon
Abstract:
This paper considers linear discrete-time systems with additive disturbances, and designs a Model Predictive Control (MPC) law incorporating a dynamic feedback gain to minimise a quadratic cost function subject to a single chance constraint. The feedback gain is selected online and we provide two selection methods based on minimising upper bounds on predicted costs. The chance constraint is define…
▽ More
This paper considers linear discrete-time systems with additive disturbances, and designs a Model Predictive Control (MPC) law incorporating a dynamic feedback gain to minimise a quadratic cost function subject to a single chance constraint. The feedback gain is selected online and we provide two selection methods based on minimising upper bounds on predicted costs. The chance constraint is defined as a discounted sum of violation probabilities on an infinite horizon. By penalising violation probabilities close to the initial time and assigning violation probabilities in the far future with vanishingly small weights, this form of constraints allows for an MPC law with guarantees of recursive feasibility without a boundedness assumption on the disturbance. A computationally convenient MPC optimisation problem is formulated using Chebyshev's inequality and we introduce an online constraint-tightening technique to ensure recursive feasibility. The closed loop system is guaranteed to satisfy the chance constraint and a quadratic stability condition. With dynamic feedback gain selection, the closed loop cost is reduced and conservativeness of Chebyshev's inequality is mitigated. Also, a larger feasible set of initial conditions can be obtained. Numerical simulations are given to show these results.
△ Less
Submitted 26 May, 2021; v1 submitted 14 July, 2020;
originally announced July 2020.
-
Infinite-Horizon Differentiable Model Predictive Control
Authors:
Sebastian East,
Marco Gallieri,
Jonathan Masci,
Jan Koutnik,
Mark Cannon
Abstract:
This paper proposes a differentiable linear quadratic Model Predictive Control (MPC) framework for safe imitation learning. The infinite-horizon cost is enforced using a terminal cost function obtained from the discrete-time algebraic Riccati equation (DARE), so that the learned controller can be proven to be stabilizing in closed-loop. A central contribution is the derivation of the analytical de…
▽ More
This paper proposes a differentiable linear quadratic Model Predictive Control (MPC) framework for safe imitation learning. The infinite-horizon cost is enforced using a terminal cost function obtained from the discrete-time algebraic Riccati equation (DARE), so that the learned controller can be proven to be stabilizing in closed-loop. A central contribution is the derivation of the analytical derivative of the solution of the DARE, thereby allowing the use of differentiation-based learning methods. A further contribution is the structure of the MPC optimization problem: an augmented Lagrangian method ensures that the MPC optimization is feasible throughout training whilst enforcing hard constraints on state and input, and a pre-stabilizing controller ensures that the MPC solution and derivatives are accurate at each iteration. The learning capabilities of the framework are demonstrated in a set of numerical studies.
△ Less
Submitted 7 January, 2020;
originally announced January 2020.
-
Stochastic Model Predictive Control with Discounted Probabilistic Constraints
Authors:
Shuhao Yan,
Paul Goulart,
Mark Cannon
Abstract:
This paper considers linear discrete-time systems with additive disturbances, and designs a Model Predictive Control (MPC) law to minimise a quadratic cost function subject to a chance constraint. The chance constraint is defined as a discounted sum of violation probabilities on an infinite horizon. By penalising violation probabilities close to the initial time and ignoring violation probabilitie…
▽ More
This paper considers linear discrete-time systems with additive disturbances, and designs a Model Predictive Control (MPC) law to minimise a quadratic cost function subject to a chance constraint. The chance constraint is defined as a discounted sum of violation probabilities on an infinite horizon. By penalising violation probabilities close to the initial time and ignoring violation probabilities in the far future, this form of constraint enables the feasibility of the online optimisation to be guaranteed without an assumption of boundedness of the disturbance. A computationally convenient MPC optimisation problem is formulated using Chebyshev's inequality and we introduce an online constraint-tightening technique to ensure recursive feasibility based on knowledge of a suboptimal solution. The closed loop system is guaranteed to satisfy the chance constraint and a quadratic stability condition.
△ Less
Submitted 19 July, 2018;
originally announced July 2018.