-
A state reduction approach for learning-based model predictive control for train rescheduling
Authors:
Caio Fabio Oliveira da Silva,
Xiaoyu Liu,
Azita Dabiri,
Bart De Schutter
Abstract:
This paper proposes a state reduction method for learning-based model predictive control (MPC) for train rescheduling in urban rail transit systems. The state reduction integrates into a control framework where the discrete decision variables are determined by a learning-based classifier and the continuous decision variables are computed by MPC. Herein, the state representation is designed separat…
▽ More
This paper proposes a state reduction method for learning-based model predictive control (MPC) for train rescheduling in urban rail transit systems. The state reduction integrates into a control framework where the discrete decision variables are determined by a learning-based classifier and the continuous decision variables are computed by MPC. Herein, the state representation is designed separately for each component of the control framework. While a reduced state is employed for learning, a full state is used in MPC. Simulations on a large-scale train network highlight the effectiveness of the state reduction mechanism in improving the performance and reducing the memory usage.
△ Less
Submitted 28 April, 2025;
originally announced April 2025.
-
Optimization-based Coordination of Traffic Lights and Automated Vehicles at Intersections
Authors:
Azita Dabiri,
Giray Önür,
Sebastien Gros,
Bart De Schutter
Abstract:
This paper tackles the challenge of coordinating traffic lights and automated vehicles at signalized intersections, formulated as a constrained finite-horizon optimal control problem. The problem falls into the category of mixed-integer nonlinear programming, posing challenges for solving large instances. To address this, we introduce a decomposition approach consisting of an upper-level problem f…
▽ More
This paper tackles the challenge of coordinating traffic lights and automated vehicles at signalized intersections, formulated as a constrained finite-horizon optimal control problem. The problem falls into the category of mixed-integer nonlinear programming, posing challenges for solving large instances. To address this, we introduce a decomposition approach consisting of an upper-level problem for traffic light timing allocation and a set of lower-level problems that generate appropriate commands for automated vehicles in each intersection movement. By leveraging solutions from the lower-level problems and employing parametric optimization techniques, we solve the upper-level problem using a standard sequential quadratic programming approach. The paper concludes by presenting an illustrative numerical example that highlights the effectiveness of our algorithm compared to scenarios where no coordination between traffic lights and vehicles exists.
△ Less
Submitted 3 February, 2025;
originally announced February 2025.
-
Certainty-Equivalence Model Predictive Control: Stability, Performance, and Beyond
Authors:
Changrui Liu,
Shengling Shi,
Bart De Schutter
Abstract:
Handling model mismatch is a common challenge in model-based controller design, particularly in model predictive control (MPC). While robust MPC is effective in managing uncertainties, its conservatism often makes it less desirable in practice. Certainty-equivalence MPC (CE-MPC), which relies on a nominal model, offers an appealing alternative due to its design simplicity and low computational req…
▽ More
Handling model mismatch is a common challenge in model-based controller design, particularly in model predictive control (MPC). While robust MPC is effective in managing uncertainties, its conservatism often makes it less desirable in practice. Certainty-equivalence MPC (CE-MPC), which relies on a nominal model, offers an appealing alternative due to its design simplicity and low computational requirements. Contrary to the existing analyses where MPC has access to the true model, this paper investigates CE-MPC for uncertain nonlinear systems with input constraints and parametric uncertainty. The primary contributions of the paper are two-fold. First, a novel perturbation analysis of the MPC value function is provided, without relying on the common assumption of Lipschitz continuity of the stage cost, better tailoring the popular quadratic cost and having broader applicability to value function approximation, online model learning in MPC, and performance-driven MPC design. Second, the stability and performance analysis of CE-MPC are provided, with a quantification of the suboptimality of CE-MPC compared to the infinite-horizon optimal controller with perfect model knowledge. The results provide valuable insights in how the prediction horizon and model mismatch jointly affect stability and performance. Furthermore, the general results are specialized to linear quadratic control, and a competitive ratio bound is derived, serving as the first competitive-ratio bound for MPC of uncertain linear systems with input constraints and multiplicative uncertainty.
△ Less
Submitted 28 March, 2025; v1 submitted 13 December, 2024;
originally announced December 2024.
-
Sensitivity Analysis for Piecewise-Affine Approximations of Nonlinear Programs with Polytopic Constraints
Authors:
Leila Gharavi,
Changrui Liu,
Bart De Schutter,
Simone Baldi
Abstract:
Nonlinear Programs (NLPs) are prevalent in optimization-based control of nonlinear systems. Solving general NLPs is computationally expensive, necessitating the development of fast hardware or tractable suboptimal approximations. This paper investigates the sensitivity of the solutions of NLPs with polytopic constraints when the nonlinear continuous objective function is approximated by a PieceWis…
▽ More
Nonlinear Programs (NLPs) are prevalent in optimization-based control of nonlinear systems. Solving general NLPs is computationally expensive, necessitating the development of fast hardware or tractable suboptimal approximations. This paper investigates the sensitivity of the solutions of NLPs with polytopic constraints when the nonlinear continuous objective function is approximated by a PieceWise-Affine (PWA) counterpart. By leveraging perturbation analysis using a convex modulus, we derive guaranteed bounds on the distance between the optimal solution of the original polytopically-constrained NLP and that of its approximated formulation. Our approach aids in determining criteria for achieving desired solution bounds. Two case studies on the Eggholder function and nonlinear model predictive control of an inverted pendulum demonstrate the theoretical results.
△ Less
Submitted 30 May, 2024;
originally announced May 2024.
-
Stability and Performance Analysis of Model Predictive Control of Uncertain Linear Systems
Authors:
Changrui Liu,
Shengling Shi,
Bart De Schutter
Abstract:
Model mismatch often poses challenges in model-based controller design. This paper investigates model predictive control (MPC) of uncertain linear systems with input constraints, focusing on stability and closed-loop infinite-horizon performance. The uncertainty arises from a parametric mismatch between the true and the estimated system under the matrix Frobenius norm. We examine a simple MPC cont…
▽ More
Model mismatch often poses challenges in model-based controller design. This paper investigates model predictive control (MPC) of uncertain linear systems with input constraints, focusing on stability and closed-loop infinite-horizon performance. The uncertainty arises from a parametric mismatch between the true and the estimated system under the matrix Frobenius norm. We examine a simple MPC controller that exclusively uses the estimated system model and establishes sufficient conditions under which the MPC controller can stabilize the true system. Moreover, we derive a theoretical performance bound based on relaxed dynamic programming, elucidating the impact of prediction horizon and modeling errors on the suboptimality gap between the MPC controller and the Oracle infinite-horizon optimal controller with knowledge of the true system. Simulations of a numerical example validate the theoretical results. Our theoretical analysis offers guidelines for obtaining the desired modeling accuracy and choosing a proper prediction horizon to develop certainty-equivalent MPC controllers for uncertain linear systems.
△ Less
Submitted 5 September, 2024; v1 submitted 24 May, 2024;
originally announced May 2024.
-
Distributed Model Predictive Control for Piecewise Affine Systems Based on Switching ADMM
Authors:
Samuel Mallick,
Azita Dabiri,
Bart De Schutter
Abstract:
This paper presents a novel approach for distributed model predictive control (MPC) for piecewise affine (PWA) systems. Existing approaches rely on solving mixed-integer optimization problems, requiring significant computation power or time. We propose a distributed MPC scheme that requires solving only convex optimization problems. The key contribution is a novel method, based on the alternating…
▽ More
This paper presents a novel approach for distributed model predictive control (MPC) for piecewise affine (PWA) systems. Existing approaches rely on solving mixed-integer optimization problems, requiring significant computation power or time. We propose a distributed MPC scheme that requires solving only convex optimization problems. The key contribution is a novel method, based on the alternating direction method of multipliers, for solving the non-convex optimal control problem that arises due to the PWA dynamics. We present a distributed MPC scheme, leveraging this method, that explicitly accounts for the coupling between subsystems by reaching agreement on the values of coupled states. Stability and recursive feasibility are shown under additional assumptions on the underlying system. Two numerical examples are provided, in which the proposed controller is shown to significantly improve the CPU time and closed-loop performance over existing state-of-the-art approaches.
△ Less
Submitted 18 December, 2024; v1 submitted 25 April, 2024;
originally announced April 2024.
-
Scenario Reduction with Guarantees for Stochastic Optimal Control of Linear Systems
Authors:
Francesco Cordiano,
Bart De Schutter
Abstract:
Scenario reduction algorithms can be an effective means to provide a tractable description of the uncertainty in optimal control problems. However, they might significantly compromise the performance of the controlled system. In this paper, we propose a method to compensate for the effect of scenario reduction on stochastic optimal control problems for chance-constrained linear systems with additi…
▽ More
Scenario reduction algorithms can be an effective means to provide a tractable description of the uncertainty in optimal control problems. However, they might significantly compromise the performance of the controlled system. In this paper, we propose a method to compensate for the effect of scenario reduction on stochastic optimal control problems for chance-constrained linear systems with additive uncertainty. We consider a setting in which the uncertainty has a discrete distribution, where the number of possible realizations is large. We then propose a reduction algorithm with a problem-dependent loss function, and we define sufficient conditions on the stochastic optimal control problem to ensure out-of-sample guarantees (i.e., against the original distribution of the uncertainty) for the controlled system in terms of performance and chance constraint satisfaction. Finally, we demonstrate the effectiveness of the approach on a numerical example.
△ Less
Submitted 11 April, 2024;
originally announced April 2024.
-
Finite-sample analysis of identification of switched linear systems with arbitrary or restricted switching
Authors:
Shengling Shi,
Othmane Mazhar,
Bart De Schutter
Abstract:
For the identification of switched systems with a measured switching signal, this work aims to analyze the effect of switching strategies on the estimation error. The data for identification is assumed to be collected from globally asymptotically or marginally stable switched systems under switches that are arbitrary or subject to an average dwell time constraint. Then the switched system is estim…
▽ More
For the identification of switched systems with a measured switching signal, this work aims to analyze the effect of switching strategies on the estimation error. The data for identification is assumed to be collected from globally asymptotically or marginally stable switched systems under switches that are arbitrary or subject to an average dwell time constraint. Then the switched system is estimated by the least-squares (LS) estimator. To capture the effect of the parameters of the switching strategies on the LS estimation error, finite-sample error bounds are developed in this work. The obtained error bounds show that the estimation error is logarithmic of the switching parameters when there are only stable modes; however, when there are unstable modes, the estimation error bound can increase linearly as the switching parameter changes. This suggests that in the presence of unstable modes, the switching strategy should be properly designed to avoid the significant increase of the estimation error.
△ Less
Submitted 28 June, 2022; v1 submitted 18 March, 2022;
originally announced March 2022.
-
Distributed Bayesian: a continuous Distributed Constraint Optimization Problem solver
Authors:
Jeroen Fransman,
Joris Sijs,
Henry Dol,
Erik Theunissen,
Bart De Schutter
Abstract:
In this work, the novel Distributed Bayesian (D-Bay) algorithm is presented for solving multi-agent problems within the continuous Distributed Constraint Optimization Problem (DCOP) framework. This framework extends the classical DCOP framework towards utility functions with continuous domains. Traditional DCOP solvers discretize the continuous domains, which increases the problem size exponential…
▽ More
In this work, the novel Distributed Bayesian (D-Bay) algorithm is presented for solving multi-agent problems within the continuous Distributed Constraint Optimization Problem (DCOP) framework. This framework extends the classical DCOP framework towards utility functions with continuous domains. Traditional DCOP solvers discretize the continuous domains, which increases the problem size exponentially. D-Bay overcomes this problem by utilizing Bayesian optimization for the adaptive sampling of variables to avoid discretization entirely. We theoretically show that D-Bay converges to the global optimum of the DCOP for Lipschitz continuous utility functions. The performance of the algorithm is evaluated empirically based on the sample efficiency. The proposed algorithm is compared to a centralized approach with equidistant discretization of the continuous domains for the sensor coordination problem. We find that our algorithm generates better solutions while requiring less samples.
△ Less
Submitted 8 February, 2020;
originally announced February 2020.
-
Controllability of Linear Positive Systems: An Alternative Formulation
Authors:
Yashar Zeinaly,
Jan H. van Schuppen,
Bart De Schutter
Abstract:
An alternative formulation for the controllability problem of single input linear positive systems is presented. Driven by many industrial applications, this formulations focuses on the case where the region of interest is only a subset of positive orthant rather than the entire positive orthant. To this end, we discuss the geometry of controllable subsets and develop numerically verifiable condit…
▽ More
An alternative formulation for the controllability problem of single input linear positive systems is presented. Driven by many industrial applications, this formulations focuses on the case where the region of interest is only a subset of positive orthant rather than the entire positive orthant. To this end, we discuss the geometry of controllable subsets and develop numerically verifiable conditions for polyhedrality of controllable subsets. Finally, we provide a method to check for controllability of a target set based on our approach.
△ Less
Submitted 22 April, 2017;
originally announced April 2017.
-
A distributed accelerated gradient algorithm for distributed model predictive control of a hydro power valley
Authors:
Minh Dang Doan,
Pontus Giselsson,
Tamás Keviczky,
Bart De Schutter,
Anders Rantzer
Abstract:
A distributed model predictive control (DMPC) approach based on distributed optimization is applied to the power reference tracking problem of a hydro power valley (HPV) system. The applied optimization algorithm is based on accelerated gradient methods and achieves a convergence rate of O(1/k^2), where k is the iteration number. Major challenges in the control of the HPV include a nonlinear and l…
▽ More
A distributed model predictive control (DMPC) approach based on distributed optimization is applied to the power reference tracking problem of a hydro power valley (HPV) system. The applied optimization algorithm is based on accelerated gradient methods and achieves a convergence rate of O(1/k^2), where k is the iteration number. Major challenges in the control of the HPV include a nonlinear and large-scale model, nonsmoothness in the power-production functions, and a globally coupled cost function that prevents distributed schemes to be applied directly. We propose a linearization and approximation approach that accommodates the proposed the DMPC framework and provides very similar performance compared to a centralized solution in simulations. The provided numerical studies also suggest that for the sparsely interconnected system at hand, the distributed algorithm we propose is faster than a centralized state-of-the-art solver such as CPLEX.
△ Less
Submitted 8 February, 2013;
originally announced February 2013.
-
A distributed optimization-based approach for hierarchical model predictive control of large-scale systems with coupled dynamics and constraints
Authors:
Minh Dang Doan,
Tamás Keviczky,
Bart De Schutter
Abstract:
We present a hierarchical model predictive control approach for large-scale systems based on dual decomposition. The proposed scheme allows coupling in both dynamics and constraints between the subsystems and generates a primal feasible solution within a finite number of iterations, using primal averaging and a constraint tightening approach. The primal update is performed in a distributed way and…
▽ More
We present a hierarchical model predictive control approach for large-scale systems based on dual decomposition. The proposed scheme allows coupling in both dynamics and constraints between the subsystems and generates a primal feasible solution within a finite number of iterations, using primal averaging and a constraint tightening approach. The primal update is performed in a distributed way and does not require exact solutions, while the dual problem uses an approximate subgradient method. Stability of the scheme is established using bounded suboptimality.
△ Less
Submitted 7 September, 2011; v1 submitted 6 September, 2011;
originally announced September 2011.
