Showing 1–34 of 34 results for author: Kerrigan, E C

State-Dependent Uncertainty Modeling in Robust Optimal Control Problems through Generalized Semi-Infinite Programming

Authors: J. Wehbeh, E. C. Kerrigan

Abstract: Generalized semi-infinite programs (generalized SIPs) are problems featuring a finite number of decision variables but an infinite number of constraints. They differ from standard SIPs in that their constraint set itself depends on the choice of the decision variable. Generalized SIPs can be used to model robust optimal control problems where the uncertainty itself is a function of the state or co… ▽ More Generalized semi-infinite programs (generalized SIPs) are problems featuring a finite number of decision variables but an infinite number of constraints. They differ from standard SIPs in that their constraint set itself depends on the choice of the decision variable. Generalized SIPs can be used to model robust optimal control problems where the uncertainty itself is a function of the state or control input, allowing for a less conservative alternative to assuming a uniform uncertainty set over the entire decision space. In this work, we demonstrate how any generalized SIP can be converted to an existence-constrained SIP through a reformulation of the constraints and solved using a local reduction approach, which approximates the infinite constraint set by a finite number of scenarios. This transformation is then exploited to solve nonlinear robust optimal control problems with state-dependent uncertainties. We showcase our proposed approach on a planar quadrotor simulation where it recovers the true generalized SIP solution and outperforms a SIP-based approach with uniform uncertainty bounds. △ Less

Submitted 13 March, 2025; originally announced March 2025.

Comments: Submitted to the 2025 Mediteranean Control Conference

MSC Class: 93C10 (Primary); 90C34; 90C47 (Secondary)

Reliable Solution to Dynamic Optimization Problems using Integrated Residual Regularized Direct Collocation

Authors: Yuanbo Nie, Eric C. Kerrigan

Abstract: Direct collocation is a widely used method for solving dynamic optimization problems (DOPs), but its implementation simplicity and computational efficiency are limited for challenging problems like those involving singular arcs. In this paper, we introduce the direct transcription method of integrated residual regularized direct collocation (IRR-DC). This method enforces dynamic constraints throug… ▽ More Direct collocation is a widely used method for solving dynamic optimization problems (DOPs), but its implementation simplicity and computational efficiency are limited for challenging problems like those involving singular arcs. In this paper, we introduce the direct transcription method of integrated residual regularized direct collocation (IRR-DC). This method enforces dynamic constraints through a combination of explicit constraints and penalty terms within discretized DOPs. This method retains the implementation simplicity of direct collocation while significantly improving both solution accuracy and efficiency, particularly for challenging problem types. Through the examples, we demonstrate that for difficult problems where traditional direct collocation results in excessive fluctuations or large errors between collocation points, IRR-DC effectively suppresses oscillations and yields solutions with greater accuracy (several magnitudes lower in various error metrics) compared to other regularization alternatives. △ Less

Submitted 12 March, 2025; originally announced March 2025.

Comments: 6 pages, 3 figures

Accurate Solutions to Optimal Control Problems via a Flexible Mesh and Integrated Residual Transcription

Authors: Lucian Nita, Eric C. Kerrigan

Abstract: We propose joining a flexible mesh design with an integrated residual transcription in order to improve the accuracy of numerical solutions to optimal control problems. This approach is particularly useful when state or input trajectories are non-smooth, but it may also be beneficial when dynamics constraints are stiff. Additionally, we implement an initial phase that will ensure a feasible soluti… ▽ More We propose joining a flexible mesh design with an integrated residual transcription in order to improve the accuracy of numerical solutions to optimal control problems. This approach is particularly useful when state or input trajectories are non-smooth, but it may also be beneficial when dynamics constraints are stiff. Additionally, we implement an initial phase that will ensure a feasible solution is found and can be implemented immediately in real-time controllers. Subsequent iterations with warm-starting will improve the solution until optimality is achieved. Optimizing over the mesh node locations allows for discontinuities to be captured exactly, while integrated residuals account for the approximation error in-between the nodal points. First, we numerically show the improved convergence order for the flexible mesh. We then present the feasibility-driven approach to solve control problems and show how flexible meshing and integrated residual methods can be used in practice. The presented numerical examples demonstrate for the first time the numerical implementation of a flexible mesh for an integrated residual transcription. The results show that our proposed method can be more than two times more accurate than conventional fixed mesh collocation for the same computational time and more than three times more accurate for the same problem size. △ Less

Submitted 30 October, 2024; originally announced October 2024.

Semi-Infinite Programs for Robust Control and Optimization: Efficient Solutions and Extensions to Existence Constraints

Authors: Jad Wehbeh, Eric C. Kerrigan

Abstract: Discrete-time robust optimal control problems generally take a min-max structure over continuous variable spaces, which can be difficult to solve in practice. In this paper, we extend the class of such problems that can be solved through a previously proposed local reduction method to consider those with existence constraints on the uncountable variables. We also consider the possibility of non-un… ▽ More Discrete-time robust optimal control problems generally take a min-max structure over continuous variable spaces, which can be difficult to solve in practice. In this paper, we extend the class of such problems that can be solved through a previously proposed local reduction method to consider those with existence constraints on the uncountable variables. We also consider the possibility of non-unique trajectories that satisfy equality and inequality constraints. Crucially, we show that the problems of interest can be cast into a standard semi-infinite program and demonstrate how to generate optimal uncertainty scenario sets in order to obtain numerical solutions. We also include examples on model predictive control for obstacle avoidance with logical conditions, control with input saturation affected by uncertainty, and optimal parameter estimation to highlight the need for the proposed extension. Our method solves each of the examples considered, producing violation-free and locally optimal solutions. △ Less

Submitted 29 April, 2024; v1 submitted 8 April, 2024; originally announced April 2024.

Comments: 6 pages, 1 figure. To be published in the proceedings of the 8th IFAC Conference on Nonlinear Model Predictive Control (NMPC 2024)

MSC Class: 93C10 (Primary); 90C34; 90C47 (Secondary)

Mesh Refinement with Early Termination for Dynamic Feasibility Problems

Authors: Eduardo M. G. Vila, Eric C. Kerrigan, Paul Bruce

Abstract: We propose a novel early-terminating mesh refinement strategy using an integrated residual method to solve dynamic feasibility problems. As a generalization of direct collocation, the integrated residual method is used to approximate an infinite-dimensional problem into a sequence of finite-dimensional optimization subproblems. Each subproblem in the sequence is a finer approximation of the previo… ▽ More We propose a novel early-terminating mesh refinement strategy using an integrated residual method to solve dynamic feasibility problems. As a generalization of direct collocation, the integrated residual method is used to approximate an infinite-dimensional problem into a sequence of finite-dimensional optimization subproblems. Each subproblem in the sequence is a finer approximation of the previous. It is shown that these subproblems need not be solved to a high precision; instead, an early termination procedure can determine when mesh refinement should be performed. The new refinement strategy, applied to an inverted pendulum swing-up problem, outperforms a conventional refinement method by up to a factor of three in function evaluations. △ Less

Submitted 12 March, 2024; originally announced March 2024.

Journal ref: IFAC-PapersOnLine Volume 56, Issue 2, 2023, Pages 10576-10581

Tight Bounds on Polynomials and Its Application to Dynamic Optimization Problems

Authors: Eduardo M. G. Vila, Eric C. Kerrigan, Paul Bruce

Abstract: This paper presents a pseudo-spectral method for Dynamic Optimization Problems (DOPs) that allows for tight polynomial bounds to be achieved via flexible sub-intervals. The proposed method not only rigorously enforces inequality constraints, but also allows for a lower cost in comparison with non-flexible discretizations. Two examples are provided to demonstrate the feasibility of the proposed met… ▽ More This paper presents a pseudo-spectral method for Dynamic Optimization Problems (DOPs) that allows for tight polynomial bounds to be achieved via flexible sub-intervals. The proposed method not only rigorously enforces inequality constraints, but also allows for a lower cost in comparison with non-flexible discretizations. Two examples are provided to demonstrate the feasibility of the proposed method to solve optimal control problems. Solutions to the example problems exhibited up to a tenfold reduction in relative cost. △ Less

Submitted 2 March, 2025; v1 submitted 12 March, 2024; originally announced March 2024.

Automatic scenario generation for efficient solution of robust optimal control problems

Authors: Marta Zagorowska, Paola Falugi, Edward O'Dwyer, Eric C. Kerrigan

Abstract: Existing methods for nonlinear robust control often use scenario-based approaches to formulate the control problem as large nonlinear optimization problems. The optimization problems are challenging to solve due to their size, especially if the control problems include time-varying uncertainty. This paper draws from local reduction methods used in semi-infinite optimization to solve robust optimal… ▽ More Existing methods for nonlinear robust control often use scenario-based approaches to formulate the control problem as large nonlinear optimization problems. The optimization problems are challenging to solve due to their size, especially if the control problems include time-varying uncertainty. This paper draws from local reduction methods used in semi-infinite optimization to solve robust optimal control problems with parametric and time-varying uncertainty. By iteratively adding interim worst-case scenarios to the problem, methods based on local reduction provide a way to manage the total number of scenarios. We show that the local reduction method for optimal control problems consists of solving a series of simplified optimal control problems to find worst-case constraint violations. In particular, we present examples where local reduction methods find worst-case scenarios that are not on the boundary of the uncertainty set. We also provide bounds on the error if local solvers are used. The proposed approach is illustrated with two case studies with parametric and additive time-varying uncertainty. In the first case study, the number of scenarios obtained from local reduction is 101, smaller than in the case when all $2^{14+3\times192}$ extreme scenarios are considered. In the second case study, the number of scenarios obtained from the local reduction is two compared to 512 extreme scenarios. Our approach was able to satisfy the constraints both for parametric uncertainty and time-varying disturbances, whereas approaches from literature either violated the constraints or became computationally expensive. △ Less

Submitted 18 August, 2023; v1 submitted 15 March, 2023; originally announced March 2023.

Comments: arXiv admin note: substantial text overlap with arXiv:2204.14145 (IFAC conference submission)

Solving optimal control problems with non-smooth solutions using an integrated residual method and flexible mesh

Authors: Lucian Nita, Eric C. Kerrigan, Eduardo M. G. Vila, Yuanbo Nie

Abstract: Solutions to optimal control problems can be discontinuous, even if all the functionals defining the problem are smooth. This can cause difficulties when numerically computing solutions to these problems. While conventional numerical methods assume state and input trajectories are continuous and differentiable or smooth, our method is able to capture discontinuities in the solution by introducing… ▽ More Solutions to optimal control problems can be discontinuous, even if all the functionals defining the problem are smooth. This can cause difficulties when numerically computing solutions to these problems. While conventional numerical methods assume state and input trajectories are continuous and differentiable or smooth, our method is able to capture discontinuities in the solution by introducing time-mesh nodes as decision variables. This allows one to obtain a higher accuracy solution for the same number of mesh nodes compared to a fixed time-mesh approach. Furthermore, we propose to first solve a sequence of suitably-defined least-squares problems to ensure that the error in the dynamic equation is below a given tolerance. The cost functional is then minimized subject to an inequality constraint on the dynamic equation residual. We demonstrate our implementation on an optimal control problem that has a chattering solution. Solving such a problem is difficult, since the solution involves infinitely many switches of decreasing duration. This simulation shows how the flexible mesh is able to capture discontinuities present in the solution and achieve superlinear convergence as the number of mesh intervals is increased. △ Less

Submitted 11 November, 2022; originally announced November 2022.

Comments: 6 pages

Journal ref: Proc. 61st IEEE Conference on Decision and Control, 2022

Fast and accurate method for computing non-smooth solutions to constrained control problems

Authors: Lucian Nita, Eduardo M. G. Vila, Marta A. Zagorowska, Eric C. Kerrigan, Yuanbo Nie, Ian McInerney, Paola Falugi

Abstract: Introducing flexibility in the time-discretisation mesh can improve convergence and computational time when solving differential equations numerically, particularly when the solutions are discontinuous, as commonly found in control problems with constraints. State-of-the-art methods use fixed mesh schemes, which cannot achieve superlinear convergence in the presence of non-smooth solutions. In thi… ▽ More Introducing flexibility in the time-discretisation mesh can improve convergence and computational time when solving differential equations numerically, particularly when the solutions are discontinuous, as commonly found in control problems with constraints. State-of-the-art methods use fixed mesh schemes, which cannot achieve superlinear convergence in the presence of non-smooth solutions. In this paper, we propose using a flexible mesh in an integrated residual method. The locations of the mesh nodes are introduced as decision variables, and constraints are added to set upper and lower bounds on the size of the mesh intervals. We compare our approach to a uniform fixed mesh on a real-world satellite reorientation example. This example demonstrates that the flexible mesh enables the solver to automatically locate the discontinuities in the solution, has superlinear convergence and faster solve times, while achieving the same accuracy as a fixed mesh. △ Less

Submitted 17 May, 2022; originally announced May 2022.

Comments: 6 pages, 4 figures, Accepted to 20th European Control Conference (ECC 2022)

Journal ref: Proc. 20th European Control Conference (ECC 2022)

Automatic Scenario Generation for Robust Optimal Control Problems

Authors: Marta Zagorowska, Paola Falugi, Edward O'Dwyer, Eric C. Kerrigan

Abstract: Existing methods for nonlinear robust control often use scenario-based approaches to formulate the control problem as nonlinear optimization problems. Increasing the number of scenarios improves robustness, while increasing the size of the optimization problems. Mitigating the size of the problem by reducing the number of scenarios requires knowledge about how the uncertainty affects the system. T… ▽ More Existing methods for nonlinear robust control often use scenario-based approaches to formulate the control problem as nonlinear optimization problems. Increasing the number of scenarios improves robustness, while increasing the size of the optimization problems. Mitigating the size of the problem by reducing the number of scenarios requires knowledge about how the uncertainty affects the system. This paper draws from local reduction methods used in semi-infinite optimization to solve robust optimal control problems with parametric uncertainty. We show that nonlinear robust optimal control problems are equivalent to semi-infinite optimization problems and can be solved by local reduction. By iteratively adding interim globally worst-case scenarios to the problem, methods based on local reduction provide a way to manage the total number of scenarios. In particular, we show that local reduction methods find worst case scenarios that are not on the boundary of the uncertainty set. The proposed approach is illustrated with a case study with both parametric and additive time-varying uncertainty. The number of scenarios obtained from local reduction is 101, smaller than in the case when all $2^{14+3\times192}$ boundary scenarios are considered. A validation with randomly drawn scenarios shows that our proposed approach reduces the number of scenarios and ensures robustness even if local solvers are used. △ Less

Submitted 8 June, 2023; v1 submitted 29 April, 2022; originally announced April 2022.

Teaching Predictive Control Using Specification-based Summative Assessments

Authors: Ian McInerney, Eric C. Kerrigan

Abstract: Including Model Predictive Control (MPC) in the undergraduate/graduate control curriculum is becoming vitally important due to the growing adoption of MPC in many industrial areas. In this paper, we present an overview of the predictive control course taught by the authors at Imperial College London between 2018 and 2021. We discuss how the course evolved from focusing solely on the linear MPC for… ▽ More Including Model Predictive Control (MPC) in the undergraduate/graduate control curriculum is becoming vitally important due to the growing adoption of MPC in many industrial areas. In this paper, we present an overview of the predictive control course taught by the authors at Imperial College London between 2018 and 2021. We discuss how the course evolved from focusing solely on the linear MPC formulation to covering nonlinear MPC and some of its extensions. We also present a novel specification-based summative assessment framework, written in MATLAB, that was developed to assess the knowledge and understanding of the students in the course by tasking them with designing a controller for a real-world problem. The MATLAB assessment framework was designed to provide the students with the freedom to design and implement any MPC controller they wanted. The submitted controllers were then assessed against over 30 variations of the real-world problem to gauge student understanding of design robustness and the MPC topics from the course. △ Less

Submitted 29 April, 2022; v1 submitted 31 January, 2022; originally announced February 2022.

Comments: Accepted for presentation at the 13th IFAC Symposium on Advances in Control Education in Hamburg Bergedorf, Germany

Towards a Framework for Nonlinear Predictive Control using Derivative-Free Optimization

Authors: Ian McInerney, Lucian Nita, Yuanbo Nie, Alberto Oliveri, Eric C. Kerrigan

Abstract: The use of derivative-based solvers to compute solutions to optimal control problems with non-differentiable cost or dynamics often requires reformulations or relaxations that complicate the implementation or increase computational complexity. We present an initial framework for using the derivative-free Mesh Adaptive Direct Search (MADS) algorithm to solve Nonlinear Model Predictive Control probl… ▽ More The use of derivative-based solvers to compute solutions to optimal control problems with non-differentiable cost or dynamics often requires reformulations or relaxations that complicate the implementation or increase computational complexity. We present an initial framework for using the derivative-free Mesh Adaptive Direct Search (MADS) algorithm to solve Nonlinear Model Predictive Control problems with non-differentiable features without the need for reformulation. The MADS algorithm performs a structured search of the input space by simulating selected system trajectories and computing the subsequent cost value. We propose handling the path constraints and the Lagrange cost term by augmenting the system dynamics with additional states to compute the violation and cost value alongside the state trajectories, eliminating the need for reconstructing the state trajectories in a separate phase. We demonstrate the practicality of this framework by solving a robust rocket control problem, where the objective is to reach a target altitude as close as possible, given a system with uncertain parameters. This example uses a non-differentiable cost function and simulates two different system trajectories simultaneously, with each system having its own free final time. △ Less

Submitted 9 June, 2021; originally announced June 2021.

Comments: Accepted for presentation at the 7th IFAC Conference on Nonlinear Model Predictive Control

Inaccuracy matters: accounting for solution accuracy in event-triggered nonlinear model predictive control

Authors: Omar J. Faqir, Eric C. Kerrigan

Abstract: We consider the effect of using approximate system predictions in event-triggered control schemes. Such approximations may result from using numerical transcription methods for solving continuous-time optimal control problems. Mesh refinement can guarantee upper bounds on the error in the differential equations which model the system dynamics. With the accuracy guarantees of a mesh refinement sche… ▽ More We consider the effect of using approximate system predictions in event-triggered control schemes. Such approximations may result from using numerical transcription methods for solving continuous-time optimal control problems. Mesh refinement can guarantee upper bounds on the error in the differential equations which model the system dynamics. With the accuracy guarantees of a mesh refinement scheme, we show that the proposed event-triggering scheme -- which compares the measured system with approximate state predictions -- can be used with a guaranteed strictly positive inter-update time. We show that if we have knowledge of the employed transcription scheme or the approximation errors, then we can obtain better online estimates of inter-update times. We additionally detail a method of tightening constraints on the approximate system trajectory used in the nonlinear programming problem to guarantee constraint satisfaction of the continuous-time system. This is the first work to incorporate prediction accuracy in triggering metrics. Using the solution accuracy we can guarantee reliable lower bounds for inter-update times and perform solution dependent constraint tightening. △ Less

Submitted 28 May, 2021; originally announced May 2021.

Comments: 14 pages, 11 figures, Submitted to IEEE Transactions on Automatic Control

A hybrid green energy-based framework with a multi-objective optimization approach for optimal frost prevention in horticulture

Authors: Ercan Atam, Tamer F. Abdelmaguid, Muhammed Emre Keskin, Eric C. Kerrigan

Abstract: In this paper, first we propose a novel hybrid renewable energy-based solution for frost prevention in horticulture applications involving active heaters. Then, we develop a multi-objective robust optimization-based formulation to optimize the distribution of a given number of active heaters in a given large-scale orchard. The objectives are to optimally heat the orchard by the proposed frost prev… ▽ More In this paper, first we propose a novel hybrid renewable energy-based solution for frost prevention in horticulture applications involving active heaters. Then, we develop a multi-objective robust optimization-based formulation to optimize the distribution of a given number of active heaters in a given large-scale orchard. The objectives are to optimally heat the orchard by the proposed frost prevention system and to minimize the total length of the energy distribution pipe network (which is directly related to the installation cost and the cost of energy losses during energy transfer). Next, the resulting optimization problem is approximated using a discretization scheme. A case study is provided to give an idea of the potential savings using the proposed optimization method compared to the result from a heuristic-based design, which showed a 24.13% reduction in the total pipe length and a 54.29% increase in frost prevention. △ Less

Submitted 27 April, 2021; v1 submitted 14 April, 2021; originally announced April 2021.

Direct Transcription for Dynamic Optimization: A Tutorial with a Case Study on Dual-Patient Ventilation During the COVID-19 Pandemic

Authors: Eric C. Kerrigan, Yuanbo Nie, Omar Faqir, Caroline H. Kennedy, Steven A. Niederer, Jose A. Solis-Lemus, Peter Vincent, Steven E. Williams

Abstract: A variety of optimal control, estimation, system identification and design problems can be formulated as functional optimization problems with differential equality and inequality constraints. Since these problems are infinite-dimensional and often do not have a known analytical solution, one has to resort to numerical methods to compute an approximate solution. This paper uses a unifying notation… ▽ More A variety of optimal control, estimation, system identification and design problems can be formulated as functional optimization problems with differential equality and inequality constraints. Since these problems are infinite-dimensional and often do not have a known analytical solution, one has to resort to numerical methods to compute an approximate solution. This paper uses a unifying notation to outline some of the techniques used in the transcription step of simultaneous direct methods (which discretize-then-optimize) for solving continuous-time dynamic optimization problems. We focus on collocation, integrated residual and Runge-Kutta schemes. These transcription methods are then applied to a simulation case study to answer a question that arose during the COVID-19 pandemic, namely: If there are not enough ventilators, is it possible to ventilate more than one patient on a single ventilator? The results suggest that it is possible, in principle, to estimate individual patient parameters sufficiently accurately, using a relatively small number of flow rate measurements, without needing to disconnect a patient from the system or needing more than one flow rate sensor. We also show that it is possible to ensure that two different patients can indeed receive their desired tidal volume, by modifying the resistance experienced by the air flow to each patient and controlling the ventilator pressure. △ Less

Submitted 23 November, 2020; originally announced November 2020.

Comments: Accepted to 59th IEEE Conference on Decision and Control, Jeju Island, Republic of Korea, December 14th-18th 2020

Journal ref: 2020 59th IEEE Conference on Decision and Control (CDC)

Horizon-independent Preconditioner Design for Linear Predictive Control

Authors: Ian McInerney, Eric C. Kerrigan, George A. Constantinides

Abstract: First-order optimization solvers, such as the Fast Gradient Method, are increasingly being used to solve Model Predictive Control problems in resource-constrained environments. Unfortunately, the convergence rate of these solvers is significantly affected by the conditioning of the problem data, with ill-conditioned problems requiring a large number of iterations. To reduce the number of iteration… ▽ More First-order optimization solvers, such as the Fast Gradient Method, are increasingly being used to solve Model Predictive Control problems in resource-constrained environments. Unfortunately, the convergence rate of these solvers is significantly affected by the conditioning of the problem data, with ill-conditioned problems requiring a large number of iterations. To reduce the number of iterations required, we present a simple method for computing a horizon-independent preconditioning matrix for the Hessian of the condensed problem. The preconditioner is based on the block Toeplitz structure of the Hessian. Horizon-independence allows one to use only the predicted system and cost matrices to compute the preconditioner, instead of the full Hessian. The proposed preconditioner has equivalent performance to an optimal preconditioner in numerical examples, producing speedups between 2x and 9x for the Fast Gradient Method. Additionally, we derive horizon-independent spectral bounds for the Hessian in terms of the transfer function of the predicted system, and show how these can be used to compute a novel horizon-independent bound on the condition number for the preconditioned Hessian. △ Less

Submitted 6 April, 2022; v1 submitted 16 October, 2020; originally announced October 2020.

Comments: Accepted for publication in IEEE Transactions on Automatic Control

Solving Dynamic Optimization Problems to a Specified Accuracy: An Alternating Approach using Integrated Residuals

Authors: Yuanbo Nie, Eric C. Kerrigan

Abstract: We propose a novel direct transcription and solution method for solving nonlinear, continuous-time dynamic optimization problems. Instead of forcing the dynamic constraints to be satisfied only at a selected number of points as in direct collocation, the new approach alternates between minimizing and constraining the squared norm of the dynamic constraint residuals integrated along the whole solut… ▽ More We propose a novel direct transcription and solution method for solving nonlinear, continuous-time dynamic optimization problems. Instead of forcing the dynamic constraints to be satisfied only at a selected number of points as in direct collocation, the new approach alternates between minimizing and constraining the squared norm of the dynamic constraint residuals integrated along the whole solution trajectories. As a result, the method can 1) obtain solutions of higher accuracy for the same mesh compared to direct collocation methods, 2) enables a flexible trade-off between solution accuracy and optimality, 3) provides reliable solutions for challenging problems, including those with singular arcs and high-index differential algebraic equations. △ Less

Submitted 21 January, 2022; v1 submitted 22 September, 2020; originally announced September 2020.

Comments: 10 pages, 7 figures

A Direct Method for Solving Integral Penalty Transcriptions of Optimal Control Problems

Authors: Martin P. Neuenhofen, Eric C. Kerrigan

Abstract: We present a numerical method for the minimization of objectives that are augmented with large quadratic penalties of overdetermined inconsistent equality constraints. Such objectives arise from quadratic integral penalty methods for the direct transcription of equality constrained optimal control problems. The Augmented Lagrangian Method (ALM) has a number of advantages over the Quadratic Penalty… ▽ More We present a numerical method for the minimization of objectives that are augmented with large quadratic penalties of overdetermined inconsistent equality constraints. Such objectives arise from quadratic integral penalty methods for the direct transcription of equality constrained optimal control problems. The Augmented Lagrangian Method (ALM) has a number of advantages over the Quadratic Penalty Method (QPM) for solving this class of problems. However, if the equality constraints of the discretization are inconsistent, then ALM might not converge to a point that minimizes the unconstrained bias of the objective and penalty term. Therefore, in this paper we explore a modification of ALM that fits our purpose. Numerical experiments demonstrate that the modified ALM can minimize certain quadratic penalty-augmented functions faster than QPM, whereas the unmodified ALM converges to a minimizer of a significantly different problem. △ Less

Submitted 14 September, 2020; originally announced September 2020.

MSC Class: 49M37 90C30

An Integral Penalty-Barrier Direct Transcription Method for Optimal Control

Authors: Martin P. Neuenhofen, Eric C. Kerrigan

Abstract: Some direct transcription methods can fail to converge, e.g. when there are singular arcs. We recently introduced a convergent direct transcription method for optimal control problems, called the penalty-barrier finite element method (PBF). PBF converges under very weak assumptions on the problem instance. PBF avoids the ringing between collocation points, for example, by avoiding collocation enti… ▽ More Some direct transcription methods can fail to converge, e.g. when there are singular arcs. We recently introduced a convergent direct transcription method for optimal control problems, called the penalty-barrier finite element method (PBF). PBF converges under very weak assumptions on the problem instance. PBF avoids the ringing between collocation points, for example, by avoiding collocation entirely. Instead, equality path constraint residuals are forced to zero everywhere by an integral quadratic penalty term. We highlight conceptual differences between collocation- and penalty-type direct transcription methods. Theoretical convergence results for both types of methods are reviewed and compared. Formulas for implementing PBF are presented, with details on the formulation as a nonlinear program (NLP), sparsity and solution. Numerical experiments compare PBF against several collocation methods with regard to robustness, accuracy, sparsity and computational cost. We show that the computational cost, sparsity and construction of the NLP functions are roughly the same as for orthogonal collocation methods of the same degree and mesh. As an advantage, PBF converges in cases where collocation methods fail. PBF also allows one to trade off computational cost, optimality and violation of differential and other equality equations against each other. △ Less

Submitted 14 September, 2020; originally announced September 2020.

Comments: 8 pages, 8 figures

MSC Class: 49M25

External Constraint Handling for Solving Optimal Control Problems with Simultaneous Approaches and Interior Point Methods

Authors: Yuanbo Nie, Eric C. Kerrigan

Abstract: Inactive constraints do not contribute to the solution of an optimal control problem, but increase the problem size and burden the numerical computations. We present a novel strategy for handling inactive constraints efficiently by systematically removing the inactive and redundant constraints. The method is designed to be used together with simultaneous approaches under a mesh refinement framewor… ▽ More Inactive constraints do not contribute to the solution of an optimal control problem, but increase the problem size and burden the numerical computations. We present a novel strategy for handling inactive constraints efficiently by systematically removing the inactive and redundant constraints. The method is designed to be used together with simultaneous approaches under a mesh refinement framework, with mild assumptions that the original problem has feasible solutions, and the initial solve of the problem is successful. The method is tailored for interior point-based solvers, which are known to be very sensitive to the choice of initial points in terms of feasibility. In the example problem shown, the proposed scheme achieves more than a 40% reduction in computation time. △ Less

Submitted 12 June, 2019; v1 submitted 28 February, 2019; originally announced February 2019.

Comments: 6 pages, 2 figures

Journal ref: IEEE Control Systems Letters 4 (1), 7-12, 2020

Efficient and More Accurate Representation of Solution Trajectories in Numerical Optimal Control

Authors: Yuanbo Nie, Eric C. Kerrigan

Abstract: We show via examples that, when solving optimal control problems, representing the optimal state and input trajectory directly using interpolation schemes may not be the best choice. Due to the lack of considerations for solution trajectories in-between collocation points, large errors may occur, posing risks if this solution is to be applied. A novel solution representation method is proposed, ca… ▽ More We show via examples that, when solving optimal control problems, representing the optimal state and input trajectory directly using interpolation schemes may not be the best choice. Due to the lack of considerations for solution trajectories in-between collocation points, large errors may occur, posing risks if this solution is to be applied. A novel solution representation method is proposed, capable of yielding a solution of much higher accuracy for the same discretization mesh. This is achieved by minimizing the integral of the residual error for the overall trajectory, instead of forcing the errors to be zero only at collocation points. In this way, the requirement for mesh resolution can be significantly reduced, leaving the problem dimensions relatively small. This particular formulation also avoids some of the drawbacks found in the earlier work of integrated residual minimization, leading to more efficient computations. △ Less

Submitted 5 June, 2019; v1 submitted 28 February, 2019; originally announced February 2019.

Comments: 6 pages, 5 figures

Journal ref: IEEE Control Systems Letters ( Volume: 4, Issue: 1, Jan. 2020)

Bounding Computational Complexity under Cost Function Scaling in Predictive Control

Authors: Ian McInerney, Eric C. Kerrigan, George A. Constantinides

Abstract: We present a framework for upper bounding the number of iterations required by first-order optimization algorithms implementing constrained LQR controllers. We derive new bounds for the condition number and extremal eigenvalues of the primal and dual Hessian matrices when the cost function is scaled. These bounds are horizon-independent, allowing for their use with receding, variable and decreasin… ▽ More We present a framework for upper bounding the number of iterations required by first-order optimization algorithms implementing constrained LQR controllers. We derive new bounds for the condition number and extremal eigenvalues of the primal and dual Hessian matrices when the cost function is scaled. These bounds are horizon-independent, allowing for their use with receding, variable and decreasing horizon controllers. We considerably relax prior assumptions on the structure of the weight matrices and assume only that the system is Schur-stable and the primal Hessian of the quadratic program (QP) is positive-definite. Our analysis uses the Toeplitz structure of the QP matrices to relate their spectrum to the transfer function of the system, allowing for the use of system-theoretic techniques to compute the bounds. Using these bounds, we can compute the effect on the computational complexity of trading off the input energy used against the state deviation. An example system shows a three-times increase in algorithm iterations between the two extremes, with the state 2-norm decreased by only 5% despite a greatly increased state deviation penalty. △ Less

Submitted 6 February, 2019; originally announced February 2019.

Dynamic Optimization with Convergence Guarantees

Authors: Martin P. Neuenhofen, Eric C. Kerrigan

Abstract: We present a novel direct transcription method to solve optimization problems subject to nonlinear differential and inequality constraints. We prove convergence of our numerical method under reasonably mild assumptions: boundedness and Lipschitz-continuity of the problem-defining functions. We do not require uniqueness, differentiability or constraint qualifications to hold and we avoid the use of… ▽ More We present a novel direct transcription method to solve optimization problems subject to nonlinear differential and inequality constraints. We prove convergence of our numerical method under reasonably mild assumptions: boundedness and Lipschitz-continuity of the problem-defining functions. We do not require uniqueness, differentiability or constraint qualifications to hold and we avoid the use of Lagrange multipliers. Our approach differs fundamentally from well-known methods based on collocation; we follow a penalty-barrier approach, where we compute integral quadratic penalties on the equality path constraints and point constraints, and integral log-barriers on the inequality path constraints. The resulting penalty-barrier functional can be minimized numerically using finite elements and penalty-barrier interior-point nonlinear programming solvers. Order of convergence results are derived, even if components of the solution are discontinuous. We also present numerical results to compare our method against collocation methods. The numerical results show that for the same degree and mesh, the computational cost is similar, but that the new method can achieve a smaller error and converges in cases where collocation methods fail. △ Less

Submitted 8 April, 2021; v1 submitted 9 October, 2018; originally announced October 2018.

Comments: Revision of previous submission. Main changes: (i) Extended numerical experiments section. (ii) correction in proof of Lemma 3 in Appendix B

Automatic Software and Computing Hardware Co-design for Predictive Control

Authors: Bulat Khusainov, Eric C. Kerrigan, George A. Constantinides

Abstract: Model Predictive Control (MPC) is a computationally demanding control technique that allows dealing with multiple-input and multiple-output systems, while handling constraints in a systematic way. The necessity of solving an optimization problem at every sampling instant often (i) limits the application scope to slow dynamical systems and/or (ii) results in expensive computational hardware impleme… ▽ More Model Predictive Control (MPC) is a computationally demanding control technique that allows dealing with multiple-input and multiple-output systems, while handling constraints in a systematic way. The necessity of solving an optimization problem at every sampling instant often (i) limits the application scope to slow dynamical systems and/or (ii) results in expensive computational hardware implementations. Traditional MPC design is based on manual tuning of software and computational hardware design parameters, which leads to suboptimal implementations. This paper proposes a framework for automating the MPC software and computational hardware co-design, while achieving the optimal trade-off between computational resource usage and controller performance. The proposed approach is based on using a multi-objective optimization algorithm, namely BiMADS. Two test studies are considered: Central Processing Unit (CPU) and Field-Programmable Gate Array (FPGA) implementations of fast gradient-based MPC. Numerical experiments show that optimization-based design outperforms Latin Hypercube Sampling (LHS), a statistical sampling-based design exploration technique. △ Less

Submitted 24 October, 2017; originally announced October 2017.

Journal ref: IEEE Transactions on Control Systems Technology (Volume: 27, Issue: 5, Sept. 2019)

Nonlinear Predictive Control on a Heterogeneous Computing Platform

Authors: Bulat Khusainov, Eric C. Kerrigan, Andrea Suardi, George A. Constantinides

Abstract: We propose an implementation of an interior-point-based nonlinear predictive controller on a heterogeneous processor. The workload can be split between a general-purpose CPU and a field-programmable gate array to trade off the contradicting design objectives of control performance and computational resource usage. A new way of exploiting the structure of the KKT matrix yields significant memory sa… ▽ More We propose an implementation of an interior-point-based nonlinear predictive controller on a heterogeneous processor. The workload can be split between a general-purpose CPU and a field-programmable gate array to trade off the contradicting design objectives of control performance and computational resource usage. A new way of exploiting the structure of the KKT matrix yields significant memory savings. We report an 18x memory saving, compared to existing approaches, and a 36x speedup over a software implementation with an ARM Cortex-A9 processor. We also introduce a new release of Protoip, which abstracts low-level details of heterogeneous programming and allows processor-in-the-loop verification. △ Less

Submitted 24 October, 2017; originally announced October 2017.

Journal ref: Control Engineering Practice, Volume 78, September 2018, Pages 105-115

Joint optimization of transmission and propulsion in aerial communication networks

Authors: Omar J. Faqir, Eric C. Kerrigan, Deniz Gündüz

Abstract: Communication energy in a wireless network of mobile autonomous agents should be considered as the sum of transmission energy and propulsion energy used to facilitate the transfer of information. Accordingly, communication-theoretic and Newtonian dynamic models are developed to model the communication and locomotion expenditures of each node. These are subsequently used to formulate a novel nonlin… ▽ More Communication energy in a wireless network of mobile autonomous agents should be considered as the sum of transmission energy and propulsion energy used to facilitate the transfer of information. Accordingly, communication-theoretic and Newtonian dynamic models are developed to model the communication and locomotion expenditures of each node. These are subsequently used to formulate a novel nonlinear optimal control problem (OCP) over a network of autonomous nodes. It is then shown that, under certain conditions, the OCP can be transformed into an equivalent convex form. Numerical results for a single link between a node and access point allow for comparison with known solutions before the framework is applied to a multiple-node UAV network, for which previous results are not readily extended. Simulations show that transmission energy can be of the same order of magnitude as propulsion energy allowing for possible savings, whilst also exemplifying how speed adaptations together with power control may increase the network throughput. △ Less

Submitted 4 October, 2017; originally announced October 2017.

Comments: This article will appear in the Proceedings of the 56th IEEE Conference on Decision and Control, 2017

Journal ref: 2017 IEEE 56th Annual Conference on Decision and Control (CDC)

Scalable computation for optimal control of cascade systems with constraints

Authors: Michael Cantoni, Farhad Farokhi, Eric C. Kerrigan, Iman Shames

Abstract: A method is devised for numerically solving a class of finite-horizon optimal control problems subject to cascade linear discrete-time dynamics. It is assumed that the linear state and input inequality constraints, and the quadratic measure of performance, are all separable with respect to the spatial dimension of the underlying cascade of sub-systems, as well as the temporal dimension of the dyna… ▽ More A method is devised for numerically solving a class of finite-horizon optimal control problems subject to cascade linear discrete-time dynamics. It is assumed that the linear state and input inequality constraints, and the quadratic measure of performance, are all separable with respect to the spatial dimension of the underlying cascade of sub-systems, as well as the temporal dimension of the dynamics. By virtue of this structure, the computation cost of an interior-point method for an equivalent quadratic programming formulation of the optimal control problem can be made to scale linearly with the number of sub-systems. However, the complexity of this approach grows cubically with the time horizon. As such, computational advantage becomes apparent in situations where the number of sub-systems is relatively large. In any case, the method is amenable to distributed computation with low communication overhead and only immediate upstream neighbour sharing of partial model data among processing agents. An example is presented to illustrate an application of the main results to model data for the cascade dynamics of an automated irrigation channel. △ Less

Submitted 12 October, 2017; v1 submitted 21 February, 2017; originally announced February 2017.

Journal ref: International Journal of Control, 2017

Optimizing Communication and Computation for Multi-UAV Information Gathering Applications

Authors: Mason Thammawichai, Sujit P. Baliyarasimhuni, Eric C. Kerrigan, João B. Sousa

Abstract: Mobile agent networks, such as multi-UAV systems, are constrained by limited resources. In particular, limited energy affects system performance directly, such as system lifetime. It has been demonstrated in the wireless sensor network literature that the communication energy consumption dominates the computational and the sensing energy consumption. Hence, the lifetime of the multi-UAV systems ca… ▽ More Mobile agent networks, such as multi-UAV systems, are constrained by limited resources. In particular, limited energy affects system performance directly, such as system lifetime. It has been demonstrated in the wireless sensor network literature that the communication energy consumption dominates the computational and the sensing energy consumption. Hence, the lifetime of the multi-UAV systems can be extended significantly by optimizing the amount of communication data, at the expense of increasing computational cost. In this work, we aim at attaining an optimal trade-off between the communication and the computational energy. Specifically, we propose a mixed-integer optimization formulation for a multi-hop hierarchical clustering-based self-organizing UAV network incorporating data aggregation, to obtain an energy-efficient information routing scheme. The proposed framework is tested on two applications, namely target tracking and area mapping. Based on simulation results, our method can significantly save energy compared to a baseline strategy, where there is no data aggregation and clustering scheme. △ Less

Submitted 13 October, 2016; originally announced October 2016.

Journal ref: IEEE Transactions on Aerospace and Electronic Systems ( Volume: 54, Issue: 2, April 2018)

Energy-Efficient Real-Time Scheduling for Two-Type Heterogeneous Multiprocessors

Authors: Mason Thammawichai, Eric C. Kerrigan

Abstract: We propose three novel mathematical optimization formulations that solve the same two-type heterogeneous multiprocessor scheduling problem for a real-time taskset with hard constraints. Our formulations are based on a global scheduling scheme and a fluid model. The first formulation is a mixed-integer nonlinear program, since the scheduling problem is intuitively considered as an assignment proble… ▽ More We propose three novel mathematical optimization formulations that solve the same two-type heterogeneous multiprocessor scheduling problem for a real-time taskset with hard constraints. Our formulations are based on a global scheduling scheme and a fluid model. The first formulation is a mixed-integer nonlinear program, since the scheduling problem is intuitively considered as an assignment problem. However, by changing the scheduling problem to first determine a task workload partition and then to find the execution order of all tasks, the computation time can be significantly reduced. Specifically, the workload partitioning problem can be formulated as a continuous nonlinear program for a system with continuous operating frequency, and as a continuous linear program for a practical system with a discrete speed level set. The task ordering problem can be solved by an algorithm with a complexity that is linear in the total number of tasks. The work is evaluated against existing global energy/feasibility optimal workload allocation formulations. The results illustrate that our algorithms are both feasibility optimal and energy optimal for both implicit and constrained deadline tasksets. Specifically, our algorithm can achieve up to 40% energy saving for some simulated tasksets with constrained deadlines. The benefit of our formulation compared with existing work is that our algorithms can solve a more general class of scheduling problems due to incorporating a scheduling dynamic model in the formulations and allowing for a time-varying speed profile. Moreover, our algorithms can be applied to both online and offline scheduling schemes. △ Less

Submitted 15 July, 2016; originally announced July 2016.

Journal ref: Real-Time Systems, 2017

Feedback Scheduling for Energy-Efficient Real-Time Homogeneous Multiprocessor Systems

Authors: Mason Thammawichai, Eric C. Kerrigan

Abstract: Real-time scheduling algorithms proposed in the literature are often based on worst-case estimates of task parameters. The performance of an open-loop scheme can be degraded significantly if there are uncertainties in task parameters, such as the execution times of the tasks. Therefore, to cope with such a situation, a closed-loop scheme, where feedback is exploited to adjust the system parameters… ▽ More Real-time scheduling algorithms proposed in the literature are often based on worst-case estimates of task parameters. The performance of an open-loop scheme can be degraded significantly if there are uncertainties in task parameters, such as the execution times of the tasks. Therefore, to cope with such a situation, a closed-loop scheme, where feedback is exploited to adjust the system parameters, can be applied. We propose an optimal control framework that takes advantage of feeding back information of finished tasks to solve a real-time multiprocessor scheduling problem with uncertainty in task execution times, with the objective of minimizing the total energy consumption. Specifically, we propose a linear programming based algorithm to solve a workload partitioning problem and adopt McNaughton's wrap around algorithm to find the task execution order. The simulation results illustrate that our feedback scheduling algorithm can save energy by as much as 40% compared to an open-loop method for two processor models, i.e. a PowerPC 405LP and an XScale processor. △ Less

Submitted 8 June, 2016; originally announced June 2016.

Journal ref: Proc. 55th IEEE Conference on Decision and Control, 2016

Analytical results for the multi-objective design of model-predictive control

Authors: Vincent Bachtiar, Chris Manzie, William H. Moase, Eric C. Kerrigan

Abstract: In model-predictive control (MPC), achieving the best closed-loop performance under a given computational resource is the underlying design consideration. This paper analyzes the MPC design problem with control performance and required computational resource as competing design objectives. The proposed multi-objective design of MPC (MOD-MPC) approach extends current methods that treat control perf… ▽ More In model-predictive control (MPC), achieving the best closed-loop performance under a given computational resource is the underlying design consideration. This paper analyzes the MPC design problem with control performance and required computational resource as competing design objectives. The proposed multi-objective design of MPC (MOD-MPC) approach extends current methods that treat control performance and the computational resource separately -- often with the latter as a fixed constraint -- which requires the implementation hardware to be known a priori. The proposed approach focuses on the tuning of structural MPC parameters, namely sampling time and prediction horizon length, to produce a set of optimal choices available to the practitioner. The posed design problem is then analyzed to reveal key properties, including smoothness of the design objectives and parameter bounds, and establish certain validated guarantees. Founded on these properties, necessary and sufficient conditions for an effective and efficient solver are presented, leading to a specialized multi-objective optimizer for the MOD-MPC being proposed. Finally, two real-world control problems are used to illustrate the results of the design approach and importance of the developed conditions for an effective solver of the MOD-MPC problem. △ Less

Submitted 22 April, 2016; originally announced April 2016.

Energy-Efficient Scheduling for Homogeneous Multiprocessor Systems

Authors: Mason Thammawichai, Eric C. Kerrigan

Abstract: We present a number of novel algorithms, based on mathematical optimization formulations, in order to solve a homogeneous multiprocessor scheduling problem, while minimizing the total energy consumption. In particular, for a system with a discrete speed set, we propose solving a tractable linear program. Our formulations are based on a fluid model and a global scheduling scheme, i.e. tasks are all… ▽ More We present a number of novel algorithms, based on mathematical optimization formulations, in order to solve a homogeneous multiprocessor scheduling problem, while minimizing the total energy consumption. In particular, for a system with a discrete speed set, we propose solving a tractable linear program. Our formulations are based on a fluid model and a global scheduling scheme, i.e. tasks are allowed to migrate between processors. The new methods are compared with three global energy/feasibility optimal workload allocation formulations. Simulation results illustrate that our methods achieve both feasibility and energy optimality and outperform existing methods for constrained deadline tasksets. Specifically, the results provided by our algorithm can achieve up to an 80% saving compared to an algorithm without a frequency scaling scheme and up to 70% saving compared to a constant frequency scaling scheme for some simulated tasksets. Another benefit is that our algorithms can solve the scheduling problem in one step instead of using a recursive scheme. Moreover, our formulations can solve a more general class of scheduling problems, i.e. any periodic real-time taskset with arbitrary deadline. Lastly, our algorithms can be applied to both online and offline scheduling schemes. △ Less

Submitted 12 November, 2015; v1 submitted 19 October, 2015; originally announced October 2015.

Comments: Corrected typos: definition of J_i in Section 2.1; (3b)-(3c); definition of Φ_A and Φ_D in paragraph after (6b). Previous equations were correct only for special case of p_i=d_i

Embedded Online Optimization for Model Predictive Control at Megahertz Rates

Authors: Juan L. Jerez, Paul J. Goulart, Stefan Richter, George A. Constantinides, Eric C. Kerrigan, Manfred Morari

Abstract: Faster, cheaper, and more power efficient optimization solvers than those currently offered by general-purpose solutions are required for extending the use of model predictive control (MPC) to resource-constrained embedded platforms. We propose several custom computational architectures for different first-order optimization methods that can handle linear-quadratic MPC problems with input, input-r… ▽ More Faster, cheaper, and more power efficient optimization solvers than those currently offered by general-purpose solutions are required for extending the use of model predictive control (MPC) to resource-constrained embedded platforms. We propose several custom computational architectures for different first-order optimization methods that can handle linear-quadratic MPC problems with input, input-rate, and soft state constraints. We provide analysis ensuring the reliable operation of the resulting controller under reduced precision fixed-point arithmetic. Implementation of the proposed architectures in FPGAs shows that satisfactory control performance at a sample rate beyond 1 MHz is achievable even on low-end devices, opening up new possibilities for the application of MPC on embedded systems. △ Less

Submitted 5 March, 2013; originally announced March 2013.

Journal ref: IEEE Trans. Automatic Control, Vol 59, Issue 12, 2014, pp. 3238-3251

Characterization of the solution to a constrained H-infinity optimal control problem

Authors: D. Q. Mayne, S. V. Rakovic, R. B. Vinter, E. C. Kerrigan

Abstract: This paper characterizes the solution to a finite horizon min-max optimal control problem where the system is linear and discrete-time with control and state constraints, and the cost quadratic; the disturbance is negatively costed, as in the standard H-infinity problem, and is constrained. The cost is minimized over control policies and maximized over disturbance sequences so that the solution… ▽ More This paper characterizes the solution to a finite horizon min-max optimal control problem where the system is linear and discrete-time with control and state constraints, and the cost quadratic; the disturbance is negatively costed, as in the standard H-infinity problem, and is constrained. The cost is minimized over control policies and maximized over disturbance sequences so that the solution yields a feedback control. It is shown that the value function is piecewise quadratic and the optimal control policy piecewise affine, being quadratic and affine, respectively, in polytopes that partition the domain of the value function. △ Less

Submitted 14 April, 2005; originally announced April 2005.

Comments: 37 pages, 3 figures

Report number: CUED/F-INFENG/TR.518 MSC Class: 93B36 (Primary); 49N35; 49N10; 93B40; 93B50; 93B51; 93B52; 90C31; 90C39; 90C47; 90C90 (Secondary)

Journal ref: Automatica, Volume 42, Issue 3, March 2006, Pages 371-382