-
Optimal Control of Parabolic Differential Equations Using Radau Collocation
Authors:
Alexander M. Davies,
Sara Pollock,
Miriam E. Dennis,
Anil V. Rao
Abstract:
A method is presented for the numerical solution of optimal boundary control problems governed by parabolic partial differential equations. The continuous space-time optimal control problem is transcribed into a sparse nonlinear programming problem through state and control parameterization. In particular, a multi-interval flipped Legendre-Gauss-Radau collocation method is implemented for temporal…
▽ More
A method is presented for the numerical solution of optimal boundary control problems governed by parabolic partial differential equations. The continuous space-time optimal control problem is transcribed into a sparse nonlinear programming problem through state and control parameterization. In particular, a multi-interval flipped Legendre-Gauss-Radau collocation method is implemented for temporal discretization alongside a Galerkin finite element spatial discretization. The finite element discretization allows for a reduction in problem size and avoids the redefinition of constraints required under a previous method. Further, a generalization of a Kirchoff transformation is performed to handle variational form nonlinearities in the context of numerical optimization. Due to the correspondence between the collocation points and the applied boundary conditions, the multi-interval flipped Legendre-Gauss-Radau collocation method is demonstrated to be preferable over the standard Legendre-Gauss-Radau collocation method for optimal control problems governed by parabolic partial differential equations. The details of the resulting transcription of the optimal control problem into a nonlinear programming problem are provided. Lastly, numerical examples demonstrate that the use of a multi-interval flipped Legendre-Gauss-Radau temporal discretization can lead to a reduction in the required number of collocation points to compute accurate values of the optimal objective in comparison to other methods.
△ Less
Submitted 14 May, 2025;
originally announced May 2025.
-
Adaptive Mesh Refinement and Error Estimation Method for Optimal Control Using Direct Collocation
Authors:
George V. Haman III,
Anil V. Rao
Abstract:
An adaptive mesh refinement and error estimation method for numerically solving optimal control problems is developed using Legendre-Gauss-Radau direct collocation. In regions of the solution where the desired accuracy tolerance has not been met, the mesh is refined by either increasing the degree of the approximating polynomial in a mesh interval or dividing a mesh interval into subintervals. In…
▽ More
An adaptive mesh refinement and error estimation method for numerically solving optimal control problems is developed using Legendre-Gauss-Radau direct collocation. In regions of the solution where the desired accuracy tolerance has not been met, the mesh is refined by either increasing the degree of the approximating polynomial in a mesh interval or dividing a mesh interval into subintervals. In regions of the solution where the desired accuracy tolerance has been met, the mesh size may be reduced by either merging adjacent mesh intervals or decreasing the degree of the approximating polynomial in a mesh interval. Coupled with the mesh refinement method described in this paper is a newly developed relative error estimate that is based on the differences between solutions obtained from the collocation method and those obtained by solving initial-value and terminal-value problems in each mesh interval using an interpolated control obtained from the collocation method. Because the error estimate is based on explicit simulation, the solution obtained via collocation is in close agreement with the solution obtained via explicit simulation using the control on the final mesh, which ensures that the control is an accurate approximation of the true optimal control. The method is demonstrated on three examples from the open literature, and the results obtained show an improvement in final mesh size when compared against previously developed mesh refinement methods.
△ Less
Submitted 9 October, 2024;
originally announced October 2024.
-
Desensitized Optimal Guidance Using Adaptive Radau Collocation
Authors:
Katrina L. Winkler,
Anil V. Rao
Abstract:
An optimal guidance method is developed that reduces sensitivity to parameters in the dynamic model. The method combines a previously developed method for guidance and control using adaptive Legendre-Gauss-Radau (LGR) collocation and a previously developed approach for desensitized optimal control. Guidance updates are performed such that the desensitized optimal control problem is re-solved on th…
▽ More
An optimal guidance method is developed that reduces sensitivity to parameters in the dynamic model. The method combines a previously developed method for guidance and control using adaptive Legendre-Gauss-Radau (LGR) collocation and a previously developed approach for desensitized optimal control. Guidance updates are performed such that the desensitized optimal control problem is re-solved on the remaining horizon at the start of each guidance cycle. The effectiveness of the method is demonstrated on a simple example using Monte Carlo simulation. It is found that the method reduces variations in the terminal state as compared to either desensitized optimal control without guidance updates or a previously developed method for optimal guidance and control.
△ Less
Submitted 7 August, 2024;
originally announced August 2024.
-
Modified Legendre-Gauss Collocation Method for Solving Optimal Control Problems with Nonsmooth Solutions
Authors:
Gabriela Abadia-Doyle,
Anil V. Rao
Abstract:
A modified form of Legendre-Gauss orthogonal direct collocation is developed for solving optimal control problems whose solutions are nonsmooth due to control discontinuities. This new method adds switch-time variables, control variables, and collocation conditions at both endpoints of a mesh interval, whereas these new variables and collocation conditions are not included in standard Legendre-Gau…
▽ More
A modified form of Legendre-Gauss orthogonal direct collocation is developed for solving optimal control problems whose solutions are nonsmooth due to control discontinuities. This new method adds switch-time variables, control variables, and collocation conditions at both endpoints of a mesh interval, whereas these new variables and collocation conditions are not included in standard Legendre-Gauss orthogonal collocation. The modified Legendre-Gauss collocation method alters the search space of the resulting nonlinear programming problem and enables determining accurately the location of the nonsmoothness in the optimal control. The transformed adjoint system of the modified Legendre-Gauss collocation method is then derived and shown to satisfy a discrete form of the continuous variational necessary conditions for optimality. The method is motivated via a control-constrained triple-integrator minimum-time optimal control problem where the solution possesses a two-switch bang-bang optimal control structure. In addition, the method developed in this paper is compared with existing Gaussian quadrature collocation methods. The method developed in this paper is shown to be capable of accurately solving optimal control problems with a discontinuous optimal control.
△ Less
Submitted 10 June, 2024;
originally announced June 2024.
-
Numerical Optimization Study of a Constrained Hypersonic Reentry Vehicle
Authors:
Cale A. Byczkowski,
Anil V. Rao
Abstract:
The trajectory optimization of the atmospheric entry of a reusable launch vehicle is studied. The objective is to maximize the crossrange of the vehicle subject to two control-inequality path constraints, two state-inequality path constraints, and one mixed state-and-control inequality path constraint. In order to determine the complex switching structure in the activity of the path constraints, a…
▽ More
The trajectory optimization of the atmospheric entry of a reusable launch vehicle is studied. The objective is to maximize the crossrange of the vehicle subject to two control-inequality path constraints, two state-inequality path constraints, and one mixed state-and-control inequality path constraint. In order to determine the complex switching structure in the activity of the path constraints, a recently developed method for solving state-path constrained optimal control problems is used. This recently developed method is designed to algorithmically locate the points of activation and deactivation in the path constraints and partition the domain of the independent variable into subdomains based on these activation and deactivation points. Additionally, in a domain where a state-inequality path constraint is found to be active, the method algorithmically determines and enforces the additional necessary conditions that apply on the constrained arc. A multiple-domain formulation of Legendre-Gauss-Radau direct collocation is then employed to transcribe the optimal control problem into a large sparse nonlinear programming problem. Two studies are performed which analyze a variety of problem formulations of the hypersonic reusable launch vehicle. Key features of the constrained trajectories are presented, and the method used is shown to obtain highly accurate solutions with minimal user intervention.
△ Less
Submitted 6 June, 2024;
originally announced June 2024.
-
Method for Solving State-Path Constrained Optimal Control Problems Using Adaptive Radau Collocation
Authors:
Cale A. Byczkowski,
Anil V. Rao
Abstract:
A new method is developed for accurately approximating the solution to state-variable inequality path constrained optimal control problems using a multiple-domain adaptive Legendre-Gauss-Radau collocation method. The method consists of the following parts. First, a structure detection method is developed to estimate switch times in the activation and deactivation of state-variable inequality path…
▽ More
A new method is developed for accurately approximating the solution to state-variable inequality path constrained optimal control problems using a multiple-domain adaptive Legendre-Gauss-Radau collocation method. The method consists of the following parts. First, a structure detection method is developed to estimate switch times in the activation and deactivation of state-variable inequality path constraints. Second, using the detected structure, the domain is partitioned into multiple-domains where each domain corresponds to either a constrained or an unconstrained segment. Furthermore, additional decision variables are introduced in the multiple-domain formulation, where these additional decision variables represent the switch times of the detected active state-variable inequality path constraints. Within a constrained domain, the path constraint is differentiated with respect to the independent variable until the control appears explicitly, and this derivative is set to zero along the constrained arc while all preceding derivatives are set to zero at the start of the constrained arc. The time derivatives of the active state-variable inequality path constraints are computed using automatic differentiation and the properties of the chain rule. The method is demonstrated on two problems, the first being a benchmark optimal control problem which has a known analytical solution and the second being a challenging problem from the field of aerospace engineering in which there is no known analytical solution. When compared against previously developed adaptive Legendre-Gauss-Radau methods, the results show that the method developed in this paper is capable of computing accurate solutions to problems whose solution contain active state-variable inequality path constraints.
△ Less
Submitted 4 January, 2024; v1 submitted 12 April, 2023;
originally announced April 2023.
-
Minimum-Fuel Earth-Based Orbit Transfers Using Multiple-Domain Adaptive Radau Collocation
Authors:
Brittanny V. Holden,
Anil V. Rao
Abstract:
A numerical optimization study of minimum-fuel Earth-based orbital transfers from low-Earth orbit (LEO) to either medium-Earth orbit (MEO), high-Earth orbit (HEO), or geostationary orbit (GEO), is performed. Various values of maximum allowable thrust acceleration are considered for each type of transfer (LEO-to-MEO, LEO-to-HEO, or LEO-to-GEO). A key aspect of the study performed in this paper is t…
▽ More
A numerical optimization study of minimum-fuel Earth-based orbital transfers from low-Earth orbit (LEO) to either medium-Earth orbit (MEO), high-Earth orbit (HEO), or geostationary orbit (GEO), is performed. Various values of maximum allowable thrust acceleration are considered for each type of transfer (LEO-to-MEO, LEO-to-HEO, or LEO-to-GEO). A key aspect of the study performed in this paper is that the optimal thrusting structure is not assumed to be known a priori, but is determined as part of the solution process. In order to determine the optimal thrusting structure, a recently developed bang-bang and singular optimal control (BBSOC) method is employed together with multiple-domain Legendre-Gauss-Radau quadrature collocation. Key results obtained in this study include not only the number of switches in the optimized thrust, but also the total impulse. Furthermore, it is found that, as the maximum allowable thrust acceleration decreases, the total impulse is less than the total impulse obtained from a previous study where a burn-coast-burn thrusting structure was assumed a priori. For each type of transfer a particular value of maximum allowable thrust acceleration is chosen to highlight in more detail the key features of the optimal solutions. This study provides improved results over previous studies and provides improved insight into the optimal thrusting structure required in order to accomplish each type of orbital transfer using the least amount of fuel.
△ Less
Submitted 27 June, 2022;
originally announced June 2022.
-
Minimum-Time Reorientation of Axisymmetric Rigid Spacecraft Using Three Controls
Authors:
Elisha R. Pager,
Anil V. Rao
Abstract:
A minimum-time reorientation of an axisymmetric rigid spacecraft controlled by three torques is studied. The orientation of the body is modeled such that the attitude kinematics are representative of a spin-stabilized spacecraft. The optimal control problem considered is shown to have a switching control structure. Moreover, under certain assumptions, the solutions contain segments that lie on a s…
▽ More
A minimum-time reorientation of an axisymmetric rigid spacecraft controlled by three torques is studied. The orientation of the body is modeled such that the attitude kinematics are representative of a spin-stabilized spacecraft. The optimal control problem considered is shown to have a switching control structure. Moreover, under certain assumptions, the solutions contain segments that lie on a singular arc. A numerical optimization study is performed using a recently developed method that is designed to accurately solve bang-bang and singular optimal control problems. The optimality conditions for the resulting optimal control problem are derived and analyzed for a variety of cases. Also, the results obtained in this study are compared to a previous method existing in the literature. The key features of the optimized trajectories and controls are identified, and the aforementioned method for solving bang-bang and singular optimal control problems is shown to efficiently and accurately solve the problem under consideration.
△ Less
Submitted 21 March, 2022;
originally announced March 2022.
-
End-to-End Ascent-Entry Mission Performance Optimization Using Gaussian Quadrature Collocation
Authors:
Alexander T. Miller,
Anil V. Rao
Abstract:
The performance optimization for a combined ascent-entry mission subject to constraints on heating rate and heating load is studied. The ascent vehicle is modeled as a three-stage rocket that places the vehicle onto a suborbital exo-atmopheric trajectory after which the vehicle undergoes an unpowered entry and descent to a vertically downward terminal condition. The entry vehicle is modeled as a h…
▽ More
The performance optimization for a combined ascent-entry mission subject to constraints on heating rate and heating load is studied. The ascent vehicle is modeled as a three-stage rocket that places the vehicle onto a suborbital exo-atmopheric trajectory after which the vehicle undergoes an unpowered entry and descent to a vertically downward terminal condition. The entry vehicle is modeled as a high lift-to-drag ratio vehicle that is capable of withstanding high levels of thermal and structural loads. A performance index is designed to improve control margin while attenuating phugoid oscillations during atmospheric entry. Furthermore, a mission corresponding to a prototype launch and target point is used in this study. The trajectory optimization problem is formulated as a multiple-phase optimal control problem, and the optimal control problem is solved using an adaptive Gaussian quadrature collocation method. A key aspect of the optimized trajectories is that, for particular ranges of maximum allowable heating rate and heating load during entry, relatively small adjustments made during ascent can potentially decrease the control effort required during atmospheric entry. Outside of these ranges for maximum allowable heating rate and heating load, however, it is found that the required control effort increases and eventually saturates the commanded angle of attack upon initial descent. The key features of the optimized trajectories and controls are identified, and the approach developed in this paper provides a systematic method for end-to-end ascent-entry trajectory optimization.
△ Less
Submitted 25 April, 2021;
originally announced April 2021.
-
Method for Solving Bang-Bang and Singular Optimal Control Problems using Adaptive Radau Collocation
Authors:
Elisha R. Pager,
Anil V. Rao
Abstract:
A method is developed for solving bang-bang and singular optimal control problems using adaptive Legendre-Gauss-Radau (LGR) collocation. The method is divided into several parts. First, a structure detection method is developed that identifies switch times in the control and analyzes the corresponding switching function for segments where the solution is either bang-bang or singular. Second, after…
▽ More
A method is developed for solving bang-bang and singular optimal control problems using adaptive Legendre-Gauss-Radau (LGR) collocation. The method is divided into several parts. First, a structure detection method is developed that identifies switch times in the control and analyzes the corresponding switching function for segments where the solution is either bang-bang or singular. Second, after the structure has been detected, the domain is decomposed into multiple domains such that the multiple-domain formulation includes additional decision variables that represent the switch times in the optimal control. In domains classified as bang-bang, the control is set to either its upper or lower limit. In domains identified as singular, the objective function is augmented with a regularization term to avoid the singular arc. An iterative procedure is then developed for singular domains to obtain a control that lies in close proximity to the singular control. The method is demonstrated on four examples, three of which have either a bang-bang and/or singular optimal control while the fourth has a smooth and nonsingular optimal control. The results demonstrate that the method of this paper provides accurate solutions to problems whose solutions are either bang-bang or singular when compared against previously developed mesh refinement methods that are not tailored for solving nonsmooth and/or singular optimal control problems, and produces results that are equivalent to those obtained using previously developed mesh refinement methods for optimal control problems whose solutions are smooth.
△ Less
Submitted 26 January, 2022; v1 submitted 25 April, 2021;
originally announced April 2021.
-
Nonsingular Euler Parameterizations for Motion of a Point Mass in Atmospheric Flight
Authors:
Alexander T. Miller,
Anil V. Rao
Abstract:
Three parameterizations are developed for modeling translational motion of a point mass in atmosphere flight over a central rotating body. Unlike well-known parameterizations such as spherical coordinate parameterizations, where position and velocity are parameterized using a magnitude an an Euler angle rotation sequence, the method presented in this research employs Euler parameters. Consequently…
▽ More
Three parameterizations are developed for modeling translational motion of a point mass in atmosphere flight over a central rotating body. Unlike well-known parameterizations such as spherical coordinate parameterizations, where position and velocity are parameterized using a magnitude an an Euler angle rotation sequence, the method presented in this research employs Euler parameters. Consequently, singularities and trigonometric functions are eliminated from the differential equations of motion. As a result, the new parameterizations presented in this paper offer computational advantages over standard parameterizations that employ Euler angle sequences. Finally, an example is studied where an atmospheric vehicle moves while in vertical flight, demonstrating the nonsingular nature of the formulations developed in this paper.
△ Less
Submitted 18 April, 2021;
originally announced April 2021.
-
Minimum-Time Earth-to-Mars Interplanetary Orbit Transfer Using Adaptive Gaussian Quadrature Collocation
Authors:
Brittanny V. Holden,
Shan He,
Anil V. Rao
Abstract:
The problem of minimum-time, low-thrust, Earth-to-Mars interplanetary orbital trajectory optimization is considered. The minimum-time orbital transfer problem is modeled as a four-phase optimal control problem where the four phases correspond to planetary alignment, Earth escape, heliocentric transfer, and Mars capture. The four-phase optimal control problem is then solved using a direct collocati…
▽ More
The problem of minimum-time, low-thrust, Earth-to-Mars interplanetary orbital trajectory optimization is considered. The minimum-time orbital transfer problem is modeled as a four-phase optimal control problem where the four phases correspond to planetary alignment, Earth escape, heliocentric transfer, and Mars capture. The four-phase optimal control problem is then solved using a direct collocation adaptive Gaussian quadrature collocation method. The following three models are used in the study: (1) circular planetary motion; (2) elliptic planetary motion; and (3) elliptic planetary motion with gravity perturbations, where the transfer begins in a geostationary orbit and terminates in a Mars-stationary orbit. Results for all three cases are provided, and one particular case is studied in detail to show the key features of the optimal solutions. Using the particular value thrust specific force of $0.00098\times 10^{-4}~\textrm{m}\cdot\textrm{s}^{-2}$, it was found that the minimum times for cases (1), (2), and (3) are, respectively, 215 d, 196 d, and 198 d with departure dates, respectively, of 1 July 2020, 30 June 2020, and 28 June 2020. Finally, the problem formulation developed in this study is compared against prior work on an Earth-to-Mars interplanetary orbit transfer where it is found that the results of this research show significant improvement in transfer time relative to the prior work.
△ Less
Submitted 6 April, 2021; v1 submitted 7 December, 2020;
originally announced December 2020.
-
Nonsingular Parameterization for Modeling Translational Motion Using Euler Parameters
Authors:
Alexander T. Miller,
Anil V. Rao
Abstract:
A parameterization is described for quantifying translational motion of a point in three-dimensional Euclidean space. The parameterization is similar to well-known parameterizations such as spherical coordinates in that both position and velocity are decoupled into magnitude and orientation components. Unlike these standard parameterizations, where principal rotation sequences are employed, the me…
▽ More
A parameterization is described for quantifying translational motion of a point in three-dimensional Euclidean space. The parameterization is similar to well-known parameterizations such as spherical coordinates in that both position and velocity are decoupled into magnitude and orientation components. Unlike these standard parameterizations, where principal rotation sequences are employed, the method presented in this research employs Euler parameters. By using Euler parameters instead of Euler angles, singularities and trigonometric functions are removed from the equations of motion. The parameterization is demonstrated on two examples, where it is found that the new parameterization offers both mathematical and computational advantages over other commonly used parameterizations.
△ Less
Submitted 22 November, 2020;
originally announced November 2020.
-
A Warm Start Method for Solving Chance Constrained Optimal Control Problems
Authors:
Rachel E. Kiel,
Mrinal Kumar,
Anil V. Rao
Abstract:
A warm start method is developed for efficiently solving complex chance constrained optimal control problems. The warm start method addresses the computational challenges of solving chance constrained optimal control problems using biased kernel density estimators and Legendre-Gauss-Radau collocation with an $hp$ adaptive mesh refinement method. To address the computational challenges, the warm st…
▽ More
A warm start method is developed for efficiently solving complex chance constrained optimal control problems. The warm start method addresses the computational challenges of solving chance constrained optimal control problems using biased kernel density estimators and Legendre-Gauss-Radau collocation with an $hp$ adaptive mesh refinement method. To address the computational challenges, the warm start method improves both the starting point for the chance constrained optimal control problem, as well as the efficiency of cycling through mesh refinement iterations. The improvement is accomplished by tuning a parameter of the kernel density estimator, as well as implementing a kernel switch as part of the solution process. Additionally, the number of samples for the biased kernel density estimator is set to incrementally increase through a series of mesh refinement iterations. Thus, the warm start method is a combination of tuning a parameter, a kernel switch, and an incremental increase in sample size. This warm start method is successfully applied to solve two challenging chance constrained optimal control problems in a computationally efficient manner using biased kernel density estimators and Legendre-Gauss-Radau collocation.
△ Less
Submitted 20 July, 2020;
originally announced July 2020.
-
Mesh Refinement Method for Solving Optimal Control Problems with Nonsmooth Solutions Using Jump Function Approximations
Authors:
Alexander T. Miller,
WIlliam W. Hager,
Anil V. Rao
Abstract:
A mesh refinement method is described for solving optimal control problems using Legendre-Gauss-Radau collocation. The method detects discontinuities in the control solution by employing an edge detection scheme based on jump function approximations. When discontinuities are identified, the mesh is refined with a targeted $h$-refinement approach whereby the discontinuity locations are bracketed wi…
▽ More
A mesh refinement method is described for solving optimal control problems using Legendre-Gauss-Radau collocation. The method detects discontinuities in the control solution by employing an edge detection scheme based on jump function approximations. When discontinuities are identified, the mesh is refined with a targeted $h$-refinement approach whereby the discontinuity locations are bracketed with mesh points. The remaining smooth portions of the mesh are refined using previously developed techniques. The method is demonstrated on two examples, and results indicate that the method solves optimal control problems with discontinuous control solutions using fewer mesh refinement iterations and less computation time when compared with previously developed methods.
△ Less
Submitted 25 March, 2020;
originally announced March 2020.
-
Method for Chance Constrained Optimal Control Using Biased Kernel Density Estimators
Authors:
Rachel E. Keil,
Alexander T. Miller,
Mrinal Kumar,
Anil V. Rao
Abstract:
A method is developed to numerically solve chance constrained optimal control problems. The chance constraints are reformulated as nonlinear constraints that retain the probability properties of the original constraint. The reformulation transforms the chance constrained optimal control problem into a deterministic optimal control problem that can be solved numerically. The new method developed in…
▽ More
A method is developed to numerically solve chance constrained optimal control problems. The chance constraints are reformulated as nonlinear constraints that retain the probability properties of the original constraint. The reformulation transforms the chance constrained optimal control problem into a deterministic optimal control problem that can be solved numerically. The new method developed in this paper approximates the chance constraints using Markov Chain Monte Carlo (MCMC) sampling and kernel density estimators whose kernels have integral functions that bound the indicator function. The nonlinear constraints resulting from the application of kernel density estimators are designed with bounds that do not violate the bounds of the original chance constraint. The method is tested on a non-trivial chance constrained modification of a soft lunar landing optimal control problem and the results are compared with results obtained using a conservative deterministic formulation of the optimal control problem. The results show that this new method efficiently solves chance constrained optimal control problems.
△ Less
Submitted 27 May, 2020; v1 submitted 17 March, 2020;
originally announced March 2020.
-
Modified Legendre-Gauss-Radau Collocation Method for Solving Optimal Control Problems with Nonsmooth Solutions
Authors:
Joseph D. Eide,
William W. Hager,
Anil V. Rao
Abstract:
A new method is developed for solving optimal control problems whose solutions are nonsmooth. The method developed in this paper employs a modified form of the Legendre-Gauss-Radau orthogonal direct collocation method. This modified Legendre-Gauss-Radau method adds two variables and two constraints at the end of a mesh interval when compared with a previously developed standard Legendre-Gauss-Rada…
▽ More
A new method is developed for solving optimal control problems whose solutions are nonsmooth. The method developed in this paper employs a modified form of the Legendre-Gauss-Radau orthogonal direct collocation method. This modified Legendre-Gauss-Radau method adds two variables and two constraints at the end of a mesh interval when compared with a previously developed standard Legendre-Gauss-Radau collocation method. The two additional variables are the time at the interface between two mesh intervals and the control at the end of each mesh interval. The two additional constraints are a collocation condition for those differential equations that depend upon the control and an inequality constraint on the control at the endpoint of each mesh interval. The additional constraints modify the search space of the nonlinear programming problem such that an accurate approximation to the location of the nonsmoothness is obtained. The transformed adjoint system of the modified Legendre-Gauss-Radau method is then developed. Using this transformed adjoint system, a method is developed to transform the Lagrange multipliers of the nonlinear programming problem to the costate of the optimal control problem. Furthermore, it is shown that the costate estimate satisfies one of the Weierstrass-Erdmann optimality conditions. Finally, the method developed in this paper is demonstrated on an example whose solution is nonsmooth.
△ Less
Submitted 8 November, 2020; v1 submitted 7 September, 2019;
originally announced September 2019.
-
Comparison of Derivative Estimation Methods in Solving Optimal Control Problems Using Direct Collocation
Authors:
Yunus M. Agamawi,
Anil V. Rao
Abstract:
A study is conducted to evaluate four derivative estimation methods when solving a large sparse nonlinear programming problem that arises from the approximation of an optimal control problem using a direct collocation method. In particular, the Taylor series-based finite-difference, bicomplex-step, and hyper-dual derivative estimation methods are evaluated and compared alongside a well known autom…
▽ More
A study is conducted to evaluate four derivative estimation methods when solving a large sparse nonlinear programming problem that arises from the approximation of an optimal control problem using a direct collocation method. In particular, the Taylor series-based finite-difference, bicomplex-step, and hyper-dual derivative estimation methods are evaluated and compared alongside a well known automatic differentiation method. The performance of each derivative estimation method is assessed based on the number of iterations, the computation time per iteration, and the total computation time required to solve the nonlinear programming problem. The efficiency of each of the four derivative estimation methods is compared by solving three benchmark optimal control problems. It is found that while central finite-differencing is typically more efficient per iteration than either the hyper-dual or bicomplex-step, the latter two methods have significantly lower overall computation times due to the fact that fewer iterations are required by the nonlinear programming problem when compared with central finite-differencing. Furthermore, while the bicomplex-step and hyper-dual methods are similar in performance, the hyper-dual method is significantly easier to implement. Moreover, the automatic differentiation method is found to be substantially less computationally efficient than any of the three Taylor series-based methods. The results of this study show that the hyper-dual method offers several benefits over the other three methods both in terms of computational efficiency and ease of implementation.
△ Less
Submitted 29 May, 2019;
originally announced May 2019.
-
CGPOPS: A C++ Software for Solving Multiple-Phase Optimal Control Problems Using Adaptive Gaussian Quadrature Collocation and Sparse Nonlinear Programming
Authors:
Yunus M. Agamawi,
Anil V. Rao
Abstract:
A general-purpose C++ software program called $\mathbb{CGPOPS}$ is described for solving multiple-phase optimal control problems using adaptive Gaussian quadrature collocation. The software employs a Legendre-Gauss-Radau direct orthogonal collocation method to transcribe the continuous-time optimal control problem into a large sparse nonlinear programming problem. A class of $hp$ mesh refinement m…
▽ More
A general-purpose C++ software program called $\mathbb{CGPOPS}$ is described for solving multiple-phase optimal control problems using adaptive Gaussian quadrature collocation. The software employs a Legendre-Gauss-Radau direct orthogonal collocation method to transcribe the continuous-time optimal control problem into a large sparse nonlinear programming problem. A class of $hp$ mesh refinement methods are implemented which determine the number of mesh intervals and the degree of the approximating polynomial within each mesh interval to achieve a specified accuracy tolerance. The software is interfaced with the open source Newton NLP solver IPOPT. All derivatives required by the NLP solver are computed using either central finite differencing, bicomplex-step derivative approximation, hyper-dual derivative approximation, or automatic differentiation. The key components of the software are described in detail and the utility of the software is demonstrated on five optimal control problems of varying complexity. The software described in this article provides a computationally efficient and accurate approach for solving a wide variety of complex constrained optimal control problems.
△ Less
Submitted 28 May, 2019; v1 submitted 28 May, 2019;
originally announced May 2019.
-
Mesh Refinement Method for Solving Bang-Bang Optimal Control Problems Using Direct Collocation
Authors:
Yunus M. Agamawi,
William W. Hager,
Anil V. Rao
Abstract:
A mesh refinement method is developed for solving bang-bang optimal control problems using direct collocation. The method starts by finding a solution on a coarse mesh. Using this initial solution, the method then determines automatically if the Hamiltonian is linear with respect to the control, and, if so, estimates the locations of the discontinuities in the control. The switch times are estimat…
▽ More
A mesh refinement method is developed for solving bang-bang optimal control problems using direct collocation. The method starts by finding a solution on a coarse mesh. Using this initial solution, the method then determines automatically if the Hamiltonian is linear with respect to the control, and, if so, estimates the locations of the discontinuities in the control. The switch times are estimated by determining the roots of the switching functions, where the switching functions are determined using estimates of the state and costate obtained from the collocation method. The accuracy of the switch times is then improved on subsequent meshes by dividing the original optimal control problem into multiple domains and including variables that define the locations of the switch times. While in principle any collocation method can be used, in this research the previously developed Legendre-Gauss-Radau collocation method is employed because it provides an accurate approximation of the costate which in turn improves the approximation of the switching functions. The method of this paper is designed to be used with a previously developed mesh refinement method in order to accurately approximate the solution in segments where the solution is smooth. The method is demonstrated on three examples where it is shown to accurately determine the switching structure of a bang-bang optimal control problem. When compared with previously developed mesh refinement methods, the results demonstrate that the method developed in this paper improves computational efficiency when solving bang-bang optimal control problems.
△ Less
Submitted 30 May, 2019; v1 submitted 28 May, 2019;
originally announced May 2019.
-
Convergence rate for a Gauss collocation method applied to constrained optimal control
Authors:
William W. Hager,
Jun Liu,
Subhashree Mohapatra,
Anil V. Rao,
Xiang-Sheng Wang
Abstract:
A local convergence rate is established for a Gauss orthogonal collocation method applied to optimal control problems with control constraints. If the Hamiltonian possesses a strong convexity property, then the theory yields convergence for problems whose optimal state and costate possess two square integrable derivatives. The convergence theory is based on a stability result for the sup-norm chan…
▽ More
A local convergence rate is established for a Gauss orthogonal collocation method applied to optimal control problems with control constraints. If the Hamiltonian possesses a strong convexity property, then the theory yields convergence for problems whose optimal state and costate possess two square integrable derivatives. The convergence theory is based on a stability result for the sup-norm change in the solution of a variational inequality relative to a 2-norm perturbation, and on a Sobolev space bound for the error in interpolation at the Gauss quadrature points and the additional point -1. The tightness of the convergence theory is examined using a numerical example.
△ Less
Submitted 18 December, 2017; v1 submitted 10 July, 2016;
originally announced July 2016.
-
Convergence Rate for a Radau hp Collocation Method Applied to Constrained Optimal Control
Authors:
William W. Hager,
Hongyan Hou,
Subhashree Mohapatra,
Anil V. Rao
Abstract:
For unconstrained control problems, a local convergence rate is established for an $hp$-method based on collocation at the Radau quadrature points in each mesh interval of the discretization. If the continuous problem has a sufficiently smooth solution and the Hamiltonian satisfies a strong convexity condition, then the discrete problem possesses a local minimizer in a neighborhood of the continuo…
▽ More
For unconstrained control problems, a local convergence rate is established for an $hp$-method based on collocation at the Radau quadrature points in each mesh interval of the discretization. If the continuous problem has a sufficiently smooth solution and the Hamiltonian satisfies a strong convexity condition, then the discrete problem possesses a local minimizer in a neighborhood of the continuous solution, and as either the number of collocation points or the number of mesh intervals increase, the discrete solution convergences to the continuous solution in the sup-norm. The convergence is exponentially fast with respect to the degree of the polynomials on each mesh interval, while the error is bounded by a polynomial in the mesh spacing. An advantage of the $hp$-scheme over global polynomials is that there is a convergence guarantee when the mesh is sufficiently small, while the convergence result for global polynomials requires that a norm of the linearized dynamics is sufficiently small. Numerical examples explore the convergence theory.
△ Less
Submitted 12 September, 2018; v1 submitted 6 May, 2016;
originally announced May 2016.
-
Convergence rate for a Radau collocation method applied to unconstrained optimal control
Authors:
William W. Hager,
Hongyan Hou,
Anil V. Rao
Abstract:
A local convergence rate is established for an orthogonal collocation method based on Radau quadrature applied to an unconstrained optimal control problem. If the continuous problem has a sufficiently smooth solution and the Hamiltonian satisfies a strong convexity condition, then the discrete problem possesses a local minimizer in a neighborhood of the continuous solution, and as the number of co…
▽ More
A local convergence rate is established for an orthogonal collocation method based on Radau quadrature applied to an unconstrained optimal control problem. If the continuous problem has a sufficiently smooth solution and the Hamiltonian satisfies a strong convexity condition, then the discrete problem possesses a local minimizer in a neighborhood of the continuous solution, and as the number of collocation points increases, the discrete solution convergences exponentially fast in the sup-norm to the continuous solution. An earlier paper analyzes an orthogonal collocation method based on Gauss quadrature, where neither end point of the problem domain is a collocation point. For the Radau quadrature scheme, one end point is a collocation point.
△ Less
Submitted 12 September, 2015; v1 submitted 15 August, 2015;
originally announced August 2015.
-
Lebesgue Constants Arising in a Class of Collocation Methods
Authors:
William W. Hager,
Hongyan Hou,
Anil V. Rao
Abstract:
Estimates are obtained for the Lebesgue constants associated with the Gauss quadrature points on $(-1, +1)$ augmented by the point $-1$ and with the Radau quadrature points on either $(-1, +1]$ or $[-1, +1)$. It is shown that the Lebesgue constants are $O(\sqrt{N})$, where $N$ is the number of quadrature points. These point sets arise in the estimation of the residual associated with recently deve…
▽ More
Estimates are obtained for the Lebesgue constants associated with the Gauss quadrature points on $(-1, +1)$ augmented by the point $-1$ and with the Radau quadrature points on either $(-1, +1]$ or $[-1, +1)$. It is shown that the Lebesgue constants are $O(\sqrt{N})$, where $N$ is the number of quadrature points. These point sets arise in the estimation of the residual associated with recently developed orthogonal collocation schemes for optimal control problems. For problems with smooth solutions, the estimates for the Lebesgue constants can imply an exponential decay of the residual in the collocated problem as a function of the number of quadrature points.
△ Less
Submitted 14 September, 2015; v1 submitted 29 July, 2015;
originally announced July 2015.
-
Convergence rate for a Gauss collocation method applied to unconstrained optimal control
Authors:
William W. Hager,
Hongyan Hou,
Anil V. Rao
Abstract:
A local convergence rate is established for an orthogonal collocation method based on Gauss quadrature applied to an unconstrained optimal control problem. If the continuous problem has a sufficiently smooth solution and the Hamiltonian satisfies a strong convexity condition, then the discrete problem possesses a local minimizer in a neighborhood of the continuous solution, and as the number of co…
▽ More
A local convergence rate is established for an orthogonal collocation method based on Gauss quadrature applied to an unconstrained optimal control problem. If the continuous problem has a sufficiently smooth solution and the Hamiltonian satisfies a strong convexity condition, then the discrete problem possesses a local minimizer in a neighborhood of the continuous solution, and as the number of collocation points increases, the discrete solution convergences exponentially fast in the sup-norm to the continuous solution. This is the first convergence rate result for an orthogonal collocation method based on global polynomials applied to an optimal control problem.
△ Less
Submitted 16 August, 2015; v1 submitted 29 July, 2015;
originally announced July 2015.
