-
Dual Control for Interactive Autonomous Merging with Model Predictive Diffusion
Authors:
Jacob Knaup,
Jovin D'sa,
Behdad Chalaki,
Hossein Nourkhiz Mahjoub,
Ehsan Moradi-Pari,
Panagiotis Tsiotras
Abstract:
Interactive decision-making is essential in applications such as autonomous driving, where the agent must infer the behavior of nearby human drivers while planning in real-time. Traditional predict-then-act frameworks are often insufficient or inefficient because accurate inference of human behavior requires a continuous interaction rather than isolated prediction. To address this, we propose an a…
▽ More
Interactive decision-making is essential in applications such as autonomous driving, where the agent must infer the behavior of nearby human drivers while planning in real-time. Traditional predict-then-act frameworks are often insufficient or inefficient because accurate inference of human behavior requires a continuous interaction rather than isolated prediction. To address this, we propose an active learning framework in which we rigorously derive predicted belief distributions. Additionally, we introduce a novel model-based diffusion solver tailored for online receding horizon control problems, demonstrated through a complex, non-convex highway merging scenario. Our approach extends previous high-fidelity dual control simulations to hardware experiments, which may be viewed at https://youtu.be/Q_JdZuopGL4, and verifies behavior inference in human-driven traffic scenarios, moving beyond idealized models. The results show improvements in adaptive planning under uncertainty, advancing the field of interactive decision-making for real-world applications.
△ Less
Submitted 14 February, 2025;
originally announced February 2025.
-
Recursively Feasible Stochastic Model Predictive Control for Time-Varying Linear Systems Subject to Unbounded Disturbances
Authors:
Jacob W. Knaup,
Panagiotis Tsiotras
Abstract:
Model predictive control solves a constrained optimization problem online in order to compute an implicit closed-loop control policy. Recursive feasibility -- guaranteeing that the optimal control problem will have a solution at every time step -- is an important property to guarantee the success of any model predictive control approach. However, recursive feasibility is difficult to establish in…
▽ More
Model predictive control solves a constrained optimization problem online in order to compute an implicit closed-loop control policy. Recursive feasibility -- guaranteeing that the optimal control problem will have a solution at every time step -- is an important property to guarantee the success of any model predictive control approach. However, recursive feasibility is difficult to establish in a stochastic setting and, in particular, in the presence of disturbances having unbounded support (e.g., Gaussian noise). The problem is further exacerbated for time-varying systems, in which case recursive feasibility must be established also in a robust sense, over all possible future time-varying parameter values, as well as in a stochastic sense, over all potential disturbance realizations. This work presents a method for ensuring the recursive feasibility of a convex, affine-feedback stochastic model predictive control problem formulation for systems with time-varying system matrices and unbounded disturbances using ideas from covariance steering stochastic model predictive control. It is additionally shown that the proposed approach ensures the closed-loop operation of the system will satisfy the desired chance constraints in practice, and that the stochastic model predictive control problem may be formulated as a convex program so that it may be efficiently solved in real-time.
△ Less
Submitted 14 October, 2024;
originally announced October 2024.
-
Adaptive Dual Covariance Steering with Active Parameter Estimation
Authors:
Jacob W. Knaup,
Panagiotis Tsiotras
Abstract:
This work examines the optimal covariance steering problem for systems subject to unknown parameters that enter multiplicatively with the state and control, in addition to additive disturbances. In contrast to existing works, the unknown parameters are modeled as random variables and are estimated online. This work proposes the utilization of recursive least squares estimation for efficient parame…
▽ More
This work examines the optimal covariance steering problem for systems subject to unknown parameters that enter multiplicatively with the state and control, in addition to additive disturbances. In contrast to existing works, the unknown parameters are modeled as random variables and are estimated online. This work proposes the utilization of recursive least squares estimation for efficient parameter identification. A dual control problem is formulated in which the effect of the planned control policy on the parameter estimates is modeled and optimized for. The parameter estimates are then used to modify the pre-computed control policy online in an adaptive control fashion. Finally, the proposed approach is demonstrated in a vehicle control example with closed-loop parameter identification.
△ Less
Submitted 22 March, 2024;
originally announced March 2024.
-
Covariance Steering for Systems Subject to Unknown Parameters
Authors:
Jacob Knaup,
Panagiotis Tsiotras
Abstract:
This work considers the optimal covariance steering problem for systems subject to both additive noise and uncertain parameters which may enter multiplicatively with the state and the control. The unknown parameters are modeled as a constant random variable sampled from a distribution with known moments. The optimal covariance steering problem is formulated using a moment-based representation of t…
▽ More
This work considers the optimal covariance steering problem for systems subject to both additive noise and uncertain parameters which may enter multiplicatively with the state and the control. The unknown parameters are modeled as a constant random variable sampled from a distribution with known moments. The optimal covariance steering problem is formulated using a moment-based representation of the system dynamics, which includes dependence between the unknown parameters and future states, and is solved using sequential convex programming. The proposed approach is demonstrated numerically using a holonomic spacecraft system and an autonomous vehicle control application.
△ Less
Submitted 17 March, 2023;
originally announced March 2023.
-
Computationally Efficient Covariance Steering for Systems Subject to Parametric Disturbances and Chance Constraints
Authors:
Jacob Knaup,
Panagiotis Tsiotras
Abstract:
This work investigates the finite-horizon optimal covariance steering problem for discrete-time linear systems subject to both additive and multiplicative uncertainties as well as state and input chance constraints. In particular, a tractable convex approximation of the optimal covariance steering problem is developed by tightening the chance constraints and by introducing a suitable change of var…
▽ More
This work investigates the finite-horizon optimal covariance steering problem for discrete-time linear systems subject to both additive and multiplicative uncertainties as well as state and input chance constraints. In particular, a tractable convex approximation of the optimal covariance steering problem is developed by tightening the chance constraints and by introducing a suitable change of variables. The solution of the convex approximation is shown to be a valid (albeit potentially suboptimal) solution to the original chance-constrained covariance steering problem.
△ Less
Submitted 18 January, 2023;
originally announced January 2023.
