-
Efficient Learning of Vehicle Controller Parameters via Multi-Fidelity Bayesian Optimization: From Simulation to Experiment
Authors:
Yongpeng Zhao,
Maik Pfefferkorn,
Maximilian Templer,
Rolf Findeisen
Abstract:
Parameter tuning for vehicle controllers remains a costly and time-intensive challenge in automotive development. Traditional approaches rely on extensive real-world testing, making the process inefficient. We propose a multi-fidelity Bayesian optimization approach that efficiently learns optimal controller parameters by leveraging both low-fidelity simulation data and a very limited number of rea…
▽ More
Parameter tuning for vehicle controllers remains a costly and time-intensive challenge in automotive development. Traditional approaches rely on extensive real-world testing, making the process inefficient. We propose a multi-fidelity Bayesian optimization approach that efficiently learns optimal controller parameters by leveraging both low-fidelity simulation data and a very limited number of real-world experiments. Our approach significantly reduces the need for manual tuning and expensive field testing while maintaining the standard two-stage development workflow used in industry. The core contribution is the integration of an auto-regressive multi-fidelity Gaussian process model into Bayesian optimization, enabling knowledge transfer between different fidelity levels without requiring additional low-fidelity evaluations during real-world testing. We validate our approach through both simulation studies and realworld experiments. The results demonstrate that our method achieves high-quality controller performance with only very few real-world experiments, highlighting its potential as a practical and scalable solution for intelligent vehicle control tuning in industrial applications.
△ Less
Submitted 10 June, 2025;
originally announced June 2025.
-
Probabilistically Input-to-State Stable Stochastic Model Predictive Control
Authors:
Maik Pfefferkorn,
Rolf Findeisen
Abstract:
Employing model predictive control to systems with unbounded, stochastic disturbances poses the challenge of guaranteeing safety, i.e., repeated feasibility and stability of the closed-loop system. Especially, there are no strict repeated feasibility guarantees for standard stochastic MPC formulations. Thus, traditional stability proofs are not straightforwardly applicable. We exploit the concept…
▽ More
Employing model predictive control to systems with unbounded, stochastic disturbances poses the challenge of guaranteeing safety, i.e., repeated feasibility and stability of the closed-loop system. Especially, there are no strict repeated feasibility guarantees for standard stochastic MPC formulations. Thus, traditional stability proofs are not straightforwardly applicable. We exploit the concept of input-to-state stability in probability and outline how it can be used to provide stability guarantees, circumventing the requirement for strict repeated feasibility guarantees. Loss of feasibility is captured by a back-up controller, which is explicitly taken into account in the stability analysis. We illustrate our findings using a numeric example.
△ Less
Submitted 10 October, 2024;
originally announced October 2024.
-
Safe Learning-Based Optimization of Model Predictive Control: Application to Battery Fast-Charging
Authors:
Sebastian Hirt,
Andreas Höhl,
Johannes Pohlodek,
Joachim Schaeffer,
Maik Pfefferkorn,
Richard D. Braatz,
Rolf Findeisen
Abstract:
Model predictive control (MPC) is a powerful tool for controlling complex nonlinear systems under constraints, but often struggles with model uncertainties and the design of suitable cost functions. To address these challenges, we discuss an approach that integrates MPC with safe Bayesian optimization to optimize long-term closed-loop performance despite significant model-plant mismatches. By para…
▽ More
Model predictive control (MPC) is a powerful tool for controlling complex nonlinear systems under constraints, but often struggles with model uncertainties and the design of suitable cost functions. To address these challenges, we discuss an approach that integrates MPC with safe Bayesian optimization to optimize long-term closed-loop performance despite significant model-plant mismatches. By parameterizing the MPC stage cost function using a radial basis function network, we employ Bayesian optimization as a multi-episode learning strategy to tune the controller without relying on precise system models. This method mitigates conservativeness introduced by overly cautious soft constraints in the MPC cost function and provides probabilistic safety guarantees during learning, ensuring that safety-critical constraints are met with high probability. As a practical application, we apply our approach to fast charging of lithium-ion batteries, a challenging task due to the complicated battery dynamics and strict safety requirements, subject to the requirement to be implementable in real time. Simulation results demonstrate that, in the context of model-plant mismatch, our method reduces charging times compared to traditional MPC methods while maintaining safety. This work extends previous research by emphasizing closed-loop constraint satisfaction and offers a promising solution for enhancing performance in systems where model uncertainties and safety are critical concerns.
△ Less
Submitted 7 October, 2024;
originally announced October 2024.
-
Safe and Stable Closed-Loop Learning for Neural-Network-Supported Model Predictive Control
Authors:
Sebastian Hirt,
Maik Pfefferkorn,
Rolf Findeisen
Abstract:
Safe learning of control policies remains challenging, both in optimal control and reinforcement learning. In this article, we consider safe learning of parametrized predictive controllers that operate with incomplete information about the underlying process. To this end, we employ Bayesian optimization for learning the best parameters from closed-loop data. Our method focuses on the system's over…
▽ More
Safe learning of control policies remains challenging, both in optimal control and reinforcement learning. In this article, we consider safe learning of parametrized predictive controllers that operate with incomplete information about the underlying process. To this end, we employ Bayesian optimization for learning the best parameters from closed-loop data. Our method focuses on the system's overall long-term performance in closed-loop while keeping it safe and stable. Specifically, we parametrize the stage cost function of an MPC using a feedforward neural network. This allows for a high degree of flexibility, enabling the system to achieve a better closed-loop performance with respect to a superordinate measure. However, this flexibility also necessitates safety measures, especially with respect to closed-loop stability. To this end, we explicitly incorporated stability information in the Bayesian-optimization-based learning procedure, thereby achieving rigorous probabilistic safety guarantees. The proposed approach is illustrated using a numeric example.
△ Less
Submitted 16 September, 2024;
originally announced September 2024.
-
Stability-informed Bayesian Optimization for MPC Cost Function Learning
Authors:
Sebastian Hirt,
Maik Pfefferkorn,
Ali Mesbah,
Rolf Findeisen
Abstract:
Designing predictive controllers towards optimal closed-loop performance while maintaining safety and stability is challenging. This work explores closed-loop learning for predictive control parameters under imperfect information while considering closed-loop stability. We employ constrained Bayesian optimization to learn a model predictive controller's (MPC) cost function parametrized as a feedfo…
▽ More
Designing predictive controllers towards optimal closed-loop performance while maintaining safety and stability is challenging. This work explores closed-loop learning for predictive control parameters under imperfect information while considering closed-loop stability. We employ constrained Bayesian optimization to learn a model predictive controller's (MPC) cost function parametrized as a feedforward neural network, optimizing closed-loop behavior as well as minimizing model-plant mismatch. Doing so offers a high degree of freedom and, thus, the opportunity for efficient and global optimization towards the desired and optimal closed-loop behavior. We extend this framework by stability constraints on the learned controller parameters, exploiting the optimal value function of the underlying MPC as a Lyapunov candidate. The effectiveness of the proposed approach is underlined in simulations, highlighting its performance and safety capabilities.
△ Less
Submitted 18 April, 2024;
originally announced April 2024.
-
Regret and Conservatism of Distributionally Robust Constrained Stochastic Model Predictive Control
Authors:
Maik Pfefferkorn,
Venkatraman Renganathan,
Rolf Findeisen
Abstract:
We analyse the conservatism and regret of distributionally robust (DR) stochastic model predictive control (SMPC) when using moment-based ambiguity sets for modeling unknown uncertainties. To quantify the conservatism, we compare the deterministic constraint tightening while taking a DR approach against the optimal tightening when the exact distributions of the stochastic uncertainties are known.…
▽ More
We analyse the conservatism and regret of distributionally robust (DR) stochastic model predictive control (SMPC) when using moment-based ambiguity sets for modeling unknown uncertainties. To quantify the conservatism, we compare the deterministic constraint tightening while taking a DR approach against the optimal tightening when the exact distributions of the stochastic uncertainties are known. Furthermore, we quantify the regret by comparing the performance when the distributions of the stochastic uncertainties are known and unknown. Analysing the accumulated sub-optimality of SMPC due to the lack of knowledge about the true distributions of the uncertainties marks the novel contribution of this work.
△ Less
Submitted 14 March, 2024; v1 submitted 21 September, 2023;
originally announced September 2023.
-
Model Predictive Control with Gaussian-Process-Supported Dynamical Constraints for Autonomous Vehicles
Authors:
Johanna Bethge,
Maik Pfefferkorn,
Alexander Rose,
Jan Peters,
Rolf Findeisen
Abstract:
We propose a model predictive control approach for autonomous vehicles that exploits learned Gaussian processes for predicting human driving behavior. The proposed approach employs the uncertainty about the GP's prediction to achieve safety. A multi-mode predictive control approach considers the possible intentions of the human drivers. While the intentions are represented by different Gaussian pr…
▽ More
We propose a model predictive control approach for autonomous vehicles that exploits learned Gaussian processes for predicting human driving behavior. The proposed approach employs the uncertainty about the GP's prediction to achieve safety. A multi-mode predictive control approach considers the possible intentions of the human drivers. While the intentions are represented by different Gaussian processes, their probabilities foreseen in the observed behaviors are determined by a suitable online classification. Intentions below a certain probability threshold are neglected to improve performance. The proposed multi-mode model predictive control approach with Gaussian process regression support enables repeated feasibility and probabilistic constraint satisfaction with high probability. The approach is underlined in simulation, considering real-world measurements for training the Gaussian processes.
△ Less
Submitted 8 March, 2023;
originally announced March 2023.
-
Fusing Online Gaussian Process-Based Learning and Control for Scanning Quantum Dot Microscopy
Authors:
Maik Pfefferkorn,
Michael Maiworm,
Christian Wagner,
F. Stefan Tautz,
Rolf Findeisen
Abstract:
Elucidating electrostatic surface potentials contributes to a deeper understanding of the nature of matter and its physicochemical properties, which is the basis for a wide field of applications. Scanning quantum dot microscopy, a recently developed technique allows to measure such potentials with atomic resolution. For an efficient deployment in scientific practice, however, it is essential to sp…
▽ More
Elucidating electrostatic surface potentials contributes to a deeper understanding of the nature of matter and its physicochemical properties, which is the basis for a wide field of applications. Scanning quantum dot microscopy, a recently developed technique allows to measure such potentials with atomic resolution. For an efficient deployment in scientific practice, however, it is essential to speed up the scanning process. To this end we employ a two-degree-of-freedom control paradigm, in which a Gaussian process is used as the feedforward part. We present a tailored online learning scheme of the Gaussian process, adapted to scanning quantum dot microscopy, that includes hyperparameter optimization during operation to enable fast and precise scanning of arbitrary surface structures. For the potential application in practice, the accompanying computational cost is reduced evaluating different sparse approximation approaches. The fully independent training conditional approximation, used on a reduced set of active training data, is found to be the most promising approach.
△ Less
Submitted 6 April, 2020;
originally announced April 2020.
