Showing 1–2 of 2 results for author: Del Vecchio, C

On a Probabilistic Approach for Inverse Data-Driven Optimal Control

Authors: Émiland Garrabé, Hozefa Jesawada, Carmen Del Vecchio, Giovanni Russo

Abstract: We consider the problem of estimating the possibly non-convex cost of an agent by observing its interactions with a nonlinear, non-stationary and stochastic environment. For this inverse problem, we give a result that allows to estimate the cost by solving a convex optimization problem. To obtain this result we also tackle a forward problem. This leads to the formulation of a finite-horizon optima… ▽ More We consider the problem of estimating the possibly non-convex cost of an agent by observing its interactions with a nonlinear, non-stationary and stochastic environment. For this inverse problem, we give a result that allows to estimate the cost by solving a convex optimization problem. To obtain this result we also tackle a forward problem. This leads to the formulation of a finite-horizon optimal control problem for which we show convexity and find the optimal solution. Our approach leverages certain probabilistic descriptions that can be obtained both from data and/or from first-principles. The effectiveness of our results, which are turned in an algorithm, is illustrated via simulations on the problem of estimating the cost of an agent that is stabilizing the unstable equilibrium of a pendulum. △ Less

Submitted 21 July, 2023; v1 submitted 31 March, 2023; originally announced March 2023.

Comments: Accepted for presentation at the 62nd IEEE Conference on Decision and Control, CDC 2023

A Model-Based Reinforcement Learning Approach for PID Design

Authors: Hozefa Jesawada, Amol Yerudkar, Carmen Del Vecchio, Navdeep Singh

Abstract: Proportional-integral-derivative (PID) controller is widely used across various industrial process control applications because of its straightforward implementation. However, it can be challenging to fine-tune the PID parameters in practice to achieve robust performance. The paper proposes a model-based reinforcement learning (RL) framework to design PID controllers leveraging the probabilistic i… ▽ More Proportional-integral-derivative (PID) controller is widely used across various industrial process control applications because of its straightforward implementation. However, it can be challenging to fine-tune the PID parameters in practice to achieve robust performance. The paper proposes a model-based reinforcement learning (RL) framework to design PID controllers leveraging the probabilistic inference for learning control (PILCO) method and Kullback-Leibler divergence (KLD). Since PID controllers have a much more interpretable control structure than a network basis function, an optimal policy given by PILCO is transformed into a set of robust PID tuning parameters for underactuated mechanical systems. The presented method is general and can blend with several model-based and model-free algorithms. The performance of the devised PID controllers is demonstrated with simulation studies for a benchmark cart-pole system under disturbances and system parameter uncertainties. △ Less

Submitted 7 June, 2022; originally announced June 2022.