-
Cloud Infrastructure Management in the Age of AI Agents
Authors:
Zhenning Yang,
Archit Bhatnagar,
Yiming Qiu,
Tongyuan Miao,
Patrick Tser Jern Kon,
Yunming Xiao,
Yibo Huang,
Martin Casado,
Ang Chen
Abstract:
Cloud infrastructure is the cornerstone of the modern IT industry. However, managing this infrastructure effectively requires considerable manual effort from the DevOps engineering team. We make a case for developing AI agents powered by large language models (LLMs) to automate cloud infrastructure management tasks. In a preliminary study, we investigate the potential for AI agents to use differen…
▽ More
Cloud infrastructure is the cornerstone of the modern IT industry. However, managing this infrastructure effectively requires considerable manual effort from the DevOps engineering team. We make a case for developing AI agents powered by large language models (LLMs) to automate cloud infrastructure management tasks. In a preliminary study, we investigate the potential for AI agents to use different cloud/user interfaces such as software development kits (SDK), command line interfaces (CLI), Infrastructure-as-Code (IaC) platforms, and web portals. We report takeaways on their effectiveness on different management tasks, and identify research challenges and potential solutions.
△ Less
Submitted 13 June, 2025;
originally announced June 2025.
-
Automatic Basis Function Selection in Iterative Learning Control: A Sparsity-Promoting Approach Applied to an Industrial Printer
Authors:
Tjeerd Ickenroth,
Max van Haren,
Johan Kon,
Max van Meer,
Jilles van hulst,
Tom Oomen
Abstract:
Iterative learning control (ILC) techniques are capable of improving the tracking performance of control systems that repeatedly perform similar tasks by utilizing data from past iterations. The aim of this paper is to design a systematic approach for learning parameterized feedforward signals with limited complexity. The developed method involves an iterative learning control in conjunction with…
▽ More
Iterative learning control (ILC) techniques are capable of improving the tracking performance of control systems that repeatedly perform similar tasks by utilizing data from past iterations. The aim of this paper is to design a systematic approach for learning parameterized feedforward signals with limited complexity. The developed method involves an iterative learning control in conjunction with a data-driven sparse subset selection procedure for basis function selection. The ILC algorithm that employs sparse optimization is able to automatically select relevant basis functions and is validated on an industrial flatbed printer.
△ Less
Submitted 9 May, 2025;
originally announced May 2025.
-
A Direct State-Space Realization of Discrete-Time Linear Parameter-Varying Input-Output Models
Authors:
Johan Kon,
Roland Tóth,
Jeroen van de Wijdeven,
Marcel Heertjes,
Tom Oomen
Abstract:
A minimal state-space (SS) realization of an identified linear parameter-varying (LPV) input-output (IO) model usually introduces dynamic and nonlinear dependency of the state-space coefficient functions, complicating stability analysis and controller synthesis. The aim of this paper is to introduce and analyze a direct SS realization of this IO model that avoids this nonlinear and dynamic depende…
▽ More
A minimal state-space (SS) realization of an identified linear parameter-varying (LPV) input-output (IO) model usually introduces dynamic and nonlinear dependency of the state-space coefficient functions, complicating stability analysis and controller synthesis. The aim of this paper is to introduce and analyze a direct SS realization of this IO model that avoids this nonlinear and dynamic dependency, at the cost of introducing a nonminimal state. It is shown that this direct SS realization 1) is reachable under a coprimeness condition on the coefficient functions of the IO model and a well-posedness condition on the model order, and 2) is never observable but that the unobservable directions converge to zero in a finite amount of steps, i.e., that the realization is reconstructible. The derived results are illustrated through numerical examples in both the LPV and LTI case.
△ Less
Submitted 26 February, 2025;
originally announced February 2025.
-
Orthogonal projection-based regularization for efficient model augmentation
Authors:
Bendegúz M. Györök,
Jan H. Hoekstra,
Johan Kon,
Tamás Péni,
Maarten Schoukens,
Roland Tóth
Abstract:
Deep-learning-based nonlinear system identification has shown the ability to produce reliable and highly accurate models in practice. However, these black-box models lack physical interpretability, and a considerable part of the learning effort is often spent on capturing already expected/known behavior of the system, that can be accurately described by first-principles laws of physics. A potentia…
▽ More
Deep-learning-based nonlinear system identification has shown the ability to produce reliable and highly accurate models in practice. However, these black-box models lack physical interpretability, and a considerable part of the learning effort is often spent on capturing already expected/known behavior of the system, that can be accurately described by first-principles laws of physics. A potential solution is to directly integrate such prior physical knowledge into the model structure, combining the strengths of physics-based modeling and deep-learning-based identification. The most common approach is to use an additive model augmentation structure, where the physics-based and the machine-learning (ML) components are connected in parallel, i.e., additively. However, such models are overparametrized, training them is challenging, potentially causing the physics-based part to lose interpretability. To overcome this challenge, this paper proposes an orthogonal projection-based regularization technique to enhance parameter learning and even model accuracy in learning-based augmentation of nonlinear baseline models.
△ Less
Submitted 22 April, 2025; v1 submitted 10 January, 2025;
originally announced January 2025.
-
Unconstrained Parameterization of Stable LPV Input-Output Models: with Application to System Identification
Authors:
Johan Kon,
Jeroen van de Wijdeven,
Dennis Bruijnen,
Roland Tóth,
Marcel Heertjes,
Tom Oomen
Abstract:
Ensuring stability of discrete-time (DT) linear parameter-varying (LPV) input-output (IO) models estimated via system identification methods is a challenging problem as known stability constraints can only be numerically verified, e.g., through solving Linear Matrix Inequalities. In this paper, an unconstrained DT-LPV-IO parameterization is developed which gives a stable model for any choice of mo…
▽ More
Ensuring stability of discrete-time (DT) linear parameter-varying (LPV) input-output (IO) models estimated via system identification methods is a challenging problem as known stability constraints can only be numerically verified, e.g., through solving Linear Matrix Inequalities. In this paper, an unconstrained DT-LPV-IO parameterization is developed which gives a stable model for any choice of model parameters. To achieve this, it is shown that all quadratically stable DT-LPV-IO models can be generated by a mapping of transformed coefficient functions that are constrained to the unit ball, i.e., a small-gain condition. The unit ball is then reparameterized through a Cayley transformation, resulting in an unconstrained parameterization of all quadratically stable DT-LPV-IO models. As a special case, an unconstrained parameterization of all stable DT linear time-invariant transfer functions is obtained. Identification using the stable DT-LPV-IO model with neural network coefficient functions is demonstrated on a simulation example of a position-varying mass-damper-spring system.
△ Less
Submitted 12 March, 2024; v1 submitted 18 January, 2024;
originally announced January 2024.
-
Direct Learning for Parameter-Varying Feedforward Control: A Neural-Network Approach
Authors:
Johan Kon,
Jeroen van de Wijdeven,
Dennis Bruijnen,
Roland Tóth,
Marcel Heertjes,
Tom Oomen
Abstract:
The performance of a feedforward controller is primarily determined by the extent to which it can capture the relevant dynamics of a system. The aim of this paper is to develop an input-output linear parameter-varying (LPV) feedforward parameterization and a corresponding data-driven estimation method in which the dependency of the coefficients on the scheduling signal are learned by a neural netw…
▽ More
The performance of a feedforward controller is primarily determined by the extent to which it can capture the relevant dynamics of a system. The aim of this paper is to develop an input-output linear parameter-varying (LPV) feedforward parameterization and a corresponding data-driven estimation method in which the dependency of the coefficients on the scheduling signal are learned by a neural network. The use of a neural network enables the parameterization to compensate a wide class of constant relative degree LPV systems. Efficient optimization of the neural-network-based controller is achieved through a Levenberg-Marquardt approach with analytic gradients and a pseudolinear approach generalizing Sanathanan-Koerner to the LPV case. The performance of the developed feedforward learning method is validated in a simulation study of an LPV system showing excellent performance.
△ Less
Submitted 22 September, 2023;
originally announced September 2023.
-
Learning for Precision Motion of an Interventional X-ray System: Add-on Physics-Guided Neural Network Feedforward Control
Authors:
Johan Kon,
Naomi de Vos,
Dennis Bruijnen,
Jeroen van de Wijdeven,
Marcel Heertjes,
Tom Oomen
Abstract:
Tracking performance of physical-model-based feedforward control for interventional X-ray systems is limited by hard-to-model parasitic nonlinear dynamics, such as cable forces and nonlinear friction. In this paper, these nonlinear dynamics are compensated using a physics-guided neural network (PGNN), consisting of a physical model, embedding prior knowledge of the dynamics, in parallel with a neu…
▽ More
Tracking performance of physical-model-based feedforward control for interventional X-ray systems is limited by hard-to-model parasitic nonlinear dynamics, such as cable forces and nonlinear friction. In this paper, these nonlinear dynamics are compensated using a physics-guided neural network (PGNN), consisting of a physical model, embedding prior knowledge of the dynamics, in parallel with a neural network to learn hard-to-model dynamics. To ensure that the neural network learns only unmodelled effects, the neural network output in the subspace spanned by the physical model is regularized via an orthogonal projection-based approach, resulting in complementary physical model and neural network contributions. The PGNN feedforward controller reduces the tracking error of an interventional X-ray system by a factor of 5 compared to an optimally tuned physical model, successfully compensating the unmodeled parasitic dynamics.
△ Less
Submitted 28 March, 2023; v1 submitted 14 March, 2023;
originally announced March 2023.
-
Unifying Model-Based and Neural Network Feedforward: Physics-Guided Neural Networks with Linear Autoregressive Dynamics
Authors:
Johan Kon,
Dennis Bruijnen,
Jeroen van de Wijdeven,
Marcel Heertjes,
Tom Oomen
Abstract:
Unknown nonlinear dynamics often limit the tracking performance of feedforward control. The aim of this paper is to develop a feedforward control framework that can compensate these unknown nonlinear dynamics using universal function approximators. The feedforward controller is parametrized as a parallel combination of a physics-based model and a neural network, where both share the same linear au…
▽ More
Unknown nonlinear dynamics often limit the tracking performance of feedforward control. The aim of this paper is to develop a feedforward control framework that can compensate these unknown nonlinear dynamics using universal function approximators. The feedforward controller is parametrized as a parallel combination of a physics-based model and a neural network, where both share the same linear autoregressive (AR) dynamics. This parametrization allows for efficient output-error optimization through Sanathanan-Koerner (SK) iterations. Within each SK-iteration, the output of the neural network is penalized in the subspace of the physics-based model through orthogonal projection-based regularization, such that the neural network captures only the unmodelled dynamics, resulting in interpretable models.
△ Less
Submitted 26 September, 2022;
originally announced September 2022.
-
Cross-Coupled Iterative Learning Control for Complex Systems: A Monotonically Convergent and Computationally Efficient Approach
Authors:
Leontine Aarnoudse,
Johan Kon,
Koen Classens,
Max van Meer,
Maurice Poot,
Paul Tacx,
Nard Strijbosch,
Tom Oomen
Abstract:
Cross-coupled iterative learning control (ILC) can achieve high performance for manufacturing applications in which tracking a contour is essential for the quality of a product. The aim of this paper is to develop a framework for norm-optimal cross-coupled ILC that enables the use of exact contour errors that are calculated offline, and iteration- and time-varying weights. Conditions for the monot…
▽ More
Cross-coupled iterative learning control (ILC) can achieve high performance for manufacturing applications in which tracking a contour is essential for the quality of a product. The aim of this paper is to develop a framework for norm-optimal cross-coupled ILC that enables the use of exact contour errors that are calculated offline, and iteration- and time-varying weights. Conditions for the monotonic convergence of this iteration-varying ILC algorithm are developed. In addition, a resource-efficient implementation is proposed in which the ILC update law is reframed as a linear quadratic tracking problem, reducing the computational load significantly. The approach is illustrated on a simulation example.
△ Less
Submitted 12 September, 2022;
originally announced September 2022.
-
Neural Network Training Using Closed-Loop Data: Hazards and an Instrumental Variable (IVNN) Solution
Authors:
Johan Kon,
Marcel Heertjes,
Tom Oomen
Abstract:
An increasing trend in the use of neural networks in control systems is being observed. The aim of this paper is to reveal that the straightforward application of learning neural network feedforward controllers with closed-loop data may introduce parameter inconsistency that degrades control performance, and to provide a solution. The proposed method employs instrumental variables to ensure consis…
▽ More
An increasing trend in the use of neural networks in control systems is being observed. The aim of this paper is to reveal that the straightforward application of learning neural network feedforward controllers with closed-loop data may introduce parameter inconsistency that degrades control performance, and to provide a solution. The proposed method employs instrumental variables to ensure consistent parameter estimates. A nonlinear system example reveals that the developed instrumental variable neural network (IVNN) approach asymptotically recovers the optimal solution, while pre-existing approaches are shown to lead to inconsistent estimates.
△ Less
Submitted 19 April, 2022; v1 submitted 10 February, 2022;
originally announced February 2022.
-
Physics-Guided Neural Networks for Feedforward Control: An Orthogonal Projection-Based Approach
Authors:
Johan Kon,
Dennis Bruijnen,
Jeroen van de Wijdeven,
Marcel Heertjes,
Tom Oomen
Abstract:
Unknown nonlinear dynamics can limit the performance of model-based feedforward control. The aim of this paper is to develop a feedforward control framework for systems with unknown, typically nonlinear, dynamics. To address the unknown dynamics, a physics-based feedforward model is complemented by a neural network. The neural network output in the subspace of the model is penalized through orthog…
▽ More
Unknown nonlinear dynamics can limit the performance of model-based feedforward control. The aim of this paper is to develop a feedforward control framework for systems with unknown, typically nonlinear, dynamics. To address the unknown dynamics, a physics-based feedforward model is complemented by a neural network. The neural network output in the subspace of the model is penalized through orthogonal projection. This results in uniquely identifiable model coefficients, enabling both increased performance and good generalization. The feedforward control framework is validated on a representative system with performance limiting nonlinear friction characteristics.
△ Less
Submitted 10 January, 2022;
originally announced January 2022.
-
Intermittent Sampling in Repetitive Control: Exploiting Time-Varying Measurements
Authors:
Johan Kon,
Nard Strijbosch,
Sjirk Koekebakker,
Tom Oomen
Abstract:
The performance increase up to the sensor resolution in repetitive control (RC) invalidates the standard assumption in RC that data is available at equidistant time instances, e.g., in systems with package loss or when exploiting timestamped data from optical encoders. The aim of this paper is to develop an intermittent sampling RC framework for non-equidistant measurements. Sufficient stability c…
▽ More
The performance increase up to the sensor resolution in repetitive control (RC) invalidates the standard assumption in RC that data is available at equidistant time instances, e.g., in systems with package loss or when exploiting timestamped data from optical encoders. The aim of this paper is to develop an intermittent sampling RC framework for non-equidistant measurements. Sufficient stability conditions are derived that can be verified using non-parametric frequency response function data. This results in a frequency domain design procedure to explicitly address uncertainty. The RC framework is validated on an industrial printbelt setup for which exact non-equidistant measurement data is available.
△ Less
Submitted 25 November, 2021;
originally announced November 2021.