-
The Milieu, Science & Logic of Feedback Control
Authors:
Robert R. Bitmead
Abstract:
'The cardinal sin in control is to believe that the plant is given' Karl Astrom. Astrom, a towering figure of control theory and practice and awardee of the 1993 IEEE Medal of Honor for his work on adaptive control, provides this assessment of the obstinate part of realizing a feedback controller. And yet we are exhorted to rely on solely-data-driven methods of control design skipping the modeling…
▽ More
'The cardinal sin in control is to believe that the plant is given' Karl Astrom. Astrom, a towering figure of control theory and practice and awardee of the 1993 IEEE Medal of Honor for his work on adaptive control, provides this assessment of the obstinate part of realizing a feedback controller. And yet we are exhorted to rely on solely-data-driven methods of control design skipping the modeling and plant identification phases entirely. What is going on? Whom should we trust? How do we reconcile the implied ease (or indeed avoidance) of modeling with the steely focus on robustness of the control and the capacity of feedback to accommodate uncertainty? This paper seeks to investigate this subject with the objective of appreciating not whom to trust but what are the circumstances where the direct paradigm of control design from any lightly qualified data set provides a sensible way forward. Here is a clue: It depends on the confidence of your contentions about the plant system, the detailed data themselves and your appetite for failure.
The paper attempts to segue repeatedly between the broad philosophical context and hard engineering examples. To instantiate ideas and add detail to vagaries, we incorporate a number of examples, each validated by their demonstrated commercial and industrial viability and each terminating with ein Blickwinkel or perspective in German. As David Wallace-Wells poses, before investing hundreds of billions of dollars we really ought to ask what is the trillion-dollar problem which might potentially be solved. By sticking to industrially proven technologies, we hope to delineate what works suitably well in practice or was judged worthy of the risk.
△ Less
Submitted 13 June, 2025;
originally announced June 2025.
-
Stable state and signal estimation in a network context
Authors:
Robert R. Bitmead
Abstract:
Power grid, communications, computer and product reticulation networks are frequently layered or subdivided by design. The layering divides responsibilities and can be driven by operational, commercial, regulatory and privacy concerns. From a control context, a layer, or part of a layer, in a network isolates the authority to manage, i.e. control, a dynamic system with connections into unknown par…
▽ More
Power grid, communications, computer and product reticulation networks are frequently layered or subdivided by design. The layering divides responsibilities and can be driven by operational, commercial, regulatory and privacy concerns. From a control context, a layer, or part of a layer, in a network isolates the authority to manage, i.e. control, a dynamic system with connections into unknown parts of the network. The topology of these connections is fully prescribed but the interconnecting signals, currents in the case of power grids and bandwidths in communications, are largely unavailable, through lack of sensing and even prohibition. Accordingly, one is driven to simultaneous input and state estimation methods. We study a class of algorithms for this joint task, which has the unfortunate issue of inverting a subsystem, which if it has unstable transmission zeros leads to an unstable and unimplementable estimator. Two modifications to the algorithm to ameliorate this problem were recently proposed involving replacing the troublesome subsystem with its outer factor from its inner-outer factorization or using a high-variance white signal model for the unknown inputs. Here, we establish the connections between the original estimation problem for state and input signal and the estimates from the algorithm applied solely to the outer factor. It is demonstrated that the state of the outer factor and that of the original system asymptotically coincide and that the estimate of the input signal to the outer factor has asymptotically stationary second-order statistics which are in one-to-one correspondence with those of the input signal to the original system, when this signal is itself stationary. Thus, the simultaneous input and state estimation algorithm applied just to the outer factor yields an unbiased state estimate for control and the statistics of the interface signals.
△ Less
Submitted 1 September, 2023; v1 submitted 8 August, 2023;
originally announced August 2023.
-
State estimation for control: an approach for output-feedback stochastic MPC
Authors:
Mohammad S. Ramadan,
Robert R. Bitmead,
Ke Huang
Abstract:
The paper provides a new approach to the determination of a single state value for stochastic output feedback problems using paradigms from Model Predictive Control, particularly the distinction between open-loop and closed-loop control and between deterministic optimal control and stochastic optimal control. The State Selection Algorithm is presented and relies on given dynamics and constraints,…
▽ More
The paper provides a new approach to the determination of a single state value for stochastic output feedback problems using paradigms from Model Predictive Control, particularly the distinction between open-loop and closed-loop control and between deterministic optimal control and stochastic optimal control. The State Selection Algorithm is presented and relies on given dynamics and constraints, a nominal deterministic state-feedback controller, and a sampling based method to select the best state value, based on optimizing a prescribed finite-horizon performance function, over the available candidates provided by a particle filter. The cost function is minimized over the horizon with controls determined by the nominal controller and the selected states. So, the minimization is performed not over the selection of the control other than through the choice of state value to use. The algorithm applies generally to nonlinear stochastic systems and relies on Monte Carlo sampling and averaging. However, in linear quadratic polyhedrally constrained cases the technique reduces to a quadratic program for the state value. The algorithm is evaluated in a set of computational examples, which illustrate its efficacy and limitations. Numerical aspects and the opportunity for parallelization are discussed. The examples demonstrate the algorithm operating, in closed-loop with its attendant particle filter, over the long horizon.
△ Less
Submitted 1 March, 2023;
originally announced March 2023.
-
Control-orientation, conservation of mass and model-based control of compressible fluid networks
Authors:
Sven Brüggemann,
Robert H. Moroto,
Robert R. Bitmead
Abstract:
We study a gas network flow regulation control problem showing the closed-loop consequences of using interconnected component models, which have been designed to preserve a variant of mass flow conservation without the inclusion of algebraic constraints into the dynamics. These are candidate \textit{control-oriented} models because they are linear state-space systems. This leads to a study of mass…
▽ More
We study a gas network flow regulation control problem showing the closed-loop consequences of using interconnected component models, which have been designed to preserve a variant of mass flow conservation without the inclusion of algebraic constraints into the dynamics. These are candidate \textit{control-oriented} models because they are linear state-space systems. This leads to a study of mass conservation in flow models and the inheritance of conservation at the network level when present at each component. Conservation is expressed as a transfer function property at DC. This property then is shown to imply the existence of integrators and other DC structure of the network model, which has important consequences for the subsequent control design. An example based on an industrial system is used to explore the facility of moving from modeling to automated interconnection or components to model reduction to digital controller design and performance evaluation. Throughout, the focus is on the teasing out of control orientation in modeling. The example shows a strong connection between the modeling and the controller design.
△ Less
Submitted 13 November, 2022;
originally announced November 2022.
-
A Compendium of Control-Oriented Models of Gas Processing Equipment Components
Authors:
Sven Brüggemann,
Robert H. Moroto,
Robert R. Bitmead
Abstract:
This work provides linear control-oriented state space models of gas flow through standard equipment, such as valves, compressors, manifolds and non-trivial pipe geometries. After presenting the catalog of components, we show how to interconnect them: we briefly recall the matrix methodology derived elsewhere, accompanied by a Matlab example for a gas loop; secondly for the same example we provide…
▽ More
This work provides linear control-oriented state space models of gas flow through standard equipment, such as valves, compressors, manifolds and non-trivial pipe geometries. After presenting the catalog of components, we show how to interconnect them: we briefly recall the matrix methodology derived elsewhere, accompanied by a Matlab example for a gas loop; secondly for the same example we provide an alternative approach using Matlab's connect function. All the aforementioned models are suited to model-based MIMO control design tools as they are in state-space form and they can be physically parametrized. Conservation of mass is the source of the algebraic constraints in and is a property subsumed in these new models. This is characterized by model transfer function properties at frequency zero. Each of the component models is shown to posses this property.
△ Less
Submitted 12 November, 2022;
originally announced November 2022.
-
Control-Oriented Modeling of Pipe Flow in Gas Processing Facilities
Authors:
Sven Brüggemann,
Robert H. Moroto,
Robert R. Bitmead
Abstract:
Pipe flow models are developed with a focus on their eventual use for feedback control design at the process control level, as opposed to the unit level, in gas processing facilities. Accordingly, linearized facility-scale models are generated to describe pressures, mass flows and temperatures based on sets of nonlinear partial differential equations from fluid dynamics and thermodynamics together…
▽ More
Pipe flow models are developed with a focus on their eventual use for feedback control design at the process control level, as opposed to the unit level, in gas processing facilities. Accordingly, linearized facility-scale models are generated to describe pressures, mass flows and temperatures based on sets of nonlinear partial differential equations from fluid dynamics and thermodynamics together with constraints associated with their interconnection. As part of the treatment, the divergence of these simplified models from physics is assessed, since robustness to these errors will be an objective for the eventual control system. The approach commences with a thorough analysis of pipe flow models and then proceeds to study their automated interconnection into network models, which subsume the algebraic constraints of bond graph or standard fluid modeling. The models are validated and their errors quantified by referring them to operational data from a commercial gas compressor test facility. For linear time-invariant models, the interconnection method to generate network models is shown to coincide with automation of Mason's Gain {Formula}. These pipe network models based on engineering data are the first part of the development of general facility process control tools.
△ Less
Submitted 14 November, 2022; v1 submitted 27 March, 2022;
originally announced March 2022.
-
Control-Oriented Modeling of Pipe Flow through Intersecting Pipe Geometries
Authors:
Sven Brüggemann,
Robert R. Bitmead
Abstract:
We present control-oriented models for transient dynamics of isothermal one-dimensional gas flow through multiple pipes in series and intersecting pipe geometries. These composite models subsume algebraic constraints that would otherwise appear due to boundary conditions, so that our linear state-space models are well-suited for model-based control design for gas flow in pipe networks with non-tri…
▽ More
We present control-oriented models for transient dynamics of isothermal one-dimensional gas flow through multiple pipes in series and intersecting pipe geometries. These composite models subsume algebraic constraints that would otherwise appear due to boundary conditions, so that our linear state-space models are well-suited for model-based control design for gas flow in pipe networks with non-trivial geometries.
△ Less
Submitted 20 May, 2022; v1 submitted 13 December, 2021;
originally announced December 2021.
-
Maximum Likelihood Recursive State Estimation using the Expectation Maximization Algorithm
Authors:
Mohammad S. Ramadan,
Robert R. Bitmead
Abstract:
A Maximum Likelihood recursive state estimator is derived for non-linear and non-Gaussian state-space models. The estimator combines a particle filter to generate the conditional density and the Expectation Maximization algorithm to compute the maximum likelihood state estimate iteratively. Algorithms for maximum likelihood state filtering, prediction and smoothing are presented. The convergence p…
▽ More
A Maximum Likelihood recursive state estimator is derived for non-linear and non-Gaussian state-space models. The estimator combines a particle filter to generate the conditional density and the Expectation Maximization algorithm to compute the maximum likelihood state estimate iteratively. Algorithms for maximum likelihood state filtering, prediction and smoothing are presented. The convergence properties of these algorithms, which are inherited from the Expectation Maximization algorithm, are proven and examined in two examples. It is shown that, with randomized reinitialization, which is feasible because of the algorithm simplicity, these methods are able to converge to the Maximum Likelihood Estimate (MLE) of multimodal, truncated and skewed densities, as well as those of disjoint support.
△ Less
Submitted 18 March, 2021;
originally announced March 2021.
-
Simultaneous input & state estimation, singular filtering and stability
Authors:
Mohammad Ali Abooshahab,
Mohammed M. J. Alyaseen,
Robert R. Bitmead,
Morten Hovd
Abstract:
Input estimation is a signal processing technique associated with deconvolution of measured signals after filtering through a known dynamic system. Kitanidis and others extended this to the simultaneous estimation of the input signal and the state of the intervening system. This is normally posed as a special least-squares estimation problem with unbiasedness. The approach has application in signa…
▽ More
Input estimation is a signal processing technique associated with deconvolution of measured signals after filtering through a known dynamic system. Kitanidis and others extended this to the simultaneous estimation of the input signal and the state of the intervening system. This is normally posed as a special least-squares estimation problem with unbiasedness. The approach has application in signal analysis and in control. Despite the connection to optimal estimation, the standard algorithms are not necessarily stable, leading to a number of recent papers which present sufficient conditions for stability. In this paper we complete these stability results in two ways in the time-invariant case: for the square case, where the number of measurements equals the number of unknown inputs, we establish exactly the location of the algorithm poles; for the non-square case, we show that the best sufficient conditions are also necessary. We then draw on our previous results interpreting these algorithms, when stable, as singular Kalman filters to advocate a direct, guaranteed stable implementation via Kalman filtering. This has the advantage of clarity and flexibility in addition to stability. En route, we decipher the existing algorithms in terms of system inversion and successive singular filtering. The stability results are extended to the time-varying case directly to recover the earlier sufficient conditions for stability via the Riccati difference equation.
△ Less
Submitted 20 August, 2020;
originally announced August 2020.
-
LQG Control Performance with Low Bitrate Periodic Coding
Authors:
Behrooz Amini,
Robert R. Bitmead
Abstract:
Specific low-bitrate coding strategies are examined through their effect on LQ control performance. By limiting the subject to these methods, we are able to identify principles underlying coding for control; a subject of significant recent interest but few tangible results. In particular, we consider coding the quantized output signal deploying period-two codes of differing delay-versus-accuracy t…
▽ More
Specific low-bitrate coding strategies are examined through their effect on LQ control performance. By limiting the subject to these methods, we are able to identify principles underlying coding for control; a subject of significant recent interest but few tangible results. In particular, we consider coding the quantized output signal deploying period-two codes of differing delay-versus-accuracy tradeoff. The quantification of coding performance is via the LQ control cost. The feedback control system comprises the coder-decoder in the path between the output and the state estimator, which is followed by linear state-variable feedback, as is optimal in the memoryless case. The quantizer is treated as the functional composition of an infinitely-long linear staircase function and a saturation. This permits the analysis to subdivide into estimator computations, seemingly independent of the control performance criterion, and an escape time evaluation, which ties the control back into the choice of quantizer saturation bound. An example is studied which illustrates the role of the control objective in determining the efficacy of coding using these schemes. The results mesh well with those observed in signal coding. However, the introduction of a realization-based escape time is a novelty departing significantly from mean square computations.
△ Less
Submitted 7 April, 2020;
originally announced April 2020.
-
Forward-looking persistent excitation in model predictive control
Authors:
Sven Brüggemann,
Robert R. Bitmead
Abstract:
This work deals with the problem of simultaneous regulation and model parameter estimation in adaptive model predictive control. We propose an adaptive model predictive control and conditions which guarantee a persistently exciting closed loop sequence by only looking forward in time into the receding prediction horizon. Earlier works needed to look backwards and preserve prior regressor data. Ins…
▽ More
This work deals with the problem of simultaneous regulation and model parameter estimation in adaptive model predictive control. We propose an adaptive model predictive control and conditions which guarantee a persistently exciting closed loop sequence by only looking forward in time into the receding prediction horizon. Earlier works needed to look backwards and preserve prior regressor data. Instead, we present a procedure for the offline generation of a persistently exciting reference trajectory perturbing the equilibrium. With the new approach we demonstrate exponential convergence of nonlinear systems under the influence of the adaptive model predictive control combined with a recursive least squares identifier with forgetting factor despite bounded noise. The results are, at this stage, local in state and parameter-estimate space.
△ Less
Submitted 18 November, 2021; v1 submitted 3 April, 2020;
originally announced April 2020.
-
Exponential convergence of recursive least squares with forgetting factor for multiple-output systems
Authors:
Sven Brüggemann,
Robert R. Bitmead
Abstract:
We extend results of the recursive-least-squares-with-forgetting-factor identifier for single-input-single-output systems to the multiple-output case by, under the assumption of persistence of excitation, deriving the corresponding minimized objective function and by showing exponential convergence of the estimation error.
We extend results of the recursive-least-squares-with-forgetting-factor identifier for single-input-single-output systems to the multiple-output case by, under the assumption of persistence of excitation, deriving the corresponding minimized objective function and by showing exponential convergence of the estimation error.
△ Less
Submitted 16 March, 2020;
originally announced March 2020.
-
Quantized Innovations Bayesian Filtering
Authors:
Chun-Chia Huang,
Robert R. Bitmead
Abstract:
The paper provides simple formulas of Bayesian filtering for the exact recursive computation of state conditional probability density functions given quantized innovations signal measurements of a linear stochastic system. This is a topic of current interest because the innovations signal should be white and therefore efficient in its use of channel capacity and in the design and optimization of t…
▽ More
The paper provides simple formulas of Bayesian filtering for the exact recursive computation of state conditional probability density functions given quantized innovations signal measurements of a linear stochastic system. This is a topic of current interest because the innovations signal should be white and therefore efficient in its use of channel capacity and in the design and optimization of the quantizer. Earlier approaches, which we reexamine and characterize here, have relied on assumptions concerning densities or approximations to yield recursive solutions, which include the sign-of-innovations Kalman filter and a Particle filtering technique. Our approach uses the Kalman filter innovations at the transmitter side and provides a point of comparison for the other methods, since it is based on the Bayesian filter. Computational examples are provided.
△ Less
Submitted 9 April, 2017;
originally announced April 2017.
-
Subspace Identification with Multiple Data Records: unlocking the archive
Authors:
Chad M. Holcomb,
Robert R. Bitmead
Abstract:
We develop an approach to subspace system identification using multiple data records and present a simple rank-based test for the adequacy of these data for fitting the unique linear, noise-free, dynamic model of prescribed state-vector, input-vector and output-vector dimensions. The approach is motivated by the prospect of sorting through archives of operational data and extracting a sequence of…
▽ More
We develop an approach to subspace system identification using multiple data records and present a simple rank-based test for the adequacy of these data for fitting the unique linear, noise-free, dynamic model of prescribed state-vector, input-vector and output-vector dimensions. The approach is motivated by the prospect of sorting through archives of operational data and extracting a sequence of not-necessarily-contiguous data records individually insufficient for providing identifiability but collectively making this possible. The test of identifiability then becomes the sorting criterion for accepting or rejecting new data records. En passant, the familiar Hankel structure of the data matrices of subspace system identification is reinterpreted and revised.
△ Less
Submitted 9 April, 2017;
originally announced April 2017.
