-
Distribution Steering for Discrete-Time Uncertain Ensemble Systems
Authors:
Guangyu Wu,
Panagiotis Tsiotras,
Anders Lindquist
Abstract:
Ensemble systems appear frequently in many engineering applications and, as a result, they have become an important research topic in control theory. These systems are best characterized by the evolution of their underlying state distribution. Despite the work to date, few results exist dealing with the problem of directly modifying (i.e., "steering") the distribution of an ensemble system. In add…
▽ More
Ensemble systems appear frequently in many engineering applications and, as a result, they have become an important research topic in control theory. These systems are best characterized by the evolution of their underlying state distribution. Despite the work to date, few results exist dealing with the problem of directly modifying (i.e., "steering") the distribution of an ensemble system. In addition, in most of the existing results, the distribution of the states of an ensemble of discrete-time systems is assumed to be Gaussian. However, in case the system parameters are uncertain, it is not always realistic to assume that the distribution of the system follows a Gaussian distribution, thus complicating the solution of the overall problem. In this paper, we address the general distribution steering problem for first-order discrete-time ensemble systems, where the distributions of the system parameters and the states are arbitrary with finite first few moments. Both linear and nonlinear system dynamics are considered using the method of power moments to transform the original infinite-dimensional problem into a finite-dimensional one. We also propose a control law for the ensuing moment system, which allows us to obtain the power moments of the desired control inputs. Finally, we solve the inverse problem to obtain the feasible control inputs from their corresponding power moments. We provide numerical results to validate our theoretical developments. These include cases where the parameter distribution is uniform, Gaussian, non-Gaussian, and multi-modal, respectively.
△ Less
Submitted 20 May, 2024;
originally announced May 2024.
-
General Discrete-Time Fokker-Planck Control by Power Moments
Authors:
Guangyu Wu,
Anders Lindquist
Abstract:
In this paper, we address the so-called general Fokker-Planck control problem for discrete-time first-order linear systems. Unlike conventional treatments, we don't assume the distributions of the system states to be Gaussian. Instead, we only assume the existence and finiteness of the first several order power moments of the distributions. It is proved in the literature that there doesn't exist a…
▽ More
In this paper, we address the so-called general Fokker-Planck control problem for discrete-time first-order linear systems. Unlike conventional treatments, we don't assume the distributions of the system states to be Gaussian. Instead, we only assume the existence and finiteness of the first several order power moments of the distributions. It is proved in the literature that there doesn't exist a solution, which has a form of conventional feedback control, to this problem. We propose a moment representation of the system to turn the original problem into a finite-dimensional one. Then a novel feedback control term, which is a mixture of a feedback term and a Markovian transition kernel term is proposed to serve as the control input of the moment system. The states of the moment system are obtained by maximizing the smoothness of the state transition. The power moments of the transition kernels are obtained by a convex optimization problem, of which the solution is proved to exist and be unique. Then they are mapped back to the probability distributions. The control inputs to the original system are then obtained by sampling from the realized distributions. Simulation results are provided to validate our algorithm in treating the general discrete-time Fokker-Planck control problem.
△ Less
Submitted 28 August, 2023;
originally announced August 2023.
-
Quantitative Error Analyses of Spectral Density Estimators Using Covariance Lags
Authors:
Guangyu Wu,
Anders Lindquist
Abstract:
Spectral density estimation is a core problem of system identification, which is an important research area of system control and signal processing. There have been numerous results on the design of spectral density estimators. However to our best knowledge, quantitative error analyses of the spectral density estimation have not been proposed yet. In real practice, there are two main factors which…
▽ More
Spectral density estimation is a core problem of system identification, which is an important research area of system control and signal processing. There have been numerous results on the design of spectral density estimators. However to our best knowledge, quantitative error analyses of the spectral density estimation have not been proposed yet. In real practice, there are two main factors which induce errors in the spectral density estimation, including the external additive noise and the limited number of samples. In this paper, which is a very preliminary version, we first consider a univariate spectral density estimator using covariance lags. The estimation task is performed by a convex optimization scheme, and the covariance lags of the estimated spectral density are exactly as desired, which makes it possible for quantitative error analyses such as to derive tight error upper bounds. We analyze the errors induced by the two factors and propose upper and lower bounds for the errors. Then the results of the univariate spectral estimator are generalized to the multivariate one.
△ Less
Submitted 20 March, 2023;
originally announced March 2023.
-
General Distribution Steering: A Sub-Optimal Solution by Convex Optimization
Authors:
Guangyu Wu,
Anders Lindquist
Abstract:
General distribution steering is intrinsically an infinite-dimensional problem, when the continuous distributions to steer are arbitrary. We put forward a moment representation of the primal system for control in [42]. However, the system trajectory was a predetermined one without optimization towards a design criterion, which doesn't always ensure a most satisfactory solution. In this paper, we p…
▽ More
General distribution steering is intrinsically an infinite-dimensional problem, when the continuous distributions to steer are arbitrary. We put forward a moment representation of the primal system for control in [42]. However, the system trajectory was a predetermined one without optimization towards a design criterion, which doesn't always ensure a most satisfactory solution. In this paper, we propose an optimization approach to the general distribution steering problem of the first-order discrete-time linear system, i.e., an optimal control law for the corresponding moment system. The domain of all feasible control inputs is non-convex and has a complex topology. We obtain a subset of it by minimizing a weighted sum of squared integral distances alongside the system trajectory. The feasible domain is then proved convex, and the optimal control problem can be treated as a convex optimization or by exhaustive search, based on the type of the cost function. Algorithms of steering for continuous and discrete distributions are then put forward respectively, by adopting a realization scheme of control inputs. We also provide an explicit advantage of our proposed algorithm by truncated power moments to the prevailing Gaussian Mixture Models. Experiments on different types of cost functions are given to validate the performance of our proposed algorithm. Since the moment system is a dimension-reduced counterpart of the primal system, we call this solution a sub-optimal one to the primal general distribution steering problem.
△ Less
Submitted 30 March, 2025; v1 submitted 15 January, 2023;
originally announced January 2023.
-
A Multivariate Non-Gaussian Bayesian Filter Using Power Moments
Authors:
Guangyu Wu,
Anders Lindquist
Abstract:
In this paper, we extend our results on the univariate non-Gaussian Bayesian filter using power moments to the multivariate systems, which can be either linear or nonlinear. Doing this introduces several challenging problems, for example a positive parametrization of the density surrogate, which is not only a problem of filter design, but also one of the multiple dimensional Hamburger moment probl…
▽ More
In this paper, we extend our results on the univariate non-Gaussian Bayesian filter using power moments to the multivariate systems, which can be either linear or nonlinear. Doing this introduces several challenging problems, for example a positive parametrization of the density surrogate, which is not only a problem of filter design, but also one of the multiple dimensional Hamburger moment problem. We propose a parametrization of the density surrogate with the proofs to its existence, Positivstellensatz and uniqueness. Based on it, we analyze the errors of moments of the density estimates by the proposed density surrogate. A discussion on continuous and discrete treatments to the non-Gaussian Bayesian filtering problem is proposed to motivate the research on continuous parametrization of the system state. Simulation results on estimating different types of multivariate density functions are given to validate our proposed filter. To the best of our knowledge, the proposed filter is the first one implementing the multivariate Bayesian filter with the system state parameterized as a continuous function, which only requires the true states being Lebesgue integrable.
△ Less
Submitted 9 November, 2023; v1 submitted 23 November, 2022;
originally announced November 2022.
-
Density Steering by Power Moments
Authors:
Guangyu Wu,
Anders Lindquist
Abstract:
This paper considers the problem of steering an arbitrary initial probability density function to an arbitrary terminal one, where the system dynamics is governed by a first-order linear stochastic difference equation. It is a generalization of the conventional stochastic control problem where the uncertainty of the system state is usually characterized by a Gaussian distribution. We propose to us…
▽ More
This paper considers the problem of steering an arbitrary initial probability density function to an arbitrary terminal one, where the system dynamics is governed by a first-order linear stochastic difference equation. It is a generalization of the conventional stochastic control problem where the uncertainty of the system state is usually characterized by a Gaussian distribution. We propose to use the power moments to turn the infinite-dimensional problem into a finite-dimensional one and to present an empirical control scheme. By the designed control law, the moment sequence of the controls at each time step is positive, which ensures the existence of the control for the moment system. We then realize the control at each time step as a function in analytic form by a convex optimization scheme, for which the existence and uniqueness of the solution have been proved in our previous paper. Two numerical examples are given to validate our proposed algorithm.
△ Less
Submitted 4 July, 2023; v1 submitted 4 November, 2022;
originally announced November 2022.
-
Mode decomposition-based time-varying phase synchronization for fMRI Data
Authors:
Hamed Honari,
Martin A. Lindquist
Abstract:
Recently there has been significant interest in measuring time-varying functional connectivity (TVC) between different brain regions using resting-state functional magnetic resonance imaging (rs-fMRI) data. One way to assess the relationship between signals from different brain regions is to measure their phase synchronization (PS) across time. However, this requires the \textit{a priori} choice o…
▽ More
Recently there has been significant interest in measuring time-varying functional connectivity (TVC) between different brain regions using resting-state functional magnetic resonance imaging (rs-fMRI) data. One way to assess the relationship between signals from different brain regions is to measure their phase synchronization (PS) across time. However, this requires the \textit{a priori} choice of type and cut-off frequencies for the bandpass filter needed to perform the analysis. Here we explore alternative approaches based on the use of various mode decomposition (MD) techniques that circumvent this issue. These techniques allow for the data driven decomposition of signals jointly into narrow-band components at different frequencies, thus fulfilling the requirements needed to measure PS. We explore several variants of MD, including empirical mode decomposition (EMD), bivariate EMD (BEMD), noise-assisted multivariate EMD (na-MEMD), and introduce the use of multivariate variational mode decomposition (MVMD) in the context of estimating time-varying PS. We contrast the approaches using a series of simulations and application to rs-fMRI data. Our results show that MVMD outperforms other evaluated MD approaches, and further suggests that this approach can be used as a tool to reliably investigate time-varying PS in rs-fMRI data.
△ Less
Submitted 25 March, 2022;
originally announced March 2022.
-
Identification of Low Rank Vector Processes
Authors:
Wenqi Cao,
Giorgio Picci,
Anders Lindquist
Abstract:
We study modeling and identification of stationary processes with a spectral density matrix of low rank. Equivalently, we consider processes having an innovation of reduced dimension for which Prediction Error Methods (PEM) algorithms are not directly applicable. We show that these processes admit a special feedback structure with a deterministic feedback channel which can be used to split the ide…
▽ More
We study modeling and identification of stationary processes with a spectral density matrix of low rank. Equivalently, we consider processes having an innovation of reduced dimension for which Prediction Error Methods (PEM) algorithms are not directly applicable. We show that these processes admit a special feedback structure with a deterministic feedback channel which can be used to split the identification in two steps, one of which can be based on standard algorithms while the other is based on a deterministic least squares fit. Identifiability of the feedback system is analyzed and a unique identifiable structure is characterized. Simulations show that the proposed procedure works well in some simple examples.
△ Less
Submitted 13 January, 2023; v1 submitted 21 November, 2021;
originally announced November 2021.
-
Modeling of Low Rank Time Series
Authors:
Wenqi Cao,
Anders Lindquist,
Giorgio Picci
Abstract:
Rank-deficient stationary stochastic vector processes are present in many problems in network theory and dynamic factor analysis. In this paper we study hidden dynamical relations between the components of a discrete-time stochastic vector process and investigate their properties with respect to stability and causality. More specifically, we construct transfer functions with a full-rank input proc…
▽ More
Rank-deficient stationary stochastic vector processes are present in many problems in network theory and dynamic factor analysis. In this paper we study hidden dynamical relations between the components of a discrete-time stochastic vector process and investigate their properties with respect to stability and causality. More specifically, we construct transfer functions with a full-rank input process formed from selected components of the given vector process and having a vector process of the remaining components as output. An important question, which we answer in the negative, is whether it is always possible to find such a deterministic relation that is stable. If it is unstable, there must be feedback from output to input ensuring that stationarity is maintained. This leads to connections to robust control. We also show how our results could be used to investigate the structure of dynamic network models and the latent low-rank stochastic process in a dynamic factor model.
△ Less
Submitted 13 April, 2023; v1 submitted 24 September, 2021;
originally announced September 2021.
-
Modeling and Identification of Low Rank Vector Processes
Authors:
Giorgio Picci,
Wenqi Cao,
Anders Lindquist
Abstract:
We study modeling and identification of processes with a spectral density matrix of low rank. Equivalently, we consider processes having an innovation of reduced dimension for which Prediction Error Methods (PEM) algorithms are not directly applicable. We show that these processes admit a special feedback structure with a deterministic feedback channel which can be used to split the identification…
▽ More
We study modeling and identification of processes with a spectral density matrix of low rank. Equivalently, we consider processes having an innovation of reduced dimension for which Prediction Error Methods (PEM) algorithms are not directly applicable. We show that these processes admit a special feedback structure with a deterministic feedback channel which can be used to split the identification in two steps, one of which can be based on standard algorithms while the other is based on a deterministic least squares fit.
△ Less
Submitted 10 May, 2021; v1 submitted 9 December, 2020;
originally announced December 2020.
-
On analytic interpolation with non-classical constraints for solving problems in robust control
Authors:
Axel Ringh,
Johan Karlsson,
Anders Lindquist
Abstract:
In this work we consider robust stabilization of uncertain dynamical systems and show that this can be achieved by solving a non-classically constrained analytic interpolation problem. In particular, this non-classical constraint confines the range of the interpolant, when evaluated on the imaginary axis, to a frequency-dependent set. By considering a sufficient condition for when this interpolati…
▽ More
In this work we consider robust stabilization of uncertain dynamical systems and show that this can be achieved by solving a non-classically constrained analytic interpolation problem. In particular, this non-classical constraint confines the range of the interpolant, when evaluated on the imaginary axis, to a frequency-dependent set. By considering a sufficient condition for when this interpolation problem has a solution, we derive an approximate solution algorithm that can also be used for controller synthesis. Finally, the theory is illustrated on a numerical example with a plant with uncertain gain, phase, and output delay.
△ Less
Submitted 26 October, 2020;
originally announced October 2020.
-
Evaluating phase synchronization methods in fMRI: a comparison study and new approaches
Authors:
Hamed Honari,
Ann S. Choe,
Martin A. Lindquist
Abstract:
In recent years there has been growing interest in measuring time-varying functional connectivity between different brain regions using resting-state functional magnetic resonance imaging (rs-fMRI) data. One way to assess the relationship between signals from different brain regions is to measure their phase synchronization (PS) across time. There are several ways to perform such analyses, and her…
▽ More
In recent years there has been growing interest in measuring time-varying functional connectivity between different brain regions using resting-state functional magnetic resonance imaging (rs-fMRI) data. One way to assess the relationship between signals from different brain regions is to measure their phase synchronization (PS) across time. There are several ways to perform such analyses, and here we compare methods that utilize a PS metric together with a sliding window, referred to here as windowed phase synchronization (WPS), with those that directly measure the instantaneous phase synchronization (IPS). In particular, IPS has recently gained popularity as it offers single time-point resolution of time-resolved fMRI connectivity. In this paper, we discuss the underlying assumptions required for performing PS analyses and emphasize the necessity of band-pass filtering the data to obtain valid results. We review various methods for evaluating PS and introduce a new approach within the IPS framework denoted the cosine of the relative phase (CRP). We contrast methods through a series of simulations and application to rs-fMRI data. Our results indicate that CRP outperforms other tested methods and overcomes issues related to undetected temporal transitions from positive to negative associations common in IPS analysis. Further, in contrast to phase coherence, CRP unfolds the distribution of PS measures, which benefits subsequent clustering of PS matrices into recurring brain states.
△ Less
Submitted 21 September, 2020;
originally announced September 2020.
-
On a Fejer-Riesz factorization of generalized trigonometric polynomials
Authors:
Tryphon T. Georgiou,
Anders Lindquist
Abstract:
Function theory on the unit disc proved key to a range of problems in statistics, probability theory, signal processing literature, and applications, and in this, a special place is occupied by trigonometric functions and the Fejer-Riesz theorem that non-negative trigonometric polynomials can be expressed as the modulus of a polynomial of the same degree evaluated on the unit circle. In the presen…
▽ More
Function theory on the unit disc proved key to a range of problems in statistics, probability theory, signal processing literature, and applications, and in this, a special place is occupied by trigonometric functions and the Fejer-Riesz theorem that non-negative trigonometric polynomials can be expressed as the modulus of a polynomial of the same degree evaluated on the unit circle. In the present note we consider a natural generalization of non-negative trigonometric polynomials that are matrix-valued with specified non-trivial poles (i.e., other than at the origin or at infinity). We are interested in the corresponding spectral factors and, specifically, we show that the factorization of trigonometric polynomials can be carried out in complete analogy with the Fejer-Riesz theorem. The affinity of the factorization with the Fejer-Riesz theorem and the contrast to classical spectral factorization lies in the fact that the spectral factors have degree smaller than what standard construction in factorization theory would suggest. We provide two juxtaposed proofs of this fundamental theorem, albeit for the case of strict positivity, one that relies on analytic interpolation theory and another that utilizes classical factorization theory based on the Yacubovich-Popov-Kalman (YPK) positive-real lemma.
△ Less
Submitted 25 May, 2020;
originally announced May 2020.
-
Spectral Rank, Feedback, Causality and the Indirect Method for CARMA Identification
Authors:
Wenqi Cao,
Anders Lindquist,
Giorgio Picci
Abstract:
Building on a recent paper by Georgiou and Lindquist [1] on the problem of rank deficiency of spectral densities and hidden dynamical relations after sampling of continuous-time stochastic processes, this paper is devoted to understanding related questions of feedback and Granger causality that affect stability properties. This then naturally connects to CARMA identification, where we remark on ce…
▽ More
Building on a recent paper by Georgiou and Lindquist [1] on the problem of rank deficiency of spectral densities and hidden dynamical relations after sampling of continuous-time stochastic processes, this paper is devoted to understanding related questions of feedback and Granger causality that affect stability properties. This then naturally connects to CARMA identification, where we remark on certain oversights in the literature.
△ Less
Submitted 7 June, 2020; v1 submitted 6 April, 2020;
originally announced April 2020.
-
An analytic interpolation approach to stability margins with emphasis on time delay
Authors:
Axel Ringh,
Johan Karlsson,
Anders Lindquist
Abstract:
Unlike the situation with gain and phase margins in robust stabilization, the problem to determine an exact maximum delay margin is still an open problem, although extensive work has been done to establish upper and lower bounds. The problem is that the corresponding constraints in the Nyquist plot are frequency dependent, and encircling the point $s=-1$ has to be done at sufficiently low frequenc…
▽ More
Unlike the situation with gain and phase margins in robust stabilization, the problem to determine an exact maximum delay margin is still an open problem, although extensive work has been done to establish upper and lower bounds. The problem is that the corresponding constraints in the Nyquist plot are frequency dependent, and encircling the point $s=-1$ has to be done at sufficiently low frequencies, as the possibility to do so closes at higher frequencies. In this paper we present a new method for determining a sharper lower bound by introducing a frequency-dependent shift. The problem of finding such a bound simultaneously with gain and phase margin constraints is also considered. In all these problems we take an analytic interpolation approach.
△ Less
Submitted 26 October, 2020; v1 submitted 18 December, 2019;
originally announced December 2019.
-
Automatic Identification of Twin Zygosity in Resting-State Functional MRI
Authors:
Andrey Gritsenko,
Martin A. Lindquist,
Gregory R. Kirk,
Moo K. Chung
Abstract:
A key strength of twin studies arises from the fact that there are two types of twins, monozygotic and dizygotic, that share differing amounts of genetic information. Accurate differentiation of twin types allows efficient inference on genetic influences in a population. However, identification of zygosity is often prone to errors without genotying. In this study, we propose a novel pairwise featu…
▽ More
A key strength of twin studies arises from the fact that there are two types of twins, monozygotic and dizygotic, that share differing amounts of genetic information. Accurate differentiation of twin types allows efficient inference on genetic influences in a population. However, identification of zygosity is often prone to errors without genotying. In this study, we propose a novel pairwise feature representation to classify the zygosity of twin pairs of resting state functional magnetic resonance images (rs-fMRI). For this, we project an fMRI signal to a set of basis functions and use the projection coefficients as the compact and discriminative feature representation of noisy fMRI. We encode the relationship between twins as the correlation between the new feature representations across brain regions. We employ hill climbing variable selection to identify brain regions that are the most genetically affected. The proposed framework was applied to 208 twin pairs and achieved 94.19% classification accuracy in automatically identifying the zygosity of paired images.
△ Less
Submitted 26 October, 2018; v1 submitted 30 June, 2018;
originally announced July 2018.
-
Dynamic relations in sampled processes
Authors:
Tryphon T. Georgiou,
Anders Lindquist
Abstract:
Linear dynamical relations that may exist in continuous-time, or at some natural sampling rate, are not directly discernable at reduced observational sampling rates. Indeed, at reduced rates, matricial spectral densities of vectorial time series have maximal rank and thereby cannot be used to ascertain potential dynamic relations between their entries. This hitherto undeclared source of inaccuraci…
▽ More
Linear dynamical relations that may exist in continuous-time, or at some natural sampling rate, are not directly discernable at reduced observational sampling rates. Indeed, at reduced rates, matricial spectral densities of vectorial time series have maximal rank and thereby cannot be used to ascertain potential dynamic relations between their entries. This hitherto undeclared source of inaccuracies appears to plague off-the-shelf identification techniques seeking remedy in hypothetical observational noise. In this paper we explain the exact relation between stochastic models at different sampling rates and show how to construct stochastic models at the finest time scale that data allows. We then point out that the correct number of dynamical dependences can only be ascertained by considering stochastic models at this finest time scale, which in general is faster than the observational sampling rate.
△ Less
Submitted 24 July, 2018; v1 submitted 5 May, 2018;
originally announced May 2018.
-
Lower bounds on the maximum delay margin by analytic interpolation
Authors:
Axel Ringh,
Johan Karlsson,
Anders Lindquist
Abstract:
We study the delay margin problem in the context of recent works by T. Qi, J. Zhu, and J. Chen, where a sufficient condition for the maximal delay margin is formulated in terms of an interpolation problem obtained after introducing a rational approximation. Instead we omit the approximation step and solve the same problem directly using techniques from function theory and analytic interpolation. F…
▽ More
We study the delay margin problem in the context of recent works by T. Qi, J. Zhu, and J. Chen, where a sufficient condition for the maximal delay margin is formulated in terms of an interpolation problem obtained after introducing a rational approximation. Instead we omit the approximation step and solve the same problem directly using techniques from function theory and analytic interpolation. Furthermore, we introduce a constant shift in the domain of the interpolation problem. In this way we are able to improve on their lower bound for the maximum delay margin.
△ Less
Submitted 30 August, 2018; v1 submitted 26 March, 2018;
originally announced March 2018.
-
Likelihood Analysis of Power Spectra and Generalized Moment Problems
Authors:
Tryphon T. Georgiou,
Anders Lindquist
Abstract:
We develop an approach to spectral estimation that has been advocated by Ferrante, Masiero and Pavon and, in the context of the scalar-valued covariance extension problem, by Enqvist and Karlsson. The aim is to determine the power spectrum that is consistent with given moments and minimizes the relative entropy between the probability law of the underlying Gaussian stochastic process to that of a…
▽ More
We develop an approach to spectral estimation that has been advocated by Ferrante, Masiero and Pavon and, in the context of the scalar-valued covariance extension problem, by Enqvist and Karlsson. The aim is to determine the power spectrum that is consistent with given moments and minimizes the relative entropy between the probability law of the underlying Gaussian stochastic process to that of a prior. The approach is analogous to the framework of earlier work by Byrnes, Georgiou and Lindquist and can also be viewed as a generalization of the classical work by Burg and Jaynes on the maximum entropy method. In the present paper we present a new fast algorithm in the general case (i.e., for general Gaussian priors) and show that for priors with a specific structure the solution can be given in closed form.
△ Less
Submitted 11 May, 2016;
originally announced May 2016.
-
Optimal estimation with missing observations via balanced time-symmetric stochastic models
Authors:
Tryphon T. Georgiou,
Anders Lindquist
Abstract:
We consider data fusion for the purpose of smoothing and interpolation based on observation records with missing data. Stochastic processes are generated by linear stochastic models. The paper begins by drawing a connection between time reversal in stochastic systems and all-pass extensions. A particular normalization (choice of basis) between the two time-directions allows the two to share the sa…
▽ More
We consider data fusion for the purpose of smoothing and interpolation based on observation records with missing data. Stochastic processes are generated by linear stochastic models. The paper begins by drawing a connection between time reversal in stochastic systems and all-pass extensions. A particular normalization (choice of basis) between the two time-directions allows the two to share the same orthonormalized state process and simplifies the mathematics of data fusion. In this framework we derive symmetric and balanced Mayne-Fraser-like formulas that apply simultaneously to smoothing and interpolation.
△ Less
Submitted 18 August, 2015; v1 submitted 20 March, 2015;
originally announced March 2015.
-
On time-reversibility of linear stochastic models
Authors:
Tryphon T. Georgiou,
Anders Lindquist
Abstract:
Reversal of the time direction in stochastic systems driven by white noise has been central throughout the development of stochastic realization theory, filtering and smoothing. Similar ideas were developed in connection with certain problems in the theory of moments, where a duality induced by time reversal was introduced to parametrize solutions. In this latter work it was shown that stochastic…
▽ More
Reversal of the time direction in stochastic systems driven by white noise has been central throughout the development of stochastic realization theory, filtering and smoothing. Similar ideas were developed in connection with certain problems in the theory of moments, where a duality induced by time reversal was introduced to parametrize solutions. In this latter work it was shown that stochastic systems driven by arbitrary second-order stationary processes can be similarly time-reversed. By combining these two sets of ideas we present herein a generalization of time-reversal in stochastic realization theory.
△ Less
Submitted 31 August, 2013;
originally announced September 2013.
-
The Separation Principle in Stochastic Control, Redux
Authors:
Tryphon T. Georgiou,
Anders Lindquist
Abstract:
Over the last 50 years a steady stream of accounts have been written on the separation principle of stochastic control. Even in the context of the linear-quadratic regulator in continuous time with Gaussian white noise, subtle difficulties arise, unexpected by many, that are often overlooked. In this paper we propose a new framework for establishing the separation principle. This approach takes th…
▽ More
Over the last 50 years a steady stream of accounts have been written on the separation principle of stochastic control. Even in the context of the linear-quadratic regulator in continuous time with Gaussian white noise, subtle difficulties arise, unexpected by many, that are often overlooked. In this paper we propose a new framework for establishing the separation principle. This approach takes the viewpoint that stochastic systems are well-defined maps between sample paths rather than stochastic processes per se and allows us to extend the separation principle to systems driven by martingales with possible jumps. While the approach is more in line with "real-life" engineering thinking where signals travel around the feedback loop, it is unconventional from a probabilistic point of view in that control laws for which the feedback equations are satisfied almost surely, and not deterministically for every sample path, are excluded.
△ Less
Submitted 5 May, 2012; v1 submitted 15 March, 2011;
originally announced March 2011.
