-
Damped Posterior Linearization Filter
Authors:
Matti Raitoharju,
Lennart Svensson,
Ángel F. García-Fernández,
Robert Piché
Abstract:
The iterated posterior linearization filter (IPLF) is an algorithm for Bayesian state estimation that performs the measurement update using iterative statistical regression. The main result behind IPLF is that the posterior approximation is more accurate when the statistical regression of measurement function is done in the posterior instead of the prior as is done in non-iterative Kalman filter e…
▽ More
The iterated posterior linearization filter (IPLF) is an algorithm for Bayesian state estimation that performs the measurement update using iterative statistical regression. The main result behind IPLF is that the posterior approximation is more accurate when the statistical regression of measurement function is done in the posterior instead of the prior as is done in non-iterative Kalman filter extensions. In IPLF, each iteration in principle gives a better posterior estimate to obtain a better statistical regression and more accurate posterior estimate in the next iteration. However, IPLF may diverge. IPLF's fixed- points are not described as solutions to an optimization problem, which makes it challenging to improve its convergence properties. In this letter, we introduce a double-loop version of IPLF, where the inner loop computes the posterior mean using an optimization algorithm. Simulation results are presented to show that the proposed algorithm has better convergence than IPLF and its accuracy is similar to or better than other state-of-the-art algorithms.
△ Less
Submitted 16 February, 2018; v1 submitted 4 April, 2017;
originally announced April 2017.
-
Kullback-Leibler Divergence Approach to Partitioned Update Kalman Filter
Authors:
Matti Raitoharju,
Ángel F. García-Fernández,
Robert Piché
Abstract:
Kalman filtering is a widely used framework for Bayesian estimation. The partitioned update Kalman filter applies a Kalman filter update in parts so that the most linear parts of measurements are applied first. In this paper, we generalize partitioned update Kalman filter, which requires the use oft the second order extended Kalman filter, so that it can be used with any Kalman filter extension. T…
▽ More
Kalman filtering is a widely used framework for Bayesian estimation. The partitioned update Kalman filter applies a Kalman filter update in parts so that the most linear parts of measurements are applied first. In this paper, we generalize partitioned update Kalman filter, which requires the use oft the second order extended Kalman filter, so that it can be used with any Kalman filter extension. To do so, we use a Kullback-Leibler divergence approach to measure the nonlinearity of the measurement, which is theoretically more sound than the nonlinearity measure used in the original partitioned update Kalman filter. Results show that the use of the proposed partitioned update filter improves the estimation accuracy.
△ Less
Submitted 15 March, 2016;
originally announced March 2016.
-
On Computational Complexity Reduction Methods for Kalman Filter Extensions
Authors:
Matti Raitoharju,
Robert Piché
Abstract:
The Kalman filter and its extensions are used in a vast number of aerospace and navigation applications for nonlinear state estimation of time series. In the literature, different approaches have been proposed to exploit the structure of the state and measurement models to reduce the computational demand of the algorithms. In this tutorial, we survey existing code optimization methods and present…
▽ More
The Kalman filter and its extensions are used in a vast number of aerospace and navigation applications for nonlinear state estimation of time series. In the literature, different approaches have been proposed to exploit the structure of the state and measurement models to reduce the computational demand of the algorithms. In this tutorial, we survey existing code optimization methods and present them using unified notation that allows them to be used with various Kalman filter extensions. We develop the optimization methods to cover a wider range of models, show how different structural optimizations can be combined, and present new applications for the existing optimizations. Furthermore, we present an example that shows that the exploitation of the structure of the problem can lead to improved estimation accuracy while reducing the computational load. This tutorial is intended for persons who are familiar with Kalman filtering and want to get insights for reducing the computational demand of different Kalman filter extensions.
△ Less
Submitted 10 October, 2019; v1 submitted 8 December, 2015;
originally announced December 2015.
-
Partitioned Update Kalman Filter
Authors:
Matti Raitoharju,
Robert Piché,
Juha Ala-Luhtala,
Simo Ali-Löytty
Abstract:
In this paper we present a new Kalman filter extension for state update called Partitioned Update Kalman Filter (PUKF). PUKF updates the state using multidimensional measurements in parts. PUKF evaluates the nonlinearity of the measurement function within a Gaussian prior by comparing the effect of the 2nd order term on the Gaussian measurement noise. A linear transformation is applied to measurem…
▽ More
In this paper we present a new Kalman filter extension for state update called Partitioned Update Kalman Filter (PUKF). PUKF updates the state using multidimensional measurements in parts. PUKF evaluates the nonlinearity of the measurement function within a Gaussian prior by comparing the effect of the 2nd order term on the Gaussian measurement noise. A linear transformation is applied to measurements to minimize the nonlinearity of a part of the measurement. The measurement update is then applied using only the part of the measurement that has low nonlinearity and the process is then repeated for the updated state using the remaining part of the transformed measurement until the whole measurement has been used. PUKF does the linearizations numerically and no analytical differentiation is required. Results show that when the measurement geometry allows effective partitioning, the proposed algorithm improves estimation accuracy and produces accurate covariance estimates.
△ Less
Submitted 13 March, 2016; v1 submitted 10 March, 2015;
originally announced March 2015.
-
Bayesian Hierarchical Model of Total Variation Regularisation for Image Deblurring
Authors:
Marko Järvenpää,
Robert Piché
Abstract:
A Bayesian hierarchical model for total variation regularisation is presented in this paper. All the parameters of an inverse problem, including the "regularisation parameter", are estimated simultaneously from the data in the model. The model is based on the characterisation of the Laplace density prior as a scale mixture of Gaussians. With different priors on the mixture variable, other total va…
▽ More
A Bayesian hierarchical model for total variation regularisation is presented in this paper. All the parameters of an inverse problem, including the "regularisation parameter", are estimated simultaneously from the data in the model. The model is based on the characterisation of the Laplace density prior as a scale mixture of Gaussians. With different priors on the mixture variable, other total variation like regularisations e.g. a prior that is related to t-distribution, are also obtained. An approximation of the resulting posterior mean is found using a variational Bayes method. In addition, an iterative alternating sequential algorithm for computing the maximum a posteriori estimate is presented. The methods are illustrated with examples of image deblurring. Results show that the proposed model can be used for automatic edge-preserving inversion in the case of image deblurring. Despite promising results, some difficulties with the model were encountered and are subject to future work.
△ Less
Submitted 14 December, 2014;
originally announced December 2014.
-
Gaussian filtering and variational approximations for Bayesian smoothing in continuous-discrete stochastic dynamic systems
Authors:
Juha Ala-Luhtala,
Simo Särkkä,
Robert Piché
Abstract:
The Bayesian smoothing equations are generally intractable for systems described by nonlinear stochastic differential equations and discrete-time measurements. Gaussian approximations are a computationally efficient way to approximate the true smoothing distribution. In this work, we present a comparison between two Gaussian approximation methods. The Gaussian filtering based Gaussian smoother use…
▽ More
The Bayesian smoothing equations are generally intractable for systems described by nonlinear stochastic differential equations and discrete-time measurements. Gaussian approximations are a computationally efficient way to approximate the true smoothing distribution. In this work, we present a comparison between two Gaussian approximation methods. The Gaussian filtering based Gaussian smoother uses a Gaussian approximation for the filtering distribution to form an approximation for the smoothing distribution. The variational Gaussian smoother is based on minimizing the Kullback-Leibler divergence of the approximate smoothing distribution with respect to the true distribution. The results suggest that for highly nonlinear systems, the variational Gaussian smoother can be used to iteratively improve the Gaussian filtering based smoothing solution. We also present linearization and sigma-point methods to approximate the intractable Gaussian expectations in the Variational Gaussian smoothing equations. In addition, we extend the variational Gaussian smoother for certain class of systems with singular diffusion matrix.
△ Less
Submitted 23 July, 2014; v1 submitted 22 July, 2014;
originally announced July 2014.
-
On the Parametric Instability Caused by Step Size Variation in Runge-Kutta-Nyström Methods
Authors:
Robert Piché
Abstract:
The parametric instability arising when ordinary differential equations (ODEs) are numerically integrated with Runge-Kutta-Nyström (RKN) methods with varying step sizes is investigated. It is shown that when linear constant coefficient ODEs are integrated with RKN methods that are based on A-stable Runge-Kutta methods, the solution is nonincreasing in some norm for all positive step sizes, constan…
▽ More
The parametric instability arising when ordinary differential equations (ODEs) are numerically integrated with Runge-Kutta-Nyström (RKN) methods with varying step sizes is investigated. It is shown that when linear constant coefficient ODEs are integrated with RKN methods that are based on A-stable Runge-Kutta methods, the solution is nonincreasing in some norm for all positive step sizes, constant or varying. Perturbation methods are used to quantify the critical step sizes associated with parametric instability.
△ Less
Submitted 24 September, 2012;
originally announced September 2012.
