Showing 1–2 of 2 results for author: Mbalawata, I S
-
Moment Conditions for Convergence of Particle Filters with Unbounded Importance Weights
Authors:
Isambi S. Mbalawata,
Simo Särkkä
Abstract:
In this paper, we derive moment conditions for particle filter importance weights, which ensure that the particle filter estimates of the expectations of bounded Borel functions converge in mean square and $L^4$ sense, and that the empirical measure of the particle filter converges weakly to the true filtering measure. The result extends the previously derived conditions by not requiring the bound…
▽ More
In this paper, we derive moment conditions for particle filter importance weights, which ensure that the particle filter estimates of the expectations of bounded Borel functions converge in mean square and $L^4$ sense, and that the empirical measure of the particle filter converges weakly to the true filtering measure. The result extends the previously derived conditions by not requiring the boundedness of the importance weights, but only boundedness of second or fourth order moments. We show that the boundedness of the second order moments of the weights implies the convergence of the estimates bounded functions in the mean square sense, and the $L^4$ convergence as well as the empirical measure convergence are assured by the boundedness of the fourth order moments of the weights. We also present an example class of models and importance distributions where the moment conditions hold, but the boundedness does not. The unboundedness in these models is caused by point-singularities in the weights which still leave the weight moments bounded. We show by using simulated data that the particle filter for this kind of model also performs well in practice.
△ Less
Submitted 18 August, 2014; v1 submitted 26 March, 2014;
originally announced March 2014.
-
Adaptive Metropolis Algorithm Using Variational Bayesian Adaptive Kalman Filter
Authors:
Isambi S. Mbalawata,
Simo Särkkä,
Matti Vihola,
Heikki Haario
Abstract:
Markov chain Monte Carlo (MCMC) methods are powerful computational tools for analysis of complex statistical problems. However, their computational efficiency is highly dependent on the chosen proposal distribution, which is generally difficult to find. One way to solve this problem is to use adaptive MCMC algorithms which automatically tune the statistics of a proposal distribution during the MCM…
▽ More
Markov chain Monte Carlo (MCMC) methods are powerful computational tools for analysis of complex statistical problems. However, their computational efficiency is highly dependent on the chosen proposal distribution, which is generally difficult to find. One way to solve this problem is to use adaptive MCMC algorithms which automatically tune the statistics of a proposal distribution during the MCMC run. A new adaptive MCMC algorithm, called the variational Bayesian adaptive Metropolis (VBAM) algorithm, is developed. The VBAM algorithm updates the proposal covariance matrix using the variational Bayesian adaptive Kalman filter (VB-AKF). A strong law of large numbers for the VBAM algorithm is proven. The empirical convergence results for three simulated examples and for two real data examples are also provided.
△ Less
Submitted 1 October, 2014; v1 submitted 27 August, 2013;
originally announced August 2013.