-
Model uncertainty estimation using the expectation maximization algorithm and a particle flow filter
Authors:
María Magdalena Lucini,
Peter Jan van Leeuwen,
Manuel Pulido
Abstract:
Model error covariances play a central role in the performance of data assimilation methods applied to nonlinear state-space models. However, these covariances are largely unknown in most of the applications. A misspecification of the model error covariance has a strong impact on the computation of the posterior probability density function, leading to unreliable estimations and even to a total fa…
▽ More
Model error covariances play a central role in the performance of data assimilation methods applied to nonlinear state-space models. However, these covariances are largely unknown in most of the applications. A misspecification of the model error covariance has a strong impact on the computation of the posterior probability density function, leading to unreliable estimations and even to a total failure of the assimilation procedure. In this work, we propose the combination of the Expectation-Maximization algorithm (EM) with an efficient particle filter to estimate the model error covariance, using a batch of observations. Based on the EM algorithm principles, the proposed method encompasses two stages: the expectation stage, in which a particle filter is used with the present estimate of the model error covariance as given to find the probability density function that maximizes the likelihood, followed by a maximization stage in which the expectation under the probability density function found in the expectation step is maximized as a function of the elements of the model error covariance. This novel algorithm here presented combines the EM with a fixed point algorithm and does not require a particle smoother to approximate the posterior densities. We demonstrate that the new method accurately and efficiently solves the linear model problem. Furthermore, for the chaotic nonlinear Lorenz-96 model the method is stable even for observation error covariance 10 times larger than the estimated model error covariance matrix, and also that it is successful in high-dimensional situations where the dimension of the estimated matrix is 1600.
△ Less
Submitted 4 November, 2019;
originally announced November 2019.
-
Comments on "Detecting Outliers in Gamma Distribution" by M. Jabbari Nooghabi et al. (2010)
Authors:
M. Magdalena Lucini,
Alejandro C. Frery
Abstract:
This note shows that the results presented by Jabbari Nooghabi et al. (2010) do not hold in all expected cases. With this, the technique proposed by Kumar and Lalhita (2012) for detecting upper outliers in Gamma samples is also not valid. Specifically, this note shows that the probability density functions (pdf) under the null hypothesis of the test statistics therein proposed are not always valid…
▽ More
This note shows that the results presented by Jabbari Nooghabi et al. (2010) do not hold in all expected cases. With this, the technique proposed by Kumar and Lalhita (2012) for detecting upper outliers in Gamma samples is also not valid. Specifically, this note shows that the probability density functions (pdf) under the null hypothesis of the test statistics therein proposed are not always valid.
△ Less
Submitted 16 September, 2015;
originally announced September 2015.
-
Parameter Estimation in SAR Imagery using Stochastic Distances and Asymmetric Kernels
Authors:
Juliana Gambini,
Julia Cassetti,
María Magdalena Lucini,
Alejandro C. Frery
Abstract:
In this paper we analyze several strategies for the estimation of the roughness parameter of the $\mathcal G_I^0$ distribution. It has been shown that this distribution is able to characterize a large number of targets in monopolarized SAR imagery, deserving the denomination of "Universal Model" It is indexed by three parameters: the number of looks (which can be estimated in the whole image), a s…
▽ More
In this paper we analyze several strategies for the estimation of the roughness parameter of the $\mathcal G_I^0$ distribution. It has been shown that this distribution is able to characterize a large number of targets in monopolarized SAR imagery, deserving the denomination of "Universal Model" It is indexed by three parameters: the number of looks (which can be estimated in the whole image), a scale parameter, and the roughness or texture parameter. The latter is closely related to the number of elementary backscatters in each pixel, one of the reasons for receiving attention in the literature. Although there are efforts in providing improved and robust estimates for such quantity, its dependable estimation still poses numerical problems in practice. We discuss estimators based on the minimization of stochastic distances between empirical and theoretical densities, and argue in favor of using an estimator based on the Triangular distance and asymmetric kernels built with Inverse Gaussian densities. We also provide new results regarding the heavytailedness of this distribution.
△ Less
Submitted 4 August, 2014; v1 submitted 1 August, 2014;
originally announced August 2014.
-
Sampling Spatially Correlated Clutter
Authors:
O. H. Bustos,
A. G. Flesia,
A. C. Frery,
M. M. Lucini
Abstract:
Correlated ${\cal G}$ distributions can be used to describe the clutter seen in images obtained with coherent illumination, as is the case of B-scan ultrasound, laser, sonar and synthetic aperture radar (SAR) imagery. These distributions are derived using the square root of the generalized inverse Gaussian distribution for the amplitude backscatter within the multiplicative model. A two-paramete…
▽ More
Correlated ${\cal G}$ distributions can be used to describe the clutter seen in images obtained with coherent illumination, as is the case of B-scan ultrasound, laser, sonar and synthetic aperture radar (SAR) imagery. These distributions are derived using the square root of the generalized inverse Gaussian distribution for the amplitude backscatter within the multiplicative model. A two-parameters particular case of the amplitude ${\mathcal G}$ distribution, called ${\mathcal G}_{A}^{0}$, constitutes a modeling improvement with respect to the widespread ${\mathcal K}_{A}$ distribution when fitting urban, forested and deforested areas in remote sensing data. This article deals with the modeling and the simulation of correlated ${\mathcal G}_{A}^{0}$-distributed random fields. It is accomplished by means of the Inverse Transform method, applied to Gaussian random fields with spatial correlation. The main feature of this approach is its generality, since it allows the introduction of negative correlation values in the resulting process, necessary for the proper explanation of the shadowing effect in many SAR images.
△ Less
Submitted 3 June, 2008;
originally announced June 2008.
