-
Stone Soup: ADS-B-based Multi-Target Tracking with Stochastic Integration Filter
Authors:
John Hiles,
Jakub Matousek,
Erik Blasch,
Ruixin Niu,
Ondrej Straka,
Jindrich Dunik
Abstract:
This paper focuses on the multi-target tracking using the Stone Soup framework. In particular, we aim at evaluation of two multi-target tracking scenarios based on the simulated class-B dataset and ADS-B class-A dataset provided by OpenSky Network. The scenarios are evaluated w.r.t. selection of a local state estimator using a range of the Stone Soup metrics. Source code with scenario definitions…
▽ More
This paper focuses on the multi-target tracking using the Stone Soup framework. In particular, we aim at evaluation of two multi-target tracking scenarios based on the simulated class-B dataset and ADS-B class-A dataset provided by OpenSky Network. The scenarios are evaluated w.r.t. selection of a local state estimator using a range of the Stone Soup metrics. Source code with scenario definitions and Stone Soup set-up are provided along with the paper.
△ Less
Submitted 10 June, 2025; v1 submitted 9 June, 2025;
originally announced June 2025.
-
Unobservable Systems: No Problem for Noise Identification
Authors:
Oliver Kost,
Jindrich Dunik,
Ivo Puncochar,
Ondrej Straka
Abstract:
This paper deals with the noise identification of a linear time-varying stochastic dynamic system described by the state-space model. In particular, the stress is laid on the design of the correlation measurement difference method for estimation of the state and measurement noise covariance matrices for both observable and \textit{unobservable} systems with possibly unknown input sequence. The met…
▽ More
This paper deals with the noise identification of a linear time-varying stochastic dynamic system described by the state-space model. In particular, the stress is laid on the design of the correlation measurement difference method for estimation of the state and measurement noise covariance matrices for both observable and \textit{unobservable} systems with possibly unknown input sequence. The method provides unbiased and consistent estimates and is implemented in a publicly available MATLAB toolbox and numerically evaluated.
△ Less
Submitted 29 May, 2025;
originally announced May 2025.
-
Interpretable Augmented Physics-Based Model for Estimation and Tracking
Authors:
Ondřej Straka,
Jindřich Duník,
Pau Closas,
Tales Imbiriba
Abstract:
State-space estimation and tracking rely on accurate dynamical models to perform well. However, obtaining an vaccurate dynamical model for complex scenarios or adapting to changes in the system poses challenges to the estimation process. Recently, augmented physics-based models (APBMs) appear as an appealing strategy to cope with these challenges where the composition of a small and adaptive neura…
▽ More
State-space estimation and tracking rely on accurate dynamical models to perform well. However, obtaining an vaccurate dynamical model for complex scenarios or adapting to changes in the system poses challenges to the estimation process. Recently, augmented physics-based models (APBMs) appear as an appealing strategy to cope with these challenges where the composition of a small and adaptive neural network with known physics-based models (PBM) is learned on the fly following an augmented state-space estimation approach. A major issue when introducing data-driven components in such a scenario is the danger of compromising the meaning (or interpretability) of estimated states. In this work, we propose a novel constrained estimation strategy that constrains the APBM dynamics close to the PBM. The novel state-space constrained approach leads to more flexible ways to impose constraints than the traditional APBM approach. Our experiments with a radar-tracking scenario demonstrate different aspects of the proposed approach and the trade-offs inherent in the imposed constraints.
△ Less
Submitted 9 June, 2025; v1 submitted 26 May, 2025;
originally announced May 2025.
-
Tensor Train Discrete Grid-Based Filters: Breaking the Curse of Dimensionality
Authors:
J. Matoušek,
M. Brandner,
J. Duník,
I. Punčochář
Abstract:
This paper deals with the state estimation of stochastic systems and examines the possible employment of tensor decompositions in grid-based filtering routines, in particular, the tensor-train decomposition. The aim is to show that these techniques can lead to a massive reduction in both the computational and storage complexity of grid-based filtering algorithms without considerable tradeoffs in a…
▽ More
This paper deals with the state estimation of stochastic systems and examines the possible employment of tensor decompositions in grid-based filtering routines, in particular, the tensor-train decomposition. The aim is to show that these techniques can lead to a massive reduction in both the computational and storage complexity of grid-based filtering algorithms without considerable tradeoffs in accuracy. This claim is supported by an algorithm descriptions and numerical illustrations.
△ Less
Submitted 17 January, 2025; v1 submitted 14 January, 2025;
originally announced January 2025.
-
Efficient Spectral Differentiation in Grid-Based Continuous State Estimation
Authors:
Jakub Matousek,
Jindrich Dunik,
Marek Brandner
Abstract:
This paper deals with the state estimation of stochastic models with continuous dynamics. The aim is to incorporate spectral differentiation methods into the solution to the Fokker-Planck equation in grid-based state estimation routine, while taking into account the specifics of the field, such as probability density function (PDF) features, moving grid, zero boundary conditions, etc. The spectral…
▽ More
This paper deals with the state estimation of stochastic models with continuous dynamics. The aim is to incorporate spectral differentiation methods into the solution to the Fokker-Planck equation in grid-based state estimation routine, while taking into account the specifics of the field, such as probability density function (PDF) features, moving grid, zero boundary conditions, etc. The spectral methods, in general, achieve very fast convergence rate of O(c^N )(O < c < 1) for analytical functions such as the probability density function, where N is the number of grid points. This is significantly better than the standard finite difference method (or midpoint rule used in discrete estimation) typically used in grid-based filter design with convergence rate O( 1 / N^2 ). As consequence, the proposed spectral method based filter provides better state estimation accuracy with lower number of grid points, and thus, with lower computational complexity.
△ Less
Submitted 17 January, 2025; v1 submitted 10 December, 2024;
originally announced December 2024.
-
Stochastic Integration Based Estimator: Robust Design and Stone Soup Implementation
Authors:
Jindrich Dunik,
Jakub Matousek,
Ondrej Straka,
Erik Blasch,
John Hiles,
Ruixin Niu
Abstract:
This paper deals with state estimation of nonlinear stochastic dynamic models. In particular, the stochastic integration rule, which provides asymptotically unbiased estimates of the moments of nonlinearly transformed Gaussian random variables, is reviewed together with the recently introduced stochastic integration filter (SIF). Using SIF, the respective multi-step prediction and smoothing algori…
▽ More
This paper deals with state estimation of nonlinear stochastic dynamic models. In particular, the stochastic integration rule, which provides asymptotically unbiased estimates of the moments of nonlinearly transformed Gaussian random variables, is reviewed together with the recently introduced stochastic integration filter (SIF). Using SIF, the respective multi-step prediction and smoothing algorithms are developed in full and efficient square-root form. The stochastic-integration-rule-based algorithms are implemented in Python (within the Stone Soup framework) and in MATLAB and are numerically evaluated and compared with the well-known unscented and extended Kalman filters using the Stone Soup defined tracking scenario.
△ Less
Submitted 14 January, 2025; v1 submitted 10 December, 2024;
originally announced December 2024.
-
Data-Augmented Numerical Integration in State Prediction: Rule Selection
Authors:
Jindrich Dunik,
Ladislav Kral,
Jakub Matousek,
Ondrej Straka,
Marek Brandner
Abstract:
This paper deals with the state prediction of nonlinear stochastic dynamic systems. The emphasis is laid on a solution to the integral Chapman-Kolmogorov equation by a deterministic-integration-rule-based point-mass method. A novel concept of reliable data-augmented, i.e., mathematics- and data-informed, integration rule is developed to enhance the point-mass state predictor, where the trained neu…
▽ More
This paper deals with the state prediction of nonlinear stochastic dynamic systems. The emphasis is laid on a solution to the integral Chapman-Kolmogorov equation by a deterministic-integration-rule-based point-mass method. A novel concept of reliable data-augmented, i.e., mathematics- and data-informed, integration rule is developed to enhance the point-mass state predictor, where the trained neural network (representing data contribution) is used for the selection of the best integration rule from a set of available rules (representing mathematics contribution). The proposed approach combining the best properties of the standard mathematics-informed and novel data-informed rules is thoroughly discussed.
△ Less
Submitted 14 January, 2025; v1 submitted 9 December, 2024;
originally announced December 2024.
-
Noise Covariances Identification by MDM: Weighting, Recursion, and Implementation
Authors:
Oliver Kost,
Jindrch Dunik,
Ondrej Straka
Abstract:
The problem of noise covariance matrix identification of stochastic linear time-varying state-space models is addressed. The measurement difference method (MDM) is generalized to time-varying dimensions of the measurement and control. Three MDM identification techniques that differ in weighting used in the underlying least squares method are proposed. The techniques differ in estimate quality and…
▽ More
The problem of noise covariance matrix identification of stochastic linear time-varying state-space models is addressed. The measurement difference method (MDM) is generalized to time-varying dimensions of the measurement and control. Three MDM identification techniques that differ in weighting used in the underlying least squares method are proposed. The techniques differ in estimate quality and computational complexity. In addition, recursive forms are designed for two techniques. The performance of the proposed techniques is analyzed using two numerical examples. The implementation of techniques is enclosed with the paper.
△ Less
Submitted 10 December, 2024; v1 submitted 9 December, 2024;
originally announced December 2024.
-
Uncovering Process Noise in LTV Systems via Kernel Deconvolution
Authors:
Jindrich Dunik,
Oliver Kost,
J. Krejci,
Ondrej Straka
Abstract:
This paper focuses on the identification of the process noise density of a linear time-varying system described by the state-space model with the known measurement noise density. A novel method is proposed that enhances the measurement difference method (MDM). The proposed method relies on a refined calculation of the MDM residue, which accounts for both process and measurement noises, as well as…
▽ More
This paper focuses on the identification of the process noise density of a linear time-varying system described by the state-space model with the known measurement noise density. A novel method is proposed that enhances the measurement difference method (MDM). The proposed method relies on a refined calculation of the MDM residue, which accounts for both process and measurement noises, as well as constructing the kernel density of the residue sample. The process noise density is then estimated by the density deconvolution algorithm utilising the Fourier transform. The method is supplemented with automatic selection of the deconvolution parameters based on the method of moments. The performance of process noise density estimation is evaluated in numerical examples and the paper is supplemented with a MATLAB implementation.
△ Less
Submitted 27 April, 2025; v1 submitted 2 December, 2024;
originally announced December 2024.
-
AI-Aided Kalman Filters
Authors:
Nir Shlezinger,
Guy Revach,
Anubhab Ghosh,
Saikat Chatterjee,
Shuo Tang,
Tales Imbiriba,
Jindrich Dunik,
Ondrej Straka,
Pau Closas,
Yonina C. Eldar
Abstract:
The Kalman filter (KF) and its variants are among the most celebrated algorithms in signal processing. These methods are used for state estimation of dynamic systems by relying on mathematical representations in the form of simple state-space (SS) models, which may be crude and inaccurate descriptions of the underlying dynamics. Emerging data-centric artificial intelligence (AI) techniques tackle…
▽ More
The Kalman filter (KF) and its variants are among the most celebrated algorithms in signal processing. These methods are used for state estimation of dynamic systems by relying on mathematical representations in the form of simple state-space (SS) models, which may be crude and inaccurate descriptions of the underlying dynamics. Emerging data-centric artificial intelligence (AI) techniques tackle these tasks using deep neural networks (DNNs), which are model-agnostic. Recent developments illustrate the possibility of fusing DNNs with classic Kalman-type filtering, obtaining systems that learn to track in partially known dynamics. This article provides a tutorial-style overview of design approaches for incorporating AI in aiding KF-type algorithms. We review both generic and dedicated DNN architectures suitable for state estimation, and provide a systematic presentation of techniques for fusing AI tools with KFs and for leveraging partial SS modeling and data, categorizing design approaches into task-oriented and SS model-oriented. The usefulness of each approach in preserving the individual strengths of model-based KFs and data-driven DNNs is investigated in a qualitative and quantitative study, whose code is publicly available, illustrating the gains of hybrid model-based/data-driven designs. We also discuss existing challenges and future research directions that arise from fusing AI and Kalman-type algorithms.
△ Less
Submitted 6 May, 2025; v1 submitted 16 October, 2024;
originally announced October 2024.
-
Advanced Receiver Autonomous Integrity Monitoring: Impact of Time-Correlated Pseudorange Measurement Noise
Authors:
Jindrich Dunik,
Martin Orejas
Abstract:
The paper deals with the allocation of the probability of false alert within the advanced receiver integrity monitoring method. Namely, the stress is laid on the correct computation of the probability of false alert per sample under assumption of time-correlated pseudorange noise. Detailed analysis of the dependence of the probability of false alert per sample on the measurement noise time constan…
▽ More
The paper deals with the allocation of the probability of false alert within the advanced receiver integrity monitoring method. Namely, the stress is laid on the correct computation of the probability of false alert per sample under assumption of time-correlated pseudorange noise. Detailed analysis of the dependence of the probability of false alert per sample on the measurement noise time constant is given and a numerical algorithm for the correct computation of the probability is proposed. The algorithm is illustrated using a numerical example.
△ Less
Submitted 16 February, 2024;
originally announced February 2024.
-
Bayesian KalmanNet: Quantifying Uncertainty in Deep Learning Augmented Kalman Filter
Authors:
Yehonatan Dahan,
Guy Revach,
Jindrich Dunik,
Nir Shlezinger
Abstract:
Recent years have witnessed a growing interest in tracking algorithms that augment Kalman Filters (KFs) with Deep Neural Networks (DNNs). By transforming KFs into trainable deep learning models, one can learn from data to reliably track a latent state in complex and partially known dynamics. However, unlike classic KFs, conventional DNN-based systems do not naturally provide an uncertainty measure…
▽ More
Recent years have witnessed a growing interest in tracking algorithms that augment Kalman Filters (KFs) with Deep Neural Networks (DNNs). By transforming KFs into trainable deep learning models, one can learn from data to reliably track a latent state in complex and partially known dynamics. However, unlike classic KFs, conventional DNN-based systems do not naturally provide an uncertainty measure, such as error covariance, alongside their estimates, which is crucial in various applications that rely on KF-type tracking. This work bridges this gap by studying error covariance extraction in DNN-aided KFs. We begin by characterizing how uncertainty can be extracted from existing DNN-aided algorithms and distinguishing between approaches by their ability to associate internal features with meaningful KF quantities, such as the Kalman Gain (KG) and prior covariance. We then identify that uncertainty extraction from existing architectures necessitates additional domain knowledge not required for state estimation. Based on this insight, we propose Bayesian KalmanNet, a novel DNN-aided KF that integrates Bayesian deep learning techniques with the recently proposed KalmanNet and transforms the KF into a stochastic machine learning architecture. This architecture employs sampling techniques to predict error covariance reliably without requiring additional domain knowledge, while retaining KalmanNet's ability to accurately track in partially known dynamics. Our numerical study demonstrates that Bayesian KalmanNet provides accurate and reliable tracking in various scenarios representing partially known dynamic systems.
△ Less
Submitted 18 June, 2025; v1 submitted 6 September, 2023;
originally announced September 2023.
-
Online Learning and Control for Data-Augmented Quadrotor Model
Authors:
Matej Smid,
Jindrich Dunik
Abstract:
The ability to adapt to changing conditions is a key feature of a successful autonomous system. In this work, we use the Recursive Gaussian Processes (RGP) for identification of the quadrotor air drag model online, without the need of training data. The identified drag model then augments a physics-based model of the quadrotor dynamics, which allows more accurate quadrotor state prediction with in…
▽ More
The ability to adapt to changing conditions is a key feature of a successful autonomous system. In this work, we use the Recursive Gaussian Processes (RGP) for identification of the quadrotor air drag model online, without the need of training data. The identified drag model then augments a physics-based model of the quadrotor dynamics, which allows more accurate quadrotor state prediction with increased ability to adapt to changing conditions. This data-augmented physics-based model is utilized for precise quadrotor trajectory tracking using the suitably modified Model Predictive Control (MPC) algorithm. The proposed modelling and control approach is evaluated using the Gazebo simulator and it is shown that the proposed approach tracks a desired trajectory with a higher accuracy compared to the MPC with the non-augmented (purely physics-based) model.
△ Less
Submitted 28 December, 2024; v1 submitted 2 April, 2023;
originally announced April 2023.
-
Design of Efficient Point-Mass Filter with Application in Terrain Aided Navigation
Authors:
J. Matoušek,
J. Duník,
M. Brandner
Abstract:
This paper deals with state estimation of stochastic models with linear state dynamics, continuous or discrete in time. The emphasis is laid on a numerical solution to the state prediction by the time-update step of the grid-point-based point-mass filter (PMF), which is the most computationally demanding part of the PMF algorithm. A novel efficient PMF (ePMF) estimator, unifying continuous and dis…
▽ More
This paper deals with state estimation of stochastic models with linear state dynamics, continuous or discrete in time. The emphasis is laid on a numerical solution to the state prediction by the time-update step of the grid-point-based point-mass filter (PMF), which is the most computationally demanding part of the PMF algorithm. A novel efficient PMF (ePMF) estimator, unifying continuous and discrete, approaches is proposed, designed, and discussed. By numerical illustrations, it is shown, that the proposed ePMF can lead to a time complexity reduction that exceeds 99.9% without compromising accuracy. The MATLAB code of the ePMF is released with this paper.
△ Less
Submitted 20 March, 2024; v1 submitted 9 March, 2023;
originally announced March 2023.
-
Efficient Point Mass Predictor for Continuous and Discrete Models with Linear Dynamics
Authors:
Jakub Matousek,
Jindrich Dunik,
Marek Brandner,
Chan Gook Park,
Yeongkwon Choe
Abstract:
This paper deals with state estimation of stochastic models with linear state dynamics, continuous or discrete in time. The emphasis is laid on a numerical solution to the state prediction by the time-update step of the grid-point-based point-mass filter (PMF), which is the most computationally demanding part of the PMF algorithm. A novel way of manipulating the grid, leading to the time-update in…
▽ More
This paper deals with state estimation of stochastic models with linear state dynamics, continuous or discrete in time. The emphasis is laid on a numerical solution to the state prediction by the time-update step of the grid-point-based point-mass filter (PMF), which is the most computationally demanding part of the PMF algorithm. A novel way of manipulating the grid, leading to the time-update in form of a convolution, is proposed. This reduces the PMF time complexity from quadratic to log-linear with respect to the number of grid points. Furthermore, the number of unique transition probability values is greatly reduced causing a significant reduction of the data storage needed. The proposed PMF prediction step is verified in a numerical study.
△ Less
Submitted 17 April, 2023; v1 submitted 24 February, 2023;
originally announced February 2023.
-
Hybrid Neural Network Augmented Physics-based Models for Nonlinear Filtering
Authors:
Tales Imbiriba,
Ahmet Demirkaya,
Jindřich Duník,
Ondřej Straka,
Deniz Erdoğmuş,
Pau Closas
Abstract:
In this paper we present a hybrid neural network augmented physics-based modeling (APBM) framework for Bayesian nonlinear latent space estimation. The proposed APBM strategy allows for model adaptation when new operation conditions come into play or the physics-based model is insufficient (or incomplete) to properly describe the latent phenomenon. One advantage of the APBMs and our estimation proc…
▽ More
In this paper we present a hybrid neural network augmented physics-based modeling (APBM) framework for Bayesian nonlinear latent space estimation. The proposed APBM strategy allows for model adaptation when new operation conditions come into play or the physics-based model is insufficient (or incomplete) to properly describe the latent phenomenon. One advantage of the APBMs and our estimation procedure is the capability of maintaining the physical interpretability of estimated states. Furthermore, we propose a constraint filtering approach to control the neural network contributions to the overall model. We also exploit assumed density filtering techniques and cubature integration rules to present a flexible estimation strategy that can easily deal with nonlinear models and high-dimensional latent spaces. Finally, we demonstrate the efficacy of our methodology by leveraging a target tracking scenario with nonlinear and incomplete measurement and acceleration models, respectively.
△ Less
Submitted 14 September, 2022; v1 submitted 13 April, 2022;
originally announced April 2022.
