-
Efficient Gaussian Mixture Filters based on Transition Density Approximation
Authors:
Ondŕej Straka,
Uwe D. Hanebeck
Abstract:
Gaussian mixture filters for nonlinear systems usually rely on severe approximations when calculating mixtures in the prediction and filtering step. Thus, offline approximations of noise densities by Gaussian mixture densities to reduce the approximation error have been proposed. This results in exponential growth in the number of components, requiring ongoing component reduction, which is computa…
▽ More
Gaussian mixture filters for nonlinear systems usually rely on severe approximations when calculating mixtures in the prediction and filtering step. Thus, offline approximations of noise densities by Gaussian mixture densities to reduce the approximation error have been proposed. This results in exponential growth in the number of components, requiring ongoing component reduction, which is computationally complex. In this paper, the key idea is to approximate the true transition density by an axis-aligned Gaussian mixture, where two different approaches are derived. These approximations automatically ensure a constant number of components in the posterior densities without the need for explicit reduction. In addition, they allow a trade-off between estimation quality and computational complexity.
△ Less
Submitted 30 May, 2025; v1 submitted 26 May, 2025;
originally announced May 2025.
-
Closed-Form Information-Theoretic Roughness Measures for Mixture Densities
Authors:
Uwe D. Hanebeck
Abstract:
We calculate the smoothest mixture density under a variety of prescribed specifications. This includes constraints on certain moments, specifications on density values and/or its derivatives, and prescribed probability masses in certain regions. As a roughness measure, we use Fisher Information (FI) in the space of mixtures $\cal M$. For mixtures, FI cannot be calculated in closed form. We define…
▽ More
We calculate the smoothest mixture density under a variety of prescribed specifications. This includes constraints on certain moments, specifications on density values and/or its derivatives, and prescribed probability masses in certain regions. As a roughness measure, we use Fisher Information (FI) in the space of mixtures $\cal M$. For mixtures, FI cannot be calculated in closed form. We define the space $\cal R$ of root mixtures (RMs) living on the Hilbert sphere. A transformation of FI to $\cal R$ admits a closed-form solution and yields the desired result in $\cal M$. This naturally leads to a tandem processing with two density representations maintained simultaneously in $\cal R$ and $\cal M$. FI is calculated in RM space $\cal R$ while the constraints are evaluated in mixture space $\cal M$.
△ Less
Submitted 16 November, 2023;
originally announced November 2023.
-
Progressive Bayesian Particle Flows based on Optimal Transport Map Sequences
Authors:
Uwe D. Hanebeck
Abstract:
We propose a method for optimal Bayesian filtering with deterministic particles. In order to avoid particle degeneration, the filter step is not performed at once. Instead, the particles progressively flow from prior to posterior. This is achieved by splitting the filter step into a series of sub-steps. In each sub-step, optimal resampling is done by a map that replaces non-equally weighted partic…
▽ More
We propose a method for optimal Bayesian filtering with deterministic particles. In order to avoid particle degeneration, the filter step is not performed at once. Instead, the particles progressively flow from prior to posterior. This is achieved by splitting the filter step into a series of sub-steps. In each sub-step, optimal resampling is done by a map that replaces non-equally weighted particles with equally weighted ones. Inversions of the maps or monotonicity constraints are not required, greatly simplifying the procedure. The parameters of the mapping network are optimized w.r.t.\ to a particle set distance. This distance is differentiable, and compares non-equally and equally weighted particles. Composition of the map sequence provides a final mapping from prior to posterior particles. Radial basis function neural networks are used as maps. It is important that no intermediate continuous density representation is required. The entire flow works directly with particle representations. This avoids costly density estimation.
△ Less
Submitted 4 March, 2023;
originally announced March 2023.
-
Continuous-Time Ultra-Wideband-Inertial Fusion
Authors:
Kailai Li,
Ziyu Cao,
Uwe D. Hanebeck
Abstract:
We introduce a novel framework of continuous-time ultra-wideband-inertial sensor fusion for online motion estimation. Quaternion-based cubic cumulative B-splines are exploited for parameterizing motion states continuously over time. Systematic derivations of analytic kinematic interpolations and spatial differentiations are further provided. Based thereon, a new sliding-window spline fitting schem…
▽ More
We introduce a novel framework of continuous-time ultra-wideband-inertial sensor fusion for online motion estimation. Quaternion-based cubic cumulative B-splines are exploited for parameterizing motion states continuously over time. Systematic derivations of analytic kinematic interpolations and spatial differentiations are further provided. Based thereon, a new sliding-window spline fitting scheme is established for asynchronous multi-sensor fusion and online calibration. We conduct a dedicated validation of the quaternion spline fitting method, and evaluate the proposed system, SFUISE (spline fusion-based ultra-wideband-inertial state estimation), in real-world scenarios using public data set and experiments. The proposed sensor fusion system is real-time capable and delivers superior performance over state-of-the-art discrete-time schemes. We release the source code and own experimental data at https://github.com/KIT-ISAS/SFUISE.
△ Less
Submitted 9 June, 2023; v1 submitted 21 January, 2023;
originally announced January 2023.
-
Hyperspherical Dirac Mixture Reapproximation
Authors:
Kailai Li,
Florian Pfaff,
Uwe D. Hanebeck
Abstract:
We propose a novel scheme for efficient Dirac mixture modeling of distributions on unit hyperspheres. A so-called hyperspherical localized cumulative distribution (HLCD) is introduced as a local and smooth characterization of the underlying continuous density in hyperspherical domains. Based on HLCD, a manifold-adapted modification of the Cramér-von Mises distance (HCvMD) is established to measure…
▽ More
We propose a novel scheme for efficient Dirac mixture modeling of distributions on unit hyperspheres. A so-called hyperspherical localized cumulative distribution (HLCD) is introduced as a local and smooth characterization of the underlying continuous density in hyperspherical domains. Based on HLCD, a manifold-adapted modification of the Cramér-von Mises distance (HCvMD) is established to measure the statistical divergence between two Dirac mixtures of arbitrary dimensions. Given a (source) Dirac mixture with many components representing an unknown hyperspherical distribution, a (target) Dirac mixture with fewer components is obtained via matching the source in the sense of least HCvMD. As the number of target Dirac components is configurable, the underlying distributions is represented in a more efficient and informative way. Based upon this hyperspherical Dirac mixture reapproximation (HDMR), we derive a density estimation method and a recursive filter. For density estimation, a maximum likelihood method is provided to reconstruct the underlying continuous distribution in the form of a von Mises-Fisher mixture. For recursive filtering, we introduce the hyperspherical reapproximation discrete filter (HRDF) for nonlinear hyperspherical estimation of dynamic systems under unknown system noise of arbitrary form. Simulations show that the HRDF delivers superior tracking performance over filters using sequential Monte Carlo and parametric modeling.
△ Less
Submitted 20 October, 2021;
originally announced October 2021.
-
Gaussian Mixture Estimation from Weighted Samples
Authors:
Daniel Frisch,
Uwe D. Hanebeck
Abstract:
We consider estimating the parameters of a Gaussian mixture density with a given number of components best representing a given set of weighted samples. We adopt a density interpretation of the samples by viewing them as a discrete Dirac mixture density over a continuous domain with weighted components. Hence, Gaussian mixture fitting is viewed as density re-approximation. In order to speed up com…
▽ More
We consider estimating the parameters of a Gaussian mixture density with a given number of components best representing a given set of weighted samples. We adopt a density interpretation of the samples by viewing them as a discrete Dirac mixture density over a continuous domain with weighted components. Hence, Gaussian mixture fitting is viewed as density re-approximation. In order to speed up computation, an expectation-maximization method is proposed that properly considers not only the sample locations, but also the corresponding weights. It is shown that methods from literature do not treat the weights correctly, resulting in wrong estimates. This is demonstrated with simple counterexamples. The proposed method works in any number of dimensions with the same computational load as standard Gaussian mixture estimators for unweighted samples.
△ Less
Submitted 9 June, 2021;
originally announced June 2021.
-
Deterministic Sampling on the Circle using Projected Cumulative Distributions
Authors:
Daniel Frisch,
Uwe D. Hanebeck
Abstract:
We propose a method for deterministic sampling of arbitrary continuous angular density functions. With deterministic sampling, good estimation results can typically be achieved with much smaller numbers of samples compared to the commonly used random sampling. While the Unscented Kalman Filter uses deterministic sampling as well, it only takes the absolute minimum number of samples. Our method can…
▽ More
We propose a method for deterministic sampling of arbitrary continuous angular density functions. With deterministic sampling, good estimation results can typically be achieved with much smaller numbers of samples compared to the commonly used random sampling. While the Unscented Kalman Filter uses deterministic sampling as well, it only takes the absolute minimum number of samples. Our method can draw arbitrary numbers of deterministic samples and therefore improve the quality of state estimation. Conformity between the continuous density function (reference) and the Dirac mixture density, i.e., sample locations (approximation) is established by minimizing the difference of the cumulatives of many univariate projections. In other words, we compare cumulatives of probability densities in the Radon space.
△ Less
Submitted 8 February, 2021;
originally announced February 2021.
-
Three-dimensional Simultaneous Shape and Pose Estimation for Extended Objects Using Spherical Harmonics
Authors:
Gerhard Kurz,
Florian Faion,
Florian Pfaff,
Antonio Zea,
Uwe D. Hanebeck
Abstract:
We propose a new recursive method for simultaneous estimation of both the pose and the shape of a three-dimensional extended object. The key idea of the presented method is to represent the shape of the object using spherical harmonics, similar to the way Fourier series can be used in the two-dimensional case. This allows us to derive a measurement equation that can be used within the framework of…
▽ More
We propose a new recursive method for simultaneous estimation of both the pose and the shape of a three-dimensional extended object. The key idea of the presented method is to represent the shape of the object using spherical harmonics, similar to the way Fourier series can be used in the two-dimensional case. This allows us to derive a measurement equation that can be used within the framework of nonlinear filters such as the UKF. We provide both simulative and experimental evaluations of the novel techniques.
△ Less
Submitted 25 December, 2020;
originally announced December 2020.
-
Towards High-Performance Solid-State-LiDAR-Inertial Odometry and Mapping
Authors:
Kailai Li,
Meng Li,
Uwe D. Hanebeck
Abstract:
We present a novel tightly-coupled LiDAR-inertial odometry and mapping scheme for both solid-state and mechanical LiDARs. As frontend, a feature-based lightweight LiDAR odometry provides fast motion estimates for adaptive keyframe selection. As backend, a hierarchical keyframe-based sliding window optimization is performed through marginalization for directly fusing IMU and LiDAR measurements. For…
▽ More
We present a novel tightly-coupled LiDAR-inertial odometry and mapping scheme for both solid-state and mechanical LiDARs. As frontend, a feature-based lightweight LiDAR odometry provides fast motion estimates for adaptive keyframe selection. As backend, a hierarchical keyframe-based sliding window optimization is performed through marginalization for directly fusing IMU and LiDAR measurements. For the Livox Horizon, a newly released solid-state LiDAR, a novel feature extraction method is proposed to handle its irregular scan pattern during preprocessing. LiLi-OM (Livox LiDAR-inertial odometry and mapping) is real-time capable and achieves superior accuracy over state-of-the-art systems for both LiDAR types on public data sets of mechanical LiDARs and in experiments using the Livox Horizon. Source code and recorded experimental data sets are available at https://github.com/KIT-ISAS/lili-om.
△ Less
Submitted 27 April, 2021; v1 submitted 25 October, 2020;
originally announced October 2020.
-
iviz: A ROS Visualization App for Mobile Devices
Authors:
Antonio Zea,
Uwe D. Hanebeck
Abstract:
In this work, we introduce iviz, a mobile application for visualizing ROS data. In the last few years, the popularity of ROS has grown enormously, making it the standard platform for open source robotic programming. A key reason for this success is the availability of polished, general-purpose modules for many tasks, such as localization, mapping, path planning, and quite importantly, data visuali…
▽ More
In this work, we introduce iviz, a mobile application for visualizing ROS data. In the last few years, the popularity of ROS has grown enormously, making it the standard platform for open source robotic programming. A key reason for this success is the availability of polished, general-purpose modules for many tasks, such as localization, mapping, path planning, and quite importantly, data visualization. However, the availability of the latter is generally restricted to PCs with the Linux operating system. Thus, users that want to see what is happening in the system with a smartphone or a tablet are stuck with solutions such as screen mirroring or using web browser versions of rviz, which are difficult to interact with from a mobile interface. More importantly, this makes newer visualization modalities such as Augmented Reality impossible. Our application iviz, based on the Unity engine, addresses these issues by providing a visualization platform designed from scratch to be usable in mobile platforms, such as iOS, Android, and UWP, and including native support for Augmented Reality for all three platforms. If desired, it can also be used in a PC with Linux, Windows, or macOS without any changes.
△ Less
Submitted 28 August, 2020;
originally announced August 2020.
-
Deterministic Sampling of Multivariate Densities based on Projected Cumulative Distributions
Authors:
Uwe D. Hanebeck
Abstract:
We want to approximate general multivariate probability density functions by deterministic sample sets. For optimal sampling, the closeness to the given continuous density has to be assessed. This is a difficult challenge in multivariate settings. Simple solutions are restricted to the one-dimensional case. In this paper, we propose to employ one-dimensional density projections. These are the Rado…
▽ More
We want to approximate general multivariate probability density functions by deterministic sample sets. For optimal sampling, the closeness to the given continuous density has to be assessed. This is a difficult challenge in multivariate settings. Simple solutions are restricted to the one-dimensional case. In this paper, we propose to employ one-dimensional density projections. These are the Radon transforms of the densities. For every projection, we compute their cumulative distribution function. These Projected Cumulative Distributions (PCDs) are compared for all possible projections (or a discrete set thereof). This leads to a tractable distance measure in multivariate space. The proposed approximation method is efficient as calculating the distance measure mainly entails sorting in one dimension. It is also surprisingly simple to implement.
△ Less
Submitted 30 December, 2019;
originally announced December 2019.
-
Improved Pose Graph Optimization for Planar Motions Using Riemannian Geometry on the Manifold of Dual Quaternions
Authors:
Kailai Li,
Johannes Cox,
Benjamin Noack,
Uwe D. Hanebeck
Abstract:
We present a novel Riemannian approach for planar pose graph optimization problems. By formulating the cost function based on the Riemannian metric on the manifold of dual quaternions representing planar motions, the nonlinear structure of the SE(2) group is inherently considered. To solve the on-manifold least squares problem, a Riemannian Gauss-Newton method using the exponential retraction is a…
▽ More
We present a novel Riemannian approach for planar pose graph optimization problems. By formulating the cost function based on the Riemannian metric on the manifold of dual quaternions representing planar motions, the nonlinear structure of the SE(2) group is inherently considered. To solve the on-manifold least squares problem, a Riemannian Gauss-Newton method using the exponential retraction is applied. The proposed Riemannian pose graph optimizer (RPG-Opt) is further evaluated based on public planar pose graph data sets. Compared with state-of-the-art frameworks, the proposed method gives equivalent accuracy and better convergence robustness under large uncertainties of odometry measurements.
△ Less
Submitted 20 November, 2019; v1 submitted 31 July, 2019;
originally announced July 2019.
-
A Distance-based Framework for Gaussian Processes over Probability Distributions
Authors:
Maxim Dolgov,
Uwe D. Hanebeck
Abstract:
Gaussian processes constitute a very powerful and well-understood method for non-parametric regression and classification. In the classical framework, the training data consists of deterministic vector-valued inputs and the corresponding (noisy) measurements whose joint distribution is assumed to be Gaussian. In many practical applications, however, the inputs are either noisy, i.e., each input is…
▽ More
Gaussian processes constitute a very powerful and well-understood method for non-parametric regression and classification. In the classical framework, the training data consists of deterministic vector-valued inputs and the corresponding (noisy) measurements whose joint distribution is assumed to be Gaussian. In many practical applications, however, the inputs are either noisy, i.e., each input is a vector-valued sample from an unknown probability distribution, or the probability distributions are the inputs. In this paper, we address Gaussian process regression with inputs given in form of probability distributions and propose a framework that is based on distances between such inputs. To this end, we review different admissible distance measures and provide a numerical example that demonstrates our framework.
△ Less
Submitted 24 September, 2018;
originally announced September 2018.
-
FLUX: Progressive State Estimation Based on Zakai-type Distributed Ordinary Differential Equations
Authors:
Uwe D. Hanebeck
Abstract:
We propose a homotopy continuation method called FLUX for approximating complicated probability density functions. It is based on progressive processing for smoothly morphing a given density into the desired one. Distributed ordinary differential equations (DODEs) with an artificial time $γ\in [0,1]$ are derived for describing the evolution from the initial density to the desired final density. Fo…
▽ More
We propose a homotopy continuation method called FLUX for approximating complicated probability density functions. It is based on progressive processing for smoothly morphing a given density into the desired one. Distributed ordinary differential equations (DODEs) with an artificial time $γ\in [0,1]$ are derived for describing the evolution from the initial density to the desired final density. For a finite-dimensional parametrization, the DODEs are converted to a system of ordinary differential equations (SODEs), which are solved for $γ\in [0,1]$ and return the desired result for $γ=1$. This includes parametric representations such as Gaussians or Gaussian mixtures and nonparametric setups such as sample sets. In the latter case, we obtain a particle flow between the two densities along the artificial time.
FLUX is applied to state estimation in stochastic nonlinear dynamic systems by gradual inclusion of measurement information. The proposed approximation method (1) is fast, (2) can be applied to arbitrary nonlinear systems and is not limited to additive noise, (3) allows for target densities that are only known at certain points, (4) does not require optimization, (5) does not require the solution of partial differential equations, and (6) works with standard procedures for solving SODEs. This manuscript is limited to the one-dimensional case and a fixed number of parameters during the progression. Future extensions will include consideration of higher dimensions and on the fly adaption of the number of parameters.
△ Less
Submitted 8 August, 2018;
originally announced August 2018.
-
Directional Statistics and Filtering Using libDirectional
Authors:
Gerhard Kurz,
Igor Gilitschenski,
Florian Pfaff,
Lukas Drude,
Uwe D. Hanebeck,
Reinhold Haeb-Umbach,
Roland Y. Siegwart
Abstract:
In this paper, we present libDirectional, a MATLAB library for directional statistics and directional estimation. It supports a variety of commonly used distributions on the unit circle, such as the von Mises, wrapped normal, and wrapped Cauchy distributions. Furthermore, various distributions on higher-dimensional manifolds such as the unit hypersphere and the hypertorus are available. Based on t…
▽ More
In this paper, we present libDirectional, a MATLAB library for directional statistics and directional estimation. It supports a variety of commonly used distributions on the unit circle, such as the von Mises, wrapped normal, and wrapped Cauchy distributions. Furthermore, various distributions on higher-dimensional manifolds such as the unit hypersphere and the hypertorus are available. Based on these distributions, several recursive filtering algorithms in libDirectional allow estimation on these manifolds. The functionality is implemented in a clear, well-documented, and object-oriented structure that is both easy to use and easy to extend.
△ Less
Submitted 27 December, 2017;
originally announced December 2017.
-
High-Accuracy Real-Time Whole-Body Human Motion Tracking Based on Constrained Nonlinear Kalman Filtering
Authors:
Jannik Steinbring,
Christian Mandery,
Nikolaus Vahrenkamp,
Tamim Asfour,
Uwe D. Hanebeck
Abstract:
We present a new online approach to track human whole-body motion from motion capture data, i.e., positions of labeled markers attached to the human body. Tracking in noisy data can be effectively performed with the aid of well-established recursive state estimation techniques. This allows us to systematically take noise of the marker measurements into account. However, as joint limits imposed by…
▽ More
We present a new online approach to track human whole-body motion from motion capture data, i.e., positions of labeled markers attached to the human body. Tracking in noisy data can be effectively performed with the aid of well-established recursive state estimation techniques. This allows us to systematically take noise of the marker measurements into account. However, as joint limits imposed by the human body have to be satisfied during estimation, first we transform this constrained estimation problem into an unconstrained one by using periodic functions. Then, we apply the Smart Sampling Kalman Filter to solve this unconstrained estimation problem. The proposed recursive state estimation approach makes the human motion tracking very robust to partial occlusion of markers and avoids any special treatment or reconstruction of the missed markers. A concrete implementation built on the kinematic human reference model of the Master Motor Map framework and a Vicon motion capture system is evaluated. Different captured motions show that our implementation can accurately estimate whole-body human motion in real-time and outperforms existing gradient-based approaches. In addition, we demonstrate its ability to smoothly handle incomplete marker data.
△ Less
Submitted 13 November, 2015;
originally announced November 2015.
-
Infinite-horizon Linear Optimal Control of Markov Jump Systems without Mode Observation via State Feedback
Authors:
Maxim Dolgov,
Uwe D. Hanebeck
Abstract:
In this paper, we consider stochastic optimal control of Markov Jump Linear Systems with state feedback but without observation of the jumping parameter. The proposed control law is assumed to be linear with constant gains that can be obtained from the necessary optimality conditions using an iterative algorithm. The proposed approach is demonstrated in a numerical example.
In this paper, we consider stochastic optimal control of Markov Jump Linear Systems with state feedback but without observation of the jumping parameter. The proposed control law is assumed to be linear with constant gains that can be obtained from the necessary optimality conditions using an iterative algorithm. The proposed approach is demonstrated in a numerical example.
△ Less
Submitted 1 July, 2015;
originally announced July 2015.
-
The Smart Sampling Kalman Filter with Symmetric Samples
Authors:
Jannik Steinbring,
Martin Pander,
Uwe D. Hanebeck
Abstract:
Nonlinear Kalman Filters are powerful and widely-used techniques when trying to estimate the hidden state of a stochastic nonlinear dynamic system. In this paper, we extend the Smart Sampling Kalman Filter (S2KF) with a new point symmetric Gaussian sampling scheme. This not only improves the S2KF's estimation quality, but also reduces the time needed to compute the required optimal Gaussian sample…
▽ More
Nonlinear Kalman Filters are powerful and widely-used techniques when trying to estimate the hidden state of a stochastic nonlinear dynamic system. In this paper, we extend the Smart Sampling Kalman Filter (S2KF) with a new point symmetric Gaussian sampling scheme. This not only improves the S2KF's estimation quality, but also reduces the time needed to compute the required optimal Gaussian samples drastically. Moreover, we improve the numerical stability of the sample computation, which allows us to accurately approximate a thousand-dimensional Gaussian distribution using tens of thousands of optimally placed samples. We evaluate the new symmetric S2KF by computing higher-order moments of standard normal distributions and investigate the estimation quality of the S2KF when dealing with symmetric measurement equations. Finally, extended object tracking based on many measurements per time step is considered. This high-dimensional estimation problem shows the advantage of the S2KF being able to use an arbitrary number of samples independent of the state dimension, in contrast to other state-of-the-art sample-based Kalman Filters.
△ Less
Submitted 10 June, 2015;
originally announced June 2015.
-
Recursive Bayesian Filtering in Circular State Spaces
Authors:
Gerhard Kurz,
Igor Gilitschenski,
Uwe D. Hanebeck
Abstract:
For recursive circular filtering based on circular statistics, we introduce a general framework for estimation of a circular state based on different circular distributions, specifically the wrapped normal distribution and the von Mises distribution. We propose an estimation method for circular systems with nonlinear system and measurement functions. This is achieved by relying on efficient determ…
▽ More
For recursive circular filtering based on circular statistics, we introduce a general framework for estimation of a circular state based on different circular distributions, specifically the wrapped normal distribution and the von Mises distribution. We propose an estimation method for circular systems with nonlinear system and measurement functions. This is achieved by relying on efficient deterministic sampling techniques. Furthermore, we show how the calculations can be simplified in a variety of important special cases, such as systems with additive noise as well as identity system or measurement functions. We introduce several novel key components, particularly a distribution-free prediction algorithm, a new and superior formula for the multiplication of wrapped normal densities, and the ability to deal with non-additive system noise. All proposed methods are thoroughly evaluated and compared to several state-of-the-art solutions.
△ Less
Submitted 21 January, 2015;
originally announced January 2015.
-
Optimal Reduction of Multivariate Dirac Mixture Densities
Authors:
Uwe D. Hanebeck
Abstract:
This paper is concerned with the optimal approximation of a given multivariate Dirac mixture, i.e., a density comprising weighted Dirac distributions on a continuous domain, by an equally weighted Dirac mixture with a reduced number of components. The parameters of the approximating density are calculated by minimizing a smooth global distance measure, a generalization of the well-known Cramér-von…
▽ More
This paper is concerned with the optimal approximation of a given multivariate Dirac mixture, i.e., a density comprising weighted Dirac distributions on a continuous domain, by an equally weighted Dirac mixture with a reduced number of components. The parameters of the approximating density are calculated by minimizing a smooth global distance measure, a generalization of the well-known Cramér-von Mises Distance to the multivariate case. This generalization is achieved by defining an alternative to the classical cumulative distribution, the Localized Cumulative Distribution (LCD), as a characterization of discrete random quantities (on continuous domains), which is unique and symmetric also in the multivariate case. The resulting approximation method provides the basis for various efficient nonlinear state and parameter estimation methods.
△ Less
Submitted 17 November, 2014;
originally announced November 2014.
-
Exact and Approximate Hidden Markov Chain Filters Based on Discrete Observations
Authors:
Nicole Bäuerle,
Igor Gilitschenski,
Uwe D. Hanebeck
Abstract:
We consider a Hidden Markov Model (HMM) where the integrated continuous-time Markov chain can be observed at discrete time points perturbed by a Brownian motion. The aim is to derive a filter for the underlying continuous-time Markov chain. The recursion formula for the discrete-time filter is easy to derive, however involves densities which are very hard to obtain. In this paper we derive exact f…
▽ More
We consider a Hidden Markov Model (HMM) where the integrated continuous-time Markov chain can be observed at discrete time points perturbed by a Brownian motion. The aim is to derive a filter for the underlying continuous-time Markov chain. The recursion formula for the discrete-time filter is easy to derive, however involves densities which are very hard to obtain. In this paper we derive exact formulas for the necessary densities in the case the state space of the HMM consists of two elements only. This is done by relating the underlying integrated continuous-time Markov chain to the so-called asymmetric telegraph process and by using recent results on this process. In case the state space consists of more than two elements we present three different ways to approximate the densities for the filter. The first approach is based on the continuous filter problem. The second approach is to derive a PDE for the densities and solve it numerically and the third approach is a crude discrete time approximation of the Markov chain. All three approaches are compared in a numerical study.
△ Less
Submitted 18 December, 2014; v1 submitted 4 November, 2014;
originally announced November 2014.
-
Truncated Moment Problem for Dirac Mixture Densities with Entropy Regularization
Authors:
Uwe D. Hanebeck
Abstract:
We assume that a finite set of moments of a random vector is given. Its underlying density is unknown. An algorithm is proposed for efficiently calculating Dirac mixture densities maintaining these moments while providing a homogeneous coverage of the state space.
We assume that a finite set of moments of a random vector is given. Its underlying density is unknown. An algorithm is proposed for efficiently calculating Dirac mixture densities maintaining these moments while providing a homogeneous coverage of the state space.
△ Less
Submitted 29 August, 2014;
originally announced August 2014.
-
e-Installation: Synesthetic Documentation of Media Art via Telepresence Technologies
Authors:
Jesús Muñoz Morcillo,
Florian Faion,
Antonio Zea,
Uwe D. Hanebeck,
Caroline Y. Robertson-von Trotha
Abstract:
In this paper, a new synesthetic documentation method that contributes to media art conservation is presented. This new method is called e-Installation in analogy to the idea of the e-Book as the electronic version of a real book. An e-Installation is a virtualized media artwork that reproduces all synesthesia, interaction, and meaning levels of the artwork. Advanced 3D modeling and telepresence t…
▽ More
In this paper, a new synesthetic documentation method that contributes to media art conservation is presented. This new method is called e-Installation in analogy to the idea of the e-Book as the electronic version of a real book. An e-Installation is a virtualized media artwork that reproduces all synesthesia, interaction, and meaning levels of the artwork. Advanced 3D modeling and telepresence technologies with a very high level of immersion allow the virtual re-enactment of works of media art that are no longer performable or rarely exhibited. The virtual re-enactment of a media artwork can be designed with a scalable level of complexity depending on whether it addresses professionals such as curators, art restorers, and art theorists or the general public. An e-Installation is independent from the artwork's physical location and can be accessed via head-mounted display or similar data goggles, computer browser, or even mobile devices. In combination with informational and preventive conservation measures, the e-Installation offers an intermediate and long-term solution to archive, disseminate, and pass down the milestones of media art history as a synesthetic documentation when the original work can no longer be repaired or exhibited in its full function.
△ Less
Submitted 6 August, 2014;
originally announced August 2014.
-
Efficient Evaluation of the Probability Density Function of a Wrapped Normal Distribution
Authors:
Gerhard Kurz,
Igor Gilitschenski,
Uwe D. Hanebeck
Abstract:
The wrapped normal distribution arises when a the density of a one-dimensional normal distribution is wrapped around the circle infinitely many times. At first look, evaluation of its probability density function appears tedious as an infinite series is involved. In this paper, we investigate the evaluation of two truncated series representations. As one representation performs well for small unce…
▽ More
The wrapped normal distribution arises when a the density of a one-dimensional normal distribution is wrapped around the circle infinitely many times. At first look, evaluation of its probability density function appears tedious as an infinite series is involved. In this paper, we investigate the evaluation of two truncated series representations. As one representation performs well for small uncertainties whereas the other performs well for large uncertainties, we show that in all cases a small number of summands is sufficient to achieve high accuracy.
△ Less
Submitted 25 May, 2014;
originally announced May 2014.
-
Unscented Orientation Estimation Based on the Bingham Distribution
Authors:
Igor Gilitschenski,
Gerhard Kurz,
Simon J. Julier,
Uwe D. Hanebeck
Abstract:
Orientation estimation for 3D objects is a common problem that is usually tackled with traditional nonlinear filtering techniques such as the extended Kalman filter (EKF) or the unscented Kalman filter (UKF). Most of these techniques assume Gaussian distributions to account for system noise and uncertain measurements. This distributional assumption does not consider the periodic nature of pose and…
▽ More
Orientation estimation for 3D objects is a common problem that is usually tackled with traditional nonlinear filtering techniques such as the extended Kalman filter (EKF) or the unscented Kalman filter (UKF). Most of these techniques assume Gaussian distributions to account for system noise and uncertain measurements. This distributional assumption does not consider the periodic nature of pose and orientation uncertainty. We propose a filter that considers the periodicity of the orientation estimation problem in its distributional assumption. This is achieved by making use of the Bingham distribution, which is defined on the hypersphere and thus inherently more suitable to periodic problems. Furthermore, handling of non-trivial system functions is done using deterministic sampling in an efficient way. A deterministic sampling scheme reminiscent of the UKF is proposed for the nonlinear manifold of orientations. It is the first deterministic sampling scheme that truly reflects the nonlinear manifold of the orientation.
△ Less
Submitted 22 November, 2013;
originally announced November 2013.
-
Recursive Estimation of Orientation Based on the Bingham Distribution
Authors:
Gerhard Kurz,
Igor Gilitschenski,
Simon Julier,
Uwe D. Hanebeck
Abstract:
Directional estimation is a common problem in many tracking applications. Traditional filters such as the Kalman filter perform poorly because they fail to take the periodic nature of the problem into account. We present a recursive filter for directional data based on the Bingham distribution in two dimensions. The proposed filter can be applied to circular filtering problems with 180 degree symm…
▽ More
Directional estimation is a common problem in many tracking applications. Traditional filters such as the Kalman filter perform poorly because they fail to take the periodic nature of the problem into account. We present a recursive filter for directional data based on the Bingham distribution in two dimensions. The proposed filter can be applied to circular filtering problems with 180 degree symmetry, i.e., rotations by 180 degrees cannot be distinguished. It is easily implemented using standard numerical techniques and suitable for real-time applications. The presented approach is extensible to quaternions, which allow tracking arbitrary three-dimensional orientations. We evaluate our filter in a challenging scenario and compare it to a traditional Kalman filtering approach.
△ Less
Submitted 30 April, 2013;
originally announced April 2013.
-
Extended Object Tracking with Random Hypersurface Models
Authors:
Marcus Baum,
Uwe D. Hanebeck
Abstract:
The Random Hypersurface Model (RHM) is introduced that allows for estimating a shape approximation of an extended object in addition to its kinematic state. An RHM represents the spatial extent by means of randomly scaled versions of the shape boundary. In doing so, the shape parameters and the measurements are related via a measurement equation that serves as the basis for a Gaussian state estima…
▽ More
The Random Hypersurface Model (RHM) is introduced that allows for estimating a shape approximation of an extended object in addition to its kinematic state. An RHM represents the spatial extent by means of randomly scaled versions of the shape boundary. In doing so, the shape parameters and the measurements are related via a measurement equation that serves as the basis for a Gaussian state estimator. Specific estimators are derived for elliptic and star-convex shapes.
△ Less
Submitted 18 April, 2013;
originally announced April 2013.
-
The Kernel-SME Filter for Multiple Target Tracking
Authors:
Marcus Baum,
Uwe D. Hanebeck
Abstract:
We present a novel method called Kernel-SME filter for tracking multiple targets when the association of the measurements to the targets is unknown. The method is a further development of the Symmetric Measurement Equation (SME) filter, which removes the data association uncertainty of the original measurement equation with the help of a symmetric transformation. The underlying idea of the Kernel-…
▽ More
We present a novel method called Kernel-SME filter for tracking multiple targets when the association of the measurements to the targets is unknown. The method is a further development of the Symmetric Measurement Equation (SME) filter, which removes the data association uncertainty of the original measurement equation with the help of a symmetric transformation. The underlying idea of the Kernel-SME filter is to construct a symmetric transformation by means of mapping the measurements to a Gaussian mixture. This transformation is scalable to a large number of targets and allows for deriving a Gaussian state estimator that has a cubic time complexity in the number of targets.
△ Less
Submitted 24 December, 2012;
originally announced December 2012.
-
Optimal Sequence-Based Control and Estimation of Networked Linear Systems
Authors:
Jörg Fischer,
Marc Reinhardt,
Uwe D. Hanebeck
Abstract:
In this paper, a unified approach to sequence-based control and estimation of linear networked systems with multiple sensors is proposed. Time delays and data losses in the controller-actuator-channel are compensated by sending sequences of control inputs. The sequence-based design paradigm is further extended to the sensor-controller-channels without increasing the load of the network. In this co…
▽ More
In this paper, a unified approach to sequence-based control and estimation of linear networked systems with multiple sensors is proposed. Time delays and data losses in the controller-actuator-channel are compensated by sending sequences of control inputs. The sequence-based design paradigm is further extended to the sensor-controller-channels without increasing the load of the network. In this context, we present a recursive solution based on the Hypothesizing Distributed Kalman Filter (HKF) that is included in the overall sequence-based controller design.
△ Less
Submitted 21 November, 2012;
originally announced November 2012.
-
Optimal Sequence-Based LQG Control over TCP-like Networks Subject to Random Transmission Delays and Packet Losses
Authors:
Jörg Fischer,
Achim Hekler,
Maxim Dolgov,
Uwe D. Hanebeck
Abstract:
This paper addresses the problem of sequence-based controller design for Networked Control Systems (NCS), where control inputs and measurements are transmitted over TCP-like network connections that are subject to stochastic packet losses and time-varying packet delays. At every time step, the controller sends a sequence of predicted control inputs to the actuator in addition to the current contro…
▽ More
This paper addresses the problem of sequence-based controller design for Networked Control Systems (NCS), where control inputs and measurements are transmitted over TCP-like network connections that are subject to stochastic packet losses and time-varying packet delays. At every time step, the controller sends a sequence of predicted control inputs to the actuator in addition to the current control input. In this sequence-based setup, we derive an optimal solution to the Linear Quadratic Gaussian (LQG) control problem and prove that the separation principle holds. Simulations demonstrate the improved performance of this optimal controller compared to other sequence-based approaches.
△ Less
Submitted 13 November, 2012;
originally announced November 2012.
-
Sequence-Based Control for Networked Control Systems Based on Virtual Control Inputs
Authors:
Achim Hekler,
Jörg Fischer,
Uwe D. Hanebeck
Abstract:
In this paper, we address the problem of controlling a system over an unreliable connection that is affected by time-varying delays and randomly occurring packet losses. A novel sequence-based approach is proposed that extends a given controller designed without consideration of the network-induced disturbances. Its key idea is to model the unknown future control inputs by random variables, the so…
▽ More
In this paper, we address the problem of controlling a system over an unreliable connection that is affected by time-varying delays and randomly occurring packet losses. A novel sequence-based approach is proposed that extends a given controller designed without consideration of the network-induced disturbances. Its key idea is to model the unknown future control inputs by random variables, the so-called virtual control inputs, which are characterized by discrete probability density functions. Subject to this probabilistic description, the actual sequence of future control inputs is determined and transmitted to the actuator. The high performance of the proposed approach is demonstrated by means of Monte Carlo simulation runs with an inverted pendulum on a cart and by a detailed comparison to standard NCS approaches.
△ Less
Submitted 12 June, 2012; v1 submitted 4 June, 2012;
originally announced June 2012.
-
Progressive Gaussian Filtering
Authors:
Uwe D. Hanebeck,
Jannik Steinbring
Abstract:
In this paper, we propose a progressive Bayesian procedure, where the measurement information is continuously included into the given prior estimate (although we perform observations at discrete time steps). The key idea is to derive a system of ordinary first-order differential equations (ODE) by employing a new coupled density representation comprising a Gaussian density and its Dirac Mixture ap…
▽ More
In this paper, we propose a progressive Bayesian procedure, where the measurement information is continuously included into the given prior estimate (although we perform observations at discrete time steps). The key idea is to derive a system of ordinary first-order differential equations (ODE) by employing a new coupled density representation comprising a Gaussian density and its Dirac Mixture approximation. The ODE is used for continuously tracking the true non-Gaussian posterior by its best matching Gaussian approximation. The performance of the new filter is evaluated in comparison with state-of-the-art filters by means of a canonical benchmark example, the discrete-time cubic sensor problem.
△ Less
Submitted 31 March, 2012;
originally announced April 2012.
-
Robust Filtering and Smoothing with Gaussian Processes
Authors:
Marc Peter Deisenroth,
Ryan Turner,
Marco F. Huber,
Uwe D. Hanebeck,
Carl Edward Rasmussen
Abstract:
We propose a principled algorithm for robust Bayesian filtering and smoothing in nonlinear stochastic dynamic systems when both the transition function and the measurement function are described by non-parametric Gaussian process (GP) models. GPs are gaining increasing importance in signal processing, machine learning, robotics, and control for representing unknown system functions by posterior pr…
▽ More
We propose a principled algorithm for robust Bayesian filtering and smoothing in nonlinear stochastic dynamic systems when both the transition function and the measurement function are described by non-parametric Gaussian process (GP) models. GPs are gaining increasing importance in signal processing, machine learning, robotics, and control for representing unknown system functions by posterior probability distributions. This modern way of "system identification" is more robust than finding point estimates of a parametric function representation. In this article, we present a principled algorithm for robust analytic smoothing in GP dynamic systems, which are increasingly used in robotics and control. Our numerical evaluations demonstrate the robustness of the proposed approach in situations where other state-of-the-art Gaussian filters and smoothers can fail.
△ Less
Submitted 20 March, 2012;
originally announced March 2012.
-
Using a Telepresence System to Investigate Route Choice Behavior
Authors:
Tobias Kretz,
Stefan Hengst,
Antonia Pérez Arias,
Simon Friedberger,
Uwe D. Hanebeck
Abstract:
A combination of a telepresence system and a microscopic traffic simulator is introduced. It is evaluated using a hotel evacuation scenario. Four different kinds of supporting information are compared, standard exit signs, floor plans with indicated exit routes, guiding lines on the floor and simulated agents leading the way. The results indicate that guiding lines are the most efficient way to su…
▽ More
A combination of a telepresence system and a microscopic traffic simulator is introduced. It is evaluated using a hotel evacuation scenario. Four different kinds of supporting information are compared, standard exit signs, floor plans with indicated exit routes, guiding lines on the floor and simulated agents leading the way. The results indicate that guiding lines are the most efficient way to support an evacuation but the natural behavior of following others comes very close. On another level the results are consistent with previously performed real and virtual experiments and validate the use of a telepresence system in evacuation studies. It is shown that using a microscopic traffic simulator extends the possibilities for evaluation, e.g. by adding simulated humans to the environment.
△ Less
Submitted 4 November, 2011;
originally announced November 2011.
-
Chance-constrained Model Predictive Control for Multi-Agent Systems
Authors:
Daniel Lyons,
Jan-P. Calliess,
Uwe D. Hanebeck
Abstract:
We consider stochastic model predictive control of a multi-agent systems with constraints on the probabilities of inter-agent collisions. We first study a sample-based approximation of the collision probabilities and use this approximation to formulate constraints for the stochastic control problem. This approximation will converge as the number of samples goes to infinity, however, the complexity…
▽ More
We consider stochastic model predictive control of a multi-agent systems with constraints on the probabilities of inter-agent collisions. We first study a sample-based approximation of the collision probabilities and use this approximation to formulate constraints for the stochastic control problem. This approximation will converge as the number of samples goes to infinity, however, the complexity of the resulting control problem is so high that this approach proves unsuitable for control under real-time requirements. To alleviate the computational burden we propose a second approach that uses probabilistic bounds to determine regions with increased probability of presence for each agent and formulate constraints for the control problem that guarantee that these regions will not overlap. We prove that the resulting problem is conservative for the original problem with probabilistic constraints, ie. every control strategy that is feasible under our new constraints will automatically be feasible for the original problem. Furthermore we show in simulations in a UAV path planning scenario that our proposed approach grants significantly better run-time performance compared to a controller with the sample-based approximation with only a small degree of sub-optimality resulting from the conservativeness of our new approach.
△ Less
Submitted 16 August, 2011; v1 submitted 28 April, 2011;
originally announced April 2011.
-
Extended Range Telepresence for Evacuation Training in Pedestrian Simulations
Authors:
Antonia Perez Arias,
Uwe D. Hanebeck,
Peter Ehrhardt,
Stefan Hengst,
Tobias Kretz,
Peter Vortisch
Abstract:
In this contribution, we propose a new framework to evaluate pedestrian simula-tions by using Extended Range Telepresence. Telepresence is used as a virtual reality walking simulator, which provides the user with a realistic impression of being present and walking in a virtual environment that is much larger than the real physical environment, in which the user actually walks. The validation of…
▽ More
In this contribution, we propose a new framework to evaluate pedestrian simula-tions by using Extended Range Telepresence. Telepresence is used as a virtual reality walking simulator, which provides the user with a realistic impression of being present and walking in a virtual environment that is much larger than the real physical environment, in which the user actually walks. The validation of the simulation is performed by comparing motion data of the telepresent user with simulated data at some points of the simulation. The use of haptic feedback from the simulation makes the framework suitable for training in emergency situations.
△ Less
Submitted 19 February, 2010;
originally announced February 2010.