-
Transferability of Convolutional Neural Networks in Stationary Learning Tasks
Authors:
Damian Owerko,
Charilaos I. Kanatsoulis,
Jennifer Bondarchuk,
Donald J. Bucci Jr,
Alejandro Ribeiro
Abstract:
Recent advances in hardware and big data acquisition have accelerated the development of deep learning techniques. For an extended period of time, increasing the model complexity has led to performance improvements for various tasks. However, this trend is becoming unsustainable and there is a need for alternative, computationally lighter methods. In this paper, we introduce a novel framework for…
▽ More
Recent advances in hardware and big data acquisition have accelerated the development of deep learning techniques. For an extended period of time, increasing the model complexity has led to performance improvements for various tasks. However, this trend is becoming unsustainable and there is a need for alternative, computationally lighter methods. In this paper, we introduce a novel framework for efficient training of convolutional neural networks (CNNs) for large-scale spatial problems. To accomplish this we investigate the properties of CNNs for tasks where the underlying signals are stationary. We show that a CNN trained on small windows of such signals achieves a nearly performance on much larger windows without retraining. This claim is supported by our theoretical analysis, which provides a bound on the performance degradation. Additionally, we conduct thorough experimental analysis on two tasks: multi-target tracking and mobile infrastructure on demand. Our results show that the CNN is able to tackle problems with many hundreds of agents after being trained with fewer than ten. Thus, CNN architectures provide solutions to these problems at previously computationally intractable scales.
△ Less
Submitted 21 July, 2023;
originally announced July 2023.
-
Deterministic Multi-sensor Measurement-adaptive Birth using Labeled Random Finite Sets
Authors:
Jennifer Bondarchuk,
Anthony Trezza,
Donald J. Bucci Jr
Abstract:
Measurement-adaptive track initiation remains a critical design requirement of many practical multi-target tracking systems. For labeled random finite sets multi-object filters, prior work has been established to construct a labeled multi-object birth density using measurements from multiple sensors. A truncation procedure has also been provided that leverages a stochastic Gibbs sampler to truncat…
▽ More
Measurement-adaptive track initiation remains a critical design requirement of many practical multi-target tracking systems. For labeled random finite sets multi-object filters, prior work has been established to construct a labeled multi-object birth density using measurements from multiple sensors. A truncation procedure has also been provided that leverages a stochastic Gibbs sampler to truncate the birth density for scalability. In this work, we introduce a deterministic herded Gibbs sampling truncation solution for efficient multi-sensor adaptive track initialization. Removing the stochastic behavior of the track initialization procedure without impacting average tracking performance enables a more robust tracking solution more suitable for safety-critical applications. Simulation results for linear sensing scenarios are provided to verify performance.
△ Less
Submitted 12 July, 2023;
originally announced July 2023.
-
On Gibbs Sampling Architecture for Labeled Random Finite Sets Multi-Object Tracking
Authors:
Anthony Trezza,
Donald J. Bucci Jr.,
Pramod K. Varshney
Abstract:
Gibbs sampling is one of the most popular Markov chain Monte Carlo algorithms because of its simplicity, scalability, and wide applicability within many fields of statistics, science, and engineering. In the labeled random finite sets literature, Gibbs sampling procedures have recently been applied to efficiently truncate the single-sensor and multi-sensor $δ$-generalized labeled multi-Bernoulli p…
▽ More
Gibbs sampling is one of the most popular Markov chain Monte Carlo algorithms because of its simplicity, scalability, and wide applicability within many fields of statistics, science, and engineering. In the labeled random finite sets literature, Gibbs sampling procedures have recently been applied to efficiently truncate the single-sensor and multi-sensor $δ$-generalized labeled multi-Bernoulli posterior density as well as the multi-sensor adaptive labeled multi-Bernoulli birth distribution. However, only a limited discussion has been provided regarding key Gibbs sampler architecture details including the Markov chain Monte Carlo sample generation technique and early termination criteria. This paper begins with a brief background on Markov chain Monte Carlo methods and a review of the Gibbs sampler implementations proposed for labeled random finite sets filters. Next, we propose a short chain, multi-simulation sample generation technique that is well suited for these applications and enables a parallel processing implementation. Additionally, we present two heuristic early termination criteria that achieve similar sampling performance with substantially fewer Markov chain observations. Finally, the benefits of the proposed Gibbs samplers are demonstrated via two Monte Carlo simulations.
△ Less
Submitted 26 June, 2023;
originally announced June 2023.
-
Multi-Target Tracking with Transferable Convolutional Neural Networks
Authors:
Damian Owerko,
Charilaos I. Kanatsoulis,
Jennifer Bondarchuk,
Donald J. Bucci Jr,
Alejandro Ribeiro
Abstract:
Multi-target tracking (MTT) is a classical signal processing task, where the goal is to estimate the states of an unknown number of moving targets from noisy sensor measurements. In this paper, we revisit MTT from a deep learning perspective and propose a convolutional neural network (CNN) architecture to tackle it. We represent the target states and sensor measurements as images and recast the pr…
▽ More
Multi-target tracking (MTT) is a classical signal processing task, where the goal is to estimate the states of an unknown number of moving targets from noisy sensor measurements. In this paper, we revisit MTT from a deep learning perspective and propose a convolutional neural network (CNN) architecture to tackle it. We represent the target states and sensor measurements as images and recast the problem as an image-to-image prediction task. Then we train a fully convolutional model at small tracking areas and transfer it to much larger areas with numerous targets and sensors. This transfer learning approach enables MTT at a large scale and is also theoretically supported by our novel analysis that bounds the generalization error. In practice, the proposed transferable CNN architecture outperforms random finite set filters on the MTT task with 10 targets and transfers without re-training to a larger MTT task with 250 targets with a 29% performance improvement.
△ Less
Submitted 25 July, 2023; v1 submitted 27 October, 2022;
originally announced October 2022.
-
Multi-sensor Joint Adaptive Birth Sampler for Labeled Random Finite Set Tracking
Authors:
Anthony Trezza,
Donald J. Bucci Jr.,
Pramod K. Varshney
Abstract:
This paper provides a scalable, multi-sensor measurement adaptive track initiation technique for labeled random finite set filters. A naive construction of the multi-sensor measurement adaptive birth set distribution leads to an exponential number of newborn components in the number of sensors. A truncation criterion is established for a labeled multi-Bernoulli random finite set birth density. The…
▽ More
This paper provides a scalable, multi-sensor measurement adaptive track initiation technique for labeled random finite set filters. A naive construction of the multi-sensor measurement adaptive birth set distribution leads to an exponential number of newborn components in the number of sensors. A truncation criterion is established for a labeled multi-Bernoulli random finite set birth density. The proposed truncation criterion is shown to have a bounded L1 error in the generalized labeled multi-Bernoulli posterior density. This criterion is used to construct a Gibbs sampler that produces a truncated measurement-generated labeled multi-Bernoulli birth distribution with quadratic complexity in the number of sensors. A closed-form solution of the conditional sampling distribution assuming linear Gaussian likelihoods is provided, alongside an approximate solution using Monte Carlo importance sampling. Multiple simulation results are provided to verify the efficacy of the truncation criterion, as well as the reduction in complexity.
△ Less
Submitted 29 April, 2022; v1 submitted 11 August, 2021;
originally announced September 2021.
-
Decentralized Gaussian Filters for Cooperative Self-localization and Multi-target Tracking
Authors:
Pranay Sharma,
Augustin-Alexandru Saucan,
Donald J. Bucci Jr.,
Pramod K. Varshney
Abstract:
Scalable and decentralized algorithms for Cooperative Self-localization (CS) of agents, and Multi-Target Tracking (MTT) are important in many applications. In this work, we address the problem of Simultaneous Cooperative Self-localization and Multi-Target Tracking (SCS-MTT) under target data association uncertainty, i.e., the associations between measurements and target tracks are unknown. Existin…
▽ More
Scalable and decentralized algorithms for Cooperative Self-localization (CS) of agents, and Multi-Target Tracking (MTT) are important in many applications. In this work, we address the problem of Simultaneous Cooperative Self-localization and Multi-Target Tracking (SCS-MTT) under target data association uncertainty, i.e., the associations between measurements and target tracks are unknown. Existing CS and tracking algorithms either make the assumption of no data association uncertainty or employ a hard-decision rule for measurement-to-target associations. We propose a novel decentralized SCS-MTT method for an unknown and time-varying number of targets under association uncertainty. Marginal posterior densities for agents and targets are obtained by an efficient belief propagation (BP) based scheme while data association is handled by marginalizing over all target-to-measurement association probabilities. Decentralized single Gaussian and Gaussian mixture implementations are provided based on average consensus schemes, which require communication only with one-hop neighbors. An additional novelty is a decentralized Gibbs mechanism for efficient evaluation of the product of Gaussian mixtures. Numerical experiments show the improved CS and MTT performance compared to the conventional approach of separate localization and target tracking.
△ Less
Submitted 15 April, 2020;
originally announced April 2020.
-
On Distributed Online Convex Optimization with Sublinear Dynamic Regret and Fit
Authors:
Pranay Sharma,
Prashant Khanduri,
Lixin Shen,
Donald J. Bucci Jr.,
Pramod K. Varshney
Abstract:
In this work, we consider a distributed online convex optimization problem, with time-varying (potentially adversarial) constraints. A set of nodes, jointly aim to minimize a global objective function, which is the sum of local convex functions. The objective and constraint functions are revealed locally to the nodes, at each time, after taking an action. Naturally, the constraints cannot be insta…
▽ More
In this work, we consider a distributed online convex optimization problem, with time-varying (potentially adversarial) constraints. A set of nodes, jointly aim to minimize a global objective function, which is the sum of local convex functions. The objective and constraint functions are revealed locally to the nodes, at each time, after taking an action. Naturally, the constraints cannot be instantaneously satisfied. Therefore, we reformulate the problem to satisfy these constraints in the long term. To this end, we propose a distributed primal-dual mirror descent based approach, in which the primal and dual updates are carried out locally at all the nodes. This is followed by sharing and mixing of the primal variables by the local nodes via communication with the immediate neighbors. To quantify the performance of the proposed algorithm, we utilize the challenging, but more realistic metrics of dynamic regret and fit. Dynamic regret measures the cumulative loss incurred by the algorithm, compared to the best dynamic strategy. On the other hand, fit measures the long term cumulative constraint violations. Without assuming the restrictive Slater's conditions, we show that the proposed algorithm achieves sublinear regret and fit under mild, commonly used assumptions.
△ Less
Submitted 5 May, 2021; v1 submitted 9 January, 2020;
originally announced January 2020.
-
Obstructed Target Tracking in Urban Environments
Authors:
Christopher Berry,
Donald J. Bucci
Abstract:
Accurate tracking in urban environments necessitates target birth, survival, and detection models that quantify the impact of terrain and building geometry on the sequential estimation procedure. Current efforts assume that target trajectories are limited to fixed paths, such as road networks. In these settings a single airborne platform with a downward-facing camera is capable of fully observing…
▽ More
Accurate tracking in urban environments necessitates target birth, survival, and detection models that quantify the impact of terrain and building geometry on the sequential estimation procedure. Current efforts assume that target trajectories are limited to fixed paths, such as road networks. In these settings a single airborne platform with a downward-facing camera is capable of fully observing a target, outside of a few obstructed regions that can be determined a priori (e.g. tunnels). However, many practical target types are not necessarily restricted to road networks and thus require knowledge of azimuthal shadowed regions to the sensor. In this paper, we propose the integration of geospatial data for an urban environment into a particle filter realization of a random finite set target tracking algorithm. Specifically, we use 3D building polygons to compute the azimuthal shadowed regions with respect to deployed sensor location. The particle filter predict and update steps are modified such that (1) target births are assumed to occur in line-of-sight (LOS) regions, (2) targets do not move into obstructions, (3) true target detections only occur in LOS regions. The localization error performance improvement for a single target Bernoulli filter under these modifications is presented using freely available building vector data of New York City.
△ Less
Submitted 5 June, 2019;
originally announced June 2019.
-
Passive Multi-Target Tracking Using the Adaptive Birth Intensity PHD Filter
Authors:
Christopher Berry,
Donald J. Bucci,
Samuel W. Schmidt
Abstract:
Passive multi-target tracking applications require the integration of multiple spatially distributed sensor measurements to distinguish true tracks from ghost tracks. A popular multi-target tracking approach for these applications is the particle filter implementation of Mahler's probability hypothesis density (PHD) filter, which jointly updates the union of all target state space estimates withou…
▽ More
Passive multi-target tracking applications require the integration of multiple spatially distributed sensor measurements to distinguish true tracks from ghost tracks. A popular multi-target tracking approach for these applications is the particle filter implementation of Mahler's probability hypothesis density (PHD) filter, which jointly updates the union of all target state space estimates without requiring computationally complex measurement-to-track data association. Although this technique is attractive for implementation in computationally limited platforms, the performance benefits can be significantly overshadowed by inefficient sampling of the target birth particles over the region of interest. We propose a multi-sensor extension of the adaptive birth intensity PHD filter described in (Ristic, 2012) to achieve efficient birth particle sampling driven by online sensor measurements from multiple sensors. The proposed approach is demonstrated using distributed time-difference-of-arrival (TDOA) and frequency-difference-of-arrival (FDOA) measurements, in which we describe exact techniques for sampling from the target state space conditioned on the observations. Numerical results are presented that demonstrate the increased particle density efficiency of the proposed approach over a uniform birth particle sampler.
△ Less
Submitted 5 June, 2019;
originally announced June 2019.
-
Decentralized Multi-target Tracking in Urban Environments: Overview and Challenges
Authors:
Donald J. Bucci Jr.,
Pramod K. Varshney
Abstract:
In multi-target tracking, sensor control involves dynamically configuring sensors to achieve improved tracking performance. Many of these techniques focus on sensors with memoryless states (e.g., waveform adaptation, beam scheduling, and sensor selection), lending themselves to computationally efficient control strategies. Mobile sensor control for multi-target tracking, however, is significantly…
▽ More
In multi-target tracking, sensor control involves dynamically configuring sensors to achieve improved tracking performance. Many of these techniques focus on sensors with memoryless states (e.g., waveform adaptation, beam scheduling, and sensor selection), lending themselves to computationally efficient control strategies. Mobile sensor control for multi-target tracking, however, is significantly more challenging due to the complexity of the platform state dynamics. This platform complexity necessitates high-fidelity, non-myopic control strategies in order to achieve strong tracking performance while maintaining safe operation. These sensor control techniques are particularly important in non-cooperative urban surveillance applications including person of interest, vehicle, and unauthorized UAV interdiction. In this overview paper, we highlight the current state of the art in mobile sensor control for multi-target tracking in urban environments. We use this application to motivate the need for closer collaboration between the information fusion, tracking, and control research communities across three challenge areas relevant to the urban surveillance problem.
△ Less
Submitted 5 July, 2019; v1 submitted 3 June, 2019;
originally announced June 2019.
