-
Online Trajectory Optimization for Persistent Monitoring Problems in Partitioned Environments
Authors:
Jonas Hall,
Christos G. Cassandras,
Sean B. Andersson
Abstract:
We consider the problem of using an autonomous agent to persistently monitor a collection of dynamic targets distributed in an environment. We generalize existing work by allowing the agent's dynamics to vary throughout the environment, leading to a hybrid dynamical system. This introduces an additional layer of complexity towards the planning portion of the problem: we must not only identify in w…
▽ More
We consider the problem of using an autonomous agent to persistently monitor a collection of dynamic targets distributed in an environment. We generalize existing work by allowing the agent's dynamics to vary throughout the environment, leading to a hybrid dynamical system. This introduces an additional layer of complexity towards the planning portion of the problem: we must not only identify in which order to visit the points of interest, but also in which order to traverse the regions. We design an offline high-level sequence planner together with an online trajectory optimizer realizing the computed visiting sequence. We provide numerical experiments to illustrate the performance of our approach.
△ Less
Submitted 28 February, 2025; v1 submitted 28 March, 2024;
originally announced March 2024.
-
A Bilevel Optimization Scheme for Persistent Monitoring
Authors:
Jonas Hall,
Logan E. Beaver,
Christos G. Cassandras,
Sean B. Andersson
Abstract:
In this paper we study an infinite-horizon persistent monitoring problem in a two-dimensional mission space containing a finite number of statically placed targets, at each of which we assume a constant rate of uncertainty accumulation. Equipped with a sensor of finite range, the agent is capable of reducing the uncertainty of nearby targets. We derive a steady-state minimum time periodic trajecto…
▽ More
In this paper we study an infinite-horizon persistent monitoring problem in a two-dimensional mission space containing a finite number of statically placed targets, at each of which we assume a constant rate of uncertainty accumulation. Equipped with a sensor of finite range, the agent is capable of reducing the uncertainty of nearby targets. We derive a steady-state minimum time periodic trajectory over which each of the target uncertainties is driven down to zero during each visit. A hierarchical decomposition leads to purely local optimal control problems, coupled via boundary conditions. We optimize both the local trajectory segments as well as the boundary conditions in an on-line bilevel optimization scheme.
△ Less
Submitted 7 April, 2023;
originally announced April 2023.
-
Optimal Persistent Monitoring of Mobile Targets in One Dimension
Authors:
Jonas Hall,
Sean B. Andersson,
Christos G. Cassandras
Abstract:
This work shows the existence of optimal control laws for persistent monitoring of mobile targets in a one-dimensional mission space and derives explicit solutions. The underlying performance metric consists of minimizing the total uncertainty accumulated over a finite mission time. We first demonstrate that the corresponding optimal control problem can be reduced to a finite-dimensional optimizat…
▽ More
This work shows the existence of optimal control laws for persistent monitoring of mobile targets in a one-dimensional mission space and derives explicit solutions. The underlying performance metric consists of minimizing the total uncertainty accumulated over a finite mission time. We first demonstrate that the corresponding optimal control problem can be reduced to a finite-dimensional optimization problem, and then establish existence of an optimal solution. Motivated by this result, we construct a parametric reformulation for which an event based gradient descent method is utilized with the goal of deriving (locally optimal) solutions. We additionally provide a more practical parameterization that has attractive properties such as simplicity, flexibility, and robustness. Both parameterizations are validated through simulation.
△ Less
Submitted 3 October, 2022;
originally announced October 2022.
-
Simultaneous Localization and Parameter Estimation for Single Particle Tracking via Sigma Points based EM
Authors:
Ye Lin,
Sean B. Andersson
Abstract:
Single Particle Tracking (SPT) is a powerful class of tools for analyzing the dynamics of individual biological macromolecules moving inside living cells. The acquired data is typically in the form of a sequence of camera images that are then post-processed to reveal details about the motion. In this work, we develop an algorithm for jointly estimating both particle trajectory and motion model par…
▽ More
Single Particle Tracking (SPT) is a powerful class of tools for analyzing the dynamics of individual biological macromolecules moving inside living cells. The acquired data is typically in the form of a sequence of camera images that are then post-processed to reveal details about the motion. In this work, we develop an algorithm for jointly estimating both particle trajectory and motion model parameters from the data. Our approach uses Expectation Maximization (EM) combined with an Unscented Kalman filter (UKF) and an Unscented Rauch-Tung-Striebel smoother (URTSS), allowing us to use an accurate, nonlinear model of the observations acquired by the camera. Due to the shot noise characteristics of the photon generation process, this model uses a Poisson distribution to capture the measurement noise inherent in imaging. In order to apply a UKF, we first must transform the measurements into a model with additive Gaussian noise. We consider two approaches, one based on variance stabilizing transformations (where we compare the Anscombe and Freeman-Tukey transforms) and one on a Gaussian approximation to the Poisson distribution. Through simulations, we demonstrate efficacy of the approach and explore the differences among these measurement transformations.
△ Less
Submitted 21 January, 2020;
originally announced January 2020.
-
Optimal Threshold-Based Control Policies for Persistent Monitoring on Graphs
Authors:
Nan Zhou,
Christos G. Cassandras,
Xi Yu,
Sean B. Andersson
Abstract:
We consider the optimal multi-agent persistent monitoring problem defined by a team of cooperating agents visiting a set of nodes (targets) on a graph with the objective of minimizing a measure of overall node state uncertainty. The solution to this problem involves agent trajectories defined both by the sequence of nodes to be visited by each agent and the amount of time spent at each node. Since…
▽ More
We consider the optimal multi-agent persistent monitoring problem defined by a team of cooperating agents visiting a set of nodes (targets) on a graph with the objective of minimizing a measure of overall node state uncertainty. The solution to this problem involves agent trajectories defined both by the sequence of nodes to be visited by each agent and the amount of time spent at each node. Since such optimal trajectories are generally intractable, we propose a class of distributed threshold-based parametric controllers through which agent transitions from one node to the next are controlled by threshold parameters on the node uncertainty states. The resulting behavior of the agent-target system can be described by a hybrid dynamic system. This enables the use of Infinitesimal Perturbation Analysis (IPA) to determine on line (locally) optimal threshold parameters through gradient descent methods and thus obtain optimal controllers within this family of threshold-based policies. We further show that in a single-agent case the IPA gradient is monotonic, which implies a simple structure whereby an agent visiting a node should reduce the uncertainty state to zero before moving to the next node. Simulation examples are included to illustrate our results and compare them to optimal solutions derived through dynamic programming when this is possible.
△ Less
Submitted 7 March, 2018;
originally announced March 2018.
-
Decentralized Event-Driven Algorithms for Multi-Agent Persistent Monitoring
Authors:
Nan Zhou,
Christos G. Cassandras,
Xi Yu,
Sean B. Andersson
Abstract:
We address the issue of identifying conditions under which the centralized solution to the optimal multi-agent persistent monitoring problem can be recovered in a decentralized event-driven manner. In this problem, multiple agents interact with a finite number of targets and the objective is to control their movement in order to minimize an uncertainty metric associated with the targets. In a one-…
▽ More
We address the issue of identifying conditions under which the centralized solution to the optimal multi-agent persistent monitoring problem can be recovered in a decentralized event-driven manner. In this problem, multiple agents interact with a finite number of targets and the objective is to control their movement in order to minimize an uncertainty metric associated with the targets. In a one-dimensional setting, it has been shown that the optimal solution can be reduced to a simpler parametric optimization problem and that the behavior of agents under optimal control is described by a hybrid system. This hybrid system can be analyzed using Infinitesimal Perturbation Analysis (IPA) to obtain a complete on-line solution through an event-driven centralized gradient-based algorithm. We show that the IPA gradient can be recovered in a distributed manner in which each agent optimizes its trajectory based on local information, except for one event requiring communication from a non-neighbor agent. Simulation examples are included to illustrate the effectiveness of this "almost decentralized" algorithm and its fully decentralized counterpart where the aforementioned non-local event is ignored.
△ Less
Submitted 21 August, 2017;
originally announced August 2017.
-
Optimal Event-Driven Multi-Agent Persistent Monitoring of a Finite Set of Targets
Authors:
Nan Zhou,
Xi Yu,
Sean B. Andersson,
Christos G. Cassandras
Abstract:
We consider the problem of controlling the movement of multiple cooperating agents so as to minimize an uncertainty metric associated with a finite number of targets. In a one-dimensional mission space, we adopt an optimal control framework and show that the solution is reduced to a simpler parametric optimization problem: determining a sequence of locations where each agent may dwell for a finite…
▽ More
We consider the problem of controlling the movement of multiple cooperating agents so as to minimize an uncertainty metric associated with a finite number of targets. In a one-dimensional mission space, we adopt an optimal control framework and show that the solution is reduced to a simpler parametric optimization problem: determining a sequence of locations where each agent may dwell for a finite amount of time and then switch direction. This amounts to a hybrid system which we analyze using Infinitesimal Perturbation Analysis (IPA) to obtain a complete on-line solution through an event-driven gradient-based algorithm which is also robust with respect to the uncertainty model used. The resulting controller depends on observing the events required to excite the gradient-based algorithm, which cannot be guaranteed. We solve this problem by proposing a new metric for the objective function which creates a potential field guaranteeing that gradient values are non-zero. This approach is compared to an alternative graph-based task scheduling algorithm for determining an optimal sequence of target visits. Simulation examples are included to demonstrate the proposed methods.
△ Less
Submitted 13 March, 2016;
originally announced March 2016.
-
Subspace estimation and prediction methods for hidden Markov models
Authors:
Sofia Andersson,
Tobias Rydén
Abstract:
Hidden Markov models (HMMs) are probabilistic functions of finite Markov chains, or, put in other words, state space models with finite state space. In this paper, we examine subspace estimation methods for HMMs whose output lies a finite set as well. In particular, we study the geometric structure arising from the nonminimality of the linear state space representation of HMMs, and consistency o…
▽ More
Hidden Markov models (HMMs) are probabilistic functions of finite Markov chains, or, put in other words, state space models with finite state space. In this paper, we examine subspace estimation methods for HMMs whose output lies a finite set as well. In particular, we study the geometric structure arising from the nonminimality of the linear state space representation of HMMs, and consistency of a subspace algorithm arising from a certain factorization of the singular value decomposition of the estimated linear prediction matrix. For this algorithm, we show that the estimates of the transition and emission probability matrices are consistent up to a similarity transformation, and that the $m$-step linear predictor computed from the estimated system matrices is consistent, i.e., converges to the true optimal linear $m$-step predictor.
△ Less
Submitted 20 November, 2009; v1 submitted 27 July, 2009;
originally announced July 2009.
-
On the structure of essential graphs for AMP chain graph models
Authors:
Steen A. Andersson,
Michael D. Perlman
Abstract:
Chain graphs (CG) use undirected and directed edges to represent both structural and associative dependences. Like acyclic directed graphs (ADGs), the CG associated with a statistical Markov model may not be unique, so CGs fall into Markov equivalence classes, which may be superexponentially large, leading to unidentifiability and computational inefficiency in model search and selection.Under the…
▽ More
Chain graphs (CG) use undirected and directed edges to represent both structural and associative dependences. Like acyclic directed graphs (ADGs), the CG associated with a statistical Markov model may not be unique, so CGs fall into Markov equivalence classes, which may be superexponentially large, leading to unidentifiability and computational inefficiency in model search and selection.Under the Andersson--Madigan--Perlman (AMP) interpretation of a CG, each Markov-equivalence class can be uniquely represented by a single CG, the AMP essential graph, that can be used for efficient inference and model search and selection. Here the graphical structure of an AMP essential graph is studied in detail. This structural information will be useful for algorithmic construction of the essential graph.
△ Less
Submitted 14 October, 2019; v1 submitted 3 July, 2006;
originally announced July 2006.
