-
Beyond boundaries: Gary Lorden's groundbreaking contributions to sequential analysis
Authors:
Jay Bartroff,
Alexander G. Tartakovsky
Abstract:
Gary Lorden provided several fundamental and novel insights into sequential hypothesis testing and changepoint detection. In this article, we provide an overview of Lorden's contributions in the context of existing results in those areas, and some extensions made possible by Lorden's work. We also mention some of Lorden's significant consulting work, including as an expert witness and for NASA, th…
▽ More
Gary Lorden provided several fundamental and novel insights into sequential hypothesis testing and changepoint detection. In this article, we provide an overview of Lorden's contributions in the context of existing results in those areas, and some extensions made possible by Lorden's work. We also mention some of Lorden's significant consulting work, including as an expert witness and for NASA, the entertainment industry, and Major League Baseball.
△ Less
Submitted 28 June, 2024; v1 submitted 27 March, 2024;
originally announced March 2024.
-
Detecting an Intermittent Change of Unknown Duration
Authors:
Grigory Sokolov,
Valentin S. Spivak,
Alexander G. Tartakovsky
Abstract:
Oftentimes in practice, the observed process changes statistical properties at an unknown point in time and the duration of a change is substantially finite, in which case one says that the change is intermittent or transient. We provide an overview of existing approaches for intermittent change detection and advocate in favor of a particular setting driven by the intermittent nature of the change…
▽ More
Oftentimes in practice, the observed process changes statistical properties at an unknown point in time and the duration of a change is substantially finite, in which case one says that the change is intermittent or transient. We provide an overview of existing approaches for intermittent change detection and advocate in favor of a particular setting driven by the intermittent nature of the change. We propose a novel optimization criterion that is more appropriate for many applied areas such as the detection of threats in physical-computer systems, near-Earth space informatics, epidemiology, pharmacokinetics, etc. We argue that controlling the local conditional probability of a false alarm, rather than the familiar average run length to a false alarm, and maximizing the local conditional probability of detection is a more reasonable approach versus a traditional quickest change detection approach that requires minimizing the expected delay to detection. We adopt the maximum likelihood (ML) approach with respect to the change duration and show that several commonly used detection rules (CUSUM, window-limited CUSUM, and FMA) are equivalent to the ML-based stopping times. We discuss how to choose design parameters for these rules and provide a comprehensive simulation study to corroborate intuitive expectations.
△ Less
Submitted 10 April, 2023; v1 submitted 31 October, 2022;
originally announced October 2022.
-
Quickest Change Detection with Non-Stationary Post-Change Observations
Authors:
Yuchen Liang,
Alexander G. Tartakovsky,
Venugopal V. Veeravalli
Abstract:
The problem of quickest detection of a change in the distribution of a sequence of independent observations is considered. The pre-change observations are assumed to be stationary with a known distribution, while the post-change observations are allowed to be non-stationary with some possible parametric uncertainty in their distribution. In particular, it is assumed that the cumulative Kullback-Le…
▽ More
The problem of quickest detection of a change in the distribution of a sequence of independent observations is considered. The pre-change observations are assumed to be stationary with a known distribution, while the post-change observations are allowed to be non-stationary with some possible parametric uncertainty in their distribution. In particular, it is assumed that the cumulative Kullback-Leibler divergence between the post-change and the pre-change distributions grows in a certain manner with time after the change-point. For the case where the post-change distributions are known, a universal asymptotic lower bound on the delay is derived, as the false alarm rate goes to zero. Furthermore, a window-limited Cumulative Sum (CuSum) procedure is developed, and shown to achieve the lower bound asymptotically. For the case where the post-change distributions have parametric uncertainty, a window-limited (WL) generalized likelihood-ratio (GLR) CuSum procedure is developed and is shown to achieve the universal lower bound asymptotically. Extensions to the case with dependent observations are discussed. The analysis is validated through numerical results on synthetic data. The use of the WL-GLR-CuSum procedure in monitoring pandemics is also demonstrated.
△ Less
Submitted 17 October, 2022; v1 submitted 4 October, 2021;
originally announced October 2021.
-
Physics-Informed Neural Networks for Multiphysics Data Assimilation with Application to Subsurface Transport
Authors:
QiZhi He,
David Brajas-Solano,
Guzel Tartakovsky,
Alexandre M. Tartakovsky
Abstract:
Data assimilation for parameter and state estimation in subsurface transport problems remains a significant challenge due to the sparsity of measurements, the heterogeneity of porous media, and the high computational cost of forward numerical models. We present a physics-informed deep neural networks (DNNs) machine learning method for estimating space-dependent hydraulic conductivity, hydraulic he…
▽ More
Data assimilation for parameter and state estimation in subsurface transport problems remains a significant challenge due to the sparsity of measurements, the heterogeneity of porous media, and the high computational cost of forward numerical models. We present a physics-informed deep neural networks (DNNs) machine learning method for estimating space-dependent hydraulic conductivity, hydraulic head, and concentration fields from sparse measurements. In this approach, we employ individual DNNs to approximate the unknown parameters (e.g., hydraulic conductivity) and states (e.g., hydraulic head and concentration) of a physical system, and jointly train these DNNs by minimizing the loss function that consists of the governing equations residuals in addition to the error with respect to measurement data. We apply this approach to assimilate conductivity, hydraulic head, and concentration measurements for joint inversion of the conductivity, hydraulic head, and concentration fields in a steady-state advection--dispersion problem. We study the accuracy of the physics-informed DNN approach with respect to data size, number of variables (conductivity and head versus conductivity, head, and concentration), DNNs size, and DNN initialization during training. We demonstrate that the physics-informed DNNs are significantly more accurate than standard data-driven DNNs when the training set consists of sparse data. We also show that the accuracy of parameter estimation increases as additional variables are inverted jointly.
△ Less
Submitted 5 December, 2019;
originally announced December 2019.
-
Physics-Informed CoKriging: A Gaussian-Process-Regression-Based Multifidelity Method for Data-Model Convergence
Authors:
Xiu Yang,
David Barajas-Solano,
Guzel Tartakovsky,
Alexandre Tartakovsky
Abstract:
In this work, we propose a new Gaussian process regression (GPR)-based multifidelity method: physics-informed CoKriging (CoPhIK). In CoKriging-based multifidelity methods, the quantities of interest are modeled as linear combinations of multiple parameterized stationary Gaussian processes (GPs), and the hyperparameters of these GPs are estimated from data via optimization. In CoPhIK, we construct…
▽ More
In this work, we propose a new Gaussian process regression (GPR)-based multifidelity method: physics-informed CoKriging (CoPhIK). In CoKriging-based multifidelity methods, the quantities of interest are modeled as linear combinations of multiple parameterized stationary Gaussian processes (GPs), and the hyperparameters of these GPs are estimated from data via optimization. In CoPhIK, we construct a GP representing low-fidelity data using physics-informed Kriging (PhIK), and model the discrepancy between low- and high-fidelity data using a parameterized GP with hyperparameters identified via optimization. Our approach reduces the cost of optimization for inferring hyperparameters by incorporating partial physical knowledge. We prove that the physical constraints in the form of deterministic linear operators are satisfied up to an error bound. Furthermore, we combine CoPhIK with a greedy active learning algorithm for guiding the selection of additional observation locations. The efficiency and accuracy of CoPhIK are demonstrated for reconstructing the partially observed modified Branin function, reconstructing the sparsely observed state of a steady state heat transport problem, and learning a conservative tracer distribution from sparse tracer concentration measurements.
△ Less
Submitted 23 November, 2018;
originally announced November 2018.
-
Physics-Information-Aided Kriging: Constructing Covariance Functions using Stochastic Simulation Models
Authors:
Xiu Yang,
Guzel Tartakovsky,
Alexandre Tartakovsky
Abstract:
In this work, we propose a new Gaussian process regression (GPR) method: physics information aided Kriging (PhIK). In the standard data-driven Kriging, the unknown function of interest is usually treated as a Gaussian process with assumed stationary covariance with hyperparameters estimated from data. In PhIK, we compute the mean and covariance function from realizations of available stochastic mo…
▽ More
In this work, we propose a new Gaussian process regression (GPR) method: physics information aided Kriging (PhIK). In the standard data-driven Kriging, the unknown function of interest is usually treated as a Gaussian process with assumed stationary covariance with hyperparameters estimated from data. In PhIK, we compute the mean and covariance function from realizations of available stochastic models, e.g., from realizations of governing stochastic partial differential equations solutions. Such constructed Gaussian process generally is non-stationary, and does not assume a specific form of the covariance function. Our approach avoids the optimization step in data-driven GPR methods to identify the hyperparameters. More importantly, we prove that the physical constraints in the form of a deterministic linear operator are guaranteed in the resulting prediction. We also provide an error estimate in preserving the physical constraints when errors are included in the stochastic model realizations. To reduce the computational cost of obtaining stochastic model realizations, we propose a multilevel Monte Carlo estimate of the mean and covariance functions. Further, we present an active learning algorithm that guides the selection of additional observation locations. The efficiency and accuracy of PhIK are demonstrated for reconstructing a partially known modified Branin function, studying a three-dimensional heat transfer problem and learning a conservative tracer distribution from sparse concentration measurements.
△ Less
Submitted 15 November, 2021; v1 submitted 10 September, 2018;
originally announced September 2018.
-
Tracking Changes in Resilience and Level of Coordination in Terrorist Groups
Authors:
Vasanthan Raghavan,
Alexander G. Tartakovsky
Abstract:
Activity profiles of terrorist groups show frequent spurts and downfalls corresponding to changes in the underlying organizational dynamics. In particular, it is of interest in understanding changes in attributes such as intentions/ideology, tactics/strategies, capabilities/resources, etc., that influence and impact the activity. The goal of this work is the quick detection of such changes and in…
▽ More
Activity profiles of terrorist groups show frequent spurts and downfalls corresponding to changes in the underlying organizational dynamics. In particular, it is of interest in understanding changes in attributes such as intentions/ideology, tactics/strategies, capabilities/resources, etc., that influence and impact the activity. The goal of this work is the quick detection of such changes and in general, tracking of macroscopic as well as microscopic trends in group dynamics. Prior work in this area are based on parametric approaches and rely on time-series analysis techniques, self-exciting hurdle models (SEHM), or hidden Markov models (HMM). While these approaches detect spurts and downfalls reasonably accurately, they are all based on model learning --- a task that is difficult in practice because of the "rare" nature of terrorist attacks from a model learning perspective. In this paper, we pursue an alternate non-parametric approach for spurt detection in activity profiles. Our approach is based on binning the count data of terrorist activity to form observation vectors that can be compared with each other. Motivated by a majorization theory framework, these vectors are then transformed via certain functionals and used in spurt classification. While the parametric approaches often result in either a large number of missed detections of real changes or false alarms of unoccurred changes, the proposed approach is shown to result in a small number of missed detections and false alarms. Further, the non-parametric nature of the approach makes it attractive for ready applications in a practical context.
△ Less
Submitted 7 April, 2016;
originally announced April 2016.
-
Multichannel Sequential Detection- Part I: Non-i.i.d. Data
Authors:
Georgios Fellouris,
Alexander G. Tartakovsky
Abstract:
We consider the problem of sequential signal detection in a multichannel system where the number and location of signals is a priori unknown. We assume that the data in each channel are sequentially observed and follow a general non-i.i.d. stochastic model. Under the assumption that the local log-likelihood ratio processes in the channels converge r-completely to positive and finite numbers, we es…
▽ More
We consider the problem of sequential signal detection in a multichannel system where the number and location of signals is a priori unknown. We assume that the data in each channel are sequentially observed and follow a general non-i.i.d. stochastic model. Under the assumption that the local log-likelihood ratio processes in the channels converge r-completely to positive and finite numbers, we establish the asymptotic optimality of a generalized sequential likelihood ratio test and a mixture-based sequential likelihood ratio test. Specifically, we show that both tests minimize the first r moments of the stopping time distribution asymptotically as the probabilities of false alarm and missed detection approach zero. Moreover, we show that both tests asymptotically minimize all moments of the stopping time distribution when the local log-likelihood ratio processes have independent increments and simply obey the Strong Law of Large Numbers. This extends a result previously known in the case of i.i.d. observations when only one channel is affected. We illustrate the general detection theory using several practical examples, including the detection of signals in Gaussian hidden Markov models, white Gaussian noises with unknown intensity, and testing of the first-order autoregression's correlation coefficient. Finally, we illustrate the feasibility of both sequential tests when assuming an upper and a lower bound on the number of signals and compare their non-asymptotic performance using a simulation study.
△ Less
Submitted 13 January, 2016;
originally announced January 2016.
-
Optimal Design and Analysis of the Exponentially Weighted Moving Average Chart for Exponential Data
Authors:
Aleksey S. Polunchenko,
Grigory Sokolov,
Alexander G. Tartakovsky
Abstract:
We study optimal design of the Exponentially Weighted Moving Average (EWMA) chart by a proper choice of the smoothing factor and the initial value (headstart) of the decision statistic. The particular problem addressed is that of quickest detection of an abrupt change in the parameter of a discrete-time exponential model. Both pre- and post-change parameter values are assumed known, but the change…
▽ More
We study optimal design of the Exponentially Weighted Moving Average (EWMA) chart by a proper choice of the smoothing factor and the initial value (headstart) of the decision statistic. The particular problem addressed is that of quickest detection of an abrupt change in the parameter of a discrete-time exponential model. Both pre- and post-change parameter values are assumed known, but the change-point is not known. For this change-point detection scenario, we examine the performance of the conventional one-sided EWMA chart with respect to two optimality criteria: Pollak's minimax criterion associated with the maximal conditional expected delay to detection and Shiryaev's multi-cyclic setup associated with the stationary expected delay to detection. Using the integral-equations approach, we derive the exact closed-form formulae for all of the required performance measures. Based on these formulae we find the optimal smoothing factor and headstart by solving the corresponding two bivariate constraint optimization problems. Finally, the performance of the optimized EWMA chart is compared against that of the Shiryaev--Roberts--$r$ procedure in the minimax setting, and against that of the original Shiryaev--Roberts procedure in the multi-cyclic setting. The main conclusion is that the EWMA chart, when fully optimized, turns out to be a very competitive procedure, with performance nearly indistinguishable from that of the known-to-be-best Shiryaev--Roberts--$r$ and Shiryaev--Roberts procedures.
△ Less
Submitted 6 November, 2014; v1 submitted 26 July, 2013;
originally announced July 2013.
-
Modeling Temporal Activity Patterns in Dynamic Social Networks
Authors:
Vasanthan Raghavan,
Greg Ver Steeg,
Aram Galstyan,
Alexander G. Tartakovsky
Abstract:
The focus of this work is on developing probabilistic models for user activity in social networks by incorporating the social network influence as perceived by the user. For this, we propose a coupled Hidden Markov Model, where each user's activity evolves according to a Markov chain with a hidden state that is influenced by the collective activity of the friends of the user. We develop generalize…
▽ More
The focus of this work is on developing probabilistic models for user activity in social networks by incorporating the social network influence as perceived by the user. For this, we propose a coupled Hidden Markov Model, where each user's activity evolves according to a Markov chain with a hidden state that is influenced by the collective activity of the friends of the user. We develop generalized Baum-Welch and Viterbi algorithms for model parameter learning and state estimation for the proposed framework. We then validate the proposed model using a significant corpus of user activity on Twitter. Our numerical studies show that with sufficient observations to ensure accurate model learning, the proposed framework explains the observed data better than either a renewal process-based model or a conventional uncoupled Hidden Markov Model. We also demonstrate the utility of the proposed approach in predicting the time to the next tweet. Finally, clustering in the model parameter space is shown to result in distinct natural clusters of users characterized by the interaction dynamic between a user and his network.
△ Less
Submitted 8 May, 2013;
originally announced May 2013.
-
Efficient Computer Network Anomaly Detection by Changepoint Detection Methods
Authors:
Alexander G. Tartakovsky,
Aleksey S. Polunchenko,
Grigory Sokolov
Abstract:
We consider the problem of efficient on-line anomaly detection in computer network traffic. The problem is approached statistically, as that of sequential (quickest) changepoint detection. A multi-cyclic setting of quickest change detection is a natural fit for this problem. We propose a novel score-based multi-cyclic detection algorithm. The algorithm is based on the so-called Shiryaev-Roberts pr…
▽ More
We consider the problem of efficient on-line anomaly detection in computer network traffic. The problem is approached statistically, as that of sequential (quickest) changepoint detection. A multi-cyclic setting of quickest change detection is a natural fit for this problem. We propose a novel score-based multi-cyclic detection algorithm. The algorithm is based on the so-called Shiryaev-Roberts procedure. This procedure is as easy to employ in practice and as computationally inexpensive as the popular Cumulative Sum chart and the Exponentially Weighted Moving Average scheme. The likelihood ratio based Shiryaev-Roberts procedure has appealing optimality properties, particularly it is exactly optimal in a multi-cyclic setting geared to detect a change occurring at a far time horizon. It is therefore expected that an intrusion detection algorithm based on the Shiryaev-Roberts procedure will perform better than other detection schemes. This is confirmed experimentally for real traces. We also discuss the possibility of complementing our anomaly detection algorithm with a spectral-signature intrusion detection system with false alarm filtering and true attack confirmation capability, so as to obtain a synergistic system.
△ Less
Submitted 8 December, 2012;
originally announced December 2012.
-
Hidden Markov models for the activity profile of terrorist groups
Authors:
Vasanthan Raghavan,
Aram Galstyan,
Alexander G. Tartakovsky
Abstract:
The main focus of this work is on developing models for the activity profile of a terrorist group, detecting sudden spurts and downfalls in this profile, and, in general, tracking it over a period of time. Toward this goal, a $d$-state hidden Markov model (HMM) that captures the latent states underlying the dynamics of the group and thus its activity profile is developed. The simplest setting of…
▽ More
The main focus of this work is on developing models for the activity profile of a terrorist group, detecting sudden spurts and downfalls in this profile, and, in general, tracking it over a period of time. Toward this goal, a $d$-state hidden Markov model (HMM) that captures the latent states underlying the dynamics of the group and thus its activity profile is developed. The simplest setting of $d=2$ corresponds to the case where the dynamics are coarsely quantized as Active and Inactive, respectively. A state estimation strategy that exploits the underlying HMM structure is then developed for spurt detection and tracking. This strategy is shown to track even nonpersistent changes that last only for a short duration at the cost of learning the underlying model. Case studies with real terrorism data from open-source databases are provided to illustrate the performance of the proposed methodology.
△ Less
Submitted 15 January, 2014; v1 submitted 5 July, 2012;
originally announced July 2012.
-
Almost optimal sequential tests of discrete composite hypotheses
Authors:
Georgios Fellouris,
Alexander G. Tartakovsky
Abstract:
We consider the problem of sequentially testing a simple null hypothesis versus a composite alternative hypothesis that consists of a finite set of densities. We study sequential tests that are based on thresholding of mixture-based likelihood ratio statistics and weighted generalized likelihood ratio statistics. It is shown that both sequential tests have several asymptotic optimality properties…
▽ More
We consider the problem of sequentially testing a simple null hypothesis versus a composite alternative hypothesis that consists of a finite set of densities. We study sequential tests that are based on thresholding of mixture-based likelihood ratio statistics and weighted generalized likelihood ratio statistics. It is shown that both sequential tests have several asymptotic optimality properties as error probabilities go to zero. First, for any weights, they minimize the expected sample size within a constant term under every scenario in the alternative hypothesis and at least to first order under the null hypothesis. Second, for appropriate weights that are specified up to a prior distribution, they minimize within an asymptotically negligible term a weighted expected sample size in the alternative hypothesis. Third, for a particular prior distribution, they are almost minimax with respect to the expected Kullback-Leibler divergence until stopping. Furthermore, based on high-order asymptotic expansions for the operating characteristics, we propose prior distributions that lead to a robust behavior. Finally, based on asymptotic analysis as well as on simulation experiments, we argue that both tests have the same performance when they are designed with the same weights.
△ Less
Submitted 22 January, 2013; v1 submitted 24 April, 2012;
originally announced April 2012.
-
Nearly Optimal Change-Point Detection with an Application to Cybersecurity
Authors:
Aleksey S. Polunchenko,
Alexander G. Tartakovsky,
Nitis Mukhopadhyay
Abstract:
We address the sequential change-point detection problem for the Gaussian model where baseline distribution is Gaussian with variance σ^2 and mean μsuch that σ^2=aμ, where a>0 is a known constant; the change is in μfrom one known value to another. First, we carry out a comparative performance analysis of four detection procedures: the CUSUM procedure, the Shiryaev-Roberts (SR) procedure, and two i…
▽ More
We address the sequential change-point detection problem for the Gaussian model where baseline distribution is Gaussian with variance σ^2 and mean μsuch that σ^2=aμ, where a>0 is a known constant; the change is in μfrom one known value to another. First, we carry out a comparative performance analysis of four detection procedures: the CUSUM procedure, the Shiryaev-Roberts (SR) procedure, and two its modifications - the Shiryaev-Roberts-Pollak and Shiryaev-Roberts-r procedures. The performance is benchmarked via Pollak's maximal average delay to detection and Shiryaev's stationary average delay to detection, each subject to a fixed average run length to false alarm. The analysis shows that in practically interesting cases the accuracy of asymptotic approximations is "reasonable" to "excellent". We also consider an application of change-point detection to cybersecurity - for rapid anomaly detection in computer networks. Using real network data we show that statistically traffic's intensity can be well-described by the proposed Gaussian model with σ^2=aμinstead of the traditional Poisson model, which requires σ^2=μ. By successively devising the SR and CUSUM procedures to "catch" a low-contrast network anomaly (caused by an ICMP reflector attack), we then show that the SR rule is quicker. We conclude that the SR procedure is a better cyber "watch dog" than the popular CUSUM procedure.
△ Less
Submitted 3 March, 2012; v1 submitted 13 February, 2012;
originally announced February 2012.
-
Nearly Minimax One-Sided Mixture-Based Sequential Tests
Authors:
Georgios Fellouris,
Alexander G. Tartakovsky
Abstract:
We focus on one-sided, mixture-based stopping rules for the problem of sequential testing a simple null hypothesis against a composite alternative. For the latter, we consider two cases---either a discrete alternative or a continuous alternative that can be embedded into an exponential family. For each case, we find a mixture-based stopping rule that is nearly minimax in the sense of minimizing th…
▽ More
We focus on one-sided, mixture-based stopping rules for the problem of sequential testing a simple null hypothesis against a composite alternative. For the latter, we consider two cases---either a discrete alternative or a continuous alternative that can be embedded into an exponential family. For each case, we find a mixture-based stopping rule that is nearly minimax in the sense of minimizing the maximal Kullback-Leibler information. The proof of this result is based on finding an almost Bayes rule for an appropriate sequential decision problem and on high-order asymptotic approximations for the performance characteristics of arbitrary mixture-based stopping times. We also evaluate the asymptotic performance loss of certain intuitive mixture rules and verify the accuracy of our asymptotic approximations with simulation experiments.
△ Less
Submitted 24 April, 2012; v1 submitted 5 October, 2011;
originally announced October 2011.
-
Numerical Comparison of Cusum and Shiryaev-Roberts Procedures for Detecting Changes in Distributions
Authors:
George V. Moustakides,
Aleksey S. Polunchenko,
Alexander G. Tartakovsky
Abstract:
The CUSUM procedure is known to be optimal for detecting a change in distribution under a minimax scenario, whereas the Shiryaev-Roberts procedure is optimal for detecting a change that occurs at a distant time horizon. As a simpler alternative to the conventional Monte Carlo approach, we propose a numerical method for the systematic comparison of the two detection schemes in both settings, i.e.…
▽ More
The CUSUM procedure is known to be optimal for detecting a change in distribution under a minimax scenario, whereas the Shiryaev-Roberts procedure is optimal for detecting a change that occurs at a distant time horizon. As a simpler alternative to the conventional Monte Carlo approach, we propose a numerical method for the systematic comparison of the two detection schemes in both settings, i.e., minimax and for detecting changes that occur in the distant future. Our goal is accomplished by deriving a set of exact integral equations for the performance metrics, which are then solved numerically. We present detailed numerical results for the problem of detecting a change in the mean of a Gaussian sequence, which show that the difference between the two procedures is significant only when detecting small changes.
△ Less
Submitted 27 August, 2009;
originally announced August 2009.
-
A Numerical Approach to Performance Analysis of Quickest Change-Point Detection Procedures
Authors:
George V. Moustakides,
Aleksey S. Polunchenko,
Alexander G. Tartakovsky
Abstract:
For the most popular sequential change detection rules such as CUSUM, EWMA, and the Shiryaev-Roberts test, we develop integral equations and a concise numerical method to compute a number of performance metrics, including average detection delay and average time to false alarm. We pay special attention to the Shiryaev-Roberts procedure and evaluate its performance for various initialization stra…
▽ More
For the most popular sequential change detection rules such as CUSUM, EWMA, and the Shiryaev-Roberts test, we develop integral equations and a concise numerical method to compute a number of performance metrics, including average detection delay and average time to false alarm. We pay special attention to the Shiryaev-Roberts procedure and evaluate its performance for various initialization strategies. Regarding the randomized initialization variant proposed by Pollak, known to be asymptotically optimal of order-3, we offer a means for numerically computing the quasi-stationary distribution of the Shiryaev-Roberts statistic that is the distribution of the initializing random variable, thus making this test applicable in practice. A significant side-product of our computational technique is the observation that deterministic initializations of the Shiryaev-Roberts procedure can also enjoy the same order-3 optimality property as Pollak's randomized test and, after careful selection, even uniformly outperform it.
△ Less
Submitted 8 December, 2009; v1 submitted 20 July, 2009;
originally announced July 2009.
