-
Spatial Autoregressive Models for Scan Statistic
Authors:
Mohamed-Salem Ahmed,
Lionel Cucala,
Michael Genin
Abstract:
Spatial scan statistics are well-known methods for cluster detection and are widely used in epidemiology and medical studies for detecting and evaluating the statistical significance of disease hotspots. For the sake of simplicity, the classical spatial scan statistic assumes that the observations of the outcome variable in different locations are independent, while in practice the data may exhibi…
▽ More
Spatial scan statistics are well-known methods for cluster detection and are widely used in epidemiology and medical studies for detecting and evaluating the statistical significance of disease hotspots. For the sake of simplicity, the classical spatial scan statistic assumes that the observations of the outcome variable in different locations are independent, while in practice the data may exhibit a spatial correlation. In this article, we use spatial autoregressive (SAR) models to account the spatial correlation in parametric/non-parametric scan statistic. Firstly, the correlation parameter is estimated in the SAR model to transform the outcome into a new independent outcome over all locations. Secondly, we propose an adapted spatial scan statistic based on this independent outcome for cluster detection. A simulation study highlights the better performance of the proposed methods than the classical one in presence of spatial correlation in the data. The latter shows a sharp increase in Type I error and false-positive rate but also decreases the true-positive rate when spatial correlation increases. Besides, our methods retain the Type I error and have stable true and false positive rates with respect to the spatial correlation. The proposed methods are illustrated using a spatial economic dataset of the median income in Paris city. In this application, we show that taking spatial correlation into account leads to the identification of more concentrated clusters than those identified by the classical spatial scan statistic.
△ Less
Submitted 22 November, 2019;
originally announced November 2019.
-
Classifying variable-structures: a general framework
Authors:
Xavier Bry,
Lionel Cucala
Abstract:
In this work, we unify recent variable-clustering techniques within a common geometric framework which allows to extend clustering to variable-structures, i.e. variable-subsets within which links between variables are taken into consideration in a given way. All variables being measured on the same n statistical units, we first represent every variable-structure with a unit-norm operator in…
▽ More
In this work, we unify recent variable-clustering techniques within a common geometric framework which allows to extend clustering to variable-structures, i.e. variable-subsets within which links between variables are taken into consideration in a given way. All variables being measured on the same n statistical units, we first represent every variable-structure with a unit-norm operator in $\mathbb{R}^{n\times n}$. We consider either the euclidean chord-distance or the geodesic distance on the unit-sphere of $\mathbb{R}^{n\times n}$. Then, we introduce the notion of rank-H average of such operators as the rank-H solution of a compound distance-minimisation program. Finally, we propose a K-means-type algorithm using the rank-H average as centroid to perform variable-structure clustering. The method is tested on simulated data and applied to wine data.
△ Less
Submitted 24 April, 2018;
originally announced April 2018.
-
Adaptive ABC model choice and geometric summary statistics for hidden Gibbs random fields
Authors:
Julien Stoehr,
Pierre Pudlo,
Lionel Cucala
Abstract:
Selecting between different dependency structures of hidden Markov random field can be very challenging, due to the intractable normalizing constant in the likelihood. We answer this question with approximate Bayesian computation (ABC) which provides a model choice method in the Bayesian paradigm. This comes after the work of Grelaud et al. (2009) who exhibited sufficient statistics on directly ob…
▽ More
Selecting between different dependency structures of hidden Markov random field can be very challenging, due to the intractable normalizing constant in the likelihood. We answer this question with approximate Bayesian computation (ABC) which provides a model choice method in the Bayesian paradigm. This comes after the work of Grelaud et al. (2009) who exhibited sufficient statistics on directly observed Gibbs random fields. But when the random field is latent, the sufficiency falls and we complement the set with geometric summary statistics. The general approach to construct these intuitive statistics relies on a clustering analysis of the sites based on the observed colors and plausible latent graphs. The efficiency of ABC model choice based on these statistics is evaluated via a local error rate which may be of independent interest. As a byproduct we derived an ABC algorithm that adapts the dimension of the summary statistics to the dataset without distorting the model selection.
△ Less
Submitted 16 July, 2014; v1 submitted 6 February, 2014;
originally announced February 2014.
-
A Bayesian reassessment of nearest-neighbour classification
Authors:
Lionel Cucala,
Jean-Michel Marin,
Christian Robert,
Mike Titterington
Abstract:
The k-nearest-neighbour procedure is a well-known deterministic method used in supervised classification. This paper proposes a reassessment of this approach as a statistical technique derived from a proper probabilistic model; in particular, we modify the assessment made in a previous analysis of this method undertaken by Holmes and Adams (2002,2003), and evaluated by Manocha and Girolami (2007…
▽ More
The k-nearest-neighbour procedure is a well-known deterministic method used in supervised classification. This paper proposes a reassessment of this approach as a statistical technique derived from a proper probabilistic model; in particular, we modify the assessment made in a previous analysis of this method undertaken by Holmes and Adams (2002,2003), and evaluated by Manocha and Girolami (2007), where the underlying probabilistic model is not completely well-defined. Once a clear probabilistic basis for the k-nearest-neighbour procedure is established, we derive computational tools for conducting Bayesian inference on the parameters of the corresponding model. In particular, we assess the difficulties inherent to pseudo-likelihood and to path sampling approximations of an intractable normalising constant, and propose a perfect sampling strategy to implement a correct MCMC sampler associated with our model. If perfect sampling is not available, we suggest using a Gibbs sampling approximation. Illustrations of the performance of the corresponding Bayesian classifier are provided for several benchmark datasets, demonstrating in particular the limitations of the pseudo-likelihood approximation in this set-up.
△ Less
Submitted 10 February, 2008;
originally announced February 2008.
