Showing 1–9 of 9 results for author: Langovoy, M

Statistical estimation for optimization problems on graphs

Authors: Mikhail Langovoy, Suvrit Sra

Abstract: Large graphs abound in machine learning, data mining, and several related areas. A useful step towards analyzing such graphs is that of obtaining certain summary statistics - e.g., or the expected length of a shortest path between two nodes, or the expected weight of a minimum spanning tree of the graph, etc. These statistics provide insight into the structure of a graph, and they can help predict… ▽ More Large graphs abound in machine learning, data mining, and several related areas. A useful step towards analyzing such graphs is that of obtaining certain summary statistics - e.g., or the expected length of a shortest path between two nodes, or the expected weight of a minimum spanning tree of the graph, etc. These statistics provide insight into the structure of a graph, and they can help predict global properties of a graph. Motivated thus, we propose to study statistical properties of structured subgraphs (of a given graph), in particular, to estimate the expected objective function value of a combinatorial optimization problem over these subgraphs. The general task is very difficult, if not unsolvable; so for concreteness we describe a more specific statistical estimation problem based on spanning trees. We hope that our position paper encourages others to also study other types of graphical structures for which one can prove nontrivial statistical estimates. △ Less

Submitted 29 November, 2013; originally announced November 2013.

Comments: Paper for the NIPS Workshop on Discrete Optimization for Machine Learning (DISCML) (2011): Uncertainty, Generalization and Feedback

Unsupervised nonparametric detection of unknown objects in noisy images based on percolation theory

Authors: Mikhail A. Langovoy, Olaf Wittich, Patrick Laurie Davies

Abstract: We develop an unsupervised, nonparametric, and scalable statistical learning method for detection of unknown objects in noisy images. The method uses results from percolation theory and random graph theory. We present an algorithm that allows to detect objects of unknown shapes and sizes in the presence of nonparametric noise of unknown level. The noise density is assumed to be unknown and can be… ▽ More We develop an unsupervised, nonparametric, and scalable statistical learning method for detection of unknown objects in noisy images. The method uses results from percolation theory and random graph theory. We present an algorithm that allows to detect objects of unknown shapes and sizes in the presence of nonparametric noise of unknown level. The noise density is assumed to be unknown and can be very irregular. The algorithm has linear complexity and exponential accuracy and is appropriate for real-time systems. We prove strong consistency and scalability of our method in this setup with minimal assumptions. △ Less

Submitted 12 July, 2018; v1 submitted 24 February, 2011; originally announced February 2011.

Comments: Added references, updated terminology, changed the order of the authors and the title. arXiv admin note: substantial text overlap with arXiv:1102.4803, arXiv:1102.5014

Randomized algorithms for statistical image analysis and site percolation on square lattices

Authors: Mikhail A. Langovoy, Olaf Wittich

Abstract: We propose a novel probabilistic method for detection of objects in noisy images. The method uses results from percolation and random graph theories. We present an algorithm that allows to detect objects of unknown shapes in the presence of random noise. The algorithm has linear complexity and exponential accuracy and is appropriate for real-time systems. We prove results on consistency and algori… ▽ More We propose a novel probabilistic method for detection of objects in noisy images. The method uses results from percolation and random graph theories. We present an algorithm that allows to detect objects of unknown shapes in the presence of random noise. The algorithm has linear complexity and exponential accuracy and is appropriate for real-time systems. We prove results on consistency and algorithmic complexity of our procedure. △ Less

Submitted 24 February, 2011; originally announced February 2011.

Comments: Submitted for publication on December 11, 2009

Algebraic polynomials and moments of stochastic integrals

Authors: Mikhail A. Langovoy

Abstract: We propose an algebraic method for proving estimates on moments of stochastic integrals. The method uses qualitative properties of roots of algebraic polynomials from certain general classes. As an application, we give a new proof of a variation of the Burkholder-Davis-Gundy inequality for the case of stochastic integrals with respect to real locally square integrable martingales. Further possible… ▽ More We propose an algebraic method for proving estimates on moments of stochastic integrals. The method uses qualitative properties of roots of algebraic polynomials from certain general classes. As an application, we give a new proof of a variation of the Burkholder-Davis-Gundy inequality for the case of stochastic integrals with respect to real locally square integrable martingales. Further possible applications and extensions of the method are outlined. △ Less

Submitted 24 February, 2011; originally announced February 2011.

Comments: Published in Statistics and Probability Letters by the Elsevier. Permanent link: http://dx.doi.org/10.1016/j.spl.2011.01.022 Preliminary version of this paper appeared on October 27, 2009 as EURANDOM Report 2009-031

Journal ref: Statistics & Probability Letters, Volume 81, Issue 6, June 2011, Pages 627-631, ISSN 0167-7152

Multiple testing, uncertainty and realistic pictures

Authors: Mikhail A. Langovoy, Olaf Wittich

Abstract: We study statistical detection of grayscale objects in noisy images. The object of interest is of unknown shape and has an unknown intensity, that can be varying over the object and can be negative. No boundary shape constraints are imposed on the object, only a weak bulk condition for the object's interior is required. We propose an algorithm that can be used to detect grayscale objects of unknow… ▽ More We study statistical detection of grayscale objects in noisy images. The object of interest is of unknown shape and has an unknown intensity, that can be varying over the object and can be negative. No boundary shape constraints are imposed on the object, only a weak bulk condition for the object's interior is required. We propose an algorithm that can be used to detect grayscale objects of unknown shapes in the presence of nonparametric noise of unknown level. Our algorithm is based on a nonparametric multiple testing procedure. We establish the limit of applicability of our method via an explicit, closed-form, non-asymptotic and nonparametric consistency bound. This bound is valid for a wide class of nonparametric noise distributions. We achieve this by proving an uncertainty principle for percolation on finite lattices. △ Less

Submitted 23 February, 2011; originally announced February 2011.

Comments: This paper initially appeared in January 2011 as EURANDOM Report 2011-004. Link to the abstract at EURANDOM Repository: http://www.eurandom.tue.nl/reports/2011/004-abstract.pdf Link to the paper at EURANDOM Repository: http://www.eurandom.tue.nl/reports/2011/004-report.pdf

Report number: EURANDOM Report 2011-004

Robust nonparametric detection of objects in noisy images

Authors: Mikhail A. Langovoy, Olaf Wittich

Abstract: We propose a novel statistical hypothesis testing method for detection of objects in noisy images. The method uses results from percolation theory and random graph theory. We present an algorithm that allows to detect objects of unknown shapes in the presence of nonparametric noise of unknown level and of unknown distribution. No boundary shape constraints are imposed on the object, only a weak bu… ▽ More We propose a novel statistical hypothesis testing method for detection of objects in noisy images. The method uses results from percolation theory and random graph theory. We present an algorithm that allows to detect objects of unknown shapes in the presence of nonparametric noise of unknown level and of unknown distribution. No boundary shape constraints are imposed on the object, only a weak bulk condition for the object's interior is required. The algorithm has linear complexity and exponential accuracy and is appropriate for real-time systems. In this paper, we develop further the mathematical formalism of our method and explore important connections to the mathematical theory of percolation and statistical physics. We prove results on consistency and algorithmic complexity of our testing procedure. In addition, we address not only an asymptotic behavior of the method, but also a finite sample performance of our test. △ Less

Submitted 23 February, 2011; originally announced February 2011.

Comments: This paper initially appeared in 2010 as EURANDOM Report 2010-049. Link to the abstract at EURANDOM repository: http://www.eurandom.tue.nl/reports/2010/049-abstract.pdf Link to the paper at EURANDOM repository: http://www.eurandom.tue.nl/reports/2010/049-report.pdf

Report number: EURANDOM Report 2010-049

Journal ref: Journal of Nonparametric Statistics (2013), Vol. 25(2), pp. 409-426

Detection of objects in noisy images and site percolation on square lattices

Authors: Mikhail A. Langovoy, Olaf Wittich

Abstract: We propose a novel probabilistic method for detection of objects in noisy images. The method uses results from percolation and random graph theories. We present an algorithm that allows to detect objects of unknown shapes in the presence of random noise. Our procedure substantially differs from wavelets-based algorithms. The algorithm has linear complexity and exponential accuracy and is appropria… ▽ More We propose a novel probabilistic method for detection of objects in noisy images. The method uses results from percolation and random graph theories. We present an algorithm that allows to detect objects of unknown shapes in the presence of random noise. Our procedure substantially differs from wavelets-based algorithms. The algorithm has linear complexity and exponential accuracy and is appropriate for real-time systems. We prove results on consistency and algorithmic complexity of our procedure. △ Less

Submitted 23 February, 2011; originally announced February 2011.

Comments: This paper first appeared as EURANDOM Report 2009-035 on November 11, 2009. Link to the paper at the EURANDOM repository: http://www.eurandom.tue.nl/reports/2009/035-report.pdf Link to the abstract at EURANDOM repository: http://www.eurandom.tue.nl/reports/2009/035-abstract.pdf

Report number: EURANDOM Report 2009-035

Data-driven goodness-of-fit tests

Authors: Mikhail Langovoy

Abstract: We propose and study a general method for construction of consistent statistical tests on the basis of possibly indirect, corrupted, or partially available observations. The class of tests devised in the paper contains Neyman's smooth tests, data-driven score tests, and some types of multi-sample tests as basic examples. Our tests are data-driven and are additionally incorporated with model select… ▽ More We propose and study a general method for construction of consistent statistical tests on the basis of possibly indirect, corrupted, or partially available observations. The class of tests devised in the paper contains Neyman's smooth tests, data-driven score tests, and some types of multi-sample tests as basic examples. Our tests are data-driven and are additionally incorporated with model selection rules. The method allows to use a wide class of model selection rules that are based on the penalization idea. In particular, many of the optimal penalties, derived in statistical literature, can be used in our tests. We establish the behavior of model selection rules and data-driven tests under both the null hypothesis and the alternative hypothesis, derive an explicit detectability rule for alternative hypotheses, and prove a master consistency theorem for the tests from the class. The paper shows that the tests are applicable to a wide range of problems, including hypothesis testing in statistical inverse problems, multi-sample problems, and nonparametric hypothesis testing. △ Less

Submitted 21 September, 2017; v1 submitted 1 August, 2007; originally announced August 2007.

Comments: Fully remastered version of the paper

MSC Class: 62G10 (Primary) 60F10; 62H10; 62E20 (Secondary)

Data-driven efficient score tests for deconvolution problems

Authors: Mikhail Langovoy

Abstract: We consider testing statistical hypotheses about densities of signals in deconvolution models. A new approach to this problem is proposed. We constructed score tests for the deconvolution with the known noise density and efficient score tests for the case of unknown density. The tests are incorporated with model selection rules to choose reasonable model dimensions automatically by the data. Con… ▽ More We consider testing statistical hypotheses about densities of signals in deconvolution models. A new approach to this problem is proposed. We constructed score tests for the deconvolution with the known noise density and efficient score tests for the case of unknown density. The tests are incorporated with model selection rules to choose reasonable model dimensions automatically by the data. Consistency of the tests is proved. △ Less

Submitted 5 July, 2007; originally announced July 2007.

Journal ref: Inverse Problems 24 (2008) 025028 17pp