Showing 1–5 of 5 results for author: Nouretdinov, I

Validity and efficiency of the conformal CUSUM procedure

Authors: Vladimir Vovk, Ilia Nouretdinov, Alex Gammerman

Abstract: In this paper we study the validity and efficiency of a conformal version of the CUSUM procedure for change detection both experimentally and theoretically. In this paper we study the validity and efficiency of a conformal version of the CUSUM procedure for change detection both experimentally and theoretically. △ Less

Submitted 4 December, 2024; originally announced December 2024.

Comments: 19 pages, 7 figures

MSC Class: 62G10 (Primary) 68T05; 68Q32; 62L10 (Secondary)

Conformal testing: binary case with Markov alternatives

Authors: Vladimir Vovk, Ilia Nouretdinov, Alex Gammerman

Abstract: We continue study of conformal testing in binary model situations. In this note we consider Markov alternatives to the null hypothesis of exchangeability. We propose two new classes of conformal test martingales; one class is statistically efficient in our experiments, and the other class partially sacrifices statistical efficiency to gain computational efficiency. We continue study of conformal testing in binary model situations. In this note we consider Markov alternatives to the null hypothesis of exchangeability. We propose two new classes of conformal test martingales; one class is statistically efficient in our experiments, and the other class partially sacrifices statistical efficiency to gain computational efficiency. △ Less

Submitted 2 November, 2021; originally announced November 2021.

Comments: 8 pages, 8 figures

MSC Class: 68Q32 (Primary) 62G10; 60G42 (Secondary)

Conformal e-testing

Authors: Vladimir Vovk, Ilia Nouretdinov, Alex Gammerman

Abstract: There is a useful counterpart of conformal prediction for e-values, called conformal e-prediction. Conformal prediction can serve as basis for testing the assumption of exchangeability, leading to conformal testing. Similarly, conformal e-prediction can also serve as basis for testing. The resulting conformal e-testing looks very different from but inherits some strengths of conformal testing; it… ▽ More There is a useful counterpart of conformal prediction for e-values, called conformal e-prediction. Conformal prediction can serve as basis for testing the assumption of exchangeability, leading to conformal testing. Similarly, conformal e-prediction can also serve as basis for testing. The resulting conformal e-testing looks very different from but inherits some strengths of conformal testing; it even has some advantages over conformal testing. In this paper we discuss systematically both strengths and limitations of conformal e-testing. △ Less

Submitted 2 November, 2024; v1 submitted 3 June, 2020; originally announced June 2020.

Comments: 21 pages and 2 figures

MSC Class: 62G10 (Primary) 68T05; 68Q32; 62L10 (Secondary)

On-line predictive linear regression

Authors: Vladimir Vovk, Ilia Nouretdinov, Alex Gammerman

Abstract: We consider the on-line predictive version of the standard problem of linear regression; the goal is to predict each consecutive response given the corresponding explanatory variables and all the previous observations. The standard treatment of prediction in linear regression analysis has two drawbacks: (1) the classical prediction intervals guarantee that the probability of error is equal to th… ▽ More We consider the on-line predictive version of the standard problem of linear regression; the goal is to predict each consecutive response given the corresponding explanatory variables and all the previous observations. The standard treatment of prediction in linear regression analysis has two drawbacks: (1) the classical prediction intervals guarantee that the probability of error is equal to the nominal significance level $\varepsilon$, but this property per se does not imply that the long-run frequency of error is close to $\varepsilon$; (2) it is not suitable for prediction of complex systems as it assumes that the number of observations exceeds the number of parameters. We state a general result showing that in the on-line protocol the frequency of error for the classical prediction intervals does equal the nominal significance level, up to statistical fluctuations. We also describe alternative regression models in which informative prediction intervals can be found before the number of observations exceeds the number of parameters. One of these models, which only assumes that the observations are independent and identically distributed, is popular in machine learning but greatly underused in the statistical theory of regression. △ Less

Submitted 17 June, 2009; originally announced June 2009.

Comments: Published in at http://dx.doi.org/10.1214/08-AOS622 the Annals of Statistics (http://www.imstat.org/aos/) by the Institute of Mathematical Statistics (http://www.imstat.org)

Report number: IMS-AOS-AOS622 MSC Class: 62J05; 62G08 (Primary) 60G25; 68Q32 (Secondary)

Journal ref: Annals of Statistics 2009, Vol. 37, No. 3, 1566-1590

On-line predictive linear regression

Authors: Vladimir Vovk, Ilia Nouretdinov, Alex Gammerman

Abstract: We consider the on-line predictive version of the standard problem of linear regression; the goal is to predict each consecutive response given the corresponding explanatory variables and all the previous observations. We are mainly interested in prediction intervals rather than point predictions. The standard treatment of prediction intervals in linear regression analysis has two drawbacks: (1) t… ▽ More We consider the on-line predictive version of the standard problem of linear regression; the goal is to predict each consecutive response given the corresponding explanatory variables and all the previous observations. We are mainly interested in prediction intervals rather than point predictions. The standard treatment of prediction intervals in linear regression analysis has two drawbacks: (1) the classical prediction intervals guarantee that the probability of error is equal to the nominal significance level epsilon, but this property per se does not imply that the long-run frequency of error is close to epsilon; (2) it is not suitable for prediction of complex systems as it assumes that the number of observations exceeds the number of parameters. We state a general result showing that in the on-line protocol the frequency of error for the classical prediction intervals does equal the nominal significance level, up to statistical fluctuations. We also describe alternative regression models in which informative prediction intervals can be found before the number of observations exceeds the number of parameters. One of these models, which only assumes that the observations are independent and identically distributed, is popular in machine learning but greatly underused in the statistical theory of regression. △ Less

Submitted 21 November, 2011; v1 submitted 21 November, 2005; originally announced November 2005.

Comments: 34 pages; 6 figures; 1 table. arXiv admin note: substantial text overlap with arXiv:0906.3123

Report number: On-line Compression Modelling Project (New Series), Working Paper 01 MSC Class: 62G08; 62J07

Journal ref: Annals of Statistics 37:1566-1590 (2009)