Showing 1–8 of 8 results for author: Viallon, V

Regression modeling on stratified data with the lasso

Authors: Edouard Ollier, Vivian Viallon

Abstract: We consider the estimation of regression models on strata defined using a categorical covariate, in order to identify interactions between this categorical covariate and the other predictors. A basic approach requires the choice of a reference stratum. We show that the performance of a penalized version of this approach depends on this arbitrary choice. We propose a refined approach that bypasses… ▽ More We consider the estimation of regression models on strata defined using a categorical covariate, in order to identify interactions between this categorical covariate and the other predictors. A basic approach requires the choice of a reference stratum. We show that the performance of a penalized version of this approach depends on this arbitrary choice. We propose a refined approach that bypasses this arbitrary choice, at almost no additional computational cost. Regarding model selection consistency, our proposal mimics the strategy based on an optimal and covariate-specific choice for the reference stratum. Results from an empirical study confirm that our proposal generally outperforms the basic approach in the identification and description of the interactions. An illustration on gene expression data is provided. △ Less

Submitted 8 November, 2016; v1 submitted 22 August, 2015; originally announced August 2015.

Comments: 23 pages, 5 figures

Safe Feature Elimination for the LASSO and Sparse Supervised Learning Problems

Authors: Laurent El Ghaoui, Vivian Viallon, Tarek Rabbani

Abstract: We describe a fast method to eliminate features (variables) in l1 -penalized least-square regression (or LASSO) problems. The elimination of features leads to a potentially substantial reduction in running time, specially for large values of the penalty parameter. Our method is not heuristic: it only eliminates features that are guaranteed to be absent after solving the LASSO problem. The feature… ▽ More We describe a fast method to eliminate features (variables) in l1 -penalized least-square regression (or LASSO) problems. The elimination of features leads to a potentially substantial reduction in running time, specially for large values of the penalty parameter. Our method is not heuristic: it only eliminates features that are guaranteed to be absent after solving the LASSO problem. The feature elimination step is easy to parallelize and can test each feature for elimination independently. Moreover, the computational effort of our method is negligible compared to that of solving the LASSO problem - roughly it is the same as single gradient step. Our method extends the scope of existing LASSO algorithms to treat larger data sets, previously out of their reach. We show how our method can be extended to general l1 -penalized convex problems and present preliminary results for the Sparse Support Vector Machine and Logistic Regression problems. △ Less

Submitted 18 May, 2011; v1 submitted 21 September, 2010; originally announced September 2010.

Comments: Submitted to JMLR in April 2011

Safe Feature Elimination in Sparse Supervised Learning

Authors: Laurent El Ghaoui, Vivian Viallon, Tarek Rabbani

Abstract: We investigate fast methods that allow to quickly eliminate variables (features) in supervised learning problems involving a convex loss function and a $l_1$-norm penalty, leading to a potentially substantial reduction in the number of variables prior to running the supervised learning algorithm. The methods are not heuristic: they only eliminate features that are {\em guaranteed} to be absent aft… ▽ More We investigate fast methods that allow to quickly eliminate variables (features) in supervised learning problems involving a convex loss function and a $l_1$-norm penalty, leading to a potentially substantial reduction in the number of variables prior to running the supervised learning algorithm. The methods are not heuristic: they only eliminate features that are {\em guaranteed} to be absent after solving the learning problem. Our framework applies to a large class of problems, including support vector machine classification, logistic regression and least-squares. The complexity of the feature elimination step is negligible compared to the typical computational effort involved in the sparse supervised learning problem: it grows linearly with the number of features times the number of examples, with much better count if data is sparse. We apply our method to data sets arising in text classification and observe a dramatic reduction of the dimensionality, hence in computational effort required to solve the learning problem, especially when very sparse classifiers are sought. Our method allows to immediately extend the scope of existing algorithms, allowing us to run them on data sets of sizes that were out of their reach before. △ Less

Submitted 26 October, 2010; v1 submitted 17 September, 2010; originally announced September 2010.

Comments: New version is on arXiv:1009.4219

Testing additivity in nonparametric regression under random censorship

Authors: Mohammed Debbarh, Vivian Viallon

Abstract: In this paper, we are concerned with nonparametric estimation of the multivariate regression function in the presence of right censored data. More precisely, we propose a statistic that is shown to be asymptotically normally distributed under the additive assumption, and that could be used to test for additivity in the censored regression setting. In this paper, we are concerned with nonparametric estimation of the multivariate regression function in the presence of right censored data. More precisely, we propose a statistic that is shown to be asymptotically normally distributed under the additive assumption, and that could be used to test for additivity in the censored regression setting. △ Less

Submitted 7 February, 2008; originally announced February 2008.

Uniform limit laws of the logarithm for nonparametric estimators of the regression function in presence of censored data

Authors: Bertrand Maillot, Vivian Viallon

Abstract: In this paper, we establish uniform-in-bandwidth limit laws of the logarithm for nonparametric Inverse Probability of Censoring Weighted (I.P.C.W.) estimators of the multivariate regression function under random censorship. A similar result is deduced for estimators of the conditional distribution function. The uniform-in-bandwidth consistency for estimators of the conditional density and the co… ▽ More In this paper, we establish uniform-in-bandwidth limit laws of the logarithm for nonparametric Inverse Probability of Censoring Weighted (I.P.C.W.) estimators of the multivariate regression function under random censorship. A similar result is deduced for estimators of the conditional distribution function. The uniform-in-bandwidth consistency for estimators of the conditional density and the conditional hazard rate functions are also derived from our main result. Moreover, the logarithm laws we establish are shown to yield almost sure simultaneous asymptotic confidence bands for the functions we consider. Examples of confidence bands obtained from simulated data are displayed. △ Less

Submitted 13 September, 2007; originally announced September 2007.

Comments: 34 pages, 4 figures

MSC Class: 62G08; 62N01

Uniform limit laws of the logarithm for estimators of the additive regression function in the presence of right censored data

Authors: Mohammed Debbarh, Vivian Viallon

Abstract: It has been recently shown that nonparametric estimators of the additive regression function could be obtained in the presence of right censoring by coupling the marginal integration method with initial kernel-type Inverse Probability of Censoring Weighted estimators of the multivariate regression function \citeDebbarhViallon3. In this paper, we get the exact rate of strong uniform consistency f… ▽ More It has been recently shown that nonparametric estimators of the additive regression function could be obtained in the presence of right censoring by coupling the marginal integration method with initial kernel-type Inverse Probability of Censoring Weighted estimators of the multivariate regression function \citeDebbarhViallon3. In this paper, we get the exact rate of strong uniform consistency for such estimators. Our uniform limit laws especially lead to the construction of asymptotic simultaneous 100% confidence bands for the true regression function. △ Less

Submitted 26 June, 2008; v1 submitted 12 February, 2007; originally announced February 2007.

Comments: Published in at http://dx.doi.org/10.1214/07-EJS117 the Electronic Journal of Statistics (http://www.i-journals.org/ejs/) by the Institute of Mathematical Statistics (http://www.imstat.org)

Report number: IMS-EJS-EJS_2007_117 MSC Class: 62G08; 62N01 (Primary)

Journal ref: Electronic Journal of Statistics 2008, Vol. 2, 516-541

Asymptotic normality for estimators of the additive regression components under random censorship

Authors: M. Debbarh, V. Viallon

Abstract: We establish asymptotic normality for estimators of the additive regression components under random censorship. To build our estimators, we couple the marginal integration method (Newey (1994)) with an initial Inverse Probability of Censoring Weighted estimator of the multivariate censored regression function introduced by Carbonez et al. (1995) and Kohler et al. (2002). Asymptotic confidence ba… ▽ More We establish asymptotic normality for estimators of the additive regression components under random censorship. To build our estimators, we couple the marginal integration method (Newey (1994)) with an initial Inverse Probability of Censoring Weighted estimator of the multivariate censored regression function introduced by Carbonez et al. (1995) and Kohler et al. (2002). Asymptotic confidence bands are derived from our result. △ Less

Submitted 7 March, 2008; v1 submitted 18 December, 2006; originally announced December 2006.

Comments: 21 pages, 1 figures

MSC Class: 62G08; 62N01

Functional limit laws for the increments of the quantile process; with applications

Authors: Vivian Viallon

Abstract: We establish a functional limit law of the logarithm for the increments of the normed quantile process based upon a random sample of size $n\to\infty$. We extend a limit law obtained by Deheuvels and Mason (12), showing that their results hold uniformly over the bandwidth $h$, restricted to vary in $[h'_n,h''_n]$, where $\{h'_n\}_{n\geq1}$ and $\{h''_n\}_{n\geq 1}$ are appropriate non-random seq… ▽ More We establish a functional limit law of the logarithm for the increments of the normed quantile process based upon a random sample of size $n\to\infty$. We extend a limit law obtained by Deheuvels and Mason (12), showing that their results hold uniformly over the bandwidth $h$, restricted to vary in $[h'_n,h''_n]$, where $\{h'_n\}_{n\geq1}$ and $\{h''_n\}_{n\geq 1}$ are appropriate non-random sequences. We treat the case where the sample observations follow possibly non-uniform distributions. As a consequence of our theorems, we provide uniform limit laws for nearest-neighbor density estimators, in the spirit of those given by Deheuvels and Mason (13) for kernel-type estimators. △ Less

Submitted 13 November, 2007; v1 submitted 10 December, 2006; originally announced December 2006.

Comments: Published in at http://dx.doi.org/10.1214/07-EJS099 the Electronic Journal of Statistics (http://www.i-journals.org/ejs/) by the Institute of Mathematical Statistics (http://www.imstat.org)

Report number: IMS-EJS-EJS_2007_99 MSC Class: 60F15; 60F17 (Primary); 62G07 (Secondary)

Journal ref: Electronic Journal of Statistics 2007, Vol. 1, 496-518