Showing 1–1 of 1 results for author: Boufounos, P T

Learning Model-Based Sparsity via Projected Gradient Descent

Authors: Sohail Bahmani, Petros T. Boufounos, Bhiksha Raj

Abstract: Several convex formulation methods have been proposed previously for statistical estimation with structured sparsity as the prior. These methods often require a carefully tuned regularization parameter, often a cumbersome or heuristic exercise. Furthermore, the estimate that these methods produce might not belong to the desired sparsity model, albeit accurately approximating the true parameter. Th… ▽ More Several convex formulation methods have been proposed previously for statistical estimation with structured sparsity as the prior. These methods often require a carefully tuned regularization parameter, often a cumbersome or heuristic exercise. Furthermore, the estimate that these methods produce might not belong to the desired sparsity model, albeit accurately approximating the true parameter. Therefore, greedy-type algorithms could often be more desirable in estimating structured-sparse parameters. So far, these greedy methods have mostly focused on linear statistical models. In this paper we study the projected gradient descent with non-convex structured-sparse parameter model as the constraint set. Should the cost function have a Stable Model-Restricted Hessian the algorithm produces an approximation for the desired minimizer. As an example we elaborate on application of the main results to estimation in Generalized Linear Model. △ Less

Submitted 27 January, 2016; v1 submitted 7 September, 2012; originally announced September 2012.

MSC Class: 62FXX; 65KXX

Journal ref: IEEE Transactions on Information Theory 62(4):2092--2099, 2016