-
Projected subgradient methods for paraconvex optimization: Application to robust low-rank matrix recovery
Authors:
Morteza Rahimi,
Susan Ghaderi,
Yves Moreau,
Masoud Ahookhosh
Abstract:
This paper is devoted to the class of paraconvex functions and presents some of its fundamental properties, characterization, and examples that can be used for their recognition and optimization. Next, the convergence analysis of the projected subgradient methods with several step-sizes (i.e., constant, nonsummable, square-summable but not summable, geometrically decaying, and Scaled Polyak's step…
▽ More
This paper is devoted to the class of paraconvex functions and presents some of its fundamental properties, characterization, and examples that can be used for their recognition and optimization. Next, the convergence analysis of the projected subgradient methods with several step-sizes (i.e., constant, nonsummable, square-summable but not summable, geometrically decaying, and Scaled Polyak's step-sizes) to global minima for this class of functions is studied. In particular, the convergence rate of the proposed methods is investigated under paraconvexity and the Hölderian error bound condition, where the latter is an extension of the classical error bound condition. The preliminary numerical experiments on several robust low-rank matrix recovery problems (i.e., robust matrix completion, image inpainting, robust nonnegative matrix factorization, robust matrix compression) indicate promising behavior for these projected subgradient methods, validating our theoretical foundations.
△ Less
Submitted 31 December, 2024;
originally announced January 2025.
-
Creation and analysis of biochemical constraint-based models: the COBRA Toolbox v3.0
Authors:
Laurent Heirendt,
Sylvain Arreckx,
Thomas Pfau,
Sebastián N. Mendoza,
Anne Richelle,
Almut Heinken,
Hulda S. Haraldsdóttir,
Jacek Wachowiak,
Sarah M. Keating,
Vanja Vlasov,
Stefania Magnusdóttir,
Chiam Yu Ng,
German Preciat,
Alise Žagare,
Siu H. J. Chan,
Maike K. Aurich,
Catherine M. Clancy,
Jennifer Modamio,
John T. Sauls,
Alberto Noronha,
Aarash Bordbar,
Benjamin Cousins,
Diana C. El Assal,
Luis V. Valcarcel,
Iñigo Apaolaza
, et al. (30 additional authors not shown)
Abstract:
COnstraint-Based Reconstruction and Analysis (COBRA) provides a molecular mechanistic framework for integrative analysis of experimental data and quantitative prediction of physicochemically and biochemically feasible phenotypic states. The COBRA Toolbox is a comprehensive software suite of interoperable COBRA methods. It has found widespread applications in biology, biomedicine, and biotechnology…
▽ More
COnstraint-Based Reconstruction and Analysis (COBRA) provides a molecular mechanistic framework for integrative analysis of experimental data and quantitative prediction of physicochemically and biochemically feasible phenotypic states. The COBRA Toolbox is a comprehensive software suite of interoperable COBRA methods. It has found widespread applications in biology, biomedicine, and biotechnology because its functions can be flexibly combined to implement tailored COBRA protocols for any biochemical network. Version 3.0 includes new methods for quality controlled reconstruction, modelling, topological analysis, strain and experimental design, network visualisation as well as network integration of chemoinformatic, metabolomic, transcriptomic, proteomic, and thermochemical data. New multi-lingual code integration also enables an expansion in COBRA application scope via high-precision, high-performance, and nonlinear numerical optimisation solvers for multi-scale, multi-cellular and reaction kinetic modelling, respectively. This protocol can be adapted for the generation and analysis of a constraint-based model in a wide variety of molecular systems biology scenarios. This protocol is an update to the COBRA Toolbox 1.0 and 2.0. The COBRA Toolbox 3.0 provides an unparalleled depth of constraint-based reconstruction and analysis methods.
△ Less
Submitted 23 February, 2018; v1 submitted 11 October, 2017;
originally announced October 2017.
-
Two globally convergent nonmonotone trust-region methods for unconstrained optimization
Authors:
Masoud Ahookhosh,
Susan Ghaderi
Abstract:
This paper addresses some trust-region methods equipped with nonmonotone strategies for solving nonlinear unconstrained optimization problems. More specifically, the importance of using nonmonotone techniques in nonlinear optimization is motivated, then two new nonmonotone terms are proposed, and their combinations into the traditional trust-region framework are studied. The global convergence to…
▽ More
This paper addresses some trust-region methods equipped with nonmonotone strategies for solving nonlinear unconstrained optimization problems. More specifically, the importance of using nonmonotone techniques in nonlinear optimization is motivated, then two new nonmonotone terms are proposed, and their combinations into the traditional trust-region framework are studied. The global convergence to first- and second-order stationary points and local superlinear and quadratic convergence rates for both algorithms are established. Numerical experiments on the \textsf{CUTEst} test collection of unconstrained problems and some highly nonlinear test functions are reported, where a comparison among state-of-the-art nonmonotone trust-region methods show the efficiency of the proposed nonmonotne schemes.
△ Less
Submitted 8 January, 2015;
originally announced January 2015.
-
On efficiency of nonmonotone Armijo-type line searches
Authors:
Masoud Ahookhosh,
Susan Ghaderi
Abstract:
Monotonicity and nonmonotonicity play a key role in studying the global convergence and the efficiency of iterative schemes employed in the field of nonlinear optimization, where globally convergent and computationally efficient schemes are explored. This paper addresses some features of descent schemes and the motivation behind nonmonotone strategies and investigates the efficiency of an Armijo-t…
▽ More
Monotonicity and nonmonotonicity play a key role in studying the global convergence and the efficiency of iterative schemes employed in the field of nonlinear optimization, where globally convergent and computationally efficient schemes are explored. This paper addresses some features of descent schemes and the motivation behind nonmonotone strategies and investigates the efficiency of an Armijo-type line search equipped with some popular nonmonotone terms. More specifically, we propose two novel nonmonotone terms, combine them into Armijo's rule and establish the global convergence of sequences generated by these schemes. Furthermore, we report extensive numerical results and comparisons indicating the performance of the nonmonotone Armijo-type line searches using the most popular search directions for solving unconstrained optimization problems. Finally, we exploit the considered nonmonotone schemes to solve an important inverse problem arising in signal and image processing.
△ Less
Submitted 20 August, 2014; v1 submitted 12 August, 2014;
originally announced August 2014.
-
An approximate solution of the MHD Falkner-Skan flow by Hermite functions pseudospectral method
Authors:
K. Parand,
A. R. Rezaei,
S. M. Ghaderi
Abstract:
Based on a new approximation method, namely pseudospectral method, a solution for the three order nonlinear ordinary differential laminar boundary layer Falkner-Skan equation has been obtained on the semi-infinite domain. The proposed approach is equipped by the orthogonal Hermite functions that have perfect properties to achieve this goal. This method solves the problem on the semi-infinite domai…
▽ More
Based on a new approximation method, namely pseudospectral method, a solution for the three order nonlinear ordinary differential laminar boundary layer Falkner-Skan equation has been obtained on the semi-infinite domain. The proposed approach is equipped by the orthogonal Hermite functions that have perfect properties to achieve this goal. This method solves the problem on the semi-infinite domain without truncating it to a finite domain and transforming domain of the problem to a finite domain. In addition, this method reduces solution of the problem to solution of a system of algebraic equations. We also present the comparison of this work with numerical results and show that the present method is applicable.
△ Less
Submitted 16 August, 2010; v1 submitted 13 August, 2010;
originally announced August 2010.
-
An approximation algorithm for the solution of the nonlinear Lane-Emden type equations arising in astrophysics using Hermite functions collocation method
Authors:
K. Parand,
Mehdi Dehghan,
A. R. Rezaei,
S. M. Ghaderi
Abstract:
In this paper we propose a collocation method for solving some well-known classes of Lane-Emden type equations which are nonlinear ordinary differential equations on the semi-infinite domain. They are categorized as singular initial value problems. The proposed approach is based on a Hermite function collocation (HFC) method. To illustrate the reliability of the method, some special cases of the e…
▽ More
In this paper we propose a collocation method for solving some well-known classes of Lane-Emden type equations which are nonlinear ordinary differential equations on the semi-infinite domain. They are categorized as singular initial value problems. The proposed approach is based on a Hermite function collocation (HFC) method. To illustrate the reliability of the method, some special cases of the equations are solved as test examples. The new method reduces the solution of a problem to the solution of a system of algebraic equations. Hermite functions have prefect properties that make them useful to achieve this goal. We compare the present work with some well-known results and show that the new method is efficient and applicable.
△ Less
Submitted 12 August, 2010;
originally announced August 2010.
