-
A Proximal Gradient Method with an Explicit Line search for Multiobjective Optimization
Authors:
Yunier Bello-Cruz,
J. G. Melo,
L. F. Prudente,
R. V. G. Serra
Abstract:
We present a proximal gradient method for solving convex multiobjective optimization problems, where each objective function is the sum of two convex functions, with one assumed to be continuously differentiable. The algorithm incorporates a backtracking line search procedure that requires solving only one proximal subproblem per iteration, and is exclusively applied to the differentiable part of…
▽ More
We present a proximal gradient method for solving convex multiobjective optimization problems, where each objective function is the sum of two convex functions, with one assumed to be continuously differentiable. The algorithm incorporates a backtracking line search procedure that requires solving only one proximal subproblem per iteration, and is exclusively applied to the differentiable part of the objective functions. Under mild assumptions, we show that the sequence generated by the method convergences to a weakly Pareto optimal point of the problem. Additionally, we establish an iteration complexity bound by showing that the method finds an $\varepsilon$-approximate weakly Pareto point in at most ${\cal O}(1/\varepsilon)$ iterations. Numerical experiments illustrating the practical behavior of the method is presented.
△ Less
Submitted 16 April, 2024;
originally announced April 2024.
-
Global convergence of a BFGS-type algorithm for nonconvex multiobjective optimization problems
Authors:
L. F. Prudente,
D. R. Souza
Abstract:
We propose a modified BFGS algorithm for multiobjective optimization problems with global convergence, even in the absence of convexity assumptions on the objective functions. Furthermore, we establish the superlinear convergence of the method under usual conditions. Our approach employs Wolfe step sizes and ensures that the Hessian approximations are updated and corrected at each iteration to add…
▽ More
We propose a modified BFGS algorithm for multiobjective optimization problems with global convergence, even in the absence of convexity assumptions on the objective functions. Furthermore, we establish the superlinear convergence of the method under usual conditions. Our approach employs Wolfe step sizes and ensures that the Hessian approximations are updated and corrected at each iteration to address the lack of convexity assumption. Numerical results shows that the introduced modifications preserve the practical efficiency of the BFGS method.
△ Less
Submitted 11 April, 2024; v1 submitted 17 July, 2023;
originally announced July 2023.
-
A generalized conditional gradient method for multiobjective composite optimization problems
Authors:
P. B. Assunção,
O. P. Ferreira,
L. F. Prudente
Abstract:
This article deals with multiobjective composite optimization problems that consist of simultaneously minimizing several objective functions, each of which is composed of a combination of smooth and non-smooth functions. To tackle these problems, we propose a generalized version of the conditional gradient method, also known as Frank-Wolfe method. The method is analyzed with three step size strate…
▽ More
This article deals with multiobjective composite optimization problems that consist of simultaneously minimizing several objective functions, each of which is composed of a combination of smooth and non-smooth functions. To tackle these problems, we propose a generalized version of the conditional gradient method, also known as Frank-Wolfe method. The method is analyzed with three step size strategies, including Armijo-type, adaptive, and diminishing step sizes. We establish asymptotic convergence properties and iteration-complexity bounds, with and without convexity assumptions on the objective functions. Numerical experiments illustrating the practical behavior of the methods are presented.
△ Less
Submitted 24 February, 2023;
originally announced February 2023.
-
On the inexact scaled gradient projection method
Authors:
Orizon P. Ferreira,
Max V. Lemes,
Leandro F. Prudente
Abstract:
The purpose of this paper is to present an inexact version of the scaled gradient projection method on a convex set, which is inexact in two sense. First, an inexact projection on the feasible set is computed, allowing for an appropriate relative error tolerance. Second, an inexact non-monotone line search scheme is employed to compute a step size which defines the next iteration. It is shown that…
▽ More
The purpose of this paper is to present an inexact version of the scaled gradient projection method on a convex set, which is inexact in two sense. First, an inexact projection on the feasible set is computed, allowing for an appropriate relative error tolerance. Second, an inexact non-monotone line search scheme is employed to compute a step size which defines the next iteration. It is shown that the proposed method has similar asymptotic convergence properties and iteration-complexity bounds as the usual scaled gradient projection method employing monotone line searches.
△ Less
Submitted 8 June, 2021;
originally announced June 2021.
-
Inexact gradient projection method with relative error tolerance
Authors:
Ademir A. Aguiar,
Orizon P. Ferreira,
Leandro F. Prudente
Abstract:
A gradient projection method with feasible inexact projections is proposed in the present paper. The inexact projection is performed using a relative error tolerance. Asymptotic convergence analysis and iteration-complexity bounds of the method employing constant and Armijo step sizes are presented. Numerical results are reported illustrating the potential advantages of considering inexact project…
▽ More
A gradient projection method with feasible inexact projections is proposed in the present paper. The inexact projection is performed using a relative error tolerance. Asymptotic convergence analysis and iteration-complexity bounds of the method employing constant and Armijo step sizes are presented. Numerical results are reported illustrating the potential advantages of considering inexact projections instead of exact ones in some medium scale instances of a least squares problem over the spectrohedron.
△ Less
Submitted 26 January, 2021;
originally announced January 2021.
-
Subgradient method with feasible inexact projections for constrained convex optimization problems
Authors:
Ademir Alves Aguiar,
Orizon Pereira Ferreira,
Leandro da Fonseca Prudente
Abstract:
In this paper, we propose a new inexact version of the projected subgradient method to solve nondifferentiable constrained convex optimization problems. The method combine $ε$-subgradient method with a procedure to obtain a feasible inexact projection onto the constraint set. Asymptotic convergence results and iteration-complexity bounds for the sequence generated by the method employing the well…
▽ More
In this paper, we propose a new inexact version of the projected subgradient method to solve nondifferentiable constrained convex optimization problems. The method combine $ε$-subgradient method with a procedure to obtain a feasible inexact projection onto the constraint set. Asymptotic convergence results and iteration-complexity bounds for the sequence generated by the method employing the well known exogenous stepsizes, Polyak's stepsizes, and dynamic stepsizes are established.
△ Less
Submitted 15 June, 2020;
originally announced June 2020.
-
Alternating conditional gradient method for convex feasibility problems
Authors:
R. Díaz Millán,
O. P. Ferreira,
L. F. Prudente
Abstract:
The classical convex feasibility problem in a finite dimensional Euclidean space is studied in the present paper. We are interested in two cases. First, we assume to know how to compute an exact project onto one of the sets involved and the other set is compact such that the conditional gradient (CondG) method can be used for computing efficiently an inexact projection on it. Second, we assume tha…
▽ More
The classical convex feasibility problem in a finite dimensional Euclidean space is studied in the present paper. We are interested in two cases. First, we assume to know how to compute an exact project onto one of the sets involved and the other set is compact such that the conditional gradient (CondG) method can be used for computing efficiently an inexact projection on it. Second, we assume that both sets involved are compact such that the CondG method can be used for computing efficiently inexact projections on them. We combine alternating projection method with CondG method to design a new method, which can be seen as an inexact feasible version of alternate projection method. The proposed method generates two different sequences belonging to each involved set, which converge to a point in the intersection of them whenever it is not empty. If the intersection is empty, then the sequences converge to points in the respective sets whose distance is equal to the distance between the sets in consideration.
△ Less
Submitted 9 December, 2019;
originally announced December 2019.
-
Iteration-complexity and asymptotic analysis of steepest descent method for multiobjective optimization on Riemannian manifolds
Authors:
Orizon P. Ferreira,
Maurício S. Louzeiro,
Leandro F. Prudente
Abstract:
The steepest descent method for multiobjective optimization on Riemannian manifolds with lower bounded sectional curvature is analyzed in this paper. The aim of the paper is twofold. Firstly, an asymptotic analysis of the method is presented with three different finite procedures for determining the stepsize, namely, Lipschitz stepsize, adaptive stepsize and Armijo-type stepsize. The second aim is…
▽ More
The steepest descent method for multiobjective optimization on Riemannian manifolds with lower bounded sectional curvature is analyzed in this paper. The aim of the paper is twofold. Firstly, an asymptotic analysis of the method is presented with three different finite procedures for determining the stepsize, namely, Lipschitz stepsize, adaptive stepsize and Armijo-type stepsize. The second aim is to present, by assuming that the Jacobian of the objective function is componentwise Lipschitz continuous, iteration-complexity bounds for the method with these three stepsizes strategies. In addition, some examples are presented to emphasize the importance of working in this new context. Numerical experiments are provided to illustrate the effectiveness of the method in this new setting and certify the obtained theoretical results.
△ Less
Submitted 13 June, 2019;
originally announced June 2019.
-
Iteration-Complexity of the Subgradient Method on Riemannian Manifolds with Lower Bounded Curvature
Authors:
O. P. Ferreira,
M. S. Louzeiro,
L. F. Prudente
Abstract:
The subgradient method for convex optimization problems on complete Riemannian manifolds with lower bounded sectional curvature is analyzed in this paper. Iteration-complexity bounds of the subgradient method with exogenous step-size and Polyak's step-size are stablished, completing and improving recent results on the subject.
The subgradient method for convex optimization problems on complete Riemannian manifolds with lower bounded sectional curvature is analyzed in this paper. Iteration-complexity bounds of the subgradient method with exogenous step-size and Polyak's step-size are stablished, completing and improving recent results on the subject.
△ Less
Submitted 19 August, 2018;
originally announced August 2018.
-
Gradient Method for Optimization on Riemannian Manifolds with Lower Bounded Curvature
Authors:
O. P. Ferreira,
M. S. Louzeiro,
L. F. Prudente
Abstract:
The gradient method for minimize a differentiable convex function on Riemannian manifolds with lower bounded sectional curvature is analyzed in this paper. The analysis of the method is presented with three different finite procedures for determining the stepsize, namely, Lipschitz stepsize, adaptive stepsize and Armijo's stepsize. The first procedure requires that the objective function has Lipsc…
▽ More
The gradient method for minimize a differentiable convex function on Riemannian manifolds with lower bounded sectional curvature is analyzed in this paper. The analysis of the method is presented with three different finite procedures for determining the stepsize, namely, Lipschitz stepsize, adaptive stepsize and Armijo's stepsize. The first procedure requires that the objective function has Lipschitz continuous gradient, which is not necessary for the other approaches. Convergence of the whole sequence to a minimizer, without any level set boundedness assumption, is proved. Iteration-complexity bound for functions with Lipschitz continuous gradient is also presented. Numerical experiments are provided to illustrate the effectiveness of the method in this new setting and certify the obtained theoretical results. In particular, we consider the problem of finding the Riemannian center of mass and the so-called Karcher's mean. Our numerical experiences indicate that the adaptive stepsize is a promising scheme that is worth considering.
△ Less
Submitted 7 June, 2018;
originally announced June 2018.
-
A semi-smooth Newton method for projection equations and linear complementarity problems with respect to the second order cone
Authors:
Jose Yunier Bello Cruz,
O. P. Ferreira,
S. Z. Nemeth,
L. F. Prudente
Abstract:
In this paper a special semi-smooth equation associated to the second order cone is studied. It is shown that, under mild assumptions, the semi-smooth Newton method applied to this equation is well-defined and the generated sequence is globally and Q-linearly convergent to a solution. As an application, the obtained results are used to study the linear second order cone complementarity problem, wi…
▽ More
In this paper a special semi-smooth equation associated to the second order cone is studied. It is shown that, under mild assumptions, the semi-smooth Newton method applied to this equation is well-defined and the generated sequence is globally and Q-linearly convergent to a solution. As an application, the obtained results are used to study the linear second order cone complementarity problem, with special emphasis on the particular case of positive definite matrices. Moreover, some computational experiments designed to investigate the practical viability of the method are presented.
△ Less
Submitted 14 October, 2016; v1 submitted 30 May, 2016;
originally announced May 2016.
-
On the global convergence of the inexact semi-smooth Newton method for absolute value equation
Authors:
J. Y. Bello Cruz,
O. P. Ferreira,
L. F. Prudente
Abstract:
In this paper, we investigate global convergence properties of the inexact nonsmooth Newton method for solving the system of absolute value equations (AVE). Global $Q$-linear convergence is established under suitable assumptions. Moreover, we present some numerical experiments designed to investigate the practical viability of the proposed scheme.
In this paper, we investigate global convergence properties of the inexact nonsmooth Newton method for solving the system of absolute value equations (AVE). Global $Q$-linear convergence is established under suitable assumptions. Moreover, we present some numerical experiments designed to investigate the practical viability of the proposed scheme.
△ Less
Submitted 12 November, 2015; v1 submitted 6 August, 2015;
originally announced August 2015.
