-
Convergence rates of particle approximation of forward-backward splitting algorithm for granular medium equations
Authors:
Matej Benko,
Iwona Chlebicka,
Jørgen Endal,
Błażej Miasojedow
Abstract:
We study the spatially homogeneous granular medium equation \[\partial_tμ=\rm{div}(μ\nabla V)+\rm{div}(μ(\nabla W \ast μ))+Δμ\,,\] within a large and natural class of the confinement potentials $V$ and interaction potentials $W$. The considered problem do not need to assume that $\nabla V$ or $\nabla W$ are globally Lipschitz. With the aim of providing particle approximation of solutions, we desig…
▽ More
We study the spatially homogeneous granular medium equation \[\partial_tμ=\rm{div}(μ\nabla V)+\rm{div}(μ(\nabla W \ast μ))+Δμ\,,\] within a large and natural class of the confinement potentials $V$ and interaction potentials $W$. The considered problem do not need to assume that $\nabla V$ or $\nabla W$ are globally Lipschitz. With the aim of providing particle approximation of solutions, we design efficient forward-backward splitting algorithms. Sharp convergence rates in terms of the Wasserstein distance are provided.
△ Less
Submitted 28 May, 2024;
originally announced May 2024.
-
On the directional asymptotic approach in optimization theory
Authors:
Matúš Benko,
Patrick Mehlitz
Abstract:
As a starting point of our research, we show that, for a fixed order $γ\geq 1$, each local minimizer of a rather general nonsmooth optimization problem in Euclidean spaces is either M-stationary in the classical sense (corresponding to stationarity of order $1$), satisfies stationarity conditions in terms of a coderivative construction of order $γ$, or is asymptotically stationary with respect to…
▽ More
As a starting point of our research, we show that, for a fixed order $γ\geq 1$, each local minimizer of a rather general nonsmooth optimization problem in Euclidean spaces is either M-stationary in the classical sense (corresponding to stationarity of order $1$), satisfies stationarity conditions in terms of a coderivative construction of order $γ$, or is asymptotically stationary with respect to a critical direction as well as order $γ$ in a certain sense. By ruling out the latter case with a constraint qualification not stronger than directional metric subregularity, we end up with new necessary optimality conditions comprising a mixture of limiting variational tools of orders $1$ and $γ$. These abstract findings are carved out for the broad class of geometric constraints and $γ:=2$, and visualized by examples from complementarity-constrained and nonlinear semidefinite optimization. As a byproduct of the particular setting $γ:=1$, our general approach yields new so-called directional asymptotic regularity conditions which serve as constraint qualifications guaranteeing M-stationarity of local minimizers. We compare these new regularity conditions with standard constraint qualifications from nonsmooth optimization. Further, we extend directional concepts of pseudo- and quasi-normality to arbitrary set-valued mappings. It is shown that these properties provide sufficient conditions for the validity of directional asymptotic regularity. Finally, a novel coderivative-like variational tool is used to construct sufficient conditions for the presence of directional asymptotic regularity. For geometric constraints, it is illustrated that all appearing objects can be calculated in terms of initial problem data.
△ Less
Submitted 26 February, 2024;
originally announced February 2024.
-
Isolated calmness of perturbation mappings in generalized nonlinear programming and local superlinear convergence of Newton-type methods
Authors:
Matúš Benko,
Patrick Mehlitz
Abstract:
In this paper, we characterize Lipschitzian properties of different multiplier-free and multiplier-dependent perturbation mappings associated with the stationarity system of a so-called generalized nonlinear program popularized by Rockafellar. Special emphasis is put on the investigation of the isolated calmness property at and around a point. The latter is decisive for the locally fast convergenc…
▽ More
In this paper, we characterize Lipschitzian properties of different multiplier-free and multiplier-dependent perturbation mappings associated with the stationarity system of a so-called generalized nonlinear program popularized by Rockafellar. Special emphasis is put on the investigation of the isolated calmness property at and around a point. The latter is decisive for the locally fast convergence of the so-called semismooth* Newton-type method by Gfrerer and Outrata. Our central result is the characterization of the isolated calmness at a point of a multiplier-free perturbation mapping via a combination of an explicit condition and a rather mild assumption, automatically satisfied e.g. for standard nonlinear programs. Isolated calmness around a point is characterized analogously by a combination of two stronger conditions. These findings are then related to so-called criticality of Lagrange multipliers, as introduced by Izmailov and extended to generalized nonlinear programming by Mordukhovich and Sarabi. We derive a new sufficient condition (a characterization for some problem classes) of nonexistence of critical multipliers, which has been also used in the literature as an assumption to guarantee local fast convergence of Newton-, SQP-, or multiplier-penalty-type methods. The obtained insights about critical multipliers seem to complement the vast literature on the topic.
△ Less
Submitted 2 July, 2024; v1 submitted 16 January, 2024;
originally announced January 2024.
-
Primal-Dual Stability in Local Optimality
Authors:
Matus Benko,
R. Tyrrell Rockafellar
Abstract:
Much is known about when a locally optimal solution depends in a single-valued Lipschitz continuous way on the problem's parameters, including tilt perturbations. Much less is known, however, about when that solution and a uniquely determined multiplier vector associated with it exhibit that dependence as a primal-dual pair. In classical nonlinear programming, such advantageous behavior is tied to…
▽ More
Much is known about when a locally optimal solution depends in a single-valued Lipschitz continuous way on the problem's parameters, including tilt perturbations. Much less is known, however, about when that solution and a uniquely determined multiplier vector associated with it exhibit that dependence as a primal-dual pair. In classical nonlinear programming, such advantageous behavior is tied to the combination of the standard strong second-order sufficient condition (SSOC) for local optimality and the linear independent gradient condition (LIGC) on the active constraint gradients. But although second-order sufficient conditions have successfully been extended far beyond nonlinear programming, insights into what should replace constraint gradient independence as the extended dual counterpart have been lacking.
The exact answer is provided here for a wide range of optimization problems in finite dimensions. Behind it are advances in how coderivatives and strict graphical derivatives can be deployed. New results about strong metric regularity in solving variational inequalities and generalized equations are obtained from that as well.
△ Less
Submitted 31 December, 2023;
originally announced January 2024.
-
Why second-order sufficient conditions are, in a way, easy -- or -- revisiting calculus for second subderivatives
Authors:
Matúš Benko,
Patrick Mehlitz
Abstract:
In this paper, we readdress the classical topic of second-order sufficient optimality conditions for optimization problems with nonsmooth structure. Based on the so-called second subderivative of the objective function and of the indicator function associated with the feasible set, one easily obtains second-order sufficient optimality conditions of abstract form. In order to exploit further struct…
▽ More
In this paper, we readdress the classical topic of second-order sufficient optimality conditions for optimization problems with nonsmooth structure. Based on the so-called second subderivative of the objective function and of the indicator function associated with the feasible set, one easily obtains second-order sufficient optimality conditions of abstract form. In order to exploit further structure of the problem, e.g., composite terms in the objective function or feasible sets given as (images of) pre-images of closed sets under smooth transformations, to make these conditions fully explicit, we study calculus rules for the second subderivative under mild conditions. To be precise, we investigate a chain rule and a marginal function rule, which then also give a pre-image and image rule, respectively. As it turns out, the chain rule and the pre-image rule yield lower estimates desirable in order to obtain sufficient optimality conditions for free. Similar estimates for the marginal function and the image rule are valid under a comparatively mild inner calmness* assumption. Our findings are illustrated by several examples including problems from composite, disjunctive, and nonlinear second-order cone programming.
△ Less
Submitted 26 January, 2023; v1 submitted 8 June, 2022;
originally announced June 2022.
-
On the directional asymptotic approach in optimization theory Part B: constraint qualifications
Authors:
Matúš Benko,
Patrick Mehlitz
Abstract:
During the last years, asymptotic (or sequential) constraint qualifications, which postulate upper semicontinuity of certain set-valued mappings and provide a natural companion of asymptotic stationarity conditions, have been shown to be comparatively mild, on the one hand, while possessing inherent practical relevance from the viewpoint of numerical solution methods, on the other one. Based on re…
▽ More
During the last years, asymptotic (or sequential) constraint qualifications, which postulate upper semicontinuity of certain set-valued mappings and provide a natural companion of asymptotic stationarity conditions, have been shown to be comparatively mild, on the one hand, while possessing inherent practical relevance from the viewpoint of numerical solution methods, on the other one. Based on recent developments, the theory in this paper enriches asymptotic constraint qualifications for very general nonsmooth optimization problems over inverse images of set-valued mappings by incorporating directional data. We compare these new directional asymptotic regularity conditions with standard constraint qualifications from nonsmooth optimization. Further, we introduce directional concepts of pseudo- and quasi-normality which apply to set-valued mappings. It is shown that these properties provide sufficient conditions for the validity of directional asymptotic regularity. Finally, a novel coderivative-like variational tool is introduced which allows to study the presence of directional asymptotic regularity. For geometric constraints, it is illustrated that all appearing objects can be calculated in terms of initial problem data.
△ Less
Submitted 9 February, 2023; v1 submitted 2 May, 2022;
originally announced May 2022.
-
On the directional asymptotic approach in optimization theory Part A: approximate, M-, and mixed-order stationarity
Authors:
Matúš Benko,
Patrick Mehlitz
Abstract:
We show that, for a fixed order $γ\geq 1$, each local minimizer of a rather general nonsmooth optimization problem in Euclidean spaces is either M-stationary in the classical sense (corresponding to stationarity of order $1$), satisfies stationarity conditions in terms of a coderivative construction of order $γ$, or is approximately stationary with respect to a critical direction as well as $γ$ in…
▽ More
We show that, for a fixed order $γ\geq 1$, each local minimizer of a rather general nonsmooth optimization problem in Euclidean spaces is either M-stationary in the classical sense (corresponding to stationarity of order $1$), satisfies stationarity conditions in terms of a coderivative construction of order $γ$, or is approximately stationary with respect to a critical direction as well as $γ$ in a certain sense. By ruling out the latter case with a constraint qualification not stronger than directional metric subregularity, we end up with new necessary optimality conditions comprising a mixture of limiting variational tools of order $1$ and $γ$. These abstract findings are carved out for the broad class of geometric constraints. As a byproduct, we obtain new constraint qualifications ensuring M-stationarity of local minimizers. The paper closes by illustrating these results in the context of standard nonlinear, complementarity-constrained, and nonlinear semidefinite programming.
△ Less
Submitted 9 February, 2023; v1 submitted 29 April, 2022;
originally announced April 2022.
-
Second-order optimality conditions for general nonconvex optimization problems and variational analysis of disjunctive systems
Authors:
Matus Benko,
Helmut Gfrerer,
Jane Ye,
Jin Zhang,
Jinchuan Zhou
Abstract:
In this paper, we propose second-order sufficient optimality conditions for a very general nonconvex constrained optimization problem, which covers many prominent mathematical programs.Unlike the existing results in the literature, our conditions prove to be sufficient, for an essential local minimizer of second order, under merely basic smoothness and closedness assumptions on the data defining t…
▽ More
In this paper, we propose second-order sufficient optimality conditions for a very general nonconvex constrained optimization problem, which covers many prominent mathematical programs.Unlike the existing results in the literature, our conditions prove to be sufficient, for an essential local minimizer of second order, under merely basic smoothness and closedness assumptions on the data defining the problem.In the second part, we propose a comprehensive first- and second-order variational analysis of disjunctive systems and demonstrate how the second-order objects appearing in the optimality conditions can be effectively computed in this case.
△ Less
Submitted 22 November, 2022; v1 submitted 18 March, 2022;
originally announced March 2022.
-
On implicit variables in optimization theory
Authors:
Matúš Benko,
Patrick Mehlitz
Abstract:
Implicit variables of a mathematical program are variables which do not need to be optimized but are used to model feasibility conditions. They frequently appear in several different problem classes of optimization theory comprising bilevel programming, evaluated multiobjective optimization, or nonlinear optimization problems with slack variables. In order to deal with implicit variables, they are…
▽ More
Implicit variables of a mathematical program are variables which do not need to be optimized but are used to model feasibility conditions. They frequently appear in several different problem classes of optimization theory comprising bilevel programming, evaluated multiobjective optimization, or nonlinear optimization problems with slack variables. In order to deal with implicit variables, they are often interpreted as explicit ones. Here, we first point out that this is a light-headed approach which induces artificial locally optimal solutions. Afterwards, we derive various Mordukhovich-stationarity-type necessary optimality conditions which correspond to treating the implicit variables as explicit ones on the one hand, or using them only implicitly to model the constraints on the other. A detailed comparison of the obtained stationarity conditions as well as the associated underlying constraint qualifications will be provided. Overall, we proceed in a fairly general setting relying on modern tools of variational analysis. Finally, we apply our findings to different well-known problem classes of mathematical optimization in order to visualize the obtained theory.
△ Less
Submitted 5 August, 2021; v1 submitted 19 August, 2020;
originally announced August 2020.
-
Calmness and Calculus: Two Basic Patterns
Authors:
Matúš Benko,
Patrick Mehlitz
Abstract:
We establish two types of estimates for generalized derivatives of set-valued mappings which carry the essence of two basic patterns observed troughout the pile of calculus rules. These estimates also illustrate the role of the essential assumptions that accompany these two patters, namely calmness on the one hand and (fuzzy) inner calmness* on the other. Afterwards, we study the relationship betw…
▽ More
We establish two types of estimates for generalized derivatives of set-valued mappings which carry the essence of two basic patterns observed troughout the pile of calculus rules. These estimates also illustrate the role of the essential assumptions that accompany these two patters, namely calmness on the one hand and (fuzzy) inner calmness* on the other. Afterwards, we study the relationship between and sufficient conditions for the various notions of (inner) calmness. The aforementioned estimates are applied in order to recover several prominent calculus rules for tangents and normals as well as generalized derivatives of marginal functions and compositions as well as Cartesian products of set-valued mappings under mild conditions. We believe that our enhanced approach puts the overall generalized calculus into some other light. Some applications of our findings are presented which exemplary address necessary optimality conditions for minimax optimization problems as well as the calculus related to the recently introduced semismoothness* property.
△ Less
Submitted 16 February, 2021; v1 submitted 17 August, 2020;
originally announced August 2020.
-
On inner calmness*, generalized calculus, and derivatives of the normal cone mapping
Authors:
Matúš Benko
Abstract:
In this paper, we study continuity and Lipschitzian properties of set-valued mappings, focusing on inner-type conditions. We introduce new notions of inner calmness* and, its relaxation, fuzzy inner calmness*. We show that polyhedral maps enjoy inner calmness* and examine (fuzzy) inner calmness* of a multiplier mapping associated with constraint systems in depth. Then we utilize these notions to d…
▽ More
In this paper, we study continuity and Lipschitzian properties of set-valued mappings, focusing on inner-type conditions. We introduce new notions of inner calmness* and, its relaxation, fuzzy inner calmness*. We show that polyhedral maps enjoy inner calmness* and examine (fuzzy) inner calmness* of a multiplier mapping associated with constraint systems in depth. Then we utilize these notions to develop some new rules of generalized differential calculus, mainly for the primal objects (e.g. tangent cones). In particular, we propose an exact chain rule for graphical derivatives. We apply these results to compute the derivatives of the normal cone mapping, essential e.g. for sensitivity analysis of variational inequalities.
△ Less
Submitted 24 June, 2021; v1 submitted 29 October, 2019;
originally announced October 2019.
-
Sufficient Conditions for Metric Subregularity of Constraint Systems with Applications to Disjunctive and Ortho-Disjunctive Programs
Authors:
Matúš Benko,
Michal Červinka,
Tim Hoheisel
Abstract:
This paper is devoted to the study of the metric subregularity constraint qualification (MSCQ) for general optimization problems, with the emphasis on the nonconvex setting. We elaborate on notions of directional pseudo- and quasi-normality, recently introduced by Bai et al. (SIAM J. Opt., 2019), which combine the standard approach via pseudo- and quasi-normality with modern tools of directional v…
▽ More
This paper is devoted to the study of the metric subregularity constraint qualification (MSCQ) for general optimization problems, with the emphasis on the nonconvex setting. We elaborate on notions of directional pseudo- and quasi-normality, recently introduced by Bai et al. (SIAM J. Opt., 2019), which combine the standard approach via pseudo- and quasi-normality with modern tools of directional variational analysis. We focus on applications to disjunctive programs, where (directional) pseudo-normality is characterized via an extremal condition. This, in turn, yields efficient tools to verify pseudo-normality and MSCQ, which include, but are not limited to, Robinson's result on polyhedral multifunctions and Gfrerer's second-order sufficient condition for metric subregularity. Finally, we refine our study by defining the new class of ortho-disjunctive programs which comprises prominent optimization problems such as mathematical programs with complementarity, vanishing or switching constraints.
△ Less
Submitted 23 October, 2020; v1 submitted 19 June, 2019;
originally announced June 2019.
-
On estimating the regular normal cone to constraint systems and stationarity conditions
Authors:
Matúš Benko,
Helmut Gfrerer
Abstract:
Estimating the regular normal cone to constraint systems plays an important role for the derivation of sharp necessary optimality conditions. We present two novel approaches and introduce a new stationarity concept which is stronger than M-stationarity. We apply our theory to three classes of mathematical programs frequently arising in the literature.
Estimating the regular normal cone to constraint systems plays an important role for the derivation of sharp necessary optimality conditions. We present two novel approaches and introduce a new stationarity concept which is stronger than M-stationarity. We apply our theory to three classes of mathematical programs frequently arising in the literature.
△ Less
Submitted 20 February, 2019;
originally announced February 2019.
-
Stability analysis for parameterized variational systems with implicit constraints
Authors:
Matúš Benko,
Helmut Gfrerer,
Jiří V. Outrata
Abstract:
In the paper we provide new conditions ensuring the isolated calmness property and the Aubin property of parameterized variational systems with constraints depending, apart from the parameter, also on the solution itself. Such systems include, e.g., quasi-variational inequalities and implicit complementarity problems. Concerning the Aubin property, possible restrictions imposed on the parameter ar…
▽ More
In the paper we provide new conditions ensuring the isolated calmness property and the Aubin property of parameterized variational systems with constraints depending, apart from the parameter, also on the solution itself. Such systems include, e.g., quasi-variational inequalities and implicit complementarity problems. Concerning the Aubin property, possible restrictions imposed on the parameter are also admitted. Throughout the paper, tools from the directional limiting generalized differential calculus are employed enabling us to impose only rather weak (non-restrictive) qualification conditions. Despite the very general problem setting, the resulting conditions are workable as documented by some academic examples
△ Less
Submitted 20 February, 2019;
originally announced February 2019.
-
Characterizations of Tilt-Stable Minimizers in Second-Order Cone Programming
Authors:
Matúš Benko,
Helmut Gfrerer,
Boris S. Mordukhovich
Abstract:
This paper is devoted to the study of tilt stability of local minimizers, which plays an important role in both theoretical and numerical aspects of optimization. This notion has been comprehensively investigated in the unconstrained framework as well as for problems of nonlinear programming with $C^2$-smooth data. Available results for nonpolyhedral conic programs were obtained only under strong…
▽ More
This paper is devoted to the study of tilt stability of local minimizers, which plays an important role in both theoretical and numerical aspects of optimization. This notion has been comprehensively investigated in the unconstrained framework as well as for problems of nonlinear programming with $C^2$-smooth data. Available results for nonpolyhedral conic programs were obtained only under strong constraint nondegeneracy assumptions. Here we develop an approach of second-order variational analysis, which allows us to establish complete neighborhood and pointbased characterizations of tilt stability for problems of second-order cone programming generated by the nonpolyhedral second-order/Lorentz/ice-cream cone. These characterizations are established under the weakest metric subregularity constraint qualification condition.
△ Less
Submitted 10 September, 2018;
originally announced September 2018.
-
Calculus for directional limiting normal cones and subdifferentials
Authors:
Matúš Benko,
Helmut Gfrerer,
Jiří V. Outrata
Abstract:
The paper is devoted to the development of a comprehensive calculus for directional limiting normal cones, subdifferentials and coderivatives in finite dimensions. This calculus encompasses the whole range of the standard generalized differential calculus for (non-directional) limiting notions and relies on very weak (non-restrictive) qualification conditions having also a directional character. T…
▽ More
The paper is devoted to the development of a comprehensive calculus for directional limiting normal cones, subdifferentials and coderivatives in finite dimensions. This calculus encompasses the whole range of the standard generalized differential calculus for (non-directional) limiting notions and relies on very weak (non-restrictive) qualification conditions having also a directional character. The derived rules facilitate the application of tools exploiting the directional limiting notions to difficult problems of variational analysis including, for instance, various stability and sensitivity issues. This is illustrated by some selected applications in the last part of the paper.
△ Less
Submitted 13 December, 2017;
originally announced December 2017.
-
New verifiable stationarity concepts for a class of mathematical programs with disjunctive constraints
Authors:
Matúš Benko,
Helmut Gfrerer
Abstract:
In this paper we consider a sufficiently broad class of nonlinear mathematical programs with disjunctive constraints, which, e.g., include mathematical programs with complemetarity/vanishing constraints. We present an extension of the concept of ${\mathcal Q}$-stationarity as introduced in the recent paper [2]. ${\mathcal Q}$-stationarity can be easily combined with the well-known notion of M-stat…
▽ More
In this paper we consider a sufficiently broad class of nonlinear mathematical programs with disjunctive constraints, which, e.g., include mathematical programs with complemetarity/vanishing constraints. We present an extension of the concept of ${\mathcal Q}$-stationarity as introduced in the recent paper [2]. ${\mathcal Q}$-stationarity can be easily combined with the well-known notion of M-stationarity to obtain the stronger property of so-called ${\mathcal Q}_M$-stationarity. We show how the property of ${\mathcal Q}_M$-stationarity (and thus also of M-stationarity) can be efficiently verified for the considered problem class by computing ${\mathcal Q}$-stationary solutions of a certain quadratic program. We consider further the situation that the point which is to be tested for ${\mathcal Q}_M$-stationarity, is not known exactly, but is approximated by some convergent sequence, as it is usually the case when applying some numerical method.
△ Less
Submitted 24 November, 2016;
originally announced November 2016.
-
An SQP method for mathematical programs with vanishing constraints with strong convergence properties
Authors:
Matúš Benko,
Helmut Gfrerer
Abstract:
We propose an SQP algorithm for mathematical programs with vanishing constraints which solves at each iteration a quadratic program with linear vanishing constraints. The algorithm is based on the newly developed concept of $\mathcal Q$-stationarity [5]. We demonstrate how $\mathcal Q_M$-stationary solutions of the quadratic program can be obtained. We show that all limit points of the sequence of…
▽ More
We propose an SQP algorithm for mathematical programs with vanishing constraints which solves at each iteration a quadratic program with linear vanishing constraints. The algorithm is based on the newly developed concept of $\mathcal Q$-stationarity [5]. We demonstrate how $\mathcal Q_M$-stationary solutions of the quadratic program can be obtained. We show that all limit points of the sequence of iterates generated by the basic SQP method are at least M-stationary and by some extension of the method we also guarantee the stronger property of $\mathcal Q_M$-stationarity of the limit points.
△ Less
Submitted 24 November, 2016;
originally announced November 2016.
-
Common functional principal components
Authors:
Michal Benko,
Wolfgang Härdle,
Alois Kneip
Abstract:
Functional principal component analysis (FPCA) based on the Karhunen--Loève decomposition has been successfully applied in many applications, mainly for one sample problems. In this paper we consider common functional principal components for two sample problems. Our research is motivated not only by the theoretical challenge of this data situation, but also by the actual question of dynamics of…
▽ More
Functional principal component analysis (FPCA) based on the Karhunen--Loève decomposition has been successfully applied in many applications, mainly for one sample problems. In this paper we consider common functional principal components for two sample problems. Our research is motivated not only by the theoretical challenge of this data situation, but also by the actual question of dynamics of implied volatility (IV) functions. For different maturities the log-returns of IVs are samples of (smooth) random functions and the methods proposed here study the similarities of their stochastic behavior. First we present a new method for estimation of functional principal components from discrete noisy data. Next we present the two sample inference for FPCA and develop the two sample theory. We propose bootstrap tests for testing the equality of eigenvalues, eigenfunctions, and mean functions of two functional samples, illustrate the test-properties by simulation study and apply the method to the IV analysis.
△ Less
Submitted 27 January, 2009;
originally announced January 2009.
