Skip to main content

Showing 1–20 of 20 results for author: Ye, J J

Searching in archive math. Search in all archives.
.
  1. arXiv:2306.17443  [pdf, ps, other

    math.OC

    Calm local optimality for nonconvex-nonconcave minimax problems

    Authors: Xiaoxiao Ma, Wei Yao, Jane J. Ye, Jin Zhang

    Abstract: Nonconvex-nonconcave minimax problems have found numerous applications in various fields including machine learning. However, questions remain about what is a good surrogate for local minimax optimum and how to characterize the minimax optimality. Recently Jin, Netrapalli, and Jordan (ICML 2020) introduced a concept of local minimax point and derived optimality conditions for the smooth and uncons… ▽ More

    Submitted 30 June, 2023; originally announced June 2023.

    Comments: 40 pages

  2. arXiv:2306.16761  [pdf, other

    math.OC cs.LG

    Moreau Envelope Based Difference-of-weakly-Convex Reformulation and Algorithm for Bilevel Programs

    Authors: Lucy L. Gao, Jane J. Ye, Haian Yin, Shangzhi Zeng, Jin Zhang

    Abstract: Bilevel programming has emerged as a valuable tool for hyperparameter selection, a central concern in machine learning. In a recent study by Ye et al. (2023), a value function-based difference of convex algorithm was introduced to address bilevel programs. This approach proves particularly powerful when dealing with scenarios where the lower-level problem exhibits convexity in both the upper-level… ▽ More

    Submitted 20 January, 2024; v1 submitted 29 June, 2023; originally announced June 2023.

    MSC Class: 90C99

  3. arXiv:2304.00695  [pdf, ps, other

    math.OC

    PLMEs and Disjunctive Decompositions for Bilevel Optimization

    Authors: Jiawang Nie, Jane J. Ye, Suhan Zhong

    Abstract: This paper studies bilevel polynomial optimization in which lower level constraining functions depend linearly on lower level variables. We show that such a bilevel program can be reformulated as a disjunctive program using partial Lagrange multiplier expressions (PLMEs). An advantage of this approach is that branch problems of the disjunctive program are easier to solve. In particular, since the… ▽ More

    Submitted 2 April, 2023; originally announced April 2023.

    Comments: 30 pages

  4. arXiv:2303.01474  [pdf, ps, other

    math.OC

    Sensitivity analysis of the maximal value function with applications in nonconvex minimax programs

    Authors: L. Guo, J. J. Ye, J. Zhang

    Abstract: In this paper, we perform sensitivity analysis for the maximal value function which is the optimal value function for a parametric maximization problem. Our aim is to study various subdifferentials for the maximal value function. We obtain upper estimates of Fréchet, limiting, and horizon subdifferentials of the maximal value function by using some sensitivity analysis techniques sophisticatedly.… ▽ More

    Submitted 2 March, 2023; originally announced March 2023.

    MSC Class: 90C30; 90C31; 90C47

  5. arXiv:2211.12597  [pdf, other

    math.OC

    Directional subdifferential of the value function

    Authors: Kuang Bai, Jane J. Ye

    Abstract: The directional subdifferential of the value function gives an estimate on how much the optimal value changes under a perturbation in a certain direction. In this paper we derive upper estimates for the directional limiting and singular subdifferential of the value function for a very general parametric optimization problem. We obtain a characterization for the directional Lipschitzness of a local… ▽ More

    Submitted 17 April, 2023; v1 submitted 22 November, 2022; originally announced November 2022.

  6. arXiv:2209.08428  [pdf, other

    math.OC

    Optimality conditions and constraint qualifications for cardinality constrained optimization problems

    Authors: Zhuoyu Xiao, Jane J. Ye

    Abstract: The cardinality constrained optimization problem (CCOP) is an optimization problem where the maximum number of nonzero components of any feasible point is bounded. In this paper, we consider CCOP as a mathematical program with disjunctive subspaces constraints (MPDSC). Since a subspace is a special case of a convex polyhedral set, MPDSC is a special case of the mathematical program with disjunctiv… ▽ More

    Submitted 17 September, 2022; originally announced September 2022.

  7. arXiv:2206.05976  [pdf, other

    math.OC cs.LG

    Value Function Based Difference-of-Convex Algorithm for Bilevel Hyperparameter Selection Problems

    Authors: Lucy Gao, Jane J. Ye, Haian Yin, Shangzhi Zeng, Jin Zhang

    Abstract: Gradient-based optimization methods for hyperparameter tuning guarantee theoretical convergence to stationary solutions when for fixed upper-level variable values, the lower level of the bilevel program is strongly convex (LLSC) and smooth (LLS). This condition is not satisfied for bilevel programs arising from tuning hyperparameters in many machine learning algorithms. In this work, we develop a… ▽ More

    Submitted 13 June, 2022; originally announced June 2022.

    Comments: 19 pages

  8. arXiv:2204.09869  [pdf, ps, other

    math.OC

    Relaxed constant positive linear dependence constraint qualification for disjunctive programs

    Authors: Mengwei Xu, Jane J. Ye

    Abstract: The disjunctive system is a system involving a disjunctive set which is the union of finitely many polyhedral convex sets. In this paper, we introduce a notion of the relaxed constant positive linear dependence constraint qualification (RCPLD) for the disjunctive system. For a disjunctive system, our notion is weaker than the one we introduced for a more general system recently (J. Glob. Optim. 20… ▽ More

    Submitted 5 March, 2023; v1 submitted 21 April, 2022; originally announced April 2022.

  9. arXiv:2108.00179  [pdf, other

    math.OC

    Combined approach with second-order optimality conditions for bilevel programming problems

    Authors: Xiaoxiao Ma, Wei Yao, Jane J. Ye, Jin Zhang

    Abstract: In this paper, we propose a combined approach with second-order optimality conditions of the lower level problem to study constraint qualifications and optimality conditions for bilevel programming problems. The new method is inspired by the combined approach developed by Ye and Zhu in 2010, where the authors combined the classical first-order and the value function approaches to derive new necess… ▽ More

    Submitted 7 February, 2023; v1 submitted 31 July, 2021; originally announced August 2021.

    Comments: 31 pages

  10. arXiv:2107.14469  [pdf, other

    math.OC

    Generic property of the partial calmness condition for bilevel programming problems

    Authors: Rongzhu Ke, Wei Yao, Jane J. Ye, Jin Zhang

    Abstract: The partial calmness for the bilevel programming problem (BLPP) is an important condition which ensures that a local optimal solution of BLPP is a local optimal solution of a partially penalized problem where the lower level optimality constraint is moved to the objective function and hence a weaker constraint qualification can be applied. In this paper we propose a sufficient condition in the for… ▽ More

    Submitted 2 November, 2021; v1 submitted 30 July, 2021; originally announced July 2021.

    Comments: 30 pages, update some information of a number of references

  11. arXiv:2102.09006  [pdf, ps, other

    math.OC

    Difference of convex algorithms for bilevel programs with applications in hyperparameter selection

    Authors: Jane J. Ye, Xiaoming Yuan, Shangzhi Zeng, Jin Zhang

    Abstract: In this paper, we present difference of convex algorithms for solving bilevel programs in which the upper level objective functions are difference of convex functions, and the lower level programs are fully convex. This nontrivial class of bilevel programs provides a powerful modelling framework for dealing with applications arising from hyperparameter selection in machine learning. Thanks to the… ▽ More

    Submitted 28 August, 2022; v1 submitted 17 February, 2021; originally announced February 2021.

  12. arXiv:2007.06148  [pdf, ps, other

    math.OC

    Optimality Conditions and Exact Penalty for Mathematical Programs with Switching Constraints

    Authors: Yan-Chao Liang, Jane J. Ye

    Abstract: In this paper, we give an overview on optimality conditions and exact penalization for the mathematical program with switching constraints (MPSC). MPSC is a new class of optimization problems which has some important applications. It is well-known that if MPSC is treated as a standard nonlinear program, some of the usual constraint qualifications may fail and to deal with this issue one could refo… ▽ More

    Submitted 20 March, 2021; v1 submitted 12 July, 2020; originally announced July 2020.

  13. arXiv:1912.12372  [pdf, ps, other

    math.OC

    Relaxed constant positive linear dependence constraint qualification and its application to bilevel programs

    Authors: Mengwei Xu, Jane J. Ye

    Abstract: Relaxed constant positive linear dependence constraint qualification (RCPLD) for a system of smooth equalities and inequalities is a constraint qualification that is weaker than the usual constraint qualifications such as Mangasarian Fromovitz constraint qualification and the linear constraint qualification. Moreover RCPLD is known to induce an error bound property. In this paper we extend RCPLD t… ▽ More

    Submitted 23 March, 2020; v1 submitted 27 December, 2019; originally announced December 2019.

  14. arXiv:1910.04072  [pdf, ps, other

    math.OC

    Constraint qualifications and optimality conditions in bilevel optimization

    Authors: Jane J. Ye

    Abstract: In this paper we study constraint qualifications and optimality conditions for bilevel programming problems. We strive to derive checkable constraint qualifications in terms of problem data and applicable optimality conditions. For the bilevel program with convex lower level program we discuss drawbacks of reformulating a bilevel programming problem by the mathematical program with complementarity… ▽ More

    Submitted 9 October, 2019; originally announced October 2019.

  15. arXiv:1906.09976  [pdf, ps, other

    math.OC

    Exact formula for the second-order tangent set of the second-order cone complementarity set

    Authors: Jein-Shan Chen, Jane J. Ye, Jin Zhang, Jinchuan Zhou

    Abstract: The second-order tangent set is an important concept in describing the curvature of the set involved. Due to the existence of the complementarity condition, the second-order cone (SOC) complementarity set is a nonconvex set. Moreover, unlike the vector complementarity set, the SOC complementarity set is not even the union of finitely many polyhedral convex sets. Despite these difficulties, we succ… ▽ More

    Submitted 24 June, 2019; originally announced June 2019.

  16. arXiv:1906.09558  [pdf, ps, other

    math.OC

    New sharp necessary optimality conditions for mathematical programs with equilibrium constraints

    Authors: Helmut Gfrerer, Jane J. Ye

    Abstract: In this paper, we study the mathematical program with equilibrium constraints (MPEC) formulated as a mathematical program with a parametric generalized equation involving the regular normal cone. We derive a new necessary optimality condition which is sharper than the usual M-stationary condition and is applicable even when no constraint qualifications hold for the corresponding mathematical progr… ▽ More

    Submitted 23 June, 2019; originally announced June 2019.

  17. arXiv:1709.01392  [pdf, ps, other

    math.OC

    Necessary optimality conditions for implicit control systems with applications to control of differential algebraic equations

    Authors: An Li, Jane J. Ye

    Abstract: In this paper we derive necessary optimality conditions for optimal control problems with nonlinear and nonsmooth implicit control systems. Implicit control systems have wide applications including differential algebraic equations (DAEs). The challenge in the study of implicit control system lies in that the system may be truly implicit, i.e., the Jacobian matrix of the constraint mapping may be s… ▽ More

    Submitted 2 September, 2017; originally announced September 2017.

    Comments: arXiv admin note: text overlap with arXiv:1512.00953

    MSC Class: 45K15; 49K21; 49J53

  18. arXiv:1701.04087  [pdf, ps, other

    math.OC

    Necessary Optimality Conditions and Exact Penalization for Non-Lipschitz Nonlinear Programs

    Authors: Lei Guo, Jane J. Ye

    Abstract: When the objective function is not locally Lipschitz, constraint qualifications are no longer sufficient for Karush-Kuhn-Tucker (KKT) conditions to hold at a local minimizer, let alone ensuring an exact penalization. In this paper, we extend quasi-normality and relaxed constant positive linear dependence (RCPLD) condition to allow the non-Lipschitzness of the objective function and show that they… ▽ More

    Submitted 15 January, 2017; originally announced January 2017.

  19. arXiv:1611.07891  [pdf, ps, other

    math.OC

    New constraint qualifications for mathematical programs with equilibrium constraints via variational analysis

    Authors: Helmut Gfrerer, Jane J. Ye

    Abstract: In this paper, we study the mathematical program with equilibrium constraints (MPEC) formulated as a mathematical program with a parametric generalized equation involving the regular normal cone. Compared with the usual way of formulating MPEC through a KKT condition, this formulation has the advantage that it does not involve extra multipliers as new variables, and it usually requires weaker assu… ▽ More

    Submitted 23 November, 2016; originally announced November 2016.

    MSC Class: 49J53; 90C30; 90C33; 90C46

  20. arXiv:1605.07293  [pdf, ps, other

    math.OC

    Exact formulas for the proximal/regular/limiting normal cone of the second-order cone complementarity set

    Authors: Jane J. Ye, Jinchuan Zhou

    Abstract: The proximal, regular and limiting normal cones to the second-order cone complementarity set play important roles in studying mathematical programs with second-order cone complementarity constraints, second-order cone programs, and the second-order cone complementarity problems. It is needed in the first-order optimality conditions for mathematical programs with second-order cone complementarity c… ▽ More

    Submitted 24 May, 2016; originally announced May 2016.

    Comments: 15