-
New complementarity formulations for root-finding and optimization of piecewise-affine functions in abs-normal form
Authors:
Yulan Zhang,
Kamil A. Khan
Abstract:
Nonsmooth functions have been used to model discrete-continuous phenomena such as contact mechanics, and are also prevalent in neural network formulations via activation functions such as ReLU. At previous AD conferences, Griewank et al. showed that nonsmooth functions may be approximated well by piecewise-affine functions constructed using an AD-like procedure. Moreover, such a piecewise-affine f…
▽ More
Nonsmooth functions have been used to model discrete-continuous phenomena such as contact mechanics, and are also prevalent in neural network formulations via activation functions such as ReLU. At previous AD conferences, Griewank et al. showed that nonsmooth functions may be approximated well by piecewise-affine functions constructed using an AD-like procedure. Moreover, such a piecewise-affine function may always be represented in an "abs-normal form", encoding it as a collection of four matrices and two vectors. We present new general complementarity formulations for root-finding and optimization of piecewise-affine functions in abs-normal form, with significantly fewer restrictions than previous approaches. In particular, piecewise-affine root-finding may always be represented as a mixed-linear complementarity problem (MLCP), which may often be simplified to a linear complementarity problem (LCP). We also present approaches for verifying existence of solutions to these problems. A proof-of-concept implementation in Julia is discussed and applied to several numerical examples, using the PATH solver to solve complementarity problems.
△ Less
Submitted 30 January, 2025;
originally announced January 2025.
-
Computing AD-compatible subgradients of convex relaxations of implicit functions
Authors:
Yingkai Song,
Kamil A. Khan
Abstract:
Automatic generation of convex relaxations and subgradients is critical in global optimization, and is typically carried out using variants of automatic/algorithmic differentiation (AD). At previous AD conferences, variants of the forward and reverse AD modes were presented to evaluate accurate subgradients for convex relaxations of supplied composite functions. In a recent approach for generating…
▽ More
Automatic generation of convex relaxations and subgradients is critical in global optimization, and is typically carried out using variants of automatic/algorithmic differentiation (AD). At previous AD conferences, variants of the forward and reverse AD modes were presented to evaluate accurate subgradients for convex relaxations of supplied composite functions. In a recent approach for generating convex relaxations of implicit functions, these relaxations are constructed as optimal-value functions; this formulation is versatile but complicates sensitivity analysis. We present the first subgradient propagation rules for these implicit function relaxations, based on supplied AD-like knowledge of the residual function. Our new subgradient rules allow implicit function relaxations to be added to the elemental function libraries for the forward AD modes for subgradient propagation of convex relaxations. Proof-of-concept numerical results in Julia are presented.
△ Less
Submitted 30 January, 2025;
originally announced January 2025.
-
Banach and Suzuki-type fixed point theorems in Generalized $n$-metric spaces with an application
Authors:
Kamran Alam Khan
Abstract:
Mustafa and Sims [12] introduced the notion of $G$-metric as a possible generalization of usual notion of a metric space. The author generalized the notion of G-metric to more than three variables and introduced the concept of Generalized $n$-metric spaces [10]. In this paper, We prove Banach fixed point theorem and a Suzuki-type fixed point theorem in Generalized $n$-metric spaces. We also discus…
▽ More
Mustafa and Sims [12] introduced the notion of $G$-metric as a possible generalization of usual notion of a metric space. The author generalized the notion of G-metric to more than three variables and introduced the concept of Generalized $n$-metric spaces [10]. In this paper, We prove Banach fixed point theorem and a Suzuki-type fixed point theorem in Generalized $n$-metric spaces. We also discuss applications to certain functional equations arising in dynamic programming.
△ Less
Submitted 8 August, 2021;
originally announced August 2021.
-
Constructing a subgradient from directional derivatives for functions of two variables
Authors:
Kamil A. Khan,
Yingwei Yuan
Abstract:
For any scalar-valued bivariate function that is locally Lipschitz continuous and directionally differentiable, it is shown that a subgradient may always be constructed from the function's directional derivatives in the four compass directions, arranged in a so-called "compass difference". When the original function is nonconvex, the obtained subgradient is an element of Clarke's generalized gradi…
▽ More
For any scalar-valued bivariate function that is locally Lipschitz continuous and directionally differentiable, it is shown that a subgradient may always be constructed from the function's directional derivatives in the four compass directions, arranged in a so-called "compass difference". When the original function is nonconvex, the obtained subgradient is an element of Clarke's generalized gradient, but the result appears to be novel even for convex functions. The function is not required to be represented in any particular form, and no further assumptions are required, though the result is strengthened when the function is additionally L-smooth in the sense of Nesterov. For certain optimal-value functions and certain parametric solutions of differential equation systems, these new results appear to provide the only known way to compute a subgradient. These results also imply that centered finite differences will converge to a subgradient for bivariate nonsmooth functions. As a dual result, we find that any compact convex set in two dimensions contains the midpoint of its interval hull. Examples are included for illustration, and it is demonstrated that these results do not extend directly to functions of more than two variables or sets in higher dimensions.
△ Less
Submitted 8 June, 2020; v1 submitted 28 January, 2020;
originally announced January 2020.
-
Generalized normed spaces and Fixed point Theorems
Authors:
Kamran Alam Khan
Abstract:
Gähler ([4],[5]) introduced and investigated the notion of 2-metric spaces and 2-normed spaces in sixties. These concepts are inspired by the notion of area in two dimensional Euclidean space. In this paper, we choose a fundamentally different approach and introduce a possible generalization of usual norm retaining the distance analogue properties. This generalized norm will be called as $G$-norm.…
▽ More
Gähler ([4],[5]) introduced and investigated the notion of 2-metric spaces and 2-normed spaces in sixties. These concepts are inspired by the notion of area in two dimensional Euclidean space. In this paper, we choose a fundamentally different approach and introduce a possible generalization of usual norm retaining the distance analogue properties. This generalized norm will be called as $G$-norm. We show that every $G$-normed space is a $G$-metric space and therefore, a topological space and develop the theory for $G$-normed spaces. We also introduce $G$-Banach spaces and obtain some fixed point theorems.
△ Less
Submitted 25 September, 2018;
originally announced September 2018.
-
Generalized n-metric spaces and fixed point theorems
Authors:
Kamran Alam Khan
Abstract:
Gähler ([3],[4]) introduced the concept of 2-metric as a possible generalization of usual notion of a metric space. In many cases the results obtained in the usual metric spaces and 2-metric spaces are found to be unrelated (see [5]). Mustafa and Sims [8] took a different approach and introduced the notion of $G$-metric. The author [6] generalized the notion of G-metric to more than three variable…
▽ More
Gähler ([3],[4]) introduced the concept of 2-metric as a possible generalization of usual notion of a metric space. In many cases the results obtained in the usual metric spaces and 2-metric spaces are found to be unrelated (see [5]). Mustafa and Sims [8] took a different approach and introduced the notion of $G$-metric. The author [6] generalized the notion of G-metric to more than three variables and introduced the concept of $K$-metric as a function $K\colon X^n \to \mathbb{R}^+$, $(n\ge 3)$. In this paper, We improve the definition of $K$-metric by making symmetry condition more general. This improved metric denoted by $G_n$ is called the Generalized $n$-metric. We develop the theory for generalized $n$-metric spaces and obtain some fixed point theorems.
△ Less
Submitted 17 September, 2018;
originally announced September 2018.
-
Generalized Fuzzy metric Spaces with an application to Colour image filtering
Authors:
Kamran Alam Khan
Abstract:
Impulsive noise is a problem encountered during the acquisition and transmission of digital images. Fuzzy metrics dealing nicely with the nonlinear nature of digital images are used in vector median-based filters for noise reduction in colour and multichannel images. In this paper, We generalize the concept of Fuzzy metric space (In the sense of George and Veeramani) and introduce the notion of Ge…
▽ More
Impulsive noise is a problem encountered during the acquisition and transmission of digital images. Fuzzy metrics dealing nicely with the nonlinear nature of digital images are used in vector median-based filters for noise reduction in colour and multichannel images. In this paper, We generalize the concept of Fuzzy metric space (In the sense of George and Veeramani) and introduce the notion of Generalized Fuzzy n-Metric Space. The theory for such spaces is developed and as practical application, we propose some new filters based on these Generalized fuzzy metrics for colour image processing.
△ Less
Submitted 17 September, 2018;
originally announced September 2018.
