-
Exact penalty functions in optimization with unbounded constraint sets
Authors:
Liguo Jiao,
Tien-Son Pham,
Nguyen Van Tuyen
Abstract:
This paper identifies necessary and sufficient conditions for the exactness of penalty functions in optimization problems whose constraint sets are not necessarily bounded. The case where the data of problems is locally Lipschitz or semi-algebraic is studied in detail. The conditions are given in terms of properties of the objective and residual functions of the problems in question. The obtained…
▽ More
This paper identifies necessary and sufficient conditions for the exactness of penalty functions in optimization problems whose constraint sets are not necessarily bounded. The case where the data of problems is locally Lipschitz or semi-algebraic is studied in detail. The conditions are given in terms of properties of the objective and residual functions of the problems in question. The obtained results generalize and improve some known results in the literature on exact penalty functions.
△ Less
Submitted 4 July, 2025;
originally announced July 2025.
-
On the mean square of the error term for the number of lattice points in a two-dimensional area
Authors:
Lirui Jia,
Wenguang Zhai
Abstract:
Suppose $a,~b$ are fixed algebraic numbers with $1\leq a<b$. Let $Δ_{a,b}(x)$ be the error term for the number of lattice points in a two-dimensional area $h^ar^b\leq x $ with $h, r$ positive integers. In this paper, we establish an asymptotic formula for the mean square of $Δ_{a,b}(x)$ when $a, b$ are fixed algebraic numbers such that $\dfrac{a}{b}$ is irrational, and improve the error term in th…
▽ More
Suppose $a,~b$ are fixed algebraic numbers with $1\leq a<b$. Let $Δ_{a,b}(x)$ be the error term for the number of lattice points in a two-dimensional area $h^ar^b\leq x $ with $h, r$ positive integers. In this paper, we establish an asymptotic formula for the mean square of $Δ_{a,b}(x)$ when $a, b$ are fixed algebraic numbers such that $\dfrac{a}{b}$ is irrational, and improve the error term in the previous asymptotic formula for $a, b$ integers with $(a, b)=1$. Based on these asymptotic formulas, we derive estimates for the sign changes of $Δ_{a,b}(x)$.
△ Less
Submitted 18 March, 2025;
originally announced March 2025.
-
Fast Maxwell Solvers Based on Exact Discrete Eigen-Decompositions I. Two-Dimensional Case
Authors:
Lixiu Wang,
Lueling Jia,
Zijian Cao,
Huiyuan Li,
Zhimin Zhang
Abstract:
In this paper, we propose fast solvers for Maxwell's equations in rectangular domains. We first discretize the simplified Maxwell's eigenvalue problems by employing the lowest-order rectangular Nédélec elements and derive the discrete eigen-solutions explicitly, providing a Hodge-Helmholtz decomposition framework at the discrete level. Based on exact eigen-decompositions, we further design fast so…
▽ More
In this paper, we propose fast solvers for Maxwell's equations in rectangular domains. We first discretize the simplified Maxwell's eigenvalue problems by employing the lowest-order rectangular Nédélec elements and derive the discrete eigen-solutions explicitly, providing a Hodge-Helmholtz decomposition framework at the discrete level. Based on exact eigen-decompositions, we further design fast solvers for various Maxwell's source problems, guaranteeing either the divergence-free constraint or the Gauss's law at the discrete level. With the help of fast sine/cosine transforms, the computational time grows asymptotically as $\mathcal{O}(n^2\log n)$ with $n$ being the number of grids in each direction. Our fast Maxwell solvers outperform other existing Maxwell solvers in the literature and fully rival fast scalar Poisson/Helmholtz solvers based on trigonometric transforms in either efficiency, robustness, or storage complexity. It is also utilized to perform an efficient pre-conditioning for solving Maxwell's source problems with variable coefficients. Finally, numerical experiments are carried out to illustrate the effectiveness and efficiency of the proposed fast solver.
△ Less
Submitted 12 March, 2025;
originally announced March 2025.
-
Angle structures on pseudo 3-manifolds
Authors:
Huabin Ge,
Longsong Jia,
Faze Zhang
Abstract:
It is still not known whether a hyperbolic 3-manifold admits an angle structure or not. We consider angle structures with area-curvature on triangulated pseudo 3-manifolds M in this article. A suficient and necessary condition for the existence of such angle structures is established. As a consequence, any compact hyperbolic 3-manifold with totally geodesic boundary admits an angle structure. We a…
▽ More
It is still not known whether a hyperbolic 3-manifold admits an angle structure or not. We consider angle structures with area-curvature on triangulated pseudo 3-manifolds M in this article. A suficient and necessary condition for the existence of such angle structures is established. As a consequence, any compact hyperbolic 3-manifold with totally geodesic boundary admits an angle structure. We also derive certain topological information of M from the existence of such angle structures.
△ Less
Submitted 16 February, 2025;
originally announced February 2025.
-
SPLD polynomial optimization and bounded degree SOS hierarchies
Authors:
Liguo Jiao,
Jae Hyoung Lee,
Nguyen Bui Nguyen Thao
Abstract:
In this paper, a new class of structured polynomials, which we dub the {\it separable plus lower degree {\rm (SPLD in short)} polynomials}, is introduced. The formal definition of an SPLD polynomial, which extends the concept of the SPQ polynomial (Ahmadi et al. in Math Oper Res 48:1316--1343, 2023), is defined. A type of bounded degree SOS hierarchy (BSOS-SPLD) is proposed to efficiently solve th…
▽ More
In this paper, a new class of structured polynomials, which we dub the {\it separable plus lower degree {\rm (SPLD in short)} polynomials}, is introduced. The formal definition of an SPLD polynomial, which extends the concept of the SPQ polynomial (Ahmadi et al. in Math Oper Res 48:1316--1343, 2023), is defined. A type of bounded degree SOS hierarchy (BSOS-SPLD) is proposed to efficiently solve the optimization problems with SPLD polynomials, and several numerical examples are performed much better than the bounded degree SOS hierarchy (Lasserre et al. in EURO J Comput Optim 5:87--117, 2017). An exact SOS relaxation for a class of convex SPLD polynomial optimization problems is proposed. Finally, an application of SPLD polynomials to polynomial regression problems in statistics is presented.
△ Less
Submitted 16 February, 2025;
originally announced February 2025.
-
Asymptotic behavior of discrete Schrödinger equations on the hexagonal triangulation
Authors:
Huabin Ge,
Bobo Hua,
Longsong Jia,
Puchun Zhou
Abstract:
In this article, we prove the decay estimate for the discrete Schrödinger equation (DS) on the hexagonal triangulation. The $l^1\rightarrow l^\infty$ dispersive decay rate is $\left\langle t\right\rangle^{-\frac{3}{4}}$, which is faster than the decay rate of DS on the 2-dimensional lattice $\mathbb{Z}^2$, which is $\left\langle t\right\rangle^{-\frac{2}{3}}$, see [32]. The proof relies on the det…
▽ More
In this article, we prove the decay estimate for the discrete Schrödinger equation (DS) on the hexagonal triangulation. The $l^1\rightarrow l^\infty$ dispersive decay rate is $\left\langle t\right\rangle^{-\frac{3}{4}}$, which is faster than the decay rate of DS on the 2-dimensional lattice $\mathbb{Z}^2$, which is $\left\langle t\right\rangle^{-\frac{2}{3}}$, see [32]. The proof relies on the detailed analysis of singularities of the corresponding phase function and the theory of uniform estimates on oscillatory integrals developed by Karpushkin [15]. Moreover, we prove the Strichartz estimate and give an application to the discrete nonlinear Schrödinger equation (DNLS) on the hexagonal triangulation.
△ Less
Submitted 6 December, 2024; v1 submitted 3 December, 2024;
originally announced December 2024.
-
Approximate optimality conditions and sensitivity analysis in nearly convex optimization
Authors:
Nguyen Van Tuyen,
Liguo Jiao,
Vu Hong Quan,
Duong Thi Viet An
Abstract:
In this paper, approximate optimality conditions and sensitivity analysis in nearly convex optimization are discussed. More precisely, as in the spirit of convex analysis, we introduce the concept of $\varepsilon$-subdifferential for nearly convex functions. Then, we examine some significant properties and rules for the $\varepsilon$-subdifferential. These rules are applied to study optimality con…
▽ More
In this paper, approximate optimality conditions and sensitivity analysis in nearly convex optimization are discussed. More precisely, as in the spirit of convex analysis, we introduce the concept of $\varepsilon$-subdifferential for nearly convex functions. Then, we examine some significant properties and rules for the $\varepsilon$-subdifferential. These rules are applied to study optimality conditions as well as sensitivity analysis for parametric nearly convex optimization problems, which are two important topics in optimization theory.
△ Less
Submitted 6 October, 2024;
originally announced October 2024.
-
Existence of positive solutions for Kirchhoff type problems with critical exponent in exterior domains
Authors:
Liqian Jia,
Xinfu Li,
Shiwang Ma
Abstract:
In this paper, by using variational methods we study the existence of positive solutions for the following Kirchhoff type problem: $$ \left\{ \begin{array}{ll} -\left(a+b\mathlarger{\int}_Ω|\nabla u|^{2}dx\right)Δu+V(x)u=u^{5}, \ & x\inΩ,\\ \\ u=0,\ & x\in\partial Ω, \end{array}\right. $$ where $a>0$, $b\geq0$, $Ω\subset\mathbb R^3$ is an unbounded exterior domain, $\partialΩ\neq\emptyset$,…
▽ More
In this paper, by using variational methods we study the existence of positive solutions for the following Kirchhoff type problem: $$ \left\{ \begin{array}{ll} -\left(a+b\mathlarger{\int}_Ω|\nabla u|^{2}dx\right)Δu+V(x)u=u^{5}, \ & x\inΩ,\\ \\ u=0,\ & x\in\partial Ω, \end{array}\right. $$ where $a>0$, $b\geq0$, $Ω\subset\mathbb R^3$ is an unbounded exterior domain, $\partialΩ\neq\emptyset$, $\mathbb{R}^{3}\backslashΩ$ is bounded, $u\in D_{0}^{1,2}(Ω)$, and $V\in L^{\frac{3}{2}}(Ω)$ is a non-negative continuous function. It turns out that the above Kirchhoff equation has no ground state solution. Nonetheless, by establishing some global compact lemma and constructing a suitable minimax value $c$ at a higher energy level where so called Palais-Smale condition holds, we succeed to obtain a positive solution for such a problem whenever $V$ and the hole $\mathbb{R}^{3}\setminusΩ$ are suitable small in some senses. To the best of our knowledge, there are few similar results published in the literature concerning the existence of positive solutions for Kirchhoff equation in exterior domains. Our result also holds true in the case $Ω=\mathbb R^3$, particularly, if $a=1$ and $b=0$, we improve some existing results (such as Benci, Cerami, Existence of positive solutions of the equation $-Δu+a(x)u=u^{(N+2)/(N-2)}$ in $\emph{R}^{N}$, J. Funct. Anal., 88 (1990), 90--117) for the corresponding Schrödinger equation in the whole space.
△ Less
Submitted 9 July, 2024;
originally announced July 2024.
-
Properties of the continuum seed-bank coalescent
Authors:
Likai Jiao
Abstract:
We study properties of the \textit{continuum seed-bank coalescent} proposed by \cite{jiao2023wright} such as \textit{not coming down from infinity} and \textit{bounds on the expected time to the most recent common ancestor}. We also provide results on the limiting distributions and propose some interesting open problems.
We study properties of the \textit{continuum seed-bank coalescent} proposed by \cite{jiao2023wright} such as \textit{not coming down from infinity} and \textit{bounds on the expected time to the most recent common ancestor}. We also provide results on the limiting distributions and propose some interesting open problems.
△ Less
Submitted 21 February, 2024;
originally announced February 2024.
-
A parameter-free approach for solving SOS-convex semi-algebraic fractional programs
Authors:
Chengmiao Yang,
Liguo Jiao,
Jae Hyoung Lee
Abstract:
In this paper, we study a class of nonsmooth fractional programs {\rm (FP, for short)} with SOS-convex semi-algebraic functions. Under suitable assumptions, we derive a strong duality result between the problem (FP) and its semidefinite programming (SDP) relaxations. Remarkably, we extract an optimal solution of the problem (FP) by solving one and only one associated SDP problem. Numerical example…
▽ More
In this paper, we study a class of nonsmooth fractional programs {\rm (FP, for short)} with SOS-convex semi-algebraic functions. Under suitable assumptions, we derive a strong duality result between the problem (FP) and its semidefinite programming (SDP) relaxations. Remarkably, we extract an optimal solution of the problem (FP) by solving one and only one associated SDP problem. Numerical examples are also given.
△ Less
Submitted 29 January, 2024;
originally announced January 2024.
-
Wright-Fisher diffusion and coalescent with a continuum of seed-banks
Authors:
Likai Jiao
Abstract:
This paper generalizes the strong seed-bank model introduced in arXiv:1411.4747 to allow for more general dormancy time distributions, such as a type of Pareto distribution. Inspired by the method of approximation using models with countably many seed-banks proposed by arXiv:2209.10086, we introduce the Wright-Fisher diffusion and coalescent with a continuum of seed-banks. To this end, we first fo…
▽ More
This paper generalizes the strong seed-bank model introduced in arXiv:1411.4747 to allow for more general dormancy time distributions, such as a type of Pareto distribution. Inspired by the method of approximation using models with countably many seed-banks proposed by arXiv:2209.10086, we introduce the Wright-Fisher diffusion and coalescent with a continuum of seed-banks. To this end, we first formulate an infinite-dimensional stochastic differential equation, and prove that it has a unique strong solution, refereed to as the \textit{continuum seed-bank diffusion}, which is a kind of Markovian lift of a non-Markovian Volterra process. In order to circumvent the technical difficulty arising from the lack of local compactness, we replace the topology induced by the norm on the state space of the solution with the weak-$^{\star}$ topology, and show that the continuum seed-bank diffusion is also a strong Markov process in this weak-$^{\star}$ setting. Then, we construct a discrete-time Wright-Fisher type model with finitely many seed-banks, and demonstrate that the continuum seed-bank diffusion under the weak-$^{\star}$ topology is the scaling limit of the allele frequency processes in a suitable sequence of such models. Finally, we establish the duality relation between the continuum seed-bank diffusion and a continuous-time continuous-state Markov jump process. The latter is the block counting process of a partition-valued Markov jump process which is referred to as the \textit{continuum seed-bank coalescent}. We prove that this new coalescent process is exactly the scaling limit of the ancestral processes in the sequence of discrete-time Wright-Fisher type models we constructed before.
△ Less
Submitted 15 September, 2023; v1 submitted 13 July, 2023;
originally announced July 2023.
-
Bi-level Multi-objective Evolutionary Learning: A Case Study on Multi-task Graph Neural Topology Search
Authors:
Chao Wang,
Licheng Jiao,
Jiaxuan Zhao,
Lingling Li,
Xu Liu,
Fang Liu,
Shuyuan Yang
Abstract:
The construction of machine learning models involves many bi-level multi-objective optimization problems (BL-MOPs), where upper level (UL) candidate solutions must be evaluated via training weights of a model in the lower level (LL). Due to the Pareto optimality of sub-problems and the complex dependency across UL solutions and LL weights, an UL solution is feasible if and only if the LL weight is…
▽ More
The construction of machine learning models involves many bi-level multi-objective optimization problems (BL-MOPs), where upper level (UL) candidate solutions must be evaluated via training weights of a model in the lower level (LL). Due to the Pareto optimality of sub-problems and the complex dependency across UL solutions and LL weights, an UL solution is feasible if and only if the LL weight is Pareto optimal. It is computationally expensive to determine which LL Pareto weight in the LL Pareto weight set is the most appropriate for each UL solution. This paper proposes a bi-level multi-objective learning framework (BLMOL), coupling the above decision-making process with the optimization process of the UL-MOP by introducing LL preference $r$. Specifically, the UL variable and $r$ are simultaneously searched to minimize multiple UL objectives by evolutionary multi-objective algorithms. The LL weight with respect to $r$ is trained to minimize multiple LL objectives via gradient-based preference multi-objective algorithms. In addition, the preference surrogate model is constructed to replace the expensive evaluation process of the UL-MOP. We consider a novel case study on multi-task graph neural topology search. It aims to find a set of Pareto topologies and their Pareto weights, representing different trade-offs across tasks at UL and LL, respectively. The found graph neural network is employed to solve multiple tasks simultaneously, including graph classification, node classification, and link prediction. Experimental results demonstrate that BLMOL can outperform some state-of-the-art algorithms and generate well-representative UL solutions and LL weights.
△ Less
Submitted 5 February, 2023;
originally announced February 2023.
-
Utopia point method based robust vector polynomial optimization scheme
Authors:
Tianyi Han,
Liguo Jiao,
Jae Hyoung Lee,
Junping Yin
Abstract:
In this paper, we focus on a class of robust vector polynomial optimization problems (RVPOP in short) without any convex assumptions. By combining/improving the utopia point method (a nonlinear scalarization) for vector optimization and "joint+marginal" relaxation method for polynomial optimization, we solve the RVPOP successfully. Both theoratical and computational aspects are considered.
In this paper, we focus on a class of robust vector polynomial optimization problems (RVPOP in short) without any convex assumptions. By combining/improving the utopia point method (a nonlinear scalarization) for vector optimization and "joint+marginal" relaxation method for polynomial optimization, we solve the RVPOP successfully. Both theoratical and computational aspects are considered.
△ Less
Submitted 11 September, 2022;
originally announced September 2022.
-
A new scheme for approximating the weakly efficient solution set of vector rational optimization problems
Authors:
Feng Guo,
Liguo Jiao
Abstract:
In this paper, we provide a new scheme for approximating the weakly efficient solution set for a class of vector optimization problems with rational objectives over a feasible set defined by finitely many polynomial inequalities. More precisely, we present a procedure to obtain a sequence of explicit approximations of the weakly efficient solution set of the problem in question. Each approximation…
▽ More
In this paper, we provide a new scheme for approximating the weakly efficient solution set for a class of vector optimization problems with rational objectives over a feasible set defined by finitely many polynomial inequalities. More precisely, we present a procedure to obtain a sequence of explicit approximations of the weakly efficient solution set of the problem in question. Each approximation is the intersection of the sublevel set of a single polynomial and the feasible set. To this end, we make use of the achievement function associated with the considered problem and construct polynomial approximations of it over the feasible set from above. Remarkably, the construction can be converted to semidefinite programming problems. Several nontrivial examples are designed to illustrate the proposed new scheme.
△ Less
Submitted 25 May, 2022;
originally announced May 2022.
-
The well-posedness and the regularity of global attractor for a couple stress fluid through porous layer with the local thermal non-equilibrium effect
Authors:
Liang Li,
Lan Jia
Abstract:
In the article, we aim to investigate the well-posedness of solution and the regularity of the global attractor for the couple stress fluid in saturated porous media with the local thermal non-equilibrium effect. To be more specific, we firstly show the existence and uniqueness of global weak solution to the model by making use of the standard Galerkin method. Second, relying on verifying the unif…
▽ More
In the article, we aim to investigate the well-posedness of solution and the regularity of the global attractor for the couple stress fluid in saturated porous media with the local thermal non-equilibrium effect. To be more specific, we firstly show the existence and uniqueness of global weak solution to the model by making use of the standard Galerkin method. Second, relying on verifying the uniformly compact condition required, we prove the existence of the global attractor of the model in the space where the weak solution resides. Finally, we improve the regularity of global attractor by uniformly compact condition and obtain the $C^{\infty}$ attractor for the model.
△ Less
Submitted 12 October, 2021;
originally announced October 2021.
-
Existence of Pareto Solutions for Vector Polynomial Optimization Problems with Constraints
Authors:
Yarui Duan,
Liguo Jiao,
Pengcheng Wu,
Yuying Zhou
Abstract:
In this paper, we are interested in the existence of Pareto solutions to vector polynomial optimization problems over a basic closed semi-algebraic set. By invoking some powerful tools from real semi-algebraic geometry, we first introduce the concept called {\it tangency varieties}; then we establish connections of the Palais--Smale condition, Cerami condition, {\it M}-tameness, and properness rel…
▽ More
In this paper, we are interested in the existence of Pareto solutions to vector polynomial optimization problems over a basic closed semi-algebraic set. By invoking some powerful tools from real semi-algebraic geometry, we first introduce the concept called {\it tangency varieties}; then we establish connections of the Palais--Smale condition, Cerami condition, {\it M}-tameness, and properness related to the considered problem, in which the condition of Mangasarian--Fromovitz constraint qualification at infinity plays an essential role in deriving these connections. According to the obtained connections, we provide some sufficient conditions for existence of Pareto solutions to the problem in consideration, and we also give some examples to illustrate our main findings.
△ Less
Submitted 19 February, 2022; v1 submitted 15 September, 2021;
originally announced September 2021.
-
A new insight on augmented Lagrangian method with applications in machine learning
Authors:
Jianchao Bai,
Linyuan Jia,
Zheng Peng
Abstract:
By exploiting double-penalty terms for the primal subproblem, we develop a novel relaxed augmented Lagrangian method for solving a family of convex optimization problems subject to equality or inequality constraints. The method is then extended to solve a general multi-block separable convex optimization problem, and two related primal-dual hybrid gradient algorithms are also discussed. Convergenc…
▽ More
By exploiting double-penalty terms for the primal subproblem, we develop a novel relaxed augmented Lagrangian method for solving a family of convex optimization problems subject to equality or inequality constraints. The method is then extended to solve a general multi-block separable convex optimization problem, and two related primal-dual hybrid gradient algorithms are also discussed. Convergence results about the sublinear and linear convergence rates are established by variational characterizations for both the saddle-point of the problem and the first-order optimality conditions of involved subproblems. A large number of experiments on testing the linear support vector machine problem and the robust principal component analysis problem arising from machine learning indicate that our proposed algorithms perform much better than several state-of-the-art algorithms.
△ Less
Submitted 13 June, 2025; v1 submitted 25 August, 2021;
originally announced August 2021.
-
Axisymmetric membranes with edges under external force: buckling, minimal surfaces, and tethers
Authors:
Leroy L. Jia,
Steven Pei,
Robert A. Pelcovits,
Thomas R. Powers
Abstract:
We use theory and numerical computation to determine the shape of an axisymmetric fluid membrane with a resistance to bending and constant area. The membrane connects two rings in the classic geometry that produces a catenoidal shape in a soap film. In our problem, we find infinitely many branches of solutions for the shape and external force as functions of the separation of the rings, analogous…
▽ More
We use theory and numerical computation to determine the shape of an axisymmetric fluid membrane with a resistance to bending and constant area. The membrane connects two rings in the classic geometry that produces a catenoidal shape in a soap film. In our problem, we find infinitely many branches of solutions for the shape and external force as functions of the separation of the rings, analogous to the infinite family of eigenmodes for the Euler buckling of a slender rod. Special attention is paid to the catenoid, which emerges as the shape of maximal allowable separation when the area is less than a critical area equal to the planar area enclosed by the two rings. A perturbation theory argument directly relates the tension of catenoidal membranes to the stability of catenoidal soap films in this regime. When the membrane area is larger than the critical area, we find additional cylindrical tether solutions to the shape equations at large ring separation, and that arbitrarily large ring separations are possible. These results apply for the case of vanishing Gaussian curvature modulus; when the Gaussian curvature modulus is nonzero and the area is below the critical area, the force and the membrane tension diverge as the ring separation approaches its maximum value. We also examine the stability of our shapes and analytically show that catenoidal membranes have markedly different stability properties than their soap film counterparts.
△ Less
Submitted 2 June, 2021;
originally announced June 2021.
-
Sparse Spectral-Galerkin Method on An Arbitrary Tetrahedron Using Generalized Koornwinder Polynomials
Authors:
Lueling Jia,
Huiyuan Li,
Zhimin Zhang
Abstract:
In this paper, we propose a sparse spectral-Galerkin approximation scheme for solving the second-order partial differential equations on an arbitrary tetrahedron. Generalized Koornwinder polynomials are introduced on the reference tetrahedron as basis functions with their various recurrence relations and differentiation properties being explored. The method leads to well-conditioned and sparse lin…
▽ More
In this paper, we propose a sparse spectral-Galerkin approximation scheme for solving the second-order partial differential equations on an arbitrary tetrahedron. Generalized Koornwinder polynomials are introduced on the reference tetrahedron as basis functions with their various recurrence relations and differentiation properties being explored. The method leads to well-conditioned and sparse linear systems whose entries can either be calculated directly by the orthogonality of the generalized Koornwinder polynomials for differential equations with constant coefficients or be evaluated efficiently via our recurrence algorithm for problems with variable coefficients. Clenshaw algorithms for the evaluation of any polynomial in an expansion of the generalized Koornwinder basis are also designed to boost the efficiency of the method. Finally, numerical experiments are carried out to illustrate the effectiveness of the proposed Koornwinder spectral method.
△ Less
Submitted 16 May, 2021;
originally announced May 2021.
-
A $C^1$-conforming Petrov-Galerkin method for convection-diffusion equations and superconvergence ananlysis over rectangular meshes
Authors:
Waixiang Cao,
Lueling Jia,
Zhimin Zhang
Abstract:
In this paper, a new $C^1$-conforming Petrov-Galerkin method for convection-diffusion equations is designed and analyzed.
The trail space of the proposed method is a $C^1$-conforming ${\mathbb Q}_k$ (i.e., tensor product of polynomials of degree at most $k$) finite element space while the test space is taken as the $L^2$ (discontinuous) piecewise ${\mathbb Q}_{k-2}$ polynomial space.
Existence…
▽ More
In this paper, a new $C^1$-conforming Petrov-Galerkin method for convection-diffusion equations is designed and analyzed.
The trail space of the proposed method is a $C^1$-conforming ${\mathbb Q}_k$ (i.e., tensor product of polynomials of degree at most $k$) finite element space while the test space is taken as the $L^2$ (discontinuous) piecewise ${\mathbb Q}_{k-2}$ polynomial space.
Existence and uniqueness of the numerical solution is proved and optimal error estimates in all $L^2, H^1, H^2$-norms are established.
In addition, superconvergence properties of the new method are investigated and superconvergence points/lines are identified at mesh nodes (with order $2k-2$ for both function value and derivatives), at roots of a special Jacobi polynomial, and at the Lobatto lines and Gauss lines with rigorous theoretical analysis.
In order to reduce the global regularity requirement, interior a priori error estimates in the $L^2, H^1, H^2$-norms are derived. Numerical experiments are presented to confirm theoretical findings.
△ Less
Submitted 13 March, 2021;
originally announced March 2021.
-
On Solving a Class of Fractional Semi-infinite Polynomial Programming Problems
Authors:
Feng Guo,
Liguo Jiao
Abstract:
In this paper, we study a class of fractional semi-infinite polynomial programming (FSIPP) problems, in which the objective is a fraction of a convex polynomial and a concave polynomial, and the constraints consist of infinitely many convex polynomial inequalities. To solve such a problem, we first reformulate it to a pair of primal and dual conic optimization problems, which reduce to semidefinit…
▽ More
In this paper, we study a class of fractional semi-infinite polynomial programming (FSIPP) problems, in which the objective is a fraction of a convex polynomial and a concave polynomial, and the constraints consist of infinitely many convex polynomial inequalities. To solve such a problem, we first reformulate it to a pair of primal and dual conic optimization problems, which reduce to semidefinite programming (SDP) problems if we can bring sum-of-squares structures into the conic constraints. To this end, we provide a characteristic cone constraint qualification for convex semi-infinite programming problems to guarantee strong duality and also the attainment of the solution in the dual problem, which is of its own interest. In this framework, we first present a hierarchy of SDP relaxations with asymptotic convergence for the FSIPP problem whose index set is defined by finitely many polynomial inequalities. Next, we study four cases of the FSIPP problems which can be reduced to either a single SDP problem or a finite sequence of SDP problems, where at least one minimizer can be extracted. Then, we apply this approach to the four corresponding multi-objective cases to find efficient solutions.
△ Less
Submitted 14 May, 2021; v1 submitted 3 August, 2020;
originally announced August 2020.
-
On continuous selections of polynomial functions
Authors:
Feng Guo,
Liguo Jiao,
Do Sang Kim
Abstract:
A continuous selection of polynomial functions is a continuous function whose domain can be partitioned into finitely many pieces on which the function coincides with a polynomial. Given a set of finitely many polynomials, we show that there are only finitely many continuous selections of it and each one is semi-algebraic. Then, we establish some generic properties regarding the critical points, d…
▽ More
A continuous selection of polynomial functions is a continuous function whose domain can be partitioned into finitely many pieces on which the function coincides with a polynomial. Given a set of finitely many polynomials, we show that there are only finitely many continuous selections of it and each one is semi-algebraic. Then, we establish some generic properties regarding the critical points, defined by the Clarke subdifferential, of these continuous selections. In particular, given a set of finitely many polynomials with generic coefficients, we show that the critical points of all continuous selections of it are finite and the critical values are all different, and we also derive the coercivity of those continuous selections which are bounded from below. We point out that some existing results about Łojasiewicz's inequality and error bounds for the maximum function of some finitely many polynomials are also valid for all the continuous selections of them.
△ Less
Submitted 8 July, 2020;
originally announced July 2020.
-
On types of KKT points in polynomial optimization
Authors:
Feng Guo,
Do Sang Kim,
Liguo Jiao,
Tien-Son Pham
Abstract:
Let $f$ be a real polynomial function with $n$ variables and $S$ be a basic closed semialgebraic set in $\Bbb{R}^n$. In this paper, we are interested in the problem of identifying the type (local minimizer, maximizer or not extremum point) of a given isolated KKT point $x^*$ of $f$ over $S.$ To this end, we investigate some properties of the tangency variety of $f$ on $S$ at $x^*,$ by which we int…
▽ More
Let $f$ be a real polynomial function with $n$ variables and $S$ be a basic closed semialgebraic set in $\Bbb{R}^n$. In this paper, we are interested in the problem of identifying the type (local minimizer, maximizer or not extremum point) of a given isolated KKT point $x^*$ of $f$ over $S.$ To this end, we investigate some properties of the tangency variety of $f$ on $S$ at $x^*,$ by which we introduce the definition of faithful radius of $f$ over $S$ at $x^*.$ Then, we show that the type of $x^*$ can be determined by the global extrema of $f$ over the intersection of $S$ and the Euclidean ball centered at $x^*$ with a faithful radius. Finally, we propose an algorithm involving algebraic computations to compute a faithful radius of $x^*$ and determine its type.
△ Less
Submitted 26 April, 2020;
originally announced April 2020.
-
Generalised Hermite spectral methods for PDEs involving integral fractional Laplacian and Schrödinger operators
Authors:
Changtao Sheng,
Suna Ma,
Huiyuan Li,
Li-Lian Wang,
Lueling Jia
Abstract:
In this paper, we introduce two new families of generalised Hermite polynomials/functions (GHPs/GHFs) in arbitrary dimensions, and develop efficient and accurate generalised Hermite spectral algorithms for PDEs with integral fractional Laplacian (IFL) and/or Schrödinger operators in $\mathbb R^d.$ As a generalisation of the G. Szegö's family in 1D (1939), the first family of GHPs (resp. GHFs) are…
▽ More
In this paper, we introduce two new families of generalised Hermite polynomials/functions (GHPs/GHFs) in arbitrary dimensions, and develop efficient and accurate generalised Hermite spectral algorithms for PDEs with integral fractional Laplacian (IFL) and/or Schrödinger operators in $\mathbb R^d.$ As a generalisation of the G. Szegö's family in 1D (1939), the first family of GHPs (resp. GHFs) are orthogonal with respect to $|\bx|^{2μ} \e^{-|\bx|^2}$ (resp. $|\bx |^{2μ}$) in $\mathbb R^d$. We further define adjoint generalised Hermite functions (A-GHFs) which have an interwoven connection with the corresponding GHFs through the Fourier transform, and which are orthogonal with respect to the inner product $[u,v]_{H^s(\mathbb R^d)}=((-Δ)^{s/ 2}u, (-Δ)^{s/2} v )_{\mathbb R^d}$ associated with the IFL of order $s>0$. Thus, the spectral-Galerkin method using A-GHFs as basis functions leads to a diagonal stiffness matrix for the IFL (which is known to be notoriously difficult and expensive to discretise). The new basis also finds efficient and accurate in solving PDEs with the fractional Schrödinger operator: $(-Δ)^s +|\bs x|^{2μ}$ with $s\in (0,1]$ and $μ>-1/2.$ Following the same spirit, we construct the second family of GHFs, dubbed as Müntz-type generalised Hermite functions (M-GHFs), which are orthogonal with respect to an inner product associated with the underlying Schrödinger operator, and are tailored to the singularity of the solution at the origin. We demonstrate that the Müntz-type GHF spectral method leads to sparse matrices and spectrally accurate to some Schrödinger eigenvalue problems.
△ Less
Submitted 23 October, 2020; v1 submitted 12 February, 2020;
originally announced February 2020.
-
A $C^1$ Petrov-Galerkin method and Gauss collocation method for 1D general elliptic problems and superconvergence
Authors:
Waixiang Cao,
Lueling Jia,
Zhimin Zhang
Abstract:
In this paper, we present and study $C^1$ Petrov-Galerkin and Gauss collocation methods with arbitrary polynomial degree $k$ ($\ge 3$) for one-dimensional elliptic equations. We prove that, the solution and its derivative approximations converge with rate $2k-2$ at all grid points; and the solution approximation is superconvergent at all interior roots of a special Jacobi polynomial of degree…
▽ More
In this paper, we present and study $C^1$ Petrov-Galerkin and Gauss collocation methods with arbitrary polynomial degree $k$ ($\ge 3$) for one-dimensional elliptic equations. We prove that, the solution and its derivative approximations converge with rate $2k-2$ at all grid points; and the solution approximation is superconvergent at all interior roots of a special Jacobi polynomial of degree $k+1$ in each element, the first-order derivative approximation is superconvergent at all interior $k-2$ Lobatto points, and the second-order derivative approximation is superconvergent at $k-1$ Gauss points, with an order of $k+2$, $k+1$, and $k$, respectively. As a by-product, we prove that both the Petrov-Galerkin solution and the Gauss collocation solution are superconvergent towards a particular Jacobi projection of the exact solution in $H^2$, $H^1$, and $L^2$ norms. All theoretical findings are confirmed by numerical experiments.
△ Less
Submitted 6 February, 2020;
originally announced February 2020.
-
On the divisor problem with congruence conditions
Authors:
Lirui Jia,
Wenguang Zhai,
Tianxin Cai
Abstract:
Let $d(n; r_1, q_1, r_2, q_2)$ be the number of factorization $n=n_1n_2$ satisfying $n_i\equiv r_i\pmod{q_i}$ ($i=1,2$) and $Δ(x; r_1, q_1, r_2, q_2)$ be the error term of the summatory function of $d(n; r_1, q_1, r_2, q_2)$ with $x\geq (q_1q_2)^{1+\varepsilon}, 1\leq r_i\leq q_i$, and $(r_i, q_i)=1$ ($i=1, 2$). We study the power moments and sign changes of $Δ(x; r_1, q_1, r_2, q_2)$, and prove t…
▽ More
Let $d(n; r_1, q_1, r_2, q_2)$ be the number of factorization $n=n_1n_2$ satisfying $n_i\equiv r_i\pmod{q_i}$ ($i=1,2$) and $Δ(x; r_1, q_1, r_2, q_2)$ be the error term of the summatory function of $d(n; r_1, q_1, r_2, q_2)$ with $x\geq (q_1q_2)^{1+\varepsilon}, 1\leq r_i\leq q_i$, and $(r_i, q_i)=1$ ($i=1, 2$). We study the power moments and sign changes of $Δ(x; r_1, q_1, r_2, q_2)$, and prove that for a sufficiently large constant $C$, $Δ(q_1q_2x; r_1, q_1, r_2, q_2)$ changes sign in the interval $[T,T+C\sqrt{T}]$ for any large $T$. Meanwhile, we show that for a small constant $c'$, there exist infinitely many subintervals of length $c'\sqrt{T}\log^{-7}T$ in $[T,2T]$ where $\pm Δ(q_1q_2x; r_1, q_1, r_2, q_2)> c_5x^\frac{1}{4}$ always holds.
△ Less
Submitted 14 August, 2019;
originally announced August 2019.
-
signADAM: Learning Confidences for Deep Neural Networks
Authors:
Dong Wang,
Yicheng Liu,
Wenwo Tang,
Fanhua Shang,
Hongying Liu,
Qigong Sun,
Licheng Jiao
Abstract:
In this paper, we propose a new first-order gradient-based algorithm to train deep neural networks. We first introduce the sign operation of stochastic gradients (as in sign-based methods, e.g., SIGN-SGD) into ADAM, which is called as signADAM. Moreover, in order to make the rate of fitting each feature closer, we define a confidence function to distinguish different components of gradients and ap…
▽ More
In this paper, we propose a new first-order gradient-based algorithm to train deep neural networks. We first introduce the sign operation of stochastic gradients (as in sign-based methods, e.g., SIGN-SGD) into ADAM, which is called as signADAM. Moreover, in order to make the rate of fitting each feature closer, we define a confidence function to distinguish different components of gradients and apply it to our algorithm. It can generate more sparse gradients than existing algorithms do. We call this new algorithm signADAM++. In particular, both our algorithms are easy to implement and can speed up training of various deep neural networks. The motivation of signADAM++ is preferably learning features from the most different samples by updating large and useful gradients regardless of useless information in stochastic gradients. We also establish theoretical convergence guarantees for our algorithms. Empirical results on various datasets and models show that our algorithms yield much better performance than many state-of-the-art algorithms including SIGN-SGD, SIGNUM and ADAM. We also analyze the performance from multiple perspectives including the loss landscape and develop an adaptive method to further improve generalization. The source code is available at https://github.com/DongWanginxdu/signADAM-Learn-by-Confidence.
△ Less
Submitted 21 July, 2019;
originally announced July 2019.
-
Multi-objective convex polynomial optimization and semidefinite programming relaxations
Authors:
Jae Hyoung Lee,
Nithirat Sisarat,
Liguo Jiao
Abstract:
This paper aims to find efficient solutions to a multi-objective optimization problem (MP) with convex polynomial data. To this end, a hybrid method, which allows us to transform problem (MP) into a scalar convex polynomial optimization problem (P$_z$) and does not destroy the properties of convexity, is considered. First, we show an existence result for efficient solutions to problem (MP) under s…
▽ More
This paper aims to find efficient solutions to a multi-objective optimization problem (MP) with convex polynomial data. To this end, a hybrid method, which allows us to transform problem (MP) into a scalar convex polynomial optimization problem (P$_z$) and does not destroy the properties of convexity, is considered. First, we show an existence result for efficient solutions to problem (MP) under some mild assumption. Then, for problem (P$_z$), we establish two kinds of representations of non-negativity of convex polynomials over convex semi-algebraic sets, and propose two kinds of finite convergence results of the Lasserre-type hierarchy of semidefinite programming relaxations for problem (P$_z$) under suitable assumptions. Finally, we show that finding efficient solutions to problem (MP) can be achieved successfully by solving hierarchies of semidefinite programming relaxations and checking a flat truncation condition.
△ Less
Submitted 1 November, 2020; v1 submitted 25 March, 2019;
originally announced March 2019.
-
Polynomial mathematical programs with equilibrium constraints and semidefinite programming relaxations
Authors:
Liguo Jiao,
Jae Hyoung Lee,
Tien-Son Pham
Abstract:
This paper focuses on the study of a mathematical program with equilibrium constraints, where the objective and the constraint functions are all polynomials. We present a method for finding its global minimizers and global minimum using a hierarchy of semidefinite programming (SDP) relaxations and prove the convergence result for the method. Numerical experiments are presented to show the efficien…
▽ More
This paper focuses on the study of a mathematical program with equilibrium constraints, where the objective and the constraint functions are all polynomials. We present a method for finding its global minimizers and global minimum using a hierarchy of semidefinite programming (SDP) relaxations and prove the convergence result for the method. Numerical experiments are presented to show the efficiency of the proposed algorithm.
△ Less
Submitted 22 March, 2019;
originally announced March 2019.
-
Generalizations of Rodrigues Type Formulas for Hypergeometric Difference Equations on Nonuniform Lattices
Authors:
Jinfa Cheng,
Lukun Jia
Abstract:
By building a second order adjoint difference equations on nonuniform lattices, the generalized Rodrigues type representation for the second kind solution of a second order difference equation of hypergeometric type on nonuniform lattices is given. The general solution of the equation in the form of a combination of a standard Rodrigues formula and a generalized Rodrigues formula is also establish…
▽ More
By building a second order adjoint difference equations on nonuniform lattices, the generalized Rodrigues type representation for the second kind solution of a second order difference equation of hypergeometric type on nonuniform lattices is given. The general solution of the equation in the form of a combination of a standard Rodrigues formula and a generalized Rodrigues formula is also established.
△ Less
Submitted 17 November, 2018;
originally announced November 2018.
-
Existence and Regularity of solutions to 1-D Fractional Order Diffusion Equations
Authors:
Lueling Jia,
Huanzhen Chen,
V. J. Ervin
Abstract:
In this article we investigate the existence and regularity of 1-d steady state fractional order diffusion equations. Two models are investigated:the Riemann-Liouville fractional diffusion equation, and the Riemann-Liouville-Caputo fractional diffusion equation. For these models we explicitly show how the regularity of the solution depends upon the right hand side (rhs) function. We also establish…
▽ More
In this article we investigate the existence and regularity of 1-d steady state fractional order diffusion equations. Two models are investigated:the Riemann-Liouville fractional diffusion equation, and the Riemann-Liouville-Caputo fractional diffusion equation. For these models we explicitly show how the regularity of the solution depends upon the right hand side (rhs) function. We also establish for which Dirichlet and Neumann boundary conditions the models are well posed.
△ Less
Submitted 30 August, 2018;
originally announced August 2018.
-
VR-SGD: A Simple Stochastic Variance Reduction Method for Machine Learning
Authors:
Fanhua Shang,
Kaiwen Zhou,
Hongying Liu,
James Cheng,
Ivor W. Tsang,
Lijun Zhang,
Dacheng Tao,
Licheng Jiao
Abstract:
In this paper, we propose a simple variant of the original SVRG, called variance reduced stochastic gradient descent (VR-SGD). Unlike the choices of snapshot and starting points in SVRG and its proximal variant, Prox-SVRG, the two vectors of VR-SGD are set to the average and last iterate of the previous epoch, respectively. The settings allow us to use much larger learning rates, and also make our…
▽ More
In this paper, we propose a simple variant of the original SVRG, called variance reduced stochastic gradient descent (VR-SGD). Unlike the choices of snapshot and starting points in SVRG and its proximal variant, Prox-SVRG, the two vectors of VR-SGD are set to the average and last iterate of the previous epoch, respectively. The settings allow us to use much larger learning rates, and also make our convergence analysis more challenging. We also design two different update rules for smooth and non-smooth objective functions, respectively, which means that VR-SGD can tackle non-smooth and/or non-strongly convex problems directly without any reduction techniques. Moreover, we analyze the convergence properties of VR-SGD for strongly convex problems, which show that VR-SGD attains linear convergence. Different from its counterparts that have no convergence guarantees for non-strongly convex problems, we also provide the convergence guarantees of VR-SGD for this case, and empirically verify that VR-SGD with varying learning rates achieves similar performance to its momentum accelerated variant that has the optimal convergence rate $\mathcal{O}(1/T^2)$. Finally, we apply VR-SGD to solve various machine learning problems, such as convex and non-convex empirical risk minimization, and leading eigenvalue computation. Experimental results show that VR-SGD converges significantly faster than SVRG and Prox-SVRG, and usually outperforms state-of-the-art accelerated methods, e.g., Katyusha.
△ Less
Submitted 28 October, 2018; v1 submitted 26 February, 2018;
originally announced February 2018.
-
On the Sign Changes of a Weighted Divisor Problem
Authors:
Lirui Jia,
Tianxin Cai,
Wenguang Zhai
Abstract:
Let $S\big(x; \frac{a_1}{q_1}, \frac{a_2}{q_2}\big)=\mathop{{\sum}'}_{mn\leq x} \cos\big(2πm\frac{a_1}{q_1}\big)\sin\big(2πn\frac{a_2}{q_2}\big)$ with $x\geq q_1q_2, 1\leq a_i\leq q_i$, and $(a_i, q_i)=1$ ($i=1, 2$). We study the sign changes of $S\big(x; \frac{a_1}{q_1}, \frac{a_2}{q_2}\big)$, and prove that for a sufficiently large constant $C$, $S\big(x; \frac{a_1}{q_1}, \frac{a_2}{q_2}\big)$ c…
▽ More
Let $S\big(x; \frac{a_1}{q_1}, \frac{a_2}{q_2}\big)=\mathop{{\sum}'}_{mn\leq x} \cos\big(2πm\frac{a_1}{q_1}\big)\sin\big(2πn\frac{a_2}{q_2}\big)$ with $x\geq q_1q_2, 1\leq a_i\leq q_i$, and $(a_i, q_i)=1$ ($i=1, 2$). We study the sign changes of $S\big(x; \frac{a_1}{q_1}, \frac{a_2}{q_2}\big)$, and prove that for a sufficiently large constant $C$, $S\big(x; \frac{a_1}{q_1}, \frac{a_2}{q_2}\big)$ changes sign in the interval $[T,T+C\sqrt{T}]$ for any large $T$. Meanwhile, we show that for a small constant $c'$, there exist infinitely many subintervals of length $c'\sqrt{T}\log^{-7}T$ in $[T,2T]$ where $\pm S\big(t; \frac{a_1}{q_1}, \frac{a_2}{q_2}\big)> c_5 (q_1q_2)^\frac{3}{4}t^\frac{1}{4}$ always holds.
△ Less
Submitted 23 November, 2016; v1 submitted 16 March, 2016;
originally announced March 2016.
-
A Weighted Divisor Problem
Authors:
Lirui Jia,
Wenguang Zhai
Abstract:
We study a weighted divisor function $\mathop{{\sum}'}\limits_{mn\leq x}\cos(2πmθ_1)\sin(2πnθ_2)$, where $θ_i (0<θ_i<1)$ is a rational number. By connecting it with the divisor problem with congruence conditions, we establish the upper bound, mean-value, mean-square and some power-moments.
We study a weighted divisor function $\mathop{{\sum}'}\limits_{mn\leq x}\cos(2πmθ_1)\sin(2πnθ_2)$, where $θ_i (0<θ_i<1)$ is a rational number. By connecting it with the divisor problem with congruence conditions, we establish the upper bound, mean-value, mean-square and some power-moments.
△ Less
Submitted 23 November, 2016; v1 submitted 19 February, 2016;
originally announced February 2016.
-
Dynamic Pricing and Distributed Energy Management for Demand Response
Authors:
Liyan Jia,
Lang Tong
Abstract:
The problem of dynamic pricing of electricity in a retail market is considered. A Stackelberg game is used to model interactions between a retailer and its customers; the retailer sets the day-ahead hourly price of electricity and consumers adjust real-time consumptions to maximize individual consumer surplus.
For thermostatic demands, the optimal aggregated demand is shown to be an affine funct…
▽ More
The problem of dynamic pricing of electricity in a retail market is considered. A Stackelberg game is used to model interactions between a retailer and its customers; the retailer sets the day-ahead hourly price of electricity and consumers adjust real-time consumptions to maximize individual consumer surplus.
For thermostatic demands, the optimal aggregated demand is shown to be an affine function of the day-ahead hourly price. A complete characterization of the trade-offs between consumer surplus and retail profit is obtained. The Pareto front of achievable trade-offs is shown to be concave, and each point on the Pareto front is achieved by an optimal day-ahead hourly price.
Effects of integrating renewables and local storage are analyzed. It is shown that benefits of renewable integration all go to the retailer when the capacity of renewable is relatively small. As the capacity increases beyond a certain threshold, the benefit from renewable that goes to consumers increases.
△ Less
Submitted 29 February, 2016; v1 submitted 10 January, 2016;
originally announced January 2016.
-
Renewables and Storage in Distribution Systems: Centralized vs. Decentralized Integration
Authors:
Liyan Jia,
Lang Tong
Abstract:
The problem of integrating renewables and storage into a distribution network is considered under two integration models: (i) a centralized model involving a retail utility that owns the integration as part of its portfolio of energy resources, and (ii) a decentralized model in which each consumer individually owns and operates the integration and is capable of selling surplus electricity back to…
▽ More
The problem of integrating renewables and storage into a distribution network is considered under two integration models: (i) a centralized model involving a retail utility that owns the integration as part of its portfolio of energy resources, and (ii) a decentralized model in which each consumer individually owns and operates the integration and is capable of selling surplus electricity back to the retailer in a net-metering setting.
The two integration models are analyzed using a Stackelberg game in which the utility is the leader in setting the retail price of electricity, and each consumer schedules its demand by maximizing individual consumer surplus. The solution of the Stackelberg game defines the Pareto front that characterizes fundamental trade-offs between retail profit of the utility and consumer surplus.
It is shown that, for both integration models, the centralized integration uniformly improves retail profit. As the level of integration increases, the proportion of benefits goes to the consumers increases. In contrast, the consumer-based decentralized integration improves consumer surplus at the expense of retail profit of the utility. For a profit regulated utility, the consumer based integration may lead to smaller consumer surplus than that when no renewable or storage is integrated at either the consumer or the retailer end.
△ Less
Submitted 10 January, 2016;
originally announced January 2016.
-
Convergence Analysis of Algorithms for DC Programming
Authors:
Bui Van Dinh,
Do Sang Kim,
Liguo Jiao
Abstract:
We consider the minimization problems of the form $P(\varphi, g, h)$: $\min\{f(x) = \varphi(x) + g(x) - h(x): x \in \Bbb R^n\}$, where $\varphi$ is a differentiable function and $g$, $h$ are convex functions, and introduce iterative methods to finding a critical point of $f$ when $f$ is differentiable. We show that the point computed by proximal point algorithm at each iteration can be used to det…
▽ More
We consider the minimization problems of the form $P(\varphi, g, h)$: $\min\{f(x) = \varphi(x) + g(x) - h(x): x \in \Bbb R^n\}$, where $\varphi$ is a differentiable function and $g$, $h$ are convex functions, and introduce iterative methods to finding a critical point of $f$ when $f$ is differentiable. We show that the point computed by proximal point algorithm at each iteration can be used to determine a descent direction for the objective function at this point. This algorithm can be considered as a combination of proximal point algorithm together with a linesearch step that uses this descent direction. We also study convergence results of these algorithms and the inertial proximal methods proposed by P.E. Maing$\acute{e}$ {\it et.al.} \cite{MM} under the main assumption that the objective function satisfies the Kurdika-Łojasiewicz property.
△ Less
Submitted 16 August, 2015;
originally announced August 2015.
-
A congruence involving harmonic sums modulo $p^αq^β$
Authors:
Tianxin Cai,
Zhongyan Shen,
Lirui Jia
Abstract:
In 2014, Wang and Cai established the following harmonic congruence for any odd prime $p$ and positive integer $r$, \begin{equation*} Z(p^{r})\equiv-2p^{r-1}B_{p-3} ~(\bmod ~ p^{r}), \end{equation*} where $ Z(n)=\sum\limits_{i+j+k=n\atop{i,j,k\in\mathcal{P}_{n}}}\frac{1}{ijk}$ and $\mathcal{P}_{n}$ denote the set of positive integers which are prime to $n$. In this note, we obtain a congruence for…
▽ More
In 2014, Wang and Cai established the following harmonic congruence for any odd prime $p$ and positive integer $r$, \begin{equation*} Z(p^{r})\equiv-2p^{r-1}B_{p-3} ~(\bmod ~ p^{r}), \end{equation*} where $ Z(n)=\sum\limits_{i+j+k=n\atop{i,j,k\in\mathcal{P}_{n}}}\frac{1}{ijk}$ and $\mathcal{P}_{n}$ denote the set of positive integers which are prime to $n$. In this note, we obtain a congruence for distinct odd primes $p,~q$ and positive integers $α,~β$, \begin{equation*} Z(p^αq^β)\equiv 2(2-q)(1-\frac{1}{q^{3}})p^{α-1}q^{β-1}B_{p-3}\pmod{p^α} \end{equation*} and the necessary and sufficient condition for \begin{equation*} Z(p^αq^β)\equiv 0\pmod{p^αq^β}. \end{equation*} Finally, we raise a conjecture that for $n>1$ and odd prime power $p^α||n$, $α\geq1$, \begin{eqnarray} \nonumber Z(n)\equiv \prod\limits_{q|n\atop{q\neq p}}(1-\frac{2}{q})(1-\frac{1}{q^{3}})(-\frac{2n}{p})B_{p-3}\pmod{p^α}. \end{eqnarray}
△ Less
Submitted 28 November, 2016; v1 submitted 10 March, 2015;
originally announced March 2015.
-
Structure-Based Self-Triggered Consensus in Networks of Multiagents with Switching Topologies
Authors:
Bo Liu,
Wenlian Lu,
Licheng Jiao,
Tianping Chen
Abstract:
In this paper, we propose a new self-triggered consensus algorithm in networks of multi-agents. Different from existing works, which are based on the observation of states, here, each agent determines its next update time based on its coupling structure. Both centralized and distributed approaches of the algorithms have been discussed. By transforming the algorithm to a proper discrete-time system…
▽ More
In this paper, we propose a new self-triggered consensus algorithm in networks of multi-agents. Different from existing works, which are based on the observation of states, here, each agent determines its next update time based on its coupling structure. Both centralized and distributed approaches of the algorithms have been discussed. By transforming the algorithm to a proper discrete-time systems without self delays, we established a new analysis framework to prove the convergence of the algorithm. Then we extended the algorithm to networks with switching topologies, especially stochastically switching topologies. Compared to existing works, our algorithm is easier to understand and implement. It explicitly provides positive lower and upper bounds for the update time interval of each agent based on its coupling structure, which can also be independently adjusted by each agent according to its own situation. Our work reveals that the event/self triggered algorithms are essentially discrete and more suitable to a discrete analysis framework. Numerical simulations are also provided to illustrate the theoretical results.
△ Less
Submitted 29 January, 2015;
originally announced January 2015.
-
An online learning approach to dynamic pricing for demand response
Authors:
Liyan Jia,
Lang Tong,
Qing Zhao
Abstract:
In this paper, the problem of optimal dynamic pricing for retail electricity with an unknown demand model is considered. Under the day-ahead dynamic pricing (a.k.a. real time pricing) mechanism, a retailer obtains electricity in a twosettlement wholesale market and serves its customers in real time. Without knowledge on the aggregated demand function of its customers, the retailer aims to maximize…
▽ More
In this paper, the problem of optimal dynamic pricing for retail electricity with an unknown demand model is considered. Under the day-ahead dynamic pricing (a.k.a. real time pricing) mechanism, a retailer obtains electricity in a twosettlement wholesale market and serves its customers in real time. Without knowledge on the aggregated demand function of its customers, the retailer aims to maximize its retail surplus by sequentially adjusting its price based on the behavior of its customers in the past. An online learning algorithm, referred to as piecewise linear stochastic approximation (PWLSA), is proposed. It is shown that PWLSA achieves the optimal rate of learning defined by the growth rate of cumulative regret. In particular, the regret of PWLSA is shown to grow logarithmically with respect to the learning horizon, and no other on-line learning algorithm can have the growth rate slower than that of PWLSA. Simulation studies are presented using traces of actual day-ahead prices, and PWLSA compares favorably under both static and dynamically changing parameters.
△ Less
Submitted 4 April, 2014;
originally announced April 2014.
-
Holder's inequalities involving the infinite product and their applications in martingale spaces
Authors:
Wei Chen,
Longbin Jia,
Yong Jiao
Abstract:
We give Hölder's inequalities for integral and conditional expectation involving the infinite product. Moreover, a generalized Doob maximal operator is introduced and weighted inequalities for the operator are established.
We give Hölder's inequalities for integral and conditional expectation involving the infinite product. Moreover, a generalized Doob maximal operator is introduced and weighted inequalities for the operator are established.
△ Less
Submitted 27 June, 2016; v1 submitted 7 January, 2014;
originally announced January 2014.
-
Impact of Data Quality on Real-Time Locational Marginal Price
Authors:
Liyan Jia,
Jinsub Kim,
Robert J. Thomas,
Lang Tong
Abstract:
The problem of characterizing impacts of data quality on real-time locational marginal price (LMP) is considered. Because the real-time LMP is computed from the estimated network topology and system state, bad data that cause errors in topology processing and state estimation affect real-time LMP. It is shown that the power system state space is partitioned into price regions of convex polytopes.…
▽ More
The problem of characterizing impacts of data quality on real-time locational marginal price (LMP) is considered. Because the real-time LMP is computed from the estimated network topology and system state, bad data that cause errors in topology processing and state estimation affect real-time LMP. It is shown that the power system state space is partitioned into price regions of convex polytopes. Under different bad data models, the worst case impacts of bad data on real-time LMP are analyzed. Numerical simulations are used to illustrate worst case performance for IEEE-14 and IEEE-118 networks.
△ Less
Submitted 30 August, 2013; v1 submitted 29 December, 2012;
originally announced December 2012.
