Showing 1–50 of 108 results for author: Shi, X

Phase Transition in Non-isentropic Compressible Immiscible Two-Phase Flow with van der Waals Equation of State

Authors: Yazhou Chen, Yi Peng, Xiaoding Shi, Xiaoping Wang

Abstract: This study establishes the global well-posedness of the compressible non-isentropic Navier-Stokes/Allen-Cahn system governed by the van der Waals equation of state $p(ρ,θ)=- aρ^2+\frac{Rθρ}{1-bρ}$ and degenerate thermal conductivity $κ(θ)=\tildeκθ^β$, where $p$, $ρ$ and $θ$ are the pressure, the density and the temperature of the flow respectively, and $a,b,R,\tildeκ$ are positive constants relate… ▽ More This study establishes the global well-posedness of the compressible non-isentropic Navier-Stokes/Allen-Cahn system governed by the van der Waals equation of state $p(ρ,θ)=- aρ^2+\frac{Rθρ}{1-bρ}$ and degenerate thermal conductivity $κ(θ)=\tildeκθ^β$, where $p$, $ρ$ and $θ$ are the pressure, the density and the temperature of the flow respectively, and $a,b,R,\tildeκ$ are positive constants related to the physical properties of the flow. Navier-Stokes/Allen-Cahn system models immiscible two-phase flow with diffusive interfaces, where the non-monotonic pressure-density relationship in the van der Waals equation drives gas-liquid phase transitions. By developing a refined $L^2$-energy framework, we prove the existence and uniqueness of global strong solutions to the one-dimensional Cauchy problem for non-vacuum and finite-temperature initial data, without imposing smallness restrictions on the initial conditions. The findings demonstrate that despite non-monotonic pressure inducing substantial density fluctuations and triggering phase transitions, all physical quantities remain bounded over finite time intervals. △ Less

Submitted 25 June, 2025; originally announced June 2025.

Comments: 33 pages, 2 figures

MSC Class: 35Q35; 35B65; 76N10; 35M10; 35B40; 35C20; 76T30

Distributed Online Randomized Gradient-Free optimization with Compressed Communication

Authors: Longkang Zhu, Xinli Shi, Xiangping Xu, Jinde Cao

Abstract: This paper addresses two fundamental challenges in distributed online convex optimization: communication efficiency and optimization under limited feedback. We propose Online Compressed Gradient Tracking with one-point Bandit Feedback (OCGT-BF), a novel algorithm that harness data compression and gradient-free optimization techniques in distributed networks. Our algorithm incorporates a compressio… ▽ More This paper addresses two fundamental challenges in distributed online convex optimization: communication efficiency and optimization under limited feedback. We propose Online Compressed Gradient Tracking with one-point Bandit Feedback (OCGT-BF), a novel algorithm that harness data compression and gradient-free optimization techniques in distributed networks. Our algorithm incorporates a compression scheme with error compensation mechanisms to reduce communication overhead while maintaining convergence guarantees. Unlike traditional approaches that assume perfect communication and full gradient access, OCGT-BF operates effectively under practical constraints by combining gradient-like tracking with one-point feedback estimation. We provide theoretical analysis demonstrating the dynamic regret bounds under both bandit feedback and stochastic gradient scenarios. Finally, extensive experiments validate that OCGT-BF achieves low dynamic regret while significantly reducing communication requirements. △ Less

Submitted 4 May, 2025; v1 submitted 30 April, 2025; originally announced April 2025.

Comments: We are withdrawing this manuscript due to factual errors identified in all the remarks presented. We will revise and resubmit a corrected version in the future

Perturbed Proximal Gradient ADMM for Nonconvex Composite Optimization

Authors: Yuan Zhou, Xinli Shi, Luyao Guo, Jinde Cao, Mahmoud Abdel-Aty

Abstract: This paper proposes a Perturbed Proximal Gradient ADMM (PPG-ADMM) framework for solving general nonconvex composite optimization problems, where the objective function consists of a smooth nonconvex term and a nonsmooth weakly convex term for both primal variables. Unlike existing ADMM-based methods which necessitate the function associated with the last updated primal variable to be smooth, the… ▽ More This paper proposes a Perturbed Proximal Gradient ADMM (PPG-ADMM) framework for solving general nonconvex composite optimization problems, where the objective function consists of a smooth nonconvex term and a nonsmooth weakly convex term for both primal variables. Unlike existing ADMM-based methods which necessitate the function associated with the last updated primal variable to be smooth, the proposed PPG-ADMM removes this restriction by introducing a perturbation mechanism, which also helps reduce oscillations in the primal-dual updates, thereby improving convergence stability. By employing a linearization technique for the smooth term and the proximal operator for the nonsmooth and weakly convex term, the subproblems have closed-form solutions, significantly reducing computational complexity. The convergence is established through a technically constructed Lyapunov function, which guarantees sufficient descent and has a well-defined lower bound. With properly chosen parameters, PPG-ADMM converges to an $ε$-approximate stationary point at a sublinear convergence rate of $\mathcal{O}(1/\sqrt{K})$. Furthermore, by appropriately tuning the perturbation parameter $β$, it achieves an $ε$-stationary point, providing stronger optimality guarantees. We further apply PPG-ADMM to two practical distributed nonconvex composite optimization problems, i.e., the distributed partial consensus problem and the resource allocation problem. The algorithm operates in a fully decentralized manner without a central coordinating node. Finally, numerical experiments validate the effectiveness of PPG-ADMM, demonstrating its improved convergence performance. △ Less

Submitted 17 April, 2025; originally announced April 2025.

Decentralized Nonconvex Composite Federated Learning with Gradient Tracking and Momentum

Authors: Yuan Zhou, Xinli Shi, Xuelong Li, Jiachen Zhong, Guanghui Wen, Jinde Cao

Abstract: Decentralized Federated Learning (DFL) eliminates the reliance on the server-client architecture inherent in traditional federated learning, attracting significant research interest in recent years. Simultaneously, the objective functions in machine learning tasks are often nonconvex and frequently incorporate additional, potentially nonsmooth regularization terms to satisfy practical requirements… ▽ More Decentralized Federated Learning (DFL) eliminates the reliance on the server-client architecture inherent in traditional federated learning, attracting significant research interest in recent years. Simultaneously, the objective functions in machine learning tasks are often nonconvex and frequently incorporate additional, potentially nonsmooth regularization terms to satisfy practical requirements, thereby forming nonconvex composite optimization problems. Employing DFL methods to solve such general optimization problems leads to the formulation of Decentralized Nonconvex Composite Federated Learning (DNCFL), a topic that remains largely underexplored. In this paper, we propose a novel DNCFL algorithm, termed \bf{DEPOSITUM}. Built upon proximal stochastic gradient tracking, DEPOSITUM mitigates the impact of data heterogeneity by enabling clients to approximate the global gradient. The introduction of momentums in the proximal gradient descent step, replacing tracking variables, reduces the variance introduced by stochastic gradients. Additionally, DEPOSITUM supports local updates of client variables, significantly reducing communication costs. Theoretical analysis demonstrates that DEPOSITUM achieves an expected $ε$-stationary point with an iteration complexity of $\mathcal{O}(1/ε^2)$. The proximal gradient, consensus errors, and gradient estimation errors decrease at a sublinear rate of $\mathcal{O}(1/T)$. With appropriate parameter selection, the algorithm achieves network-independent linear speedup without requiring mega-batch sampling. Finally, we apply DEPOSITUM to the training of neural networks on real-world datasets, systematically examining the influence of various hyperparameters on its performance. Comparisons with other federated composite optimization algorithms validate the effectiveness of the proposed method. △ Less

Submitted 17 April, 2025; originally announced April 2025.

Stochastic Gradient Descent in Non-Convex Problems: Asymptotic Convergence with Relaxed Step-Size via Stopping Time Methods

Authors: Ruinan Jin, Difei Cheng, Hong Qiao, Xin Shi, Shaodong Liu, Bo Zhang

Abstract: Stochastic Gradient Descent (SGD) is widely used in machine learning research. Previous convergence analyses of SGD under the vanishing step-size setting typically require Robbins-Monro conditions. However, in practice, a wider variety of step-size schemes are frequently employed, yet existing convergence results remain limited and often rely on strong assumptions. This paper bridges this gap by i… ▽ More Stochastic Gradient Descent (SGD) is widely used in machine learning research. Previous convergence analyses of SGD under the vanishing step-size setting typically require Robbins-Monro conditions. However, in practice, a wider variety of step-size schemes are frequently employed, yet existing convergence results remain limited and often rely on strong assumptions. This paper bridges this gap by introducing a novel analytical framework based on a stopping-time method, enabling asymptotic convergence analysis of SGD under more relaxed step-size conditions and weaker assumptions. In the non-convex setting, we prove the almost sure convergence of SGD iterates for step-sizes $ \{ ε_t \}_{t \geq 1} $ satisfying $\sum_{t=1}^{+\infty} ε_t = +\infty$ and $\sum_{t=1}^{+\infty} ε_t^p < +\infty$ for some $p > 2$. Compared with previous studies, our analysis eliminates the global Lipschitz continuity assumption on the loss function and relaxes the boundedness requirements for higher-order moments of stochastic gradients. Building upon the almost sure convergence results, we further establish $L_2$ convergence. These significantly relaxed assumptions make our theoretical results more general, thereby enhancing their applicability in practical scenarios. △ Less

Submitted 16 April, 2025; originally announced April 2025.

Comments: 42 pages

MSC Class: 40G15 ACM Class: G.1.0

FedCanon: Non-Convex Composite Federated Learning with Efficient Proximal Operation on Heterogeneous Data

Authors: Yuan Zhou, Jiachen Zhong, Xinli Shi, Guanghui Wen, Xinghuo Yu

Abstract: Composite federated learning offers a general framework for solving machine learning problems with additional regularization terms. However, many existing methods require clients to perform multiple proximal operations to handle non-smooth terms and their performance are often susceptible to data heterogeneity. To overcome these limitations, we propose a novel composite federated learning algorith… ▽ More Composite federated learning offers a general framework for solving machine learning problems with additional regularization terms. However, many existing methods require clients to perform multiple proximal operations to handle non-smooth terms and their performance are often susceptible to data heterogeneity. To overcome these limitations, we propose a novel composite federated learning algorithm called \textbf{FedCanon}, designed to solve the optimization problems comprising a possibly non-convex loss function and a weakly convex, potentially non-smooth regularization term. By decoupling proximal mappings from local updates, FedCanon requires only a single proximal evaluation on the server per iteration, thereby reducing the overall proximal computation cost. It also introduces control variables that incorporate global gradient information into client updates, which helps mitigate the effects of data heterogeneity. Theoretical analysis demonstrates that FedCanon achieves sublinear convergence rates under general non-convex settings and linear convergence under the Polyak-Łojasiewicz condition, without relying on bounded heterogeneity assumptions. Experiments demonstrate that FedCanon outperforms the state-of-the-art methods in terms of both accuracy and computational efficiency, particularly under heterogeneous data distributions. △ Less

Submitted 16 April, 2025; originally announced April 2025.

An Adaptive Algorithm for Bilevel Optimization on Riemannian Manifolds

Authors: Xu Shi, Rufeng Xiao, Rujun Jiang

Abstract: Existing methods for solving Riemannian bilevel optimization (RBO) problems require prior knowledge of the problem's first- and second-order information and curvature parameter of the Riemannian manifold to determine step sizes, which poses practical limitations when these parameters are unknown or computationally infeasible to obtain. In this paper, we introduce the Adaptive Riemannian Hypergradi… ▽ More Existing methods for solving Riemannian bilevel optimization (RBO) problems require prior knowledge of the problem's first- and second-order information and curvature parameter of the Riemannian manifold to determine step sizes, which poses practical limitations when these parameters are unknown or computationally infeasible to obtain. In this paper, we introduce the Adaptive Riemannian Hypergradient Descent (AdaRHD) algorithm for solving RBO problems. To our knowledge, AdaRHD is the first method to incorporate a fully adaptive step size strategy that eliminates the need for problem-specific parameters in RBO problem resolution. We prove that AdaRHD achieves an $\mathcal{O}(1/ε)$ iteration complexity for finding an $ε$-stationary point, thus matching the complexity of existing non-adaptive methods. Furthermore, we demonstrate that substituting exponential mappings with retraction mappings maintains the same complexity bound. Experiments demonstrate that AdaRHD achieves comparable performance to existing non-adaptive approaches while exhibiting greater robustness. △ Less

Submitted 22 April, 2025; v1 submitted 8 April, 2025; originally announced April 2025.

Constrained stochastic linear quadratic control under regime switching with controlled jump size

Authors: Xiaomin Shi, Zuo Quan Xu

Abstract: In this paper, we examine a stochastic linear-quadratic control problem characterized by regime switching and Poisson jumps. All the coefficients in the problem are random processes adapted to the filtration generated by Brownian motion and the Poisson random measure for each given regime. The model incorporates two distinct types of controls: the first is a conventional control that appears in th… ▽ More In this paper, we examine a stochastic linear-quadratic control problem characterized by regime switching and Poisson jumps. All the coefficients in the problem are random processes adapted to the filtration generated by Brownian motion and the Poisson random measure for each given regime. The model incorporates two distinct types of controls: the first is a conventional control that appears in the continuous diffusion component, while the second is an unconventional control, dependent on the variable $z$, which influences the jump size in the jump diffusion component. Both controls are constrained within general closed cones. By employing the Meyer-Itô formula in conjunction with a generalized squares completion technique, we rigorously and explicitly derive the optimal value and optimal feedback control. These depend on solutions to certain multi-dimensional fully coupled stochastic Riccati equations, which are essentially backward stochastic differential equations with jumps (BSDEJs). We establish the existence of a unique nonnegative solution to the BSDEJs. One of the major tools used in the proof is the newly established comparison theorems for multidimensional BSDEJs. △ Less

Submitted 26 December, 2024; originally announced December 2024.

A System of BSDEs with Singular Terminal Values Arising in Optimal Liquidation with Regime Switching

Authors: Guanxing Fu, Xiaomin Shi, Zuo Quan Xu

Abstract: We study a stochastic control problem with regime switching arising in an optimal liquidation problem with dark pools and multiple regimes. The new feature of this model is that it introduces a system of BSDEs with jumps and with singular terminal values, which appears in literature for the first time. The existence result for this system is obtained. As a result, we solve the stochastic control p… ▽ More We study a stochastic control problem with regime switching arising in an optimal liquidation problem with dark pools and multiple regimes. The new feature of this model is that it introduces a system of BSDEs with jumps and with singular terminal values, which appears in literature for the first time. The existence result for this system is obtained. As a result, we solve the stochastic control problem with regime switching. More importantly, the uniqueness result of this system is also obtained, in contrast to merely minimal solutions established in most related literature. △ Less

Submitted 19 January, 2025; v1 submitted 26 December, 2024; originally announced December 2024.

Comments: 19 pages

Reinterpreting PID Controller From the Perspective of State Feedback and Lumped Disturbance Compensation

Authors: Xinyu Shi

Abstract: This paper analyzes the motion of solutions to non-homogeneous linear differential equations. It further clarifies that a proportional-integral-derivative (PID) controller essentially comprises two parts: a homogeneous controller and a disturbance observer, which are responsible for stabilizing the homogeneous system and compensating for the lumped disturbances (non-homogeneous components) of the… ▽ More This paper analyzes the motion of solutions to non-homogeneous linear differential equations. It further clarifies that a proportional-integral-derivative (PID) controller essentially comprises two parts: a homogeneous controller and a disturbance observer, which are responsible for stabilizing the homogeneous system and compensating for the lumped disturbances (non-homogeneous components) of the system respectively. Based on this framework, the impact of measurement noise on control performance is examined, and a parameter tuning scheme for the traditional PID controller is provided. Finally, as examples, controllers are designed for two representative control problems: a trajectory tracking controller for an underactuated vertical takeoff and landing (VTOL) aircraft in the time domain, and a lateral controller for a vehicle in the distance domain. △ Less

Submitted 21 November, 2024; originally announced November 2024.

Series Expansion of Probability of Correct Selection for Improved Finite Budget Allocation in Ranking and Selection

Authors: Xinbo Shi, Yijie Peng, Bruno Tuffin

Abstract: This paper addresses the challenge of improving finite sample performance in Ranking and Selection by developing a Bahadur-Rao type expansion for the Probability of Correct Selection (PCS). While traditional large deviations approximations captures PCS behavior in the asymptotic regime, they can lack precision in finite sample settings. Our approach enhances PCS approximation under limited simulat… ▽ More This paper addresses the challenge of improving finite sample performance in Ranking and Selection by developing a Bahadur-Rao type expansion for the Probability of Correct Selection (PCS). While traditional large deviations approximations captures PCS behavior in the asymptotic regime, they can lack precision in finite sample settings. Our approach enhances PCS approximation under limited simulation budgets, providing more accurate characterization of optimal sampling ratios and optimality conditions dependent of budgets. Algorithmically, we propose a novel finite budget allocation (FCBA) policy, which sequentially estimates the optimality conditions and accordingly balances the sampling ratios. We illustrate numerically on toy examples that our FCBA policy achieves superior PCS performance compared to tested traditional methods. As an extension, we note that the non-monotonic PCS behavior described in the literature for low-confidence scenarios can be attributed to the negligence of simultaneous incorrect binary comparisons in PCS approximations. We provide a refined expansion and a tailored allocation strategy to handle low-confidence scenarios, addressing the non-monotonicity issue. △ Less

Submitted 15 November, 2024; originally announced November 2024.

Near-Optimal Algorithms for Convex Simple Bilevel Optimization under Weak Assumptions

Authors: Rujun Jiang, Xu Shi, Weizheng Song, Jiulin Wang

Abstract: This paper considers the simple bilevel optimization (SBO) problem, which minimizes a composite convex function over the optimal solution set of another composite convex minimization problem. We first show that this bilevel problem is equivalent to finding the left-most root of a nonlinear equation. Based on this and a novel dual approach for solving the subproblem in each iteration, we efficientl… ▽ More This paper considers the simple bilevel optimization (SBO) problem, which minimizes a composite convex function over the optimal solution set of another composite convex minimization problem. We first show that this bilevel problem is equivalent to finding the left-most root of a nonlinear equation. Based on this and a novel dual approach for solving the subproblem in each iteration, we efficiently obtain an $(ε, ε)$-optimal solution through the bisection and Newton methods. The proposed methods achieve near-optimal operation complexity of ${\tilde{\mathcal{O}}(\sqrt{1/ε})}$ under mild assumptions, aligning with the lower complexity bounds of the first-order methods in SBO with both level objectives being smooth convex and unconstrained composite convex optimization when ignoring logarithmic terms. △ Less

Submitted 10 July, 2025; v1 submitted 13 September, 2024; originally announced September 2024.

Privacy enhanced collaborative inference in the Cox proportional hazards model for distributed data

Authors: Mengtong Hu, Xu Shi, Peter X. -K. Song

Abstract: Data sharing barriers are paramount challenges arising from multicenter clinical studies where multiple data sources are stored in a distributed fashion at different local study sites. Particularly in the case of time-to-event analysis when global risk sets are needed for the Cox proportional hazards model, access to a centralized database is typically necessary. Merging such data sources into a c… ▽ More Data sharing barriers are paramount challenges arising from multicenter clinical studies where multiple data sources are stored in a distributed fashion at different local study sites. Particularly in the case of time-to-event analysis when global risk sets are needed for the Cox proportional hazards model, access to a centralized database is typically necessary. Merging such data sources into a common data storage for a centralized statistical analysis requires a data use agreement, which is often time-consuming. Furthermore, the construction and distribution of risk sets to participating clinical centers for subsequent calculations may pose a risk of revealing individual-level information. We propose a new collaborative Cox model that eliminates the need for accessing the centralized database and constructing global risk sets but needs only the sharing of summary statistics with significantly smaller dimensions than risk sets. Thus, the proposed collaborative inference enjoys maximal protection of data privacy. We show theoretically and numerically that the new distributed proportional hazards model approach has little loss of statistical power when compared to the centralized method that requires merging the entire data. We present a renewable sieve method to establish large-sample properties for the proposed method. We illustrate its performance through simulation experiments and a real-world data example from patients with kidney transplantation in the Organ Procurement and Transplantation Network (OPTN) to understand the factors associated with the 5-year death-censored graft failure (DCGF) for patients who underwent kidney transplants in the US. △ Less

Submitted 7 September, 2024; originally announced September 2024.

Q statistics in data depth: fundamental theory revisited and variants

Authors: Min Gao, Yiting Chen, Xiaoping Shi, Wenzhi Yang

Abstract: Recently, data depth has been widely used to rank multivariate data. The study of the depth-based $Q$ statistic, originally proposed by Liu and Singh (1993), has become increasingly popular when it can be used as a quality index to differentiate between two samples. Based on the existing theoretical foundations, more and more variants have been developed for increasing power in the two sample test… ▽ More Recently, data depth has been widely used to rank multivariate data. The study of the depth-based $Q$ statistic, originally proposed by Liu and Singh (1993), has become increasingly popular when it can be used as a quality index to differentiate between two samples. Based on the existing theoretical foundations, more and more variants have been developed for increasing power in the two sample test. However, the asymptotic expansion of the $Q$ statistic in the important foundation work of Zuo and He (2006) currently has an optimal rate $m^{-3/4}$ slower than the target $m^{-1}$, leading to limitations in higher-order expansions for developing more powerful tests. We revisit the existing assumptions and add two new plausible assumptions to obtain the target rate by applying a new proof method based on the Hoeffding decomposition and the Cox-Reid expansion. The aim of this paper is to rekindle interest in asymptotic data depth theory, to place Q-statistical inference on a firmer theoretical basis, to show its variants in current research, to open the door to the development of new theories for further variants requiring higher-order expansions, and to explore more of its potential applications. △ Less

Submitted 12 July, 2024; originally announced July 2024.

Large Time Behavior of Solutions to Cauchy Problem for 1-D Compressible Isentropic Navier-Stokes/Allen-Cahn System

Authors: Yazhou Chen, Qiaolin He, Xiaoding Shi

Abstract: This paper is concerned with the large time behavior of the solutions to the Cauchy problem for the one-dimensional compressible Navier-Stokes/Allen-Cahn system with the immiscible two-phase flow initially located near the phase separation state. Under the assumptions that the initial data is a small perturbation of the constant state, we prove the global existence and uniqueness of the solutions… ▽ More This paper is concerned with the large time behavior of the solutions to the Cauchy problem for the one-dimensional compressible Navier-Stokes/Allen-Cahn system with the immiscible two-phase flow initially located near the phase separation state. Under the assumptions that the initial data is a small perturbation of the constant state, we prove the global existence and uniqueness of the solutions and establish the time decay rates of the solution as well as its higher-order spatial derivatives. Moreover, we derive that the solutions of the system are time asymptotically approximated by the solutions of the modified parabolic system and obtain decay rates in $L^2$ and $L^1$. Furthermore, we show that the solution of the system is time asymptotically approximated in $L^p (1 \leq p \leq+\infty)$ by the diffusion waves. △ Less

Submitted 3 July, 2024; originally announced July 2024.

Comments: 26 pages

MSC Class: 35Q35; 35B65; 76N10; 35M10; 35B40; 35C20; 76T30

Constrained mean-variance investment-reinsurance under the Cramér-Lundberg model with random coefficients

Authors: Xiaomin Shi, Zuo Quan Xu

Abstract: In this paper, we study an optimal mean-variance investment-reinsurance problem for an insurer (she) under a Cramér-Lundberg model with random coefficients. At any time, the insurer can purchase reinsurance or acquire new business and invest her surplus in a security market consisting of a risk-free asset and multiple risky assets, subject to a general convex cone investment constraint. We reduce… ▽ More In this paper, we study an optimal mean-variance investment-reinsurance problem for an insurer (she) under a Cramér-Lundberg model with random coefficients. At any time, the insurer can purchase reinsurance or acquire new business and invest her surplus in a security market consisting of a risk-free asset and multiple risky assets, subject to a general convex cone investment constraint. We reduce the problem to a constrained stochastic linear-quadratic control problem with jumps whose solution is related to a system of partially coupled stochastic Riccati equations (SREs). Then we devote ourselves to establishing the existence and uniqueness of solutions to the SREs by pure backward stochastic differential equation (BSDE) techniques. We achieve this with the help of approximation procedure, comparison theorems for BSDEs with jumps, log transformation and BMO martingales. The efficient investment-reinsurance strategy and efficient mean-variance frontier are explicitly given through the solutions of the SREs, which are shown to be a linear feedback form of the wealth process and a half-line, respectively. △ Less

Submitted 14 June, 2024; originally announced June 2024.

Mean-variance portfolio selection in jump-diffusion model under no-shorting constraint: A viscosity solution approach

Authors: Xiaomin Shi, Zuo Quan Xu

Abstract: This paper concerns a continuous time mean-variance (MV) portfolio selection problem in a jump-diffusion financial model with no-shorting trading constraint. The problem is reduced to two subproblems: solving a stochastic linear-quadratic (LQ) control problem under control constraint, and finding a maximal point of a real function. Based on a two-dimensional fully coupled ordinary differential equ… ▽ More This paper concerns a continuous time mean-variance (MV) portfolio selection problem in a jump-diffusion financial model with no-shorting trading constraint. The problem is reduced to two subproblems: solving a stochastic linear-quadratic (LQ) control problem under control constraint, and finding a maximal point of a real function. Based on a two-dimensional fully coupled ordinary differential equation (ODE), we construct an explicit viscosity solution to the Hamilton-Jacobi-Bellman equation of the constrained LQ problem. Together with the Meyer-Itô formula and a verification procedure, we obtain the optimal feedback controls of the constrained LQ problem and the original MV problem, which corrects the flawed results in some existing literatures. In addition, closed-form efficient portfolio and efficient frontier are derived. In the end, we present several examples where the two-dimensional ODE is decoupled. △ Less

Submitted 5 June, 2024; originally announced June 2024.

Large Time Behavior and Sharp Interface Limit of Compressible Navier-Stokes/Allen-Cahn System for Interacting Shock Waves

Authors: Yazhou Chen, Qiaolin He, Xiaoding Shi, Xiaoping Wang

Abstract: In this paper, we study the large time behavior and sharp interface limit of the Cauchy problem for compressible Navier-Stokes/Allen-Cahn system with interaction shock waves in the same family. This system is an important mathematical model for describing the motion of immiscible two-phase flow. The results show that, if the initial density and velocity are near the superposition of two shock wave… ▽ More In this paper, we study the large time behavior and sharp interface limit of the Cauchy problem for compressible Navier-Stokes/Allen-Cahn system with interaction shock waves in the same family. This system is an important mathematical model for describing the motion of immiscible two-phase flow. The results show that, if the initial density and velocity are near the superposition of two shock waves in the same family, then there exists a unique global solution to the compressible Navier-Stokes/Allen-Cahn system, and this solution asymptotically converges to the superposition of the viscous shock wave and rarefaction wave which moving in opposite directions. Moreover, this global-in-time solution converges to the entropy solution of $p$-system in $L^\infty$-norm as the thickness of the diffusion interface tends to zero. △ Less

Submitted 3 June, 2024; originally announced June 2024.

Comments: 41pages, 2 figures

MSC Class: 35Q35; 35B65; 76N10; 35M10; 35B40; 35C20; 76T30

Entropy density and large deviation principles without upper semi-continuity of entropy

Authors: Zhiqiang Li, Xianghui Shi

Abstract: Expanding Thurston maps were introduced by M. Bonk and D. Meyer with motivation from complex dynamics and Cannon's conjecture from geometric group theory via Sullivan's dictionary. In this paper, we show that the entropy map of an expanding Thurston map is upper semi-continuous if and only if the map has no periodic critical points. For all expanding Thurston maps, even in the presence of periodic… ▽ More Expanding Thurston maps were introduced by M. Bonk and D. Meyer with motivation from complex dynamics and Cannon's conjecture from geometric group theory via Sullivan's dictionary. In this paper, we show that the entropy map of an expanding Thurston map is upper semi-continuous if and only if the map has no periodic critical points. For all expanding Thurston maps, even in the presence of periodic critical points, we show that ergodic measures are entropy-dense and establish level-2 large deviation principles for the distribution of Birkhoff averages, periodic points, and iterated preimages. It follows that iterated preimages and periodic points are equidistributed with respect to the unique equilibrium state for an expanding Thurston map and a potential that is Hölder continuous with respect to a visual metric on $S^2$. In particular, our results answer two questions in [Li15]. The main technical tools in this paper are called subsystems of expanding Thurston maps, inspired by a translation of the notion of subgroups via Sullivan's dictionary. △ Less

Submitted 3 June, 2024; originally announced June 2024.

Comments: 59 pages. arXiv admin note: text overlap with arXiv:2312.15822

MSC Class: Primary: 37F10; Secondary: 37A50; 37A35; 37D35; 37F15; 37B99; 57M12

Landscapes of the Octahedron

Authors: Emiko Saso, Houston Schuerger, Xin Shi

Abstract: The landscapes of a polyhedron are subsets of its nets one must consider to identify all shortest paths. Landscapes of cubes and tetrahedra have been used to identify coordinate based formulas for the lengths of the shortest paths between points on these surfaces. We extend these results to develop formulas for the lengths of the shortest paths between points on the surface of octahedra. The landscapes of a polyhedron are subsets of its nets one must consider to identify all shortest paths. Landscapes of cubes and tetrahedra have been used to identify coordinate based formulas for the lengths of the shortest paths between points on these surfaces. We extend these results to develop formulas for the lengths of the shortest paths between points on the surface of octahedra. △ Less

Submitted 11 April, 2024; originally announced May 2024.

Comments: arXiv admin note: substantial text overlap with arXiv:2201.04253

Constrained monotone mean--variance investment-reinsurance under the Cramér--Lundberg model with random coefficients

Authors: Xiaomin Shi, Zuo Quan Xu

Abstract: This paper studies an optimal investment-reinsurance problem for an insurer (she) under the Cramér--Lundberg model with monotone mean--variance (MMV) criterion. At any time, the insurer can purchase reinsurance (or acquire new business) and invest in a security market consisting of a risk-free asset and multiple risky assets whose excess return rate and volatility rate are allowed to be random. Th… ▽ More This paper studies an optimal investment-reinsurance problem for an insurer (she) under the Cramér--Lundberg model with monotone mean--variance (MMV) criterion. At any time, the insurer can purchase reinsurance (or acquire new business) and invest in a security market consisting of a risk-free asset and multiple risky assets whose excess return rate and volatility rate are allowed to be random. The trading strategy is subject to a general convex cone constraint, encompassing no-shorting constraint as a special case. The optimal investment-reinsurance strategy and optimal value for the MMV problem are deduced by solving certain backward stochastic differential equations with jumps. In the literature, it is known that models with MMV criterion and mean--variance criterion lead to the same optimal strategy and optimal value when the wealth process is continuous. Our result shows that the conclusion remains true even if the wealth process has compensated Poisson jumps and the market coefficients are random. △ Less

Submitted 29 May, 2024; v1 submitted 28 May, 2024; originally announced May 2024.

Comments: arXiv admin note: text overlap with arXiv:2212.14188

MSC Class: 91B16. 93E20. 60H30. 91G10

Ensemble Control for Stochastic Systems with Asymmetric Laplace Noises

Authors: Yajie Yu, Xuehui Ma, Shiliang Zhang, Zhuzhu Wang, Xubing Shi, Yushuai Li, Tingwen Huang

Abstract: This paper presents an adaptive ensemble control for stochastic systems subject to asymmetric noises and outliers. Asymmetric noises skew system observations, and outliers with large amplitude deteriorate the observations even further. Such disturbances induce poor system estimation and degraded stochastic system control. In this work, we model the asymmetric noises and outliers by mixed asymmetri… ▽ More This paper presents an adaptive ensemble control for stochastic systems subject to asymmetric noises and outliers. Asymmetric noises skew system observations, and outliers with large amplitude deteriorate the observations even further. Such disturbances induce poor system estimation and degraded stochastic system control. In this work, we model the asymmetric noises and outliers by mixed asymmetric Laplace distributions (ALDs), and propose an optimal control for stochastic systems with mixed ALD noises. Particularly, we segregate the system disturbed by mixed ALD noises into subsystems, each of which is subject to a specific ALD noise. For each subsystem, we design an iterative quantile filter (IQF) to estimate the system parameters using system observations. With the estimated parameters by IQF, we derive the certainty equivalence (CE) control law for each subsystem. Then we use the Bayesian approach to ensemble the subsystem CE controllers, with each of the controllers weighted by their posterior probability. We finalize our control law as the weighted sum of the control signals by the sub-system CE controllers. To demonstrate our approach, we conduct numerical simulations and Monte Carlo analyses. The results show improved tracking performance by our approach for skew noises and its robustness to outliers, compared with single ALD based and RLS-based control policy. △ Less

Submitted 8 January, 2025; v1 submitted 16 May, 2024; originally announced May 2024.

Thermodynamic formalism for subsystems of expanding Thurston maps II

Authors: Zhiqiang Li, Xianghui Shi

Abstract: Expanding Thurston maps were introduced by M. Bonk and D. Meyer with motivation from complex dynamics and Cannon's conjecture from geometric group theory via Sullivan's dictionary. In this paper, we study subsystems of expanding Thurston maps motivated via Sullivan's dictionary as analogs of some subgroups of Kleinian groups. We prove the uniqueness and various ergodic properties of the equilibriu… ▽ More Expanding Thurston maps were introduced by M. Bonk and D. Meyer with motivation from complex dynamics and Cannon's conjecture from geometric group theory via Sullivan's dictionary. In this paper, we study subsystems of expanding Thurston maps motivated via Sullivan's dictionary as analogs of some subgroups of Kleinian groups. We prove the uniqueness and various ergodic properties of the equilibrium states for strongly primitive subsystems and real-valued Hölder continuous potentials, and establish the equidistribution of preimages of subsystems with respect to the equilibrium states. Here, the sphere $S^{2}$ is equipped with a natural metric, called a visual metric, introduced by M. Bonk and D. Meyer. As a result, for strongly primitive subsystems of expanding Thurston maps without periodic critical points, we obtain a level-$2$ large deviation principle for Birkhoff averages and iterated preimages. △ Less

Submitted 10 April, 2024; originally announced April 2024.

Comments: 46 pages. This is a sequel to arXiv:2312.15822

MSC Class: Primary: 37F10; Secondary: 37D35; 37F20; 37F15; 37B99; 57M12

Nonlinear Stability for the Superposition of Viscous Contact Wave and Rarefaction Waves to Non-isentropic Compressible Navier-Stokes System with General Initial Perturbations

Authors: Yi Peng, Xiaoding Shi, Yuhang Wu

Abstract: In this paper, the large time behavior of the solutions for the Cauchy problem to the one-dimensional compressible Navier-Stokes system with the motion of a viscous heat-conducting perfect polytropic gas is investigated.Our result shows that the combination of a viscous contact wave with rarefaction waves is asymptotically stable, when the large initial disturbance of the density, velocity and tem… ▽ More In this paper, the large time behavior of the solutions for the Cauchy problem to the one-dimensional compressible Navier-Stokes system with the motion of a viscous heat-conducting perfect polytropic gas is investigated.Our result shows that the combination of a viscous contact wave with rarefaction waves is asymptotically stable, when the large initial disturbance of the density, velocity and temperature belong to $H^{1}(\mathbb{R})$, $L^{2}(\mathbb{R})\cap L^{4}(\mathbb{R})$ and $L^{2}(\mathbb{R})$, provided the strength of the combination waves is suitably small. In addition, the initial disturbance on the derivation of velocity and temperature belong to $L^{2}(\mathbb{R})$ can be arbitrarily large. △ Less

Submitted 22 March, 2024; originally announced March 2024.

Comments: 38 pages. arXiv admin note: text overlap with arXiv:1502.00211 by other authors

MSC Class: 35Q35; 35B65; 76N10; 35M10; 35B40; 35C20; 76T30 ACM Class: G.1.8

Transchromatic phenomena in the equivariant slice spectral sequence

Authors: Lennart Meier, XiaoLin Danny Shi, Mingcong Zeng

Abstract: In this paper, we prove a transchromatic phenomenon for Hill--Hopkins--Ravenel and Lubin--Tate theories. This establishes a direct relationship between the equivariant slice spectral sequences of height-$h$ and height-$(h/2)$ theories. As applications of this transchromatic phenomenon, we prove periodicity and vanishing line results for these theories. In this paper, we prove a transchromatic phenomenon for Hill--Hopkins--Ravenel and Lubin--Tate theories. This establishes a direct relationship between the equivariant slice spectral sequences of height-$h$ and height-$(h/2)$ theories. As applications of this transchromatic phenomenon, we prove periodicity and vanishing line results for these theories. △ Less

Submitted 1 March, 2024; originally announced March 2024.

Comments: 47 pages, 7 figures. Comments welcome!

Near-Optimal Convex Simple Bilevel Optimization with a Bisection Method

Authors: Jiulin Wang, Xu Shi, Rujun Jiang

Abstract: This paper studies a class of simple bilevel optimization problems where we minimize a composite convex function at the upper-level subject to a composite convex lower-level problem. Existing methods either provide asymptotic guarantees for the upper-level objective or attain slow sublinear convergence rates. We propose a bisection algorithm to find a solution that is $ε_f$-optimal for the upper-l… ▽ More This paper studies a class of simple bilevel optimization problems where we minimize a composite convex function at the upper-level subject to a composite convex lower-level problem. Existing methods either provide asymptotic guarantees for the upper-level objective or attain slow sublinear convergence rates. We propose a bisection algorithm to find a solution that is $ε_f$-optimal for the upper-level objective and $ε_g$-optimal for the lower-level objective. In each iteration, the binary search narrows the interval by assessing inequality system feasibility. Under mild conditions, the total operation complexity of our method is ${\tilde {\mathcal{O}}}\left(\max\{\sqrt{L_{f_1}/ε_f},\sqrt{L_{g_1}/ε_g} \} \right)$. Here, a unit operation can be a function evaluation, gradient evaluation, or the invocation of the proximal mapping, $L_{f_1}$ and $L_{g_1}$ are the Lipschitz constants of the upper- and lower-level objectives' smooth components, and ${\tilde {\mathcal{O}}}$ hides logarithmic terms. Our approach achieves a near-optimal rate, matching the optimal rate in unconstrained smooth or composite convex optimization when disregarding logarithmic terms. Numerical experiments demonstrate the effectiveness of our method. △ Less

Submitted 4 March, 2024; v1 submitted 8 February, 2024; originally announced February 2024.

Comments: Accepted to AISTATS2024

Penalty-based Methods for Simple Bilevel Optimization under Hölderian Error Bounds

Authors: Pengyu Chen, Xu Shi, Rujun Jiang, Jiulin Wang

Abstract: This paper investigates simple bilevel optimization problems where we minimize an upper-level objective over the optimal solution set of a convex lower-level objective. Existing methods for such problems either only guarantee asymptotic convergence, have slow sublinear rates, or require strong assumptions. To address these challenges, we propose a penalization framework that delineates the relatio… ▽ More This paper investigates simple bilevel optimization problems where we minimize an upper-level objective over the optimal solution set of a convex lower-level objective. Existing methods for such problems either only guarantee asymptotic convergence, have slow sublinear rates, or require strong assumptions. To address these challenges, we propose a penalization framework that delineates the relationship between approximate solutions of the original problem and its reformulated counterparts. This framework accommodates varying assumptions regarding smoothness and convexity, enabling the application of specific methods with different complexity results. Specifically, when both upper- and lower-level objectives are composite convex functions, under an $α$-H{ö}lderian error bound condition and certain mild assumptions, our algorithm attains an $(ε,ε^β)$-optimal solution of the original problem for any $β> 0$ within $\mathcal{O}\left(\sqrt{{1}/{ε^{\max\{α,β\}}}}\right)$ iterations. The result can be improved further if the smooth part of the upper-level objective is strongly convex. We also establish complexity results when the upper- and lower-level objectives are general nonsmooth functions. Numerical experiments demonstrate the effectiveness of our algorithms. △ Less

Submitted 1 November, 2024; v1 submitted 3 February, 2024; originally announced February 2024.

Comments: Accepted by NeurIPS 2024

Controlling the occurrence sequence of reaction modules through biochemical relaxation oscillators

Authors: Xiaopeng Shi, Chuanhou Gao, Denis Dochain

Abstract: Embedding sequential computations in biochemical environments is challenging because the computations are carried out by chemical reactions, which are inherently disordered. In this paper we apply modular design to specific calculations through chemical reactions and provide a design scheme of biochemical oscillator models in order to generate periodical species for the order regulation of these r… ▽ More Embedding sequential computations in biochemical environments is challenging because the computations are carried out by chemical reactions, which are inherently disordered. In this paper we apply modular design to specific calculations through chemical reactions and provide a design scheme of biochemical oscillator models in order to generate periodical species for the order regulation of these reaction modules. We take the case of arbitrary multi-module regulation into consideration, analyze the main errors in the regulation process under \textit{mass-action kinetics} and demonstrate our design scheme under existing synthetic biochemical oscillator models. △ Less

Submitted 3 January, 2024; originally announced January 2024.

Thermodynamic formalism for subsystems of expanding Thurston maps and large deviations asymptotics

Authors: Zhiqiang Li, Xianghui Shi, Yiwei Zhang

Abstract: Expanding Thurston maps were introduced by M. Bonk and D. Meyer with motivation from complex dynamics and Cannon's conjecture from geometric group theory via Sullivan's dictionary. In this paper, we introduce subsystems of expanding Thurston maps motivated via Sullivan's dictionary as analogs of some subgroups of Kleinian groups. We use thermodynamic formalism to prove the Variational Principle an… ▽ More Expanding Thurston maps were introduced by M. Bonk and D. Meyer with motivation from complex dynamics and Cannon's conjecture from geometric group theory via Sullivan's dictionary. In this paper, we introduce subsystems of expanding Thurston maps motivated via Sullivan's dictionary as analogs of some subgroups of Kleinian groups. We use thermodynamic formalism to prove the Variational Principle and the existence of equilibrium states for strongly irreducible subsystems and real-valued Hölder continuous potentials. Here, the sphere $S^{2}$ is equipped with a natural metric, called a visual metric, introduced by M. Bonk and D. Meyer. As an application, we establish large deviation asymptotics for expanding Thurston maps. △ Less

Submitted 28 December, 2024; v1 submitted 25 December, 2023; originally announced December 2023.

Comments: 67 pages, 4 figures. Minor polish, final published version

MSC Class: Primary: 37F10; Secondary: 37D35; 37C30; 37F20; 37F15; 37B99; 57M12

Journal ref: Proc. Lond. Math. Soc. (3) 130, 2025, e70019. 77 pages

A Proximal Gradient Method With Probabilistic Multi-Gossip Communications for Decentralized Composite Optimization

Authors: Luyao Guo, Luqing Wang, Xinli Shi, Jinde Cao

Abstract: Decentralized optimization methods with local updates have recently gained attention for their provable ability to communication acceleration. In these methods, nodes perform several iterations of local computations between the communication rounds. Nevertheless, this capability is effective only when the loss function is smooth and the network is sufficiently well-connected. In this paper, we pro… ▽ More Decentralized optimization methods with local updates have recently gained attention for their provable ability to communication acceleration. In these methods, nodes perform several iterations of local computations between the communication rounds. Nevertheless, this capability is effective only when the loss function is smooth and the network is sufficiently well-connected. In this paper, we propose a communication-efficient method MG-Skip with probabilistic local updates and multi-gossip communications for decentralized composite (smooth + nonsmooth) optimization, whose stepsize is independent of the number of local updates and the network topology. Without any additional condition for network connectivity, MG-Skip allows for the multi-gossip communications to be skipped in most iterations in the strongly convex setting, while its iteration complexity is $\mathcal{O}\left(κ\log \frac{1}ε\right)$ and communication complexity is only $\mathcal{O}\left(\sqrt{\fracκ{(1-ρ)}} \log \frac{1}ε\right)$, where $κ$ is the condition number of the loss function, $ρ$ reflects the connectivity of the network topology, and $ε$ is the target accuracy. The theoretical results demonstrate that MG-Skip achieves the optimal communication complexity and confirm the benefits of local updates in the nonsmooth setup. △ Less

Submitted 27 October, 2024; v1 submitted 19 December, 2023; originally announced December 2023.

Fixed-Time Gradient Flows for Solving Constrained Optimization: A Unified Approach

Authors: Xinli Shi, Xiangping Xu, Guanghui Wen, Jinde Cao

Abstract: The accelerated method in solving optimization problems has always been an absorbing topic. Based on the fixed-time (FxT) stability of nonlinear dynamical systems, we provide a unified approach for designing FxT gradient flows (FxTGFs). First, a general class of nonlinear functions in designing FxTGFs is provided. A unified method for designing first-order FxTGFs is shown under PolyakL jasiewicz i… ▽ More The accelerated method in solving optimization problems has always been an absorbing topic. Based on the fixed-time (FxT) stability of nonlinear dynamical systems, we provide a unified approach for designing FxT gradient flows (FxTGFs). First, a general class of nonlinear functions in designing FxTGFs is provided. A unified method for designing first-order FxTGFs is shown under PolyakL jasiewicz inequality assumption, a weaker condition than strong convexity. When there exist both bounded and vanishing disturbances in the gradient flow, a specific class of nonsmooth robust FxTGFs with disturbance rejection is presented. Under the strict convexity assumption, Newton-based FxTGFs is given and further extended to solve time-varying optimization. Besides, the proposed FxTGFs are further used for solving equation-constrained optimization. Moreover, an FxT proximal gradient flow with a wide range of parameters is provided for solving nonsmooth composite optimization. To show the effectiveness of various FxTGFs, the static regret analysis for several typical FxTGFs are also provided in detail. Finally, the proposed FxTGFs are applied to solve two network problems, i.e., the network consensus problem and solving a system linear equations, respectively, from the respective of optimization. Particularly, by choosing component-wisely sign-preserving functions, these problems can be solved in a distributed way, which extends the existing results. The accelerated convergence and robustness of the proposed FxTGFs are validated in several numerical examples stemming from practical applications. △ Less

Submitted 12 November, 2023; originally announced November 2023.

Comparison theorems for multi-dimensional BSDEs with jumps and applications to constrained stochastic linear-quadratic control

Authors: Ying Hu, Xiaomin Shi, Zuo Quan Xu

Abstract: In this paper, we, for the first time, establish two comparison theorems for multi-dimensional backward stochastic differential equations with jumps. Our approach is novel and completely different from the existing results for one-dimensional case. Using these and other delicate tools, we then construct solutions to coupled two-dimensional stochastic Riccati equation with jumps in both standard an… ▽ More In this paper, we, for the first time, establish two comparison theorems for multi-dimensional backward stochastic differential equations with jumps. Our approach is novel and completely different from the existing results for one-dimensional case. Using these and other delicate tools, we then construct solutions to coupled two-dimensional stochastic Riccati equation with jumps in both standard and singular cases. In the end, these results are applied to solve a cone-constrained stochastic linear-quadratic and a mean-variance portfolio selection problem with jumps. Different from no jump problems, the optimal (relative) state processes may change their signs, which is of course due to the presence of jumps. △ Less

Submitted 11 November, 2023; originally announced November 2023.

A stratification of the equivariant slice filtration

Authors: Lennart Meier, XiaoLin Danny Shi, Mingcong Zeng

Abstract: In this paper, we construct a stratification tower for the equivariant slice filtration. This tower stratifies the slice spectral sequence of a $G$-spectrum $X$ into distinct regions. Within each of these regions, the differentials are determined by the localized slice spectral sequences, which compute the geometric fixed points along with their associated residue group actions. Consequently, the… ▽ More In this paper, we construct a stratification tower for the equivariant slice filtration. This tower stratifies the slice spectral sequence of a $G$-spectrum $X$ into distinct regions. Within each of these regions, the differentials are determined by the localized slice spectral sequences, which compute the geometric fixed points along with their associated residue group actions. Consequently, the stratification tower offers an inductive method of understanding the entirety of the equivariant slice spectral sequence of $X$ by examining each of its distinct stratification regions. △ Less

Submitted 9 March, 2024; v1 submitted 18 October, 2023; originally announced October 2023.

Comments: 26 pages, 10 figures. Comments welcome!

An Efficient Resilient MPC Scheme via Constraint Tightening against Cyberattacks: Application to Vehicle Cruise Control

Authors: Milad Farsi, Shuhao Bian, Nasser L. Azad, Xiaobing Shi, Andrew Walenstein

Abstract: We propose a novel framework for designing a resilient Model Predictive Control (MPC) targeting uncertain linear systems under cyber attack. Assuming a periodic attack scenario, we model the system under Denial of Service (DoS) attack, also with measurement noise, as an uncertain linear system with parametric and additive uncertainty. To detect anomalies, we employ a Kalman filter-based approach.… ▽ More We propose a novel framework for designing a resilient Model Predictive Control (MPC) targeting uncertain linear systems under cyber attack. Assuming a periodic attack scenario, we model the system under Denial of Service (DoS) attack, also with measurement noise, as an uncertain linear system with parametric and additive uncertainty. To detect anomalies, we employ a Kalman filter-based approach. Then, through our observations of the intensity of the launched attack, we determine a range of possible values for the system matrices, as well as establish bounds of the additive uncertainty for the equivalent uncertain system. Leveraging a recent constraint tightening robust MPC method, we present an optimization-based resilient algorithm. Accordingly, we compute the uncertainty bounds and corresponding constraints offline for various attack magnitudes. Then, this data can be used efficiently in the MPC computations online. We demonstrate the effectiveness of the developed framework on the Adaptive Cruise Control (ACC) problem. △ Less

Submitted 12 October, 2023; originally announced October 2023.

Comments: To Appear in ICINCO 2023

Extended Zero-Gradient-Sum Approach for Constrained Distributed Optimization with Free Initialization

Authors: Xinli Shi, Xinghuo Yu, Guanghui Wen, Xiangping Xu

Abstract: This paper proposes an extended zero-gradient-sum (EZGS) approach for solving constrained distributed optimization (DO) with free initialization. A Newton-based continuous-time algorithm (CTA) is first designed for general constrained optimization and then extended to solve constrained DO based on the EZGS method. It is shown that for typical consensus protocols, the EZGS CTA can achieve the perfo… ▽ More This paper proposes an extended zero-gradient-sum (EZGS) approach for solving constrained distributed optimization (DO) with free initialization. A Newton-based continuous-time algorithm (CTA) is first designed for general constrained optimization and then extended to solve constrained DO based on the EZGS method. It is shown that for typical consensus protocols, the EZGS CTA can achieve the performance with exponential/finite/fixed/prescribed-time convergence. Particularly, the nonlinear consensus protocols for finite-time EZGS algorithms can have heterogeneous power coefficients. The prescribed-time EZGS dynamics is continuous and uniformly bounded, which can achieve the optimal solution in one stage. Moreover, the barrier method is employed to tackle the inequality constraints. Finally, the performance of the proposed algorithms is verified by numerical examples. △ Less

Submitted 2 June, 2024; v1 submitted 25 August, 2023; originally announced August 2023.

Comments: This work has been submitted to the IEEE for possible publication

Nonlinear Controller Design for a Quadrotor with Inverted Pendulum

Authors: Xichen Shi, Yashwanth Kumar Nakka

Abstract: The quadrotor is a $6$ degrees-of-freedom (DoF) system with underactuation. Adding a spherical pendulum on top of a quadrotor further complicates the task of achieving any output tracking while stabilizing the rest. In this report, we present different types of controllers for the nonlinear dynamical system of quadrotor and pendulum combination, utilizing feedback-linearization and control Lyapuno… ▽ More The quadrotor is a $6$ degrees-of-freedom (DoF) system with underactuation. Adding a spherical pendulum on top of a quadrotor further complicates the task of achieving any output tracking while stabilizing the rest. In this report, we present different types of controllers for the nonlinear dynamical system of quadrotor and pendulum combination, utilizing feedback-linearization and control Lyapunov function with quadratic programming (CLF-QP) approaches. We demonstrated trajectory tracking for quadrotor-only case as well as quadrotor-pendulum-combined case. △ Less

Submitted 4 August, 2023; originally announced August 2023.

Comments: This work was done as part of a course project for CDS 233 at Caltech

Top-Two Thompson Sampling for Contextual Top-mc Selection Problems

Authors: Xinbo Shi, Yijie Peng, Gongbo Zhang

Abstract: We aim to efficiently allocate a fixed simulation budget to identify the top-mc designs for each context among a finite number of contexts. The performance of each design under a context is measured by an identifiable statistical characteristic, possibly with the existence of nuisance parameters. Under a Bayesian framework, we extend the top-two Thompson sampling method designed for selecting the… ▽ More We aim to efficiently allocate a fixed simulation budget to identify the top-mc designs for each context among a finite number of contexts. The performance of each design under a context is measured by an identifiable statistical characteristic, possibly with the existence of nuisance parameters. Under a Bayesian framework, we extend the top-two Thompson sampling method designed for selecting the best design in a single context to the contextual top-mc selection problems, leading to an efficient sampling policy that simultaneously allocates simulation samples to both contexts and designs. To demonstrate the asymptotic optimality of the proposed sampling policy, we characterize the exponential convergence rate of the posterior distribution for a wide range of identifiable sampling distribution families. The proposed sampling policy is proved to be consistent, and asymptotically satisfies a necessary condition for optimality. In particular, when selecting contextual best designs (i.e., mc = 1), the proposed sampling policy is proved to be asymptotically optimal. Numerical experiments demonstrate the good finite sample performance of the proposed sampling policy. △ Less

Submitted 30 June, 2023; originally announced June 2023.

MSC Class: 62F07 (Primary) 62C10; 62L10 (Secondary)

Multivariate two-sample test statistics based on data depth

Authors: Yiting Chen, Wei Lin, Xiaoping Shi

Abstract: Data depth has been applied as a nonparametric measurement for ranking multivariate samples. In this paper, we focus on homogeneity tests to assess whether two multivariate samples are from the same distribution. There are many data depth-based tests for this problem, but they may not be very powerful, or have unknown asymptotic distributions, or have slow convergence rates to asymptotic distribut… ▽ More Data depth has been applied as a nonparametric measurement for ranking multivariate samples. In this paper, we focus on homogeneity tests to assess whether two multivariate samples are from the same distribution. There are many data depth-based tests for this problem, but they may not be very powerful, or have unknown asymptotic distributions, or have slow convergence rates to asymptotic distributions. Given the recent development of data depth as an important measure in quality assurance, we propose three new test statistics for multivariate two-sample homogeneity tests. The proposed minimum test statistics have simple asymptotic half-normal distribution. We also discuss the generalization of the proposed tests to multiple samples. The simulation study demonstrates the superior performance of the proposed tests. The test procedure is illustrated by two real data examples. △ Less

Submitted 7 June, 2023; originally announced June 2023.

Chemical relaxation oscillator designed to control molecular computation

Authors: Xiaopeng Shi, Chuanhou Gao, Denis Dochain

Abstract: Embedding efficient calculation instructions into biochemical system has always been a research focus in synthetic biology. One of the key problems is how to sequence the chemical reaction modules that act as units of computation and make them alternate spontaneously. Our work takes the design of chemical clock signals as a solution and presents a $4$-dimensional chemical oscillator model based on… ▽ More Embedding efficient calculation instructions into biochemical system has always been a research focus in synthetic biology. One of the key problems is how to sequence the chemical reaction modules that act as units of computation and make them alternate spontaneously. Our work takes the design of chemical clock signals as a solution and presents a $4$-dimensional chemical oscillator model based on relaxation oscillation to generate a pair of symmetric clock signals for two-module regulation. We give detailed dynamical analysis of the model and discuss how to control the period and occurrence order of clock signals. We also demonstrate the loop control of molecular computations and provide termination strategy for them. We can expect that our design for module regulation and loop termination will help advance the embedding of more complicate calculations into biochemical environments. △ Less

Submitted 27 February, 2023; originally announced February 2023.

Decentralized Inexact Proximal Gradient Method With Network-Independent Stepsizes for Convex Composite Optimization

Authors: Luyao Guo, Xinli Shi, Jinde Cao, Zihao Wang

Abstract: This paper proposes a novel CTA (Combine-Then-Adapt)-based decentralized algorithm for solving convex composite optimization problems over undirected and connected networks. The local loss function in these problems contains both smooth and nonsmooth terms. The proposed algorithm uses uncoordinated network-independent constant stepsizes and only needs to approximately solve a sequence of proximal… ▽ More This paper proposes a novel CTA (Combine-Then-Adapt)-based decentralized algorithm for solving convex composite optimization problems over undirected and connected networks. The local loss function in these problems contains both smooth and nonsmooth terms. The proposed algorithm uses uncoordinated network-independent constant stepsizes and only needs to approximately solve a sequence of proximal mappings, which is advantageous for solving decentralized composite optimization problems where the proximal mappings of the nonsmooth loss functions may not have analytical solutions. For the general convex case, we prove an O(1/k) convergence rate of the proposed algorithm, which can be improved to o(1/k) if the proximal mappings are solved exactly. Furthermore, with metric subregularity, we establish a linear convergence rate for the proposed algorithm. Numerical experiments demonstrate the efficiency of the algorithm. △ Less

Submitted 4 March, 2023; v1 submitted 6 February, 2023; originally announced February 2023.

Constrained monotone mean-variance problem with random coefficients

Authors: Ying Hu, Xiaomin Shi, Zuo Quan Xu

Abstract: This paper studies the monotone mean-variance (MMV) problem and the classical mean-variance (MV) problem with convex cone trading constraints in a market with random coefficients. We provide semiclosed optimal strategies and optimal values for both problems via certain backward stochastic differential equations (BSDEs). After noting the links between these BSDEs, we find that the two problems shar… ▽ More This paper studies the monotone mean-variance (MMV) problem and the classical mean-variance (MV) problem with convex cone trading constraints in a market with random coefficients. We provide semiclosed optimal strategies and optimal values for both problems via certain backward stochastic differential equations (BSDEs). After noting the links between these BSDEs, we find that the two problems share the same optimal portfolio and optimal value. This generalizes the result of Shen and Zou $[$ SIAM J. Financial Math., 13 (2022), pp. SC99-SC112$]$ from deterministic coefficients to random ones. △ Less

Submitted 23 August, 2023; v1 submitted 29 December, 2022; originally announced December 2022.

Differentially Private Decentralized Optimization with Relay Communication

Authors: Luqing Wang, Luyao Guo, Shaofu Yang, Xinli Shi

Abstract: Security concerns in large-scale networked environments are becoming increasingly critical. To further improve the algorithm security from the design perspective of decentralized optimization algorithms, we introduce a new measure: Privacy Leakage Frequency (PLF), which reveals the relationship between communication and privacy leakage of algorithms, showing that lower PLF corresponds to lower pri… ▽ More Security concerns in large-scale networked environments are becoming increasingly critical. To further improve the algorithm security from the design perspective of decentralized optimization algorithms, we introduce a new measure: Privacy Leakage Frequency (PLF), which reveals the relationship between communication and privacy leakage of algorithms, showing that lower PLF corresponds to lower privacy budgets. Based on such assertion, a novel differentially private decentralized primal--dual algorithm named DP-RECAL is proposed to take advantage of operator splitting method and relay communication mechanism to experience less PLF so as to reduce the overall privacy budget. To the best of our knowledge, compared with existing differentially private algorithms, DP-RECAL presents superior privacy performance and communication complexity. In addition, with uncoordinated network-independent stepsizes, we prove the convergence of DP-RECAL for general convex problems and establish a linear convergence rate under the metric subregularity. Evaluation analysis on least squares problem and numerical experiments on real-world datasets verify our theoretical results and demonstrate that DP-RECAL can defend some classical gradient leakage attacks. △ Less

Submitted 13 December, 2024; v1 submitted 21 December, 2022; originally announced December 2022.

BALPA: A Balanced Primal-Dual Algorithm for Nonsmooth Optimization with Application to Distributed Optimization

Authors: Luyao Guo, Jinde Cao, Xinli Shi, Shaofu Yang

Abstract: In this paper, we propose a novel primal-dual proximal splitting algorithm (PD-PSA), named BALPA, for the composite optimization problem with equality constraints, where the loss function consists of a smooth term and a nonsmooth term composed with a linear mapping. In BALPA, the dual update is designed as a proximal point for a time-varying quadratic function, which balances the implementation of… ▽ More In this paper, we propose a novel primal-dual proximal splitting algorithm (PD-PSA), named BALPA, for the composite optimization problem with equality constraints, where the loss function consists of a smooth term and a nonsmooth term composed with a linear mapping. In BALPA, the dual update is designed as a proximal point for a time-varying quadratic function, which balances the implementation of primal and dual update and retains the proximity-induced feature of classic PD-PSAs. In addition, by this balance, BALPA eliminates the inefficiency of classic PD-PSAs for composite optimization problems in which the Euclidean norm of the linear mapping or the equality constraint mapping is large. Therefore, BALPA not only inherits the advantages of simple structure and easy implementation of classic PD-PSAs but also ensures a fast convergence when these norms are large. Moreover, we propose a stochastic version of BALPA (S-BALPA) and apply the developed BALPA to distributed optimization to devise a new distributed optimization algorithm. Furthermore, a comprehensive convergence analysis for BALPA and S-BALPA is conducted, respectively. Finally, numerical experiments demonstrate the efficiency of the proposed algorithms. △ Less

Submitted 6 December, 2022; originally announced December 2022.

Optimal consumption-investment with coupled constraints on consumption and investment strategies in a regime switching market with random coefficients

Authors: Ying Hu, Xiaomin Shi, Zuo Quan Xu

Abstract: This paper studies finite-time optimal consumption-investment problems with power, logarithmic and exponential utilities, in a regime switching market with random coefficients, subject to coupled constraints on the consumption and investment strategies. We provide explicit optimal consumption-investment strategies and optimal values for the problems in terms of the solutions to some diagonally qua… ▽ More This paper studies finite-time optimal consumption-investment problems with power, logarithmic and exponential utilities, in a regime switching market with random coefficients, subject to coupled constraints on the consumption and investment strategies. We provide explicit optimal consumption-investment strategies and optimal values for the problems in terms of the solutions to some diagonally quadratic backward stochastic differential equation (BSDE) systems and linear BSDE systems with unbound coefficients. Some of these BSDEs are new in the literature and solving them is one of the main theoretical contributions of this paper. We accomplish the latter by applying the truncation, approximation technique to get some a priori uniformly lower and upper bounds for their solutions. △ Less

Submitted 9 November, 2022; originally announced November 2022.

Accurate control to run and stop chemical reactions via relaxation oscillators

Authors: Xiaopeng Shi, Chuanhou Gao, Denis Dochain

Abstract: Regulation of multiple reaction modules is quite common in molecular computation and deep learning networks construction through chemical reactions, as is always a headache for that sequential execution of modules goes against the intrinsically parallel nature of chemical reactions. Precisely switching multiple reaction modules both on and off acts as the core role in programming chemical reaction… ▽ More Regulation of multiple reaction modules is quite common in molecular computation and deep learning networks construction through chemical reactions, as is always a headache for that sequential execution of modules goes against the intrinsically parallel nature of chemical reactions. Precisely switching multiple reaction modules both on and off acts as the core role in programming chemical reaction systems. Unlike setting up physical compartments or adding human intervention signals, we adopt the idea of chemical oscillators based on relaxation oscillation, and assign corresponding clock signal components into the modules that need to be regulated. This paper mainly demonstrates the design process of oscillators under the regulation task of three modules, and provides a suitable approach for automatic termination of the modules cycle. We provide the simulation results at the level of ordinary differential equation and ensure that equations can be translated into corresponding chemical reaction networks. △ Less

Submitted 5 November, 2022; originally announced November 2022.

Sharp Interface Limit for Compressible Immiscible Two-Phase Dynamics with Relaxation

Authors: Yazhou Chen, Yi Peng, Qiaolin He, Xiaoding Shi

Abstract: In this paper, the compressible immiscible two-phase flow with relaxation is investigated, this model can be regarded as a natural modification of Jin-Xin relaxation scheme proposed and developed by S.Jin and Z.P.Xin([Comm.Pure Appl.Math., 48,1995]) in view of the numerical approximation of conservation laws. Given any entropy solution consists of two different families of shocks interacting at so… ▽ More In this paper, the compressible immiscible two-phase flow with relaxation is investigated, this model can be regarded as a natural modification of Jin-Xin relaxation scheme proposed and developed by S.Jin and Z.P.Xin([Comm.Pure Appl.Math., 48,1995]) in view of the numerical approximation of conservation laws. Given any entropy solution consists of two different families of shocks interacting at some positive time for the standard two-phase compressible Euler equations, it is proved that such entropy solution is the sharp interface limit for a family global strong solutions of the modified Jin-Xin relaxation scheme for Navier-Stokes/Allen-Cahn system, here the relaxation time is selected as the thickness of the interface, weighted estimation and improved antiderivative method are used in the proof. Moreover, the simulation results are given by this modified Jin-Xin relaxation scheme method. Both numerical and theoretical results show that, the interacting shock waves can pass through the interface without any effect. △ Less

Submitted 17 October, 2022; originally announced October 2022.

Comments: 25 pages, 9 figures

MSC Class: Sharp Interface Limit; Compressible Immiscible Two-Phase Dynamics; Shock Wave; Rarefaction Wave; Jin-Xin Relaxation

Finite-Time Convergent Algorithms for Time-Varying Distributed Optimization

Authors: Xinli Shi, Guanghui Wen, Xinghuo Yu

Abstract: This paper focuses on finite-time (FT) convergent distributed algorithms for solving time-varying (TV) distributed optimization (TVDO). The objective is to minimize the sum of local TV cost functions subject to the possible TV constraints by the coordination of multiple agents in finite time. Specifically, two classes of TVDO are investigated included unconstrained distributed consensus optimizati… ▽ More This paper focuses on finite-time (FT) convergent distributed algorithms for solving time-varying (TV) distributed optimization (TVDO). The objective is to minimize the sum of local TV cost functions subject to the possible TV constraints by the coordination of multiple agents in finite time. Specifically, two classes of TVDO are investigated included unconstrained distributed consensus optimization and distributed optimal resource allocation problems (DORAP) with both TV cost functions and coupled equation constraints. For the previous one, based on non-smooth analysis, a continuous-time distributed discontinuous dynamics with FT convergence is proposed based on an extended zero-gradient-sum method with a local auxiliary subsystem. Then, an FT convergent distributed dynamics is further obtained for TV-DORAP by dual transformation. Particularly, the inversion of the cost functions' Hessians is not required in the dual variables' dynamics, while another local optimization needs to be solved to obtain the primal variable at each time instant. Finally, two numerical examples are conducted to verify the proposed algorithms. △ Less

Submitted 1 September, 2023; v1 submitted 8 October, 2022; originally announced October 2022.

Design of universal chemical relaxation oscillator to control molecular computation

Authors: Xiaopeng Shi, Chuanhou Gao

Abstract: Embedding efficient command operation into biochemical system has always been a research focus in synthetic biology. One of the key problems is how to sequence the chemical reactions that act as units of computation. The answer is to design chemical oscillator, a component that acts as a clock signal to turn corresponding reaction on or off. Some previous work mentioned the use of chemical oscilla… ▽ More Embedding efficient command operation into biochemical system has always been a research focus in synthetic biology. One of the key problems is how to sequence the chemical reactions that act as units of computation. The answer is to design chemical oscillator, a component that acts as a clock signal to turn corresponding reaction on or off. Some previous work mentioned the use of chemical oscillations. However, the models used either lack a systematic analysis of the mechanism and properties of oscillation, or are too complex to be tackled with in practice. Our work summarizes the universal process for designing chemical oscillators, including generating robust oscillatory species, constructing clock signals from these species, and setting up termination component to eventually end the loop of whole reaction modules. We analyze the dynamic properties of the proposed oscillator model in the context of ordinary differential equations, and discuss how to determine parameters for the effect we want in detail. Our model corresponds to abstract chemical reactions based on mass-action kinetics which are expected to be implemented into chemistry with the help of DNA strand displacement cascades. Our consideration of ordering chemical reaction modules helps advance the embedding of more complex calculations into biochemical environments. △ Less

Submitted 7 September, 2022; originally announced September 2022.

DISA: A Dual Inexact Splitting Algorithm for Distributed Convex Composite Optimization

Authors: Luyao Guo, Xinli Shi, Shaofu Yang, Jinde Cao

Abstract: In this paper, we propose a novel Dual Inexact Splitting Algorithm (DISA) for distributed convex composite optimization problems, where the local loss function consists of a smooth term and a possibly nonsmooth term composed with a linear mapping. DISA, for the first time, eliminates the dependence of the convergent step-size range on the Euclidean norm of the linear mapping, while inheriting the… ▽ More In this paper, we propose a novel Dual Inexact Splitting Algorithm (DISA) for distributed convex composite optimization problems, where the local loss function consists of a smooth term and a possibly nonsmooth term composed with a linear mapping. DISA, for the first time, eliminates the dependence of the convergent step-size range on the Euclidean norm of the linear mapping, while inheriting the advantages of the classic Primal-Dual Proximal Splitting Algorithm (PD-PSA): simple structure and easy implementation. This indicates that DISA can be executed without prior knowledge of the norm, and tiny step-sizes can be avoided when the norm is large. Additionally, we prove sublinear and linear convergence rates of DISA under general convexity and metric subregularity, respectively. Moreover, we provide a variant of DISA with approximate proximal mapping and prove its global convergence and sublinear convergence rate. Numerical experiments corroborate our theoretical analyses and demonstrate a significant acceleration of DISA compared to existing PD-PSAs. △ Less

Submitted 22 April, 2023; v1 submitted 5 September, 2022; originally announced September 2022.

Vanishing lines in chromatic homotopy theory

Authors: Zhipeng Duan, Guchuan Li, XiaoLin Danny Shi

Abstract: We show that at the prime 2, for any height $h$ and any finite subgroup $G \subset \mathbb{G}_h$ of the Morava stabilizer group, the $RO(G)$-graded homotopy fixed point spectral sequence for the Lubin--Tate spectrum $E_h$ has a strong horizontal vanishing line of filtration $N_{h, G}$, a specific number depending on $h$ and $G$. It is a consequence of the nilpotence theorem that such homotopy fixe… ▽ More We show that at the prime 2, for any height $h$ and any finite subgroup $G \subset \mathbb{G}_h$ of the Morava stabilizer group, the $RO(G)$-graded homotopy fixed point spectral sequence for the Lubin--Tate spectrum $E_h$ has a strong horizontal vanishing line of filtration $N_{h, G}$, a specific number depending on $h$ and $G$. It is a consequence of the nilpotence theorem that such homotopy fixed point spectral sequences all admit strong horizontal vanishing lines at some finite filtration. Here, we establish specific bounds for them. Our bounds are sharp for all the known computations of $E_h^{hG}$. Our approach involves investigating the effect of the Hill--Hopkins--Ravenel norm functor on the slice differentials. As a result, we also show that the $RO(G)$-graded slice spectral sequence for $(N_{C_2}^{G}\bar{v}_h)^{-1}BP^{(\!(G)\!)}$ shares the same horizontal vanishing line at filtration $N_{h, G}$. As an application, we utilize this vanishing line to establish a bound on the orientation order $Θ(h, G)$, the smallest number such that the $Θ(h, G)$-fold direct sum of any real vector bundle is $E_h^{hG}$-orientable. △ Less

Submitted 1 August, 2024; v1 submitted 18 April, 2022; originally announced April 2022.

Comments: 23 pages, accepted version. To appear in Geometry & Topology

Report number: MPIM-Bonn-2022

Journal ref: Geom. Topol. 29 (2025) 903-930