Showing 1–15 of 15 results for author: Kou, C

New Lagrangian dual algorithms for solving the continuous nonlinear resource allocation problem

Authors: Kaixiang Hu, Caixia Kou, Jianhua Yuan

Abstract: The continuous nonlinear resource allocation problem (CONRAP) has broad applications in economics, engineering, production and inventory management, and often serves as a subproblem in complex programming. Without relying on monotonicity assumptions for the objective and constraint functions, we propose two Lagrangian dual algorithms for solving two types of CONRAP. Both algorithms determine an up… ▽ More The continuous nonlinear resource allocation problem (CONRAP) has broad applications in economics, engineering, production and inventory management, and often serves as a subproblem in complex programming. Without relying on monotonicity assumptions for the objective and constraint functions, we propose two Lagrangian dual algorithms for solving two types of CONRAP. Both algorithms determine an update strategy for the Lagrange multiplier, utilizing the values of the objective and constraint functions at the current and previous iterations. This strategy accelerates the process of finding dual optimal solutions. Subsequently, leveraging the problem's convexity, the primal optimal solution is either directly identified or derived by solving a one-dimensional linear equation. We also prove that both algorithms converge to optimal solutions within a finite number of iterations. Numerical experiments on six types of practical test problems illustrate the superior computational efficiency of the proposed algorithms. For test problems with a general inequality constraint, the first algorithm achieves a CPU time reduction exceeding an order of magnitude compared to solvers such as Gurobi and CVX. For test problems with a linear equality constraint, the second algorithm consistently outperforms four existing algorithms, delivering an improvement of over two orders of magnitude in computational efficiency. △ Less

Submitted 8 January, 2025; v1 submitted 4 November, 2024; originally announced November 2024.

An exact column generation algorithm for load balancing in capacity sharing networks

Authors: Kaixiang Hu, Feilong Huang, Caixia Kou

Abstract: Capacity sharing networks are typical heterogeneous communication networks widely applied in information and communications technology (ICT) field. In such networks, resources like bandwidth, spectrum, computation and storage are shared among various communication services. Meanwhile, the issue of network congestion is always a prominent challenge. To handle network congestion essentially needs to… ▽ More Capacity sharing networks are typical heterogeneous communication networks widely applied in information and communications technology (ICT) field. In such networks, resources like bandwidth, spectrum, computation and storage are shared among various communication services. Meanwhile, the issue of network congestion is always a prominent challenge. To handle network congestion essentially needs to solve the load balancing of networks. In this paper, for capacity sharing networks, we formulate their load balancing problem as a maximum multi-commodity flow problem. For such a problem, always a large-scale linear programming, the column generation algorithm is a commonly used and crucial method to solve it. In each iteration, this algorithm involves solving a linear programming subproblem and determining whether to terminate or generate a new column for inclusion in the subproblem. This iterative procedure of solving and checking continues throughout the algorithm. Nevertheless, since the checking subproblem is NP-hard, its solution significantly impacts the overall efficiency of the algorithm. In this paper, we innovatively convert the checking subproblem into a single-constrained shortest path (SCSP) subproblem. By exactly solving the SCSP subproblem, we can obtain the optimal solution to the checking subproblem with same or less computing time. Experimental results demonstrate that our algorithm achieves computational efficiency comparable to heuristic algorithms while outperforming other state-of-the-art algorithms by at least an order of magnitude. △ Less

Submitted 30 November, 2024; v1 submitted 1 November, 2024; originally announced November 2024.

The Mini-batch Stochastic Conjugate Algorithms with the unbiasedness and Minimized Variance Reduction

Authors: Feifei Gao, Caixia Kou

Abstract: We firstly propose the new stochastic gradient estimate of unbiasedness and minimized variance in this paper. Secondly, we propose the two algorithms: Algorithml and Algorithm2 which apply the new stochastic gradient estimate to modern stochastic conjugate gradient algorithms SCGA 7and CGVR 8. Then we prove that the proposed algorithms can obtain linearconvergence rate under assumptions of strong… ▽ More We firstly propose the new stochastic gradient estimate of unbiasedness and minimized variance in this paper. Secondly, we propose the two algorithms: Algorithml and Algorithm2 which apply the new stochastic gradient estimate to modern stochastic conjugate gradient algorithms SCGA 7and CGVR 8. Then we prove that the proposed algorithms can obtain linearconvergence rate under assumptions of strong convexity and smoothness. Finally, numerical experiments show that the new stochastic gradient estimatecan reduce variance of stochastic gradient effectively. And our algorithms compared SCGA and CGVR can convergent faster in numerical experimentson ridge regression model. △ Less

Submitted 1 June, 2023; originally announced June 2023.

Comments: 17 pages, 3 figures

Inference of dynamic systems from noisy and sparse data via manifold-constrained Gaussian processes

Authors: Shihao Yang, Samuel W. K. Wong, S. C. Kou

Abstract: Parameter estimation for nonlinear dynamic system models, represented by ordinary differential equations (ODEs), using noisy and sparse data is a vital task in many fields. We propose a fast and accurate method, MAGI (MAnifold-constrained Gaussian process Inference), for this task. MAGI uses a Gaussian process model over time-series data, explicitly conditioned on the manifold constraint that deri… ▽ More Parameter estimation for nonlinear dynamic system models, represented by ordinary differential equations (ODEs), using noisy and sparse data is a vital task in many fields. We propose a fast and accurate method, MAGI (MAnifold-constrained Gaussian process Inference), for this task. MAGI uses a Gaussian process model over time-series data, explicitly conditioned on the manifold constraint that derivatives of the Gaussian process must satisfy the ODE system. By doing so, we completely bypass the need for numerical integration and achieve substantial savings in computational time. MAGI is also suitable for inference with unobserved system components, which often occur in real experiments. MAGI is distinct from existing approaches as we provide a principled statistical construction under a Bayesian framework, which incorporates the ODE system through the manifold constraint. We demonstrate the accuracy and speed of MAGI using realistic examples based on physical experiments. △ Less

Submitted 21 February, 2021; v1 submitted 15 September, 2020; originally announced September 2020.

Regional gradient controllability of ultra-slow diffusions involving the Hadamard-Caputo time fractional derivative

Authors: Ruiyang Cai, Fudong Ge, YangQuan Chen, Chunhai Kou

Abstract: This paper investigates the regional gradient controllability for ultra-slow diffusion processes governed by the time fractional diffusion systems with a Hadamard-Caputo time fractional derivative. Some necessary and sufficient conditions on regional gradient exact and approximate controllability are first given and proved in detail. Secondly, we propose an approach on how to calculate the minimum… ▽ More This paper investigates the regional gradient controllability for ultra-slow diffusion processes governed by the time fractional diffusion systems with a Hadamard-Caputo time fractional derivative. Some necessary and sufficient conditions on regional gradient exact and approximate controllability are first given and proved in detail. Secondly, we propose an approach on how to calculate the minimum number of $ω-$strategic actuators. Moreover, the existence, uniqueness and the concrete form of the optimal controller for the system under consideration are presented by employing the Hilbert Uniqueness Method (HUM) among all the admissible ones. Finally, we illustrate our results by an interesting example. △ Less

Submitted 15 April, 2019; originally announced April 2019.

Comments: 16 pages

Estimating thresholding levels for random fields via Euler characteristics

Authors: Robert J. Adler, Kevin Bartz, Sam C. Kou, Anthea Monod

Abstract: We introduce Lipschitz-Killing curvature (LKC) regression, a new method to produce $(1-α)$ thresholds for signal detection in random fields that does not require knowledge of the spatial correlation structure. The idea is to fit observed empirical Euler characteristics to the Gaussian kinematic formula via generalized least squares, which quickly and easily provides statistical estimates of the LK… ▽ More We introduce Lipschitz-Killing curvature (LKC) regression, a new method to produce $(1-α)$ thresholds for signal detection in random fields that does not require knowledge of the spatial correlation structure. The idea is to fit observed empirical Euler characteristics to the Gaussian kinematic formula via generalized least squares, which quickly and easily provides statistical estimates of the LKCs --- complex topological quantities that can be extremely challenging to compute, both theoretically and numerically. With these estimates, we can then make use of a powerful parametric approximation via Euler characteristics for Gaussian random fields to generate accurate $(1-α)$ thresholds and $p$-values. The main features of our proposed LKC regression method are easy implementation, conceptual simplicity, and facilitated diagnostics, which we demonstrate in a variety of simulations and applications. △ Less

Submitted 27 April, 2017; originally announced April 2017.

Comments: 35 pages, 13 figures. 3 tables

MSC Class: 60G60; 62G32; 62E20

Regional controllability analysis of fractional diffusion equations with Riemann-Liouville time fractional derivatives

Authors: Fudong Ge, YangQuan Chen, Chunhai Kou

Abstract: This paper is concerned with the concepts of regional controllability for the Riemann-Liouville time fractional diffusion systems of order $α\in(0,1)$. The characterizations of strategic actuators to achieve regional controllability are investigated when the control inputs emerge in the differential equations as distributed inputs. In the end, an approach to guarantee the regional controllability… ▽ More This paper is concerned with the concepts of regional controllability for the Riemann-Liouville time fractional diffusion systems of order $α\in(0,1)$. The characterizations of strategic actuators to achieve regional controllability are investigated when the control inputs emerge in the differential equations as distributed inputs. In the end, an approach to guarantee the regional controllability of the problems under consideration in the considered subregion with minimum energy control is described and successfully tested through two applications. △ Less

Submitted 8 August, 2016; originally announced August 2016.

Comments: 10 pages, Accpted to appear, Automatica, 2016

MSC Class: 35R11; 93B05; 60J60 ACM Class: D.4.8, G.1.8, G.1.10

On the regional gradient observability of time fractional diffusion processes

Authors: Fudong Ge, YangQuan Chen, Chunhai Kou

Abstract: This paper for the first time addresses the concepts of regional gradient observability for the Riemann-Liouville time fractional order diffusion system in an interested subregion of the whole domain without the knowledge of the initial vector and its gradient. The Riemann-Liouville time fractional order diffusion system which replaces the first order time derivative of normal diffusion system by… ▽ More This paper for the first time addresses the concepts of regional gradient observability for the Riemann-Liouville time fractional order diffusion system in an interested subregion of the whole domain without the knowledge of the initial vector and its gradient. The Riemann-Liouville time fractional order diffusion system which replaces the first order time derivative of normal diffusion system by a Riemann-Liouville time fractional order derivative of order $α\in (0,1]$ is used to well characterize those anomalous sub-diffusion processes. The characterizations of the strategic sensors when the system under consideration is regional gradient observability are explored. We then describe an approach leading to the reconstruction of the initial gradient in the considered subregion with zero residual gradient vector. At last, to illustrate the effectiveness of our results, we present several application examples where the sensors are zone, pointwise or filament ones. △ Less

Submitted 8 August, 2016; originally announced August 2016.

Comments: 11 pages, 1 figure, Accepted to appear, Automatica, 2016

MSC Class: 35R11; 93B07; 60J60 ACM Class: G.1.6, G.1.8

Optimal shrinkage estimation of mean parameters in family of distributions with quadratic variance

Authors: Xianchao Xie, S. C. Kou, Lawrence Brown

Abstract: This paper discusses the simultaneous inference of mean parameters in a family of distributions with quadratic variance function. We first introduce a class of semiparametric/parametric shrinkage estimators and establish their asymptotic optimality properties. Two specific cases, the location-scale family and the natural exponential family with quadratic variance function, are then studied in deta… ▽ More This paper discusses the simultaneous inference of mean parameters in a family of distributions with quadratic variance function. We first introduce a class of semiparametric/parametric shrinkage estimators and establish their asymptotic optimality properties. Two specific cases, the location-scale family and the natural exponential family with quadratic variance function, are then studied in detail. We conduct a comprehensive simulation study to compare the performance of the proposed methods with existing shrinkage estimators. We also apply the method to real data and obtain encouraging results. △ Less

Submitted 30 March, 2016; originally announced March 2016.

Comments: Published at http://dx.doi.org/10.1214/15-AOS1377 in the Annals of Statistics (http://www.imstat.org/aos/) by the Institute of Mathematical Statistics (http://www.imstat.org)

Report number: IMS-AOS-AOS1377

Journal ref: Annals of Statistics 2016, Vol. 44, No. 2, 564-597

Regional boundary controllability of time fractional diffusion processes

Authors: Fudong Ge, YangQuan Chen, Chunhai Kou

Abstract: In this paper, we are concerned with the regional boundary controllability of the Riemann-Liouville time fractional diffusion systems of order $α\in (0,1]$. The characterizations of strategic actuators are established when the systems studied are regionally boundary controllable. The determination of control to achieve regional boundary controllability with minimum energy is explored. We also show… ▽ More In this paper, we are concerned with the regional boundary controllability of the Riemann-Liouville time fractional diffusion systems of order $α\in (0,1]$. The characterizations of strategic actuators are established when the systems studied are regionally boundary controllable. The determination of control to achieve regional boundary controllability with minimum energy is explored. We also show a connection between the regional internal controllability and regional boundary controllability. Several useful results for the optimal control from an implementation point of view are presented in the end. △ Less

Submitted 12 January, 2016; originally announced January 2016.

Comments: 19 pages 2figures in IMA J. Math. Control Info. 2016

MSC Class: 35R11; 93B05; 60J60

Cyber-Physical Systems as General Distributed Parameter Systems: Three Types of Fractional Order Models and Emerging Research Opportunities

Authors: Fudong Ge, YangQuan Chen, Chunhai Kou

Abstract: Cyber-physical systems (CPSs) are man-made complex systems coupled with natural processes that, as a whole, should be described by distributed parameter systems (DPSs) in general forms. This paper presents three such general models for generalized DPSs that can be used to characterize complex CPSs. These three different types of fractional operators based DPS models are: fractional Laplacian opera… ▽ More Cyber-physical systems (CPSs) are man-made complex systems coupled with natural processes that, as a whole, should be described by distributed parameter systems (DPSs) in general forms. This paper presents three such general models for generalized DPSs that can be used to characterize complex CPSs. These three different types of fractional operators based DPS models are: fractional Laplacian operator, fractional power of operator or fractional derivative. This research investigation is motivated by many fractional order models describing natural, physical, and anomalous phenomena, such as sub-diffusion process or super-diffusion process. The relationships among these three different operators are explored and explained. Several potential future research opportunities are then articulated followed by some conclusions and remarks. △ Less

Submitted 7 September, 2015; originally announced September 2015.

Comments: 12 pages, 0 figures, IEEE/CAA Journal of Automatica Sinica, 2015

MSC Class: 35R11; 68M14; 35J05

Regional controllability of anomalous diffusion generated by the time fractional diffusion equations

Authors: Fudong Ge, YangQuan Chen, Chunhai Kou

Abstract: This paper is concerned with the investigation of the regional controllability of the time fractional diffusion equations. First, some preliminaries and definitions of regional controllability of the system under consideration are introduced, which promote the existence contributions on controllability analysis. Then we analyze the regional controllability with minimum energy of the time fractiona… ▽ More This paper is concerned with the investigation of the regional controllability of the time fractional diffusion equations. First, some preliminaries and definitions of regional controllability of the system under consideration are introduced, which promote the existence contributions on controllability analysis. Then we analyze the regional controllability with minimum energy of the time fractional diffusion equations on two cases: $B\in \mathbf{L}\left(\mathbf{R}^m, L^2(Ω) \right)$ and $B\notin \mathbf{L}\left(\mathbf{R}^m, L^2(Ω) \right)$. In the end, two applications are given to illustrate our obtained results. △ Less

Submitted 31 July, 2015; originally announced August 2015.

Comments: 15 pages, conference, (Accepted to appear)

Report number: DETC2015-46697 MSC Class: 93B05; 35R11; 60J60

Rejoinder to "Equi-energy sampler with applications in statistical inference and statistical mechanics"

Authors: S. C. Kou, Qing Zhou, Wing H. Wong

Abstract: Rejoinder to ``Equi-energy sampler with applications in statistical inference and statistical mechanics'' by Kou, Zhou and Wong [math.ST/0507080] Rejoinder to ``Equi-energy sampler with applications in statistical inference and statistical mechanics'' by Kou, Zhou and Wong [math.ST/0507080] △ Less

Submitted 8 November, 2006; originally announced November 2006.

Comments: Published at http://dx.doi.org/10.1214/009053606000000524 in the Annals of Statistics (http://www.imstat.org/aos/) by the Institute of Mathematical Statistics (http://www.imstat.org)

Report number: IMS-AOS-AOS0088REJ

Journal ref: Annals of Statistics 2006, Vol. 34, No. 4, 1646-1652

From finite sample to asymptotics: A geometric bridge for selection criteria in spline regression

Authors: S. C. Kou

Abstract: This paper studies, under the setting of spline regression, the connection between finite-sample properties of selection criteria and their asymptotic counterparts, focusing on bridging the gap between the two. We introduce a bias-variance decomposition of the prediction error, using which it is shown that in the asymptotics the bias term dominates the variability term, providing an explanation… ▽ More This paper studies, under the setting of spline regression, the connection between finite-sample properties of selection criteria and their asymptotic counterparts, focusing on bridging the gap between the two. We introduce a bias-variance decomposition of the prediction error, using which it is shown that in the asymptotics the bias term dominates the variability term, providing an explanation of the gap. A geometric exposition is provided for intuitive understanding. The theoretical and geometric results are illustrated through a numerical example. △ Less

Submitted 30 August, 2005; originally announced August 2005.

Comments: Published at http://dx.doi.org/10.1214/009053604000000841 in the Annals of Statistics (http://www.imstat.org/aos/) by the Institute of Mathematical Statistics (http://www.imstat.org)

Report number: IMS-AOS-AOS279 MSC Class: 62G08 (Primary) 62G20. (Secondary)

Journal ref: Annals of Statistics 2004, Vol. 32, No. 6, 2444-2468

Equi-energy sampler with applications in statistical inference and statistical mechanics

Authors: S. C. Kou, Qing Zhou, Wing Hung Wong

Abstract: We introduce a new sampling algorithm, the equi-energy sampler, for efficient statistical sampling and estimation. Complementary to the widely used temperature-domain methods, the equi-energy sampler, utilizing the temperature--energy duality, targets the energy directly. The focus on the energy function not only facilitates efficient sampling, but also provides a powerful means for statistical… ▽ More We introduce a new sampling algorithm, the equi-energy sampler, for efficient statistical sampling and estimation. Complementary to the widely used temperature-domain methods, the equi-energy sampler, utilizing the temperature--energy duality, targets the energy directly. The focus on the energy function not only facilitates efficient sampling, but also provides a powerful means for statistical estimation, for example, the calculation of the density of states and microcanonical averages in statistical mechanics. The equi-energy sampler is applied to a variety of problems, including exponential regression in statistics, motif sampling in computational biology and protein folding in biophysics. △ Less

Submitted 8 November, 2006; v1 submitted 4 July, 2005; originally announced July 2005.

Comments: This paper discussed in: [math.ST/0611217], [math.ST/0611219], [math.ST/0611221], [math.ST/0611222]. Rejoinder in [math.ST/0611224]. Published at http://dx.doi.org/10.1214/009053606000000515 in the Annals of Statistics (http://www.imstat.org/aos/) by the Institute of Mathematical Statistics (http://www.imstat.org)

Report number: IMS-AOS-AOS0088 MSC Class: 65C05 (Primary) 65C40; 82B80; 62F15 (Secondary)

Journal ref: Annals Statist.34:1581-1619,2006