Showing 1–4 of 4 results for author: Huan, S

Sparse inverse Cholesky factorization of dense kernel matrices by greedy conditional selection

Authors: Stephen Huan, Joseph Guinness, Matthias Katzfuss, Houman Owhadi, Florian Schäfer

Abstract: Dense kernel matrices resulting from pairwise evaluations of a kernel function arise naturally in machine learning and statistics. Previous work in constructing sparse approximate inverse Cholesky factors of such matrices by minimizing Kullback-Leibler divergence recovers the Vecchia approximation for Gaussian processes. These methods rely only on the geometry of the evaluation points to construct… ▽ More Dense kernel matrices resulting from pairwise evaluations of a kernel function arise naturally in machine learning and statistics. Previous work in constructing sparse approximate inverse Cholesky factors of such matrices by minimizing Kullback-Leibler divergence recovers the Vecchia approximation for Gaussian processes. These methods rely only on the geometry of the evaluation points to construct the sparsity pattern. In this work, we instead construct the sparsity pattern by leveraging a greedy selection algorithm that maximizes mutual information with target points, conditional on all points previously selected. For selecting $k$ points out of $N$, the naive time complexity is $\mathcal{O}(N k^4)$, but by maintaining a partial Cholesky factor we reduce this to $\mathcal{O}(N k^2)$. Furthermore, for multiple ($m$) targets we achieve a time complexity of $\mathcal{O}(N k^2 + N m^2 + m^3)$, which is maintained in the setting of aggregated Cholesky factorization where a selected point need not condition every target. We apply the selection algorithm to image classification and recovery of sparse Cholesky factors. By minimizing Kullback-Leibler divergence, we apply the algorithm to Cholesky factorization, Gaussian process regression, and preconditioning with the conjugate gradient, improving over $k$-nearest neighbors selection. △ Less

Submitted 8 May, 2025; v1 submitted 21 July, 2023; originally announced July 2023.

Comments: Accepted for publication in SIAM JUQ

MSC Class: 65F08; 65F55; 62-08

Existence of periodic orbits in three-dimensional piecewise linear systems

Authors: Songmei Huan, Xiao-Song Yang

Abstract: Based on the results about the invariant cones appeared in the literature this paper analyses the existence of periodic orbits in three-dimensional continuous piecewise linear homogeneous systems with two zones, and a necessary and sufficient condition for the existence of periodic orbits of such systems is given. Based on the results about the invariant cones appeared in the literature this paper analyses the existence of periodic orbits in three-dimensional continuous piecewise linear homogeneous systems with two zones, and a necessary and sufficient condition for the existence of periodic orbits of such systems is given. △ Less

Submitted 13 January, 2010; originally announced January 2010.

Comments: 17 pages, 6 figures

MSC Class: 34C25; 34C05(Secondary)

Nonstandard Hopf bifurcation in switched

Authors: Xiao-Song Yang, Songmei Huan

Abstract: This paper presents an analysis on nonstandard generalized Hopf bifurcation in a class of switched systems where the lost of stability of linearized systems is not due to the crossing of their complex conjugate eigenvalues but relevant to the switching laws between the subslystems. Thus is remarkably different from the mechanism of the Hopf bifurcation and the generalized Hopf bifurcation studie… ▽ More This paper presents an analysis on nonstandard generalized Hopf bifurcation in a class of switched systems where the lost of stability of linearized systems is not due to the crossing of their complex conjugate eigenvalues but relevant to the switching laws between the subslystems. Thus is remarkably different from the mechanism of the Hopf bifurcation and the generalized Hopf bifurcation studied in the literature. △ Less

Submitted 12 January, 2010; originally announced January 2010.

Comments: 15 pages, 5 figures

MSC Class: 34C23; 34C37(Primary) 37G99(Secondary)

Existence and bifurcation of homoclinic orbits in planar piecewise linear systems

Authors: Xiao-Song Yang, Songmei Huan

Abstract: The existence and bifurcation of homoclinic orbits in planar piecewise linear homogeneous systems with two regions separated by a discontinuity boundary are investigated in this paper. In addition, existence of periodic orbits and stability of the origin are also discussed without the assumption of continuity for the planar piecewise linear homogeneous systems. The existence and bifurcation of homoclinic orbits in planar piecewise linear homogeneous systems with two regions separated by a discontinuity boundary are investigated in this paper. In addition, existence of periodic orbits and stability of the origin are also discussed without the assumption of continuity for the planar piecewise linear homogeneous systems. △ Less

Submitted 30 June, 2009; originally announced July 2009.

Comments: 17pages,20figures

MSC Class: 34C23; 34C37(Primary) 37G99(Secondary)