-
Birkhoff sections in 3-manifold with invariant toric foliation
Authors:
Wentian Kuang
Abstract:
In this paper, we study the Birkhoff sections in a 3-manifold foliated by invariant tori. We establish the necessary and sufficient conditions for various types of periodic orbits to serve as boundary orbits of a Birkhoff section. The construction relies on the dynamical behaviour of the flow combined with fundamental topological argument. As an application, we study the boundaries of toric domain…
▽ More
In this paper, we study the Birkhoff sections in a 3-manifold foliated by invariant tori. We establish the necessary and sufficient conditions for various types of periodic orbits to serve as boundary orbits of a Birkhoff section. The construction relies on the dynamical behaviour of the flow combined with fundamental topological argument. As an application, we study the boundaries of toric domains and the energy hypersurfaces of separable Hamiltonian systems, providing conditions for the existence or non-existence of different types of Birkhoff sections. Additionally, we offer an alternative proof of part of the results presented in [23] and [14].
△ Less
Submitted 11 May, 2025; v1 submitted 20 February, 2025;
originally announced February 2025.
-
Online Covariance Matrix Estimation in Sketched Newton Methods
Authors:
Wei Kuang,
Mihai Anitescu,
Sen Na
Abstract:
Given the ubiquity of streaming data, online algorithms have been widely used for parameter estimation, with second-order methods particularly standing out for their efficiency and robustness. In this paper, we study an online sketched Newton method that leverages a randomized sketching technique to perform an approximate Newton step in each iteration, thereby eliminating the computational bottlen…
▽ More
Given the ubiquity of streaming data, online algorithms have been widely used for parameter estimation, with second-order methods particularly standing out for their efficiency and robustness. In this paper, we study an online sketched Newton method that leverages a randomized sketching technique to perform an approximate Newton step in each iteration, thereby eliminating the computational bottleneck of second-order methods. While existing studies have established the asymptotic normality of sketched Newton methods, a consistent estimator of the limiting covariance matrix remains an open problem. We propose a fully online covariance matrix estimator that is constructed entirely from the Newton iterates and requires no matrix factorization. Compared to covariance estimators for first-order online methods, our estimator for second-order methods is batch-free. We establish the consistency and convergence rate of our estimator, and coupled with asymptotic normality results, we can then perform online statistical inference for the model parameters based on sketched Newton methods. We also discuss the extension of our estimator to constrained problems, and demonstrate its superior performance on regression problems as well as benchmark problems in the CUTEst set.
△ Less
Submitted 10 February, 2025;
originally announced February 2025.
-
Recovering sparse DFT from missing signals via interior point method on GPU
Authors:
Wei Kuang,
Alexis Montoison,
Vishwas Rao,
François Pacaud,
Mihai Anitescu
Abstract:
We propose a method to recover the sparse discrete Fourier transform (DFT) of a signal that is both noisy and potentially incomplete, with missing values. The problem is formulated as a penalized least-squares minimization based on the inverse discrete Fourier transform (IDFT) with an $\ell_1$-penalty term, reformulated to be solvable using a primal-dual interior point method (IPM). Although Krylo…
▽ More
We propose a method to recover the sparse discrete Fourier transform (DFT) of a signal that is both noisy and potentially incomplete, with missing values. The problem is formulated as a penalized least-squares minimization based on the inverse discrete Fourier transform (IDFT) with an $\ell_1$-penalty term, reformulated to be solvable using a primal-dual interior point method (IPM). Although Krylov methods are not typically used to solve Karush-Kuhn-Tucker (KKT) systems arising in IPMs due to their ill-conditioning, we employ a tailored preconditioner and establish new asymptotic bounds on the condition number of preconditioned KKT matrices. Thanks to this dedicated preconditioner -- and the fact that FFT and IFFT operate as linear operators without requiring explicit matrix materialization -- KKT systems can be solved efficiently at large scales in a matrix-free manner. Numerical results from a Julia implementation leveraging GPU-accelerated interior point methods, Krylov methods, and FFT toolkits demonstrate the scalability of our approach on problems with hundreds of millions of variables, inclusive of real data obtained from the diffuse scattering from a slightly disordered Molybdenum Vanadium Dioxide crystal.
△ Less
Submitted 6 February, 2025;
originally announced February 2025.
-
A Mean Field Ansatz for Zero-Shot Weight Transfer
Authors:
Xingyuan Chen,
Wenwei Kuang,
Lei Deng,
Wei Han,
Bo Bai,
Goncalo dos Reis
Abstract:
The pre-training cost of large language models (LLMs) is prohibitive. One cutting-edge approach to reduce the cost is zero-shot weight transfer, also known as model growth for some cases, which magically transfers the weights trained in a small model to a large model. However, there are still some theoretical mysteries behind the weight transfer. In this paper, inspired by prior applications of me…
▽ More
The pre-training cost of large language models (LLMs) is prohibitive. One cutting-edge approach to reduce the cost is zero-shot weight transfer, also known as model growth for some cases, which magically transfers the weights trained in a small model to a large model. However, there are still some theoretical mysteries behind the weight transfer. In this paper, inspired by prior applications of mean field theory to neural network dynamics, we introduce a mean field ansatz to provide a theoretical explanation for weight transfer. Specifically, we propose the row-column (RC) ansatz under the mean field point of view, which describes the measure structure of the weights in the neural network (NN) and admits a close measure dynamic. Thus, the weights of different sizes NN admit a common distribution under proper assumptions, and weight transfer methods can be viewed as sampling methods. We empirically validate the RC ansatz by exploring simple MLP examples and LLMs such as GPT-3 and Llama-3.1. We show the mean-field point of view is adequate under suitable assumptions which can provide theoretical support for zero-shot weight transfer.
△ Less
Submitted 16 August, 2024;
originally announced August 2024.
-
Periodic orbits of the Stark problem
Authors:
Ku-Jung Hsu,
Wentian Kuang
Abstract:
The Stark problem is Kepler problem with an external constant acceleration. In this paper, we study the periodic orbits for Stark problem for both planar case and spatial case. We have conducted a detailed analysis of the invariant tori and periodic orbits appearing in the Stark problem, providing a more refined characterization of the properties of the orbits. Interestingly, there exists a family…
▽ More
The Stark problem is Kepler problem with an external constant acceleration. In this paper, we study the periodic orbits for Stark problem for both planar case and spatial case. We have conducted a detailed analysis of the invariant tori and periodic orbits appearing in the Stark problem, providing a more refined characterization of the properties of the orbits. Interestingly, there exists a family of circular orbits in the spatial case, some of which are quite stable with $L$ being fixed.
△ Less
Submitted 16 May, 2024; v1 submitted 18 January, 2024;
originally announced January 2024.
-
$hp$-Multigrid preconditioner for a divergence-conforming HDG scheme for the incompressible flow problems
Authors:
Guosheng Fu,
Wenzheng Kuang
Abstract:
In this study, we present an $hp$-multigrid preconditioner for a divergence-conforming HDG scheme for the generalized Stokes and the Navier-Stokes equations using an augmented Lagrangian formulation. Our method relies on conforming simplicial meshes in two- and three-dimensions. The $hp$-multigrid algorithm is a multiplicative auxiliary space preconditioner that employs the lowest-order space as t…
▽ More
In this study, we present an $hp$-multigrid preconditioner for a divergence-conforming HDG scheme for the generalized Stokes and the Navier-Stokes equations using an augmented Lagrangian formulation. Our method relies on conforming simplicial meshes in two- and three-dimensions. The $hp$-multigrid algorithm is a multiplicative auxiliary space preconditioner that employs the lowest-order space as the auxiliary space, and we developed a geometric multigrid method as the auxiliary space solver. For the generalized Stokes problem, the crucial ingredient of the geometric multigrid method is the equivalence between the condensed lowest-order divergence-conforming HDG scheme and a Crouzeix-Raviart discretization with a pressure-robust treatment as introduced in Linke and Merdon (Comput. Methods Appl. Mech. Engrg., 311 (2016)), which allows for the direct application of geometric multigrid theory on the Crouzeix-Raviart discretization. The numerical experiments demonstrate the robustness of the proposed $hp$-multigrid preconditioner with respect to mesh size and augmented Lagrangian parameter, with iteration counts insensitivity to polynomial order increase. Inspired by the works by Benzi & Olshanskii (SIAM J. Sci. Comput., 28(6) (2006)) and Farrell et al. (SIAM J. Sci. Comput., 41(5) (2019)), we further test the proposed preconditioner on the divergence-conforming HDG scheme for the Navier-Stokes equations. Numerical experiments show a mild increase in the iteration counts of the preconditioned GMRes solver with the rise in Reynolds number up to $10^3$.
△ Less
Submitted 12 March, 2023;
originally announced March 2023.
-
Optimal geometric multigrid preconditioners for HDG-P0 schemes for the reaction-diffusion equation and the generalized Stokes equations
Authors:
Guosheng Fu,
Wenzheng Kuang
Abstract:
We present the lowest-order hybridizable discontinuous Galerkin schemes with numerical integration (quadrature), denoted as HDG-P0, for the reaction-diffusion equation and the generalized Stokes equations on conforming simplicial meshes in two- and three-dimensions. Here by lowest order, we mean that the (hybrid) finite element space for the global HDG facet degrees of freedom (DOFs) is the space…
▽ More
We present the lowest-order hybridizable discontinuous Galerkin schemes with numerical integration (quadrature), denoted as HDG-P0, for the reaction-diffusion equation and the generalized Stokes equations on conforming simplicial meshes in two- and three-dimensions. Here by lowest order, we mean that the (hybrid) finite element space for the global HDG facet degrees of freedom (DOFs) is the space of piecewise constants on the mesh skeleton. A discontinuous piecewise linear space is used for the approximation of the local primal unknowns. We give the optimal a priori error analysis of the proposed {\sf HDG-P0} schemes, which hasn't appeared in the literature yet for HDG discretizations as far as numerical integration is concerned.
Moreover, we propose optimal geometric multigrid preconditioners for the statically condensed HDG-P0 linear systems on conforming simplicial meshes. In both cases, we first establish the equivalence of the statically condensed HDG system with a (slightly modified) nonconforming Crouzeix-Raviart (CR) discretization, where the global (piecewise-constant) HDG finite element space on the mesh skeleton has a natural one-to-one correspondence to the nonconforming CR (piecewise-linear) finite element space that live on the whole mesh. This equivalence then allows us to use the well-established nonconforming geometry multigrid theory to precondition the condensed HDG system. Numerical results in two- and three-dimensions are presented to verify our theoretical findings.
△ Less
Submitted 1 January, 2023; v1 submitted 30 August, 2022;
originally announced August 2022.
-
On shape sphere and rotation of three-body motion
Authors:
Wentian Kuang
Abstract:
For three-body problem, R.Montgomery [3] proved a reconstruction formula which calculates the overall rotation relating two similar triangle configurations if the initial triangular configuration is similar to the configuration formed at some later time. In this paper, we extend the formula so that it gives the angle of rotation for a single particle without requiring the similarity of initial and…
▽ More
For three-body problem, R.Montgomery [3] proved a reconstruction formula which calculates the overall rotation relating two similar triangle configurations if the initial triangular configuration is similar to the configuration formed at some later time. In this paper, we extend the formula so that it gives the angle of rotation for a single particle without requiring the similarity of initial and final configurations. The proof is different from that in [3] and uses fundamental calculus. Moreover, we answered a question proposed in [3].
△ Less
Submitted 29 June, 2021;
originally announced June 2021.
-
Uniform block-diagonal preconditioners for divergence-conforming HDG Methods for the generalized Stokes equations and the linear elasticity equations
Authors:
Guosheng Fu,
Wenzheng Kuang
Abstract:
We propose a uniform block-diagonal preconditioner for condensed $H$(div)-conforming HDG schemes for parameter-dependent saddle point problems, including the generalized Stokes equations and the linear elasticity equations. An optimal preconditioner is obtained for the stiffness matrix on the global velocity/displacement space via the auxiliary space preconditioning (ASP) technique \cite{Xu96}. A…
▽ More
We propose a uniform block-diagonal preconditioner for condensed $H$(div)-conforming HDG schemes for parameter-dependent saddle point problems, including the generalized Stokes equations and the linear elasticity equations. An optimal preconditioner is obtained for the stiffness matrix on the global velocity/displacement space via the auxiliary space preconditioning (ASP) technique \cite{Xu96}. A spectrally equivalent approximation to the Schur complement on the element-wise constant pressure space is also constructed, and an explicit computable exact inverse is obtained via the Woodbury matrix identity. Finally, the numerical results verify the robustness of our proposed preconditioner with respect to model parameters and mesh size.
△ Less
Submitted 21 April, 2022; v1 submitted 28 April, 2021;
originally announced April 2021.
-
A monolithic divergence-conforming HDG scheme for a linear fluid-structure interaction model
Authors:
Guosheng Fu,
Wenzheng Kuang
Abstract:
We present a novel monolithic divergence-conforming HDG scheme for a linear fluid-structure interaction (FSI) problem with a thick structure. A pressure-robust optimal energy-norm estimate is obtained for the semidiscrete scheme. When combined with a Crank-Nicolson time discretization, our fully discrete scheme is energy stable and produces an exactly divergence-free fluid velocity approximation.…
▽ More
We present a novel monolithic divergence-conforming HDG scheme for a linear fluid-structure interaction (FSI) problem with a thick structure. A pressure-robust optimal energy-norm estimate is obtained for the semidiscrete scheme. When combined with a Crank-Nicolson time discretization, our fully discrete scheme is energy stable and produces an exactly divergence-free fluid velocity approximation. The resulting linear system, which is symmetric and indefinite, is solved using a preconditioned MinRes method with a robust block algebraic multigrid (AMG) preconditioner.
△ Less
Submitted 30 November, 2020;
originally announced December 2020.
-
Geometric properties of minimizers in the planar three-body problem with two equal masses
Authors:
Wentian Kuang,
Duokui Yan
Abstract:
It it shown that each lobe of the figure-eight orbit is star-shaped, which implies the polar angle is monotone in each lobe. In general, it is not clear when a minimizer is star-shaped. In this paper, we study minimizers connecting two fixed-ends (i.e. the Bolza problem) in the planar three-body problem with two equal masses. We show that if the Jacobi coordinates of the two fixed-ends are in adja…
▽ More
It it shown that each lobe of the figure-eight orbit is star-shaped, which implies the polar angle is monotone in each lobe. In general, it is not clear when a minimizer is star-shaped. In this paper, we study minimizers connecting two fixed-ends (i.e. the Bolza problem) in the planar three-body problem with two equal masses. We show that if the Jacobi coordinates of the two fixed-ends are in adjacent closed quadrants, then the corresponding minimizer must stay in two adjacent closed quadrants. If we further assume the two Jacobi coordinates are orthogonal on one of the fixed-ends, then the polar angles of the Jacobi coordinates in the minimizer have at most one critical point. If the two Jacobi coordinates are orthogonal on both ends, then the two polar angles must be monotone. These geometric properties can be applied to show the existence of two sets of periodic orbits.
△ Less
Submitted 25 October, 2020; v1 submitted 11 December, 2017;
originally announced December 2017.
-
Existence of prograde double-double orbits in the equal-mass four-body problem
Authors:
Wentian Kuang,
Duokui Yan
Abstract:
By introducing simple topological constraints and applying a binary decomposition method, we show the existence of a set of prograde double-double orbits for any rotation angle $θ\in (0, π/7]$ in the equal-mass four-body problem.
A new geometric argument is introduced to show that for any $θ\in (0, π/2)$, the action of the minimizer corresponding to the prograde double-double orbit is strictly g…
▽ More
By introducing simple topological constraints and applying a binary decomposition method, we show the existence of a set of prograde double-double orbits for any rotation angle $θ\in (0, π/7]$ in the equal-mass four-body problem.
A new geometric argument is introduced to show that for any $θ\in (0, π/2)$, the action of the minimizer corresponding to the prograde double-double orbit is strictly greater than the action of the minimizer corresponding to the retrograde double-double orbit. This geometric argument can also be applied to study orbits in the planar three-body problem, such as the retrograde orbits, the prograde orbits, the Schubart orbit and the Hénon orbit.
△ Less
Submitted 2 November, 2017; v1 submitted 26 October, 2017;
originally announced October 2017.
-
The Broucke-Hénon orbit and the Schubart Orbit in the planar three-body problem with equal masses
Authors:
Wentian Kuang,
Tiancheng Ouyang,
Zhifu Xie,
Duokui Yan
Abstract:
In this paper, we study the variational properties of two special orbits: the Schubart orbit and the Broucke-Hénon orbit. We show that under an appropriate topological constraint, the action minimizer must be either the Schubart orbit or the Broucke-Hénon orbit. One of the main challenges is to prove that the Schubart orbit coincides with the action minimizer connecting a collinear configuration w…
▽ More
In this paper, we study the variational properties of two special orbits: the Schubart orbit and the Broucke-Hénon orbit. We show that under an appropriate topological constraint, the action minimizer must be either the Schubart orbit or the Broucke-Hénon orbit. One of the main challenges is to prove that the Schubart orbit coincides with the action minimizer connecting a collinear configuration with a binary collision and an isosceles configuration. A new geometric argument is introduced to overcome this challenge.
△ Less
Submitted 26 October, 2017; v1 submitted 2 July, 2016;
originally announced July 2016.
