-
Extrinsic Bayesian Optimizations on Manifolds
Authors:
Yihao Fang,
Mu Niu,
Pokman Cheung,
Lizhen Lin
Abstract:
We propose an extrinsic Bayesian optimization (eBO) framework for general optimization problems on manifolds. Bayesian optimization algorithms build a surrogate of the objective function by employing Gaussian processes and quantify the uncertainty in that surrogate by deriving an acquisition function. This acquisition function represents the probability of improvement based on the kernel of the Ga…
▽ More
We propose an extrinsic Bayesian optimization (eBO) framework for general optimization problems on manifolds. Bayesian optimization algorithms build a surrogate of the objective function by employing Gaussian processes and quantify the uncertainty in that surrogate by deriving an acquisition function. This acquisition function represents the probability of improvement based on the kernel of the Gaussian process, which guides the search in the optimization process. The critical challenge for designing Bayesian optimization algorithms on manifolds lies in the difficulty of constructing valid covariance kernels for Gaussian processes on general manifolds. Our approach is to employ extrinsic Gaussian processes by first embedding the manifold onto some higher dimensional Euclidean space via equivariant embeddings and then constructing a valid covariance kernel on the image manifold after the embedding. This leads to efficient and scalable algorithms for optimization over complex manifolds. Simulation study and real data analysis are carried out to demonstrate the utilities of our eBO framework by applying the eBO to various optimization problems over manifolds such as the sphere, the Grassmannian, and the manifold of positive definite matrices.
△ Less
Submitted 28 December, 2022; v1 submitted 21 December, 2022;
originally announced December 2022.
-
Intrinsic Gaussian Processes on Manifolds and Their Accelerations by Symmetry
Authors:
Ke Ye,
Mu Niu,
Pokman Cheung,
Zhenwen Dai,
Yuan Liu
Abstract:
Amidst the growing interest in nonparametric regression, we address a significant challenge in Gaussian processes(GP) applied to manifold-based predictors. Existing methods primarily focus on low dimensional constrained domains for heat kernel estimation, limiting their effectiveness in higher-dimensional manifolds. Our research proposes an intrinsic approach for constructing GP on general manifol…
▽ More
Amidst the growing interest in nonparametric regression, we address a significant challenge in Gaussian processes(GP) applied to manifold-based predictors. Existing methods primarily focus on low dimensional constrained domains for heat kernel estimation, limiting their effectiveness in higher-dimensional manifolds. Our research proposes an intrinsic approach for constructing GP on general manifolds such as orthogonal groups, unitary groups, Stiefel manifolds and Grassmannian manifolds. Our methodology estimates the heat kernel by simulating Brownian motion sample paths using the exponential map, ensuring independence from the manifold's embedding. The introduction of our strip algorithm, tailored for manifolds with extra symmetries, and the ball algorithm, designed for arbitrary manifolds, constitutes our significant contribution. Both algorithms are rigorously substantiated through theoretical proofs and numerical testing, with the strip algorithm showcasing remarkable efficiency gains over traditional methods. This intrinsic approach delivers several key advantages, including applicability to high dimensional manifolds, eliminating the requirement for global parametrization or embedding. We demonstrate its practicality through regression case studies (torus knots and eight dimensional projective spaces) and by developing binary classifiers for real world datasets (gorilla skulls planar images and diffusion tensor images). These classifiers outperform traditional methods, particularly in limited data scenarios.
△ Less
Submitted 31 January, 2024; v1 submitted 25 June, 2020;
originally announced June 2020.
-
Higher Order, Polar and Sz.-Nagy's Generalized Derivatives of Random Polynomials with Independent and Identically Distributed Zeros on the Unit Circle
Authors:
Pak-Leong Cheung,
Tuen Wai Ng,
Jonathan Tsai,
S. C. P. Yam
Abstract:
For random polynomials with i.i.d. (independent and identically distribu-ted) zeros following any common probability distribution $μ$ with support contained in the unit circle, the empirical measures of the zeros of their first and higher order derivatives will be proved to converge weakly to $μ$ a.s. (almost sure(ly)). This, in particular, completes a recent work of Subramanian on the first order…
▽ More
For random polynomials with i.i.d. (independent and identically distribu-ted) zeros following any common probability distribution $μ$ with support contained in the unit circle, the empirical measures of the zeros of their first and higher order derivatives will be proved to converge weakly to $μ$ a.s. (almost sure(ly)). This, in particular, completes a recent work of Subramanian on the first order derivative case where $μ$ was assumed to be non-uniform. The same a.s. weak convergence will also be shown for polar and Sz.-Nagy's generalized derivatives, on some mild conditions.
△ Less
Submitted 25 September, 2014;
originally announced September 2014.
-
Finiteness of Fixed Equilibrium Configurations of Point Vortices in the Plane with Background Flow
Authors:
Pak-Leong Cheung,
Tuen Wai Ng
Abstract:
For a dynamic system consisting of $n$ point vortices in an ideal plane fluid with a steady, incompressible and} irrotational background flow, a more physically significant definition of a fixed equilibrium configuration is suggested. Under this new definition, if the complex polynomial $w$ that determines the aforesaid background flow is non-constant, we have found an attainable generic upper bou…
▽ More
For a dynamic system consisting of $n$ point vortices in an ideal plane fluid with a steady, incompressible and} irrotational background flow, a more physically significant definition of a fixed equilibrium configuration is suggested. Under this new definition, if the complex polynomial $w$ that determines the aforesaid background flow is non-constant, we have found an attainable generic upper bound \smash{$\fr{(m+n-1)!}{(m-1)!\,n_1!\cdots n_{i_0}!}$} for the number of fixed equilibrium configurations. Here, $m=°w$, $i_0$ is the number of species, and each $n_i$ is the number of vortices in a species. We transform the rational function system arisen from} fixed equilibria into a polynomial system, whose form is good enough to apply the BKK theory (named after D. N. Bernshtein, A. G. Khovanskii and A. G. Kushnirenko) to show the finiteness of its number of solutions. Having this finiteness, the required bound follows from Bézout's theorem or the BKK root count by T. Y. Li and X.-S. Wang.}
△ Less
Submitted 8 September, 2014;
originally announced September 2014.
-
Chiral differential operators: formal loop group actions and associated modules
Authors:
Pokman Cheung
Abstract:
Chiral differential operators (CDOs) are closely related to string geometry and the quantum theory of two-dimensional sigma models. This paper investigates two topics about CDOs on smooth manifolds. In the first half, we study how a Lie group action on a smooth manifold can be lifted to a `formal loop group action' on an algebra of CDOs; this turns out to be a condition on the equivariant first Po…
▽ More
Chiral differential operators (CDOs) are closely related to string geometry and the quantum theory of two-dimensional sigma models. This paper investigates two topics about CDOs on smooth manifolds. In the first half, we study how a Lie group action on a smooth manifold can be lifted to a `formal loop group action' on an algebra of CDOs; this turns out to be a condition on the equivariant first Pontrjagin class. The case of a principal bundle receives particular attention and gives rise to a type of vertex algebras of great interest. In the second half, we introduce a construction of modules over CDOs using the said `formal loop group actions' and semi-infinite cohomology. Intuitively, these modules should have a geometric meaning in terms of `formal loop spaces'. The first example we study leads to a new conceptual construction of an arbitrary algebra of CDOs. The other example, called the spinor module, may be useful for a geometric theory of the Witten genus.
△ Less
Submitted 8 November, 2013; v1 submitted 31 May, 2012;
originally announced May 2012.
-
Chiral differential operators on supermanifolds
Authors:
Pokman Cheung
Abstract:
The first part of this paper provides a new formulation of chiral differential operators (CDOs) in terms of global geometric quantities. The main result is a recipe to define all sheaves of CDOs on a smooth cs-manifold; its ingredients consist of an affine connection and an even 3-form that trivializes the first Pontrjagin form. With the connection fixed, two suitable 3-forms define isomorphic she…
▽ More
The first part of this paper provides a new formulation of chiral differential operators (CDOs) in terms of global geometric quantities. The main result is a recipe to define all sheaves of CDOs on a smooth cs-manifold; its ingredients consist of an affine connection and an even 3-form that trivializes the first Pontrjagin form. With the connection fixed, two suitable 3-forms define isomorphic sheaves of CDOs if and only if their difference is exact. Moreover, conformal structures are in one-to-one correspondence with even 1-forms that trivialize the first Chern form.
Applying our work in the first part, we construct what may be called "chiral Dolbeault complexes" of a complex manifold M, and analyze conditions under which these differential vertex superalgebras admit compatible conformal structures or extra gradings (fermion numbers). When M is compact, their cohomology computes (in various cases) the Witten genus, the two-variable elliptic genus and a spin-c version of the Witten genus. This part contains some new results as well as provides a geometric formulation of certain known facts from the study of holomorphic CDOs and sigma models.
△ Less
Submitted 22 June, 2011; v1 submitted 28 September, 2010;
originally announced September 2010.
-
Supersymmetric field theories and cohomology
Authors:
Pokman Cheung
Abstract:
This is the Ph.D. dissertation of the author. The project has been motivated by the conjecture that the Hopkins-Miller tmf spectrum can be described in terms of `spaces' of conformal field theories. In this dissertation, spaces of field theories are constructed as classifying spaces of categories whose objects are certain types of field theories. If such a category has a symmetric monoidal struc…
▽ More
This is the Ph.D. dissertation of the author. The project has been motivated by the conjecture that the Hopkins-Miller tmf spectrum can be described in terms of `spaces' of conformal field theories. In this dissertation, spaces of field theories are constructed as classifying spaces of categories whose objects are certain types of field theories. If such a category has a symmetric monoidal structure and its components form a group, by work of Segal, its classifying space is an infinite loop space and defines a cohomology theory. This has been carried out for two classes of field theories: (i) For each integer n, there is a category SEFT_n whose objects are the Stolz-Teichner (1|1)-dimensional super Euclidean field theories of degree n. It is proved that the classifying space |SEFT_n| represents degree-n K or KO cohomology, depending on the coefficients of the field theories. (ii) For each integer n, there is a category AFT_n whose objects are a kind of (2|1)-dimensional field theories called `annular field theories,' defined using supergeometric versions of circles and annuli only. It is proved that the classifying space |AFT_n| represents the degree-n elliptic cohomology associated with the Tate curve. To the author's knowledge, this is the first time the definitions of low-dimensional supersymmetric field theories are given in full detail.
△ Less
Submitted 14 November, 2008;
originally announced November 2008.
-
The Witten genus and vertex algebras
Authors:
Pokman Cheung
Abstract:
This article is the first report of an ongoing project aimed at finding a geometric interpretation of the Witten genus and other tmf classes. Section 2 reviews the sheaves of chiral differential operators (CDOs) over a complex manifold, including their construction, obstructions and relation with the Witten genus. In section 3, the structure of each sheaf of CDOs is reorganized in terms of modul…
▽ More
This article is the first report of an ongoing project aimed at finding a geometric interpretation of the Witten genus and other tmf classes. Section 2 reviews the sheaves of chiral differential operators (CDOs) over a complex manifold, including their construction, obstructions and relation with the Witten genus. In section 3, the structure of each sheaf of CDOs is reorganized in terms of modules over the sheaf of holomorphic functions. This invokes the notion of a differential graded vertex algebroid. The construction of sheaves of CDOs is due to Gorbounov, Malikov and Schechtman, and so is the notion of a vertex algebroid; the differential graded version is first introduced here. Section 4 contains the main result, namely the construction of a sheaf of differential graded conformal vertex algebras that provides a fine resolution of a sheaf of CDOs. This `infinite dimensional Dolbeault complex' plays a role for the Witten genus similar to that of the Dolbeault complex for the Todd genus.
△ Less
Submitted 16 February, 2010; v1 submitted 10 November, 2008;
originally announced November 2008.