-
Pullbacks in tangent categories and tangent display maps
Authors:
Geoffrey Cruttwell,
Marcello Lanfranchi
Abstract:
In differential geometry, the existence of pullbacks is a delicate matter, since the category of smooth manifolds does not admit all of them. When pullbacks are required, often submersions are employed as an ideal class of maps which behaves well under this operation and the tangent bundle functor. This issue is reflected in tangent category theory, which aims to axiomatize the tangent bundle func…
▽ More
In differential geometry, the existence of pullbacks is a delicate matter, since the category of smooth manifolds does not admit all of them. When pullbacks are required, often submersions are employed as an ideal class of maps which behaves well under this operation and the tangent bundle functor. This issue is reflected in tangent category theory, which aims to axiomatize the tangent bundle functor of differential geometry categorically. Key constructions such as connections, tangent fibrations, or reverse tangent categories require one to work with pullbacks preserved by the tangent bundle functor. In previous work, this issue has been left as a technicality and solved by introducing extra structure to carry around. This paper gives an alternative to this by focusing on a special class of maps in a tangent category called tangent display maps; such maps are well-behaved with respect to pullbacks and applications of the tangent functor. We develop some of the general theory of such maps, show how using them can simplify previous work in tangent categories, and show that in the tangent category of smooth manifolds, they are the same as the submersions. Finally, we consider a subclass of tangent display maps to define open subobjects in any tangent category, allowing one to build a canonical split restriction tangent category in which the original one naturally embeds.
△ Less
Submitted 27 February, 2025;
originally announced February 2025.
-
A Fibrational Theory of First Order Differential Structures
Authors:
Matteo Capucci,
Geoffrey S. H. Cruttwell,
Neil Ghani,
Fabio Zanasi
Abstract:
We develop a categorical framework for reasoning about abstract properties of differentiation, based on the theory of fibrations. Our work encompasses the first-order fragments of several existing categorical structures for differentiation, including cartesian differential categories, generalised cartesian differential categories, tangent categories, as well as the versions of these categories axi…
▽ More
We develop a categorical framework for reasoning about abstract properties of differentiation, based on the theory of fibrations. Our work encompasses the first-order fragments of several existing categorical structures for differentiation, including cartesian differential categories, generalised cartesian differential categories, tangent categories, as well as the versions of these categories axiomatising reverse derivatives. We explain uniformly and concisely the requirements expressed by these structures, using sections of suitable fibrations as unifying concept. Our perspective sheds light on their similarities and differences, as well as simplifying certain constructions from the literature.
△ Less
Submitted 9 September, 2024;
originally announced September 2024.
-
A Tangent Category Perspective on Connections in Algebraic Geometry
Authors:
G. S. H. Cruttwell,
Jean-Simon Pacaud Lemay,
Elias Vandenberg
Abstract:
There is an abstract notion of connection in any tangent category. In this paper, we show that when applied to the tangent category of affine schemes, this recreates the classical notion of a connection on a module (and similarly, in the tangent category of schemes, this recreates the notion of connection on a quasi-coherent sheaf of modules). By contrast, we also show that in the tangent category…
▽ More
There is an abstract notion of connection in any tangent category. In this paper, we show that when applied to the tangent category of affine schemes, this recreates the classical notion of a connection on a module (and similarly, in the tangent category of schemes, this recreates the notion of connection on a quasi-coherent sheaf of modules). By contrast, we also show that in the tangent category of algebras, there are no non-trivial connections.
△ Less
Submitted 21 November, 2024; v1 submitted 21 June, 2024;
originally announced June 2024.
-
Reverse Tangent Categories
Authors:
Geoffrey Cruttwell,
Jean-Simon Pacaud Lemay
Abstract:
Previous work has shown that reverse differential categories give an abstract setting for gradient-based learning of functions between Euclidean spaces. However, reverse differential categories are not suited to handle gradient-based learning for functions between more general spaces such as smooth manifolds. In this paper, we propose a setting to handle this, which we call reverse tangent categor…
▽ More
Previous work has shown that reverse differential categories give an abstract setting for gradient-based learning of functions between Euclidean spaces. However, reverse differential categories are not suited to handle gradient-based learning for functions between more general spaces such as smooth manifolds. In this paper, we propose a setting to handle this, which we call reverse tangent categories: tangent categories with an involution operation for their differential bundles.
△ Less
Submitted 23 November, 2023; v1 submitted 2 August, 2023;
originally announced August 2023.
-
Differential Bundles in Commutative Algebra and Algebraic Geometry
Authors:
G. S. H. Cruttwell,
Jean-Simon Pacaud Lemay
Abstract:
In this paper, we explain how the abstract notion of a differential bundle in a tangent category provides a new way of thinking about the category of modules over a commutative ring and its opposite category. MacAdam previously showed that differential bundles in the tangent category of smooth manifolds are precisely smooth vector bundles. Here we provide characterizations of differential bundles…
▽ More
In this paper, we explain how the abstract notion of a differential bundle in a tangent category provides a new way of thinking about the category of modules over a commutative ring and its opposite category. MacAdam previously showed that differential bundles in the tangent category of smooth manifolds are precisely smooth vector bundles. Here we provide characterizations of differential bundles in the tangent categories of commutative rings and (affine) schemes. For commutative rings, the category of differential bundles over a commutative ring is equivalent to the category of modules over that ring. For affine schemes, the category of differential bundles over the Spec of a commutative ring is equivalent to the opposite category of modules over said ring. Finally, for schemes, the category of differential bundles over a scheme is equivalent to the opposite category of quasi-coherent sheaves of modules over that scheme.
△ Less
Submitted 18 December, 2023; v1 submitted 13 January, 2023;
originally announced January 2023.
-
Double Fibrations
Authors:
Geoffrey Cruttwell,
Michael Lambert,
Dorette Pronk,
Martin Szyld
Abstract:
This paper defines double fibrations (fibrations of double categories) and describes their key examples and properties. In particular, it shows how double fibrations relate to existing fibrational notions such as monoidal fibrations and discrete double fibrations, proves a representation theorem for double fibrations, and shows how double fibrations are a type of internal fibration.
This paper defines double fibrations (fibrations of double categories) and describes their key examples and properties. In particular, it shows how double fibrations relate to existing fibrational notions such as monoidal fibrations and discrete double fibrations, proves a representation theorem for double fibrations, and shows how double fibrations are a type of internal fibration.
△ Less
Submitted 30 May, 2022;
originally announced May 2022.
-
Monoidal Reverse Differential Categories
Authors:
Geoffrey Cruttwell,
Jonathan Gallagher,
Jean-Simon Pacaud Lemay,
Dorette Pronk
Abstract:
Cartesian reverse differential categories (CRDCs) are a recently defined structure which categorically model the reverse differentiation operations used in supervised learning. Here we define a related structure called a monoidal reverse differential category, prove important results about its relationship to CRDCs, and provide examples of both structures, including examples coming from models of…
▽ More
Cartesian reverse differential categories (CRDCs) are a recently defined structure which categorically model the reverse differentiation operations used in supervised learning. Here we define a related structure called a monoidal reverse differential category, prove important results about its relationship to CRDCs, and provide examples of both structures, including examples coming from models of quantum computation.
△ Less
Submitted 9 September, 2022; v1 submitted 23 March, 2022;
originally announced March 2022.
-
Categorical Foundations of Gradient-Based Learning
Authors:
G. S. H. Cruttwell,
Bruno Gavranović,
Neil Ghani,
Paul Wilson,
Fabio Zanasi
Abstract:
We propose a categorical semantics of gradient-based machine learning algorithms in terms of lenses, parametrised maps, and reverse derivative categories. This foundation provides a powerful explanatory and unifying framework: it encompasses a variety of gradient descent algorithms such as ADAM, AdaGrad, and Nesterov momentum, as well as a variety of loss functions such as as MSE and Softmax cross…
▽ More
We propose a categorical semantics of gradient-based machine learning algorithms in terms of lenses, parametrised maps, and reverse derivative categories. This foundation provides a powerful explanatory and unifying framework: it encompasses a variety of gradient descent algorithms such as ADAM, AdaGrad, and Nesterov momentum, as well as a variety of loss functions such as as MSE and Softmax cross-entropy, shedding new light on their similarities and differences. Our approach to gradient-based learning has examples generalising beyond the familiar continuous domains (modelled in categories of smooth maps) and can be realized in the discrete setting of boolean circuits. Finally, we demonstrate the practical significance of our framework with an implementation in Python.
△ Less
Submitted 13 July, 2021; v1 submitted 2 March, 2021;
originally announced March 2021.
-
Categorical semantics of a simple differential programming language
Authors:
Geoffrey Cruttwell,
Jonathan Gallagher,
Dorette Pronk
Abstract:
With the increased interest in machine learning, and deep learning in particular, the use of automatic differentiation has become more wide-spread in computation. There have been two recent developments to provide the theoretical support for this types of structure. One approach, due to Abadi and Plotkin, provides a simple differential programming language. Another approach is the notion of a…
▽ More
With the increased interest in machine learning, and deep learning in particular, the use of automatic differentiation has become more wide-spread in computation. There have been two recent developments to provide the theoretical support for this types of structure. One approach, due to Abadi and Plotkin, provides a simple differential programming language. Another approach is the notion of a reverse differential category. In the present paper we bring these two approaches together. In particular, we show how an extension of reverse derivative categories models Abadi and Plotkin's language, and describe how this categorical model allows one to consider potential improvements to the operational semantics of the language.
△ Less
Submitted 25 January, 2021;
originally announced January 2021.
-
Latent Fibrations: Fibrations for Categories of Partial Maps
Authors:
Robin Cockett,
Geoff Cruttwell,
Jonathan Gallagher,
Dorette Pronk
Abstract:
Latent fibrations are an adaptation, appropriate for categories of partial maps (as presented by restriction categories), of the usual notion of fibration. The paper initiates the development of the basic theory of latent fibrations and explores some key examples. Latent fibrations cover a wide variety of examples, some of which are partial versions of standard fibrations, and some of which are pa…
▽ More
Latent fibrations are an adaptation, appropriate for categories of partial maps (as presented by restriction categories), of the usual notion of fibration. The paper initiates the development of the basic theory of latent fibrations and explores some key examples. Latent fibrations cover a wide variety of examples, some of which are partial versions of standard fibrations, and some of which are particular to partial map categories (particularly those that arise in computational settings). Latent fibrations with various special properties are identified: hyperconnected latent fibrations, in particular, are shown to support the construction of a fibrational dual; this is important to reverse differential programming and, more generally, in the theory of lenses.
△ Less
Submitted 28 October, 2020;
originally announced October 2020.
-
Differential equations in a tangent category I: Complete vector fields, flows, and exponentials
Authors:
J. R. B. Cockett,
G. S. H. Cruttwell,
J. -S. P. Lemay
Abstract:
This paper describes how to define and work with differential equations in the abstract setting of tangent categories. The key notion is that of a curve object which is, for differential geometry, the structural analogue of a natural number object. A curve object is a preinitial object for dynamical systems; dynamical systems may, in turn, be viewed as determining systems of differential equations…
▽ More
This paper describes how to define and work with differential equations in the abstract setting of tangent categories. The key notion is that of a curve object which is, for differential geometry, the structural analogue of a natural number object. A curve object is a preinitial object for dynamical systems; dynamical systems may, in turn, be viewed as determining systems of differential equations. The unique map from the curve object to a dynamical system is a solution of the system, and a dynamical system is said to be complete when for all initial conditions there is a solution. A subtle issue concerns the question of when a dynamical system is complete, and the paper provides abstract conditions for this.
This abstract formulation also allows new perspectives on topics such as commutative vector fields and flows. In addition, the stronger notion of a differential curve object, which is the centrepiece of the last section of the paper, has exponential maps and forms a differential exponential rig. This rig then, somewhat surprisingly, has an action on every differential object and bundle in the setting. In this manner, in a very strong sense, such a curve object plays the role of the real numbers in standard differential geometry.
△ Less
Submitted 8 February, 2021; v1 submitted 27 November, 2019;
originally announced November 2019.
-
Reverse derivative categories
Authors:
Robin Cockett,
Geoffrey Cruttwell,
Jonathan Gallagher,
Jean-Simon Pacaud Lemay,
Benjamin MacAdam,
Gordon Plotkin,
Dorette Pronk
Abstract:
The reverse derivative is a fundamental operation in machine learning and automatic differentiation. This paper gives a direct axiomatization of a category with a reverse derivative operation, in a similar style to that given by Cartesian differential categories for a forward derivative. Intriguingly, a category with a reverse derivative also has a forward derivative, but the converse is not true.…
▽ More
The reverse derivative is a fundamental operation in machine learning and automatic differentiation. This paper gives a direct axiomatization of a category with a reverse derivative operation, in a similar style to that given by Cartesian differential categories for a forward derivative. Intriguingly, a category with a reverse derivative also has a forward derivative, but the converse is not true. In fact, we show explicitly what a forward derivative is missing: a reverse derivative is equivalent to a forward derivative with a dagger structure on its subcategory of linear maps. Furthermore, we show that these linear maps form an additively enriched category with dagger biproducts.
△ Less
Submitted 15 October, 2019;
originally announced October 2019.
-
Integral and differential structure on the free $C^{\infty}$-ring modality
Authors:
G. S. H. Cruttwell,
J. -S. P. Lemay,
R. B. B. Lucyshyn-Wright
Abstract:
Integral categories were recently developed as a counterpart to differential categories. In particular, integral categories come equipped with an integration operator, known as an integral transformation, whose axioms generalize the basic integration identities from calculus such as integration by parts. However, the literature on integral categories contains no example that captures integration o…
▽ More
Integral categories were recently developed as a counterpart to differential categories. In particular, integral categories come equipped with an integration operator, known as an integral transformation, whose axioms generalize the basic integration identities from calculus such as integration by parts. However, the literature on integral categories contains no example that captures integration of arbitrary smooth functions: the closest are examples involving integration of polynomial functions. This paper fills in this gap by developing an example of an integral category whose integral transformation operates on smooth 1-forms. We also provide an alternative viewpoint on the differential structure of this key example, investigate derivations and coderelictions in this context, and prove that free $C^{\infty}$-rings are Rota-Baxter algebras.
△ Less
Submitted 25 July, 2019; v1 submitted 12 February, 2019;
originally announced February 2019.
-
Affine geometric spaces in tangent categories
Authors:
R. F. Blute,
G. S. H. Cruttwell,
R. B. B. Lucyshyn-Wright
Abstract:
We continue the program of structural differential geometry that begins with the notion of a tangent category, an axiomatization of structural aspects of the tangent functor on the category of smooth manifolds. In classical geometry, having an affine structure on a manifold is equivalent to having a flat torsion-free connection on its tangent bundle. This equivalence allows us to define a category…
▽ More
We continue the program of structural differential geometry that begins with the notion of a tangent category, an axiomatization of structural aspects of the tangent functor on the category of smooth manifolds. In classical geometry, having an affine structure on a manifold is equivalent to having a flat torsion-free connection on its tangent bundle. This equivalence allows us to define a category of affine objects associated to a tangent category and we show that the resulting category is also a tangent category, as are several related categories. As a consequence of some of these ideas we also give two new characterizations of flat torsion-free connections.
We also consider 2-categorical structure associated to the category of tangent categories and demonstrate that assignment of the tangent category of affine objects to a tangent category induces a 2-comonad.
Finally, following work of Jubin, we consider monads and comonads on the category of affine objects associated to a tangent category. We show that there is a rich theory of monads and comonads in this setting as well as various distributive laws and mixed distributive laws relating these monads and comonads. Even in the category of smooth manifolds, several of these results are new or fill in gaps in the existing literature.
△ Less
Submitted 29 April, 2019; v1 submitted 25 July, 2018;
originally announced July 2018.
-
Connections in Tangent Categories
Authors:
J. R. B. Cockett,
G. S. H. Cruttwell
Abstract:
Connections are an important tool of differential geometry. This paper investigates their definition and structure in the abstract setting of tangent categories. At this level of abstraction we derive several classically important results about connections, including the Bianchi identities, identities for curvature and torsion, almost complex structure, and parallel transport.
Connections are an important tool of differential geometry. This paper investigates their definition and structure in the abstract setting of tangent categories. At this level of abstraction we derive several classically important results about connections, including the Bianchi identities, identities for curvature and torsion, almost complex structure, and parallel transport.
△ Less
Submitted 27 July, 2017; v1 submitted 27 October, 2016;
originally announced October 2016.
-
A simplicial foundation for differential and sector forms in tangent categories
Authors:
G. S. H. Cruttwell,
Rory B. B. Lucyshyn-Wright
Abstract:
Tangent categories provide an axiomatic framework for understanding various tangent bundles and differential operations that occur in differential geometry, algebraic geometry, abstract homotopy theory, and computer science. Previous work has shown that one can formulate and prove a wide variety of definitions and results from differential geometry in an arbitrary tangent category, including gener…
▽ More
Tangent categories provide an axiomatic framework for understanding various tangent bundles and differential operations that occur in differential geometry, algebraic geometry, abstract homotopy theory, and computer science. Previous work has shown that one can formulate and prove a wide variety of definitions and results from differential geometry in an arbitrary tangent category, including generalizations of vector fields and their Lie bracket, vector bundles, and connections.
In this paper we investigate differential and sector forms in tangent categories. We show that sector forms in any tangent category have a rich structure: they form a symmetric cosimplicial object. This appears to be a new result in differential geometry, even for smooth manifolds. In the category of smooth manifolds, the resulting complex of sector forms has a subcomplex isomorphic to the de Rham complex of differential forms, which may be identified with alternating sector forms. Further, the symmetric cosimplicial structure on sector forms arises naturally through a new equational presentation of symmetric cosimplicial objects, which we develop herein.
△ Less
Submitted 11 April, 2018; v1 submitted 29 June, 2016;
originally announced June 2016.
-
Differential bundles and fibrations for tangent categories
Authors:
J. R. B. Cockett,
G. S. H. Cruttwell
Abstract:
Tangent categories are categories equipped with a tangent functor: an endofunctor with certain natural transformations which make it behave like the tangent bundle functor on the category of smooth manifolds. They provide an abstract setting for differential geometry by axiomatizing key aspects of the subject which allow the basic theory of these geometric settings to be captured. Importantly, the…
▽ More
Tangent categories are categories equipped with a tangent functor: an endofunctor with certain natural transformations which make it behave like the tangent bundle functor on the category of smooth manifolds. They provide an abstract setting for differential geometry by axiomatizing key aspects of the subject which allow the basic theory of these geometric settings to be captured. Importantly, they have models not only in classical differential geometry and its extensions, but also in algebraic geometry, combinatorics, computer science, and physics.
This paper develops the theory of "differential bundles" for such categories, considers their relation to "differential objects", and develops the theory of fibrations of tangent categories. Differential bundles generalize the notion of smooth vector bundles in classical differential geometry. However, the definition departs from the standard one in several significant ways: in general, there is no scalar multiplication in the fibres of these bundles, and in general these bundles need not be locally trivial.
To understand how these differential bundles relate to differential objects, which are the generalization of vector spaces in smooth manifolds, requires some careful handling of the behaviour of pullbacks with respect to the tangent functor. This is captured by "transverse" and "display" systems for tangent categories, which leads one into the fibrational theory of tangent categories. A key example of a tangent fibration is provided by the "display" differential bundles of a tangent category with a display system. Strikingly, in such examples the fibres are Cartesian differential categories demonstrating a -- not unexpected -- tight connection between the theory of these categories and that of tangent categories.
△ Less
Submitted 9 March, 2017; v1 submitted 27 June, 2016;
originally announced June 2016.
-
Cartesian differential categories revisited
Authors:
G. S. H. Cruttwell
Abstract:
We revisit the definition of Cartesian differential categories, showing that a slightly more general version is useful for a number of reasons. As one application, we show that these general differential categories are comonadic over Cartesian categories, so that every Cartesian category has an associated cofree differential category. We also work out the corresponding results when the categories…
▽ More
We revisit the definition of Cartesian differential categories, showing that a slightly more general version is useful for a number of reasons. As one application, we show that these general differential categories are comonadic over Cartesian categories, so that every Cartesian category has an associated cofree differential category. We also work out the corresponding results when the categories involved have restriction structure, and show that these categories are closed under splitting restriction idempotents.
△ Less
Submitted 20 August, 2012;
originally announced August 2012.
-
Differential restriction categories
Authors:
J. R. B. Cockett,
G. S. H. Cruttwell,
J. D. Gallagher
Abstract:
We combine two recent ideas: cartesian differential categories, and restriction categories. The result is a new structure which axiomatizes the category of smooth maps defined on open subsets of $\R^n$ in a way that is completely algebraic. We also give other models for the resulting structure, discuss what it means for a partial map to be additive or linear, and show that differential restriction…
▽ More
We combine two recent ideas: cartesian differential categories, and restriction categories. The result is a new structure which axiomatizes the category of smooth maps defined on open subsets of $\R^n$ in a way that is completely algebraic. We also give other models for the resulting structure, discuss what it means for a partial map to be additive or linear, and show that differential restriction structure can be lifted through various completion operations.
△ Less
Submitted 20 August, 2012;
originally announced August 2012.
-
A unified framework for generalized multicategories
Authors:
G. S. H. Cruttwell,
Michael A. Shulman
Abstract:
Notions of generalized multicategory have been defined in numerous contexts throughout the literature, and include such diverse examples as symmetric multicategories, globular operads, Lawvere theories, and topological spaces. In each case, generalized multicategories are defined as the "lax algebras" or "Kleisli monoids" relative to a "monad" on a bicategory. However, the meanings of these words…
▽ More
Notions of generalized multicategory have been defined in numerous contexts throughout the literature, and include such diverse examples as symmetric multicategories, globular operads, Lawvere theories, and topological spaces. In each case, generalized multicategories are defined as the "lax algebras" or "Kleisli monoids" relative to a "monad" on a bicategory. However, the meanings of these words differ from author to author, as do the specific bicategories considered. We propose a unified framework: by working with monads on double categories and related structures (rather than bicategories), one can define generalized multicategories in a way that unifies all previous examples, while at the same time simplifying and clarifying much of the theory.
△ Less
Submitted 8 December, 2010; v1 submitted 14 July, 2009;
originally announced July 2009.
