-
Topos and Stacks of Deep Neural Networks
Authors:
Jean-Claude Belfiore,
Daniel Bennequin
Abstract:
Every known artificial deep neural network (DNN) corresponds to an object in a canonical Grothendieck's topos; its learning dynamic corresponds to a flow of morphisms in this topos. Invariance structures in the layers (like CNNs or LSTMs) correspond to Giraud's stacks. This invariance is supposed to be responsible of the generalization property, that is extrapolation from learning data under const…
▽ More
Every known artificial deep neural network (DNN) corresponds to an object in a canonical Grothendieck's topos; its learning dynamic corresponds to a flow of morphisms in this topos. Invariance structures in the layers (like CNNs or LSTMs) correspond to Giraud's stacks. This invariance is supposed to be responsible of the generalization property, that is extrapolation from learning data under constraints. The fibers represent pre-semantic categories (Culioli, Thom), over which artificial languages are defined, with internal logics, intuitionist, classical or linear (Girard). Semantic functioning of a network is its ability to express theories in such a language for answering questions in output about input data. Quantities and spaces of semantic information are defined by analogy with the homological interpretation of Shannon's entropy of P.Baudot and D.Bennequin in 2015). They generalize the measures found by Carnap and Bar-Hillel (1952). Amazingly, the above semantical structures are classified by geometric fibrant objects in a closed model category of Quillen, then they give rise to homotopical invariants of DNNs and of their semantic functioning. Intentional type theories (Martin-Loef) organize these objects and fibrations between them. Information contents and exchanges are analyzed by Grothendieck's derivators.
△ Less
Submitted 16 June, 2022; v1 submitted 28 June, 2021;
originally announced June 2021.
-
Extra-fine sheaves and interaction decompositions
Authors:
Daniel Bennequin,
Olivier Peltre,
Grégoire Sergeant-Perthuis,
Juan Pablo Vigneaux
Abstract:
We introduce an original notion of extra-fine sheaf on a topological space, and a variant (hyper-extra-fine) for which Čech cohomology in strictly positive degree vanishes. We provide a characterization of such sheaves when the topological space is a partially ordered set (poset) equipped with the Alexandrov topology. Then we further specialize our results to some sheaves of vector spaces and inje…
▽ More
We introduce an original notion of extra-fine sheaf on a topological space, and a variant (hyper-extra-fine) for which Čech cohomology in strictly positive degree vanishes. We provide a characterization of such sheaves when the topological space is a partially ordered set (poset) equipped with the Alexandrov topology. Then we further specialize our results to some sheaves of vector spaces and injective maps, where extra-fineness is (essentially) equivalent to the decomposition of the sheaf into a direct sum of subfunctors, known as interaction decomposition, and can be expressed by a sum-intersection condition. We use these results to compute the dimension of the space of global sections when the presheaves are freely generated over a functor of sets, generalizing classical counting formulae for the number of solutions of the linearized marginal problem (Kellerer and Matúš). We finish with a comparison theorem between the Čech cohomology associated to a covering and the topos cohomology of the poset with coefficients in the presheaf, which is also the cohomology of a cosimplicial local system over the nerve of the poset. For that, we give a detailed treatment of cosimplicial local systems on simplicial sets. The appendixes present presheaves, sheaves and Čech cohomology, and their application to the marginal problem.
△ Less
Submitted 18 December, 2020; v1 submitted 26 September, 2020;
originally announced September 2020.
-
A functional equation related to generalized entropies and the modular group
Authors:
Daniel Bennequin,
Juan Pablo Vigneaux
Abstract:
We solve a functional equation connected to the algebraic characterization of generalized information functions. To prove the symmetry of the solution, we study a related system of functional equations, which involves two homographies. These transformations generate the modular group, and this fact plays a crucial role in solving the system. The method suggests a more general relation between cond…
▽ More
We solve a functional equation connected to the algebraic characterization of generalized information functions. To prove the symmetry of the solution, we study a related system of functional equations, which involves two homographies. These transformations generate the modular group, and this fact plays a crucial role in solving the system. The method suggests a more general relation between conditional probabilities and arithmetic.
△ Less
Submitted 4 March, 2020; v1 submitted 15 October, 2019;
originally announced October 2019.
-
Optimized Schwarz Waveform Relaxation for Advection Reaction Diffusion Equations in Two Dimensions
Authors:
Daniel Bennequin,
Martin J. Gander,
Loic Gouarin,
Laurence Halpern
Abstract:
Optimized Schwarz Waveform Relaxation methods have been developed over the last decade for the parallel solution of evolution problems. They are based on a decomposition in space and an iteration, where only subproblems in space-time need to be solved. Each subproblem can be simulated using an adapted numerical method, for example with local time stepping, or one can even use a different model in…
▽ More
Optimized Schwarz Waveform Relaxation methods have been developed over the last decade for the parallel solution of evolution problems. They are based on a decomposition in space and an iteration, where only subproblems in space-time need to be solved. Each subproblem can be simulated using an adapted numerical method, for example with local time stepping, or one can even use a different model in different subdomains, which makes these methods very suitable also from a modeling point of view. For rapid convergence however, it is important to use effective transmission conditions between the space-time subdomains, and for best performance, these transmission conditions need to take the physics of the underlying evolution problem into account. The optimization of these transmission conditions leads to a mathematically hard best approximation problem of homographic type. We study in this paper in detail this problem for the case of linear advection reaction diffusion equations in two spatial dimensions. We prove comprehensively best approximation results for transmission conditions of Robin and Ventcel type. We give for each case closed form asymptotic values for the parameters, which guarantee asymptotically best performance of the iterative methods. We finally show extensive numerical experiments, and we measure performance corresponding to our analysis
△ Less
Submitted 4 July, 2014;
originally announced July 2014.
-
Representants lagrangiens de l'homologie des surfaces projectives complexes
Authors:
Daniel Bennequin,
Thanh-Tam Le
Abstract:
Using results by Donaldson and Auroux on pseudo-holomorphic curves as well as Duval's rational convexity construction, the paper investigates the existence of smooth Lagrangian surfaces representing 2-dimensional homology classes in complex projective surfaces. We prove that if the projective surface X is minimal, of general type, with uneven geometric genus, and has an effective, smooth and con…
▽ More
Using results by Donaldson and Auroux on pseudo-holomorphic curves as well as Duval's rational convexity construction, the paper investigates the existence of smooth Lagrangian surfaces representing 2-dimensional homology classes in complex projective surfaces. We prove that if the projective surface X is minimal, of general type, with uneven geometric genus, and has an effective, smooth and connected canonical divisor K, then there exists a non-empty convex open cone in the real 2-dimensional homology group H2(X) such that a multiple of every integral homology class in this cone can be represented by an embedded Lagrangian surface in X\K. A corollary asserts that such a surface X is of simple type in the sense of Kronheimer and Mrowka.
△ Less
Submitted 25 March, 2009;
originally announced March 2009.
