-
Lagrangian and Hamiltonian Mechanics for Probabilities on the Statistical Manifold
Authors:
Goffredo Chirco,
Luigi Malagò,
Giovanni Pistone
Abstract:
We provide an Information-Geometric formulation of Classical Mechanics on the Riemannian manifold of probability distributions, which is an affine manifold endowed with a dually-flat connection. In a non-parametric formalism, we consider the full set of positive probability functions on a finite sample space, and we provide a specific expression for the tangent and cotangent spaces over the statis…
▽ More
We provide an Information-Geometric formulation of Classical Mechanics on the Riemannian manifold of probability distributions, which is an affine manifold endowed with a dually-flat connection. In a non-parametric formalism, we consider the full set of positive probability functions on a finite sample space, and we provide a specific expression for the tangent and cotangent spaces over the statistical manifold, in terms of a Hilbert bundle structure that we call the Statistical Bundle. In this setting, we compute velocities and accelerations of a one-dimensional statistical model using the canonical dual pair of parallel transports and define a coherent formalism for Lagrangian and Hamiltonian mechanics on the bundle. Finally, in a series of examples, we show how our formalism provides a consistent framework for accelerated natural gradient dynamics on the probability simplex, paving the way for direct applications in optimization, game theory and neural networks.
△ Less
Submitted 25 August, 2022; v1 submitted 20 September, 2020;
originally announced September 2020.
-
Finite space Kantorovich problem with an MCMC of table moves
Authors:
Giovanni Pistone,
Fabio Rapallo,
Maria Piera Rogantin
Abstract:
In Optimal Transport (OT) on a finite metric space, one defines a distance on the probability simplex that extends the distance on the ground space. The distance is the value of a Linear Programming (LP) problem on the set of non-negative-valued 2-way tables with assigned probability functions as margins. We apply to this case the methodology of moves from Algebraic Statistics (AS) and use it to d…
▽ More
In Optimal Transport (OT) on a finite metric space, one defines a distance on the probability simplex that extends the distance on the ground space. The distance is the value of a Linear Programming (LP) problem on the set of non-negative-valued 2-way tables with assigned probability functions as margins. We apply to this case the methodology of moves from Algebraic Statistics (AS) and use it to derive a Monte Carlo Markov Chain (MCMC) solution algorithm.
△ Less
Submitted 13 January, 2021; v1 submitted 24 February, 2020;
originally announced February 2020.
-
Generation of Fractional Factorial Designs
Authors:
Roberto Fontana,
Giovanni Pistone
Abstract:
The joint use of counting functions, Hilbert basis and Markov basis allows to define a procedure to generate all the fractions that satisfy a given set of constraints in terms of orthogonality. The general case of mixed level designs, without restrictions on the number of levels of each factor (like primes or power of primes) is studied. This new methodology has been experimented on some signifi…
▽ More
The joint use of counting functions, Hilbert basis and Markov basis allows to define a procedure to generate all the fractions that satisfy a given set of constraints in terms of orthogonality. The general case of mixed level designs, without restrictions on the number of levels of each factor (like primes or power of primes) is studied. This new methodology has been experimented on some significant classes of fractional factorial designs, including mixed level orthogonal arrays.
△ Less
Submitted 17 June, 2009;
originally announced June 2009.
-
2-level fractional factorial designs which are the union of non trivial regular designs
Authors:
Roberto Fontana,
Giovanni Pistone
Abstract:
Every fraction is a union of points, which are trivial regular fractions. To characterize non trivial decomposition, we derive a condition for the inclusion of a regular fraction as follows. Let $F = \sum_αb_αX^α$ be the indicator polynomial of a generic fraction, see Fontana et al, JSPI 2000, 149-172. Regular fractions are characterized by $R = \frac 1l \sum_{α\in \mathcal L} e_αX^α$, where…
▽ More
Every fraction is a union of points, which are trivial regular fractions. To characterize non trivial decomposition, we derive a condition for the inclusion of a regular fraction as follows. Let $F = \sum_αb_αX^α$ be the indicator polynomial of a generic fraction, see Fontana et al, JSPI 2000, 149-172. Regular fractions are characterized by $R = \frac 1l \sum_{α\in \mathcal L} e_αX^α$, where $α\mapsto e_α$ is an group homeomorphism from $\mathcal L \subset \mathbb Z_2^d$ into $\{-1,+1\}$. The regular $R$ is a subset of the fraction $F$ if $FR = R$, which in turn is equivalent to $\sum_t F(t)R(t) = \sum_t R(t)$. If $\mathcal H = \{α_1 >... α_k\}$ is a generating set of $\mathcal L$, and $R = \frac1{2^k}(1 + e_1X^{α_1}) ... (1 + e_kX^{α_k})$, $e_j = \pm 1$, $j=1 ... k$, the inclusion condition in term of the $b_α$'s is % \begin{equation}b_0 + e_1 b_{α_1} + >... + e_1 ... e_k b_{α_1 + ... + α_k} = 1. \tag{*}\end{equation} % The last part of the paper will discuss some examples to investigate the practical applicability of the previous condition (*).
This paper is an offspring of the Alcotra 158 EU research contract on the planning of sequential designs for sample surveys in tourism statistics.
△ Less
Submitted 31 October, 2007;
originally announced October 2007.