Showing 1–4 of 4 results for author: Krefl, D

Product Jacobi-Theta Boltzmann machines with score matching

Authors: Andrea Pasquale, Daniel Krefl, Stefano Carrazza, Frank Nielsen

Abstract: The estimation of probability density functions is a non trivial task that over the last years has been tackled with machine learning techniques. Successful applications can be obtained using models inspired by the Boltzmann machine (BM) architecture. In this manuscript, the product Jacobi-Theta Boltzmann machine (pJTBM) is introduced as a restricted version of the Riemann-Theta Boltzmann machine… ▽ More The estimation of probability density functions is a non trivial task that over the last years has been tackled with machine learning techniques. Successful applications can be obtained using models inspired by the Boltzmann machine (BM) architecture. In this manuscript, the product Jacobi-Theta Boltzmann machine (pJTBM) is introduced as a restricted version of the Riemann-Theta Boltzmann machine (RTBM) with diagonal hidden sector connection matrix. We show that score matching, based on the Fisher divergence, can be used to fit probability densities with the pJTBM more efficiently than with the original RTBM. △ Less

Submitted 12 January, 2024; v1 submitted 10 March, 2023; originally announced March 2023.

Comments: 7 pages, 3 figures, ACAT22 proceedings

Report number: TIF-UNIMI-2023-8

Modelling conditional probabilities with Riemann-Theta Boltzmann Machines

Authors: Stefano Carrazza, Daniel Krefl, Andrea Papaluca

Abstract: The probability density function for the visible sector of a Riemann-Theta Boltzmann machine can be taken conditional on a subset of the visible units. We derive that the corresponding conditional density function is given by a reparameterization of the Riemann-Theta Boltzmann machine modelling the original probability density function. Therefore the conditional densities can be directly inferred… ▽ More The probability density function for the visible sector of a Riemann-Theta Boltzmann machine can be taken conditional on a subset of the visible units. We derive that the corresponding conditional density function is given by a reparameterization of the Riemann-Theta Boltzmann machine modelling the original probability density function. Therefore the conditional densities can be directly inferred from the Riemann-Theta Boltzmann machine. △ Less

Submitted 27 May, 2019; originally announced May 2019.

Comments: 7 pages, 3 figures, in proceedings of the 19th International Workshop on Advanced Computing and Analysis Techniques in Physics Research (ACAT 2019)

Report number: TIF-UNIMI-2019-6

Sampling the Riemann-Theta Boltzmann Machine

Authors: Stefano Carrazza, Daniel Krefl

Abstract: We show that the visible sector probability density function of the Riemann-Theta Boltzmann machine corresponds to a gaussian mixture model consisting of an infinite number of component multi-variate gaussians. The weights of the mixture are given by a discrete multi-variate gaussian over the hidden state space. This allows us to sample the visible sector density function in a straight-forward man… ▽ More We show that the visible sector probability density function of the Riemann-Theta Boltzmann machine corresponds to a gaussian mixture model consisting of an infinite number of component multi-variate gaussians. The weights of the mixture are given by a discrete multi-variate gaussian over the hidden state space. This allows us to sample the visible sector density function in a straight-forward manner. Furthermore, we show that the visible sector probability density function possesses an affine transform property, similar to the multi-variate gaussian density. △ Less

Submitted 30 June, 2020; v1 submitted 20 April, 2018; originally announced April 2018.

Comments: 9 pages, 6 figures

Riemann-Theta Boltzmann Machine

Authors: Daniel Krefl, Stefano Carrazza, Babak Haghighat, Jens Kahlen

Abstract: A general Boltzmann machine with continuous visible and discrete integer valued hidden states is introduced. Under mild assumptions about the connection matrices, the probability density function of the visible units can be solved for analytically, yielding a novel parametric density function involving a ratio of Riemann-Theta functions. The conditional expectation of a hidden state for given visi… ▽ More A general Boltzmann machine with continuous visible and discrete integer valued hidden states is introduced. Under mild assumptions about the connection matrices, the probability density function of the visible units can be solved for analytically, yielding a novel parametric density function involving a ratio of Riemann-Theta functions. The conditional expectation of a hidden state for given visible states can also be calculated analytically, yielding a derivative of the logarithmic Riemann-Theta function. The conditional expectation can be used as activation function in a feedforward neural network, thereby increasing the modelling capacity of the network. Both the Boltzmann machine and the derived feedforward neural network can be successfully trained via standard gradient- and non-gradient-based optimization techniques. △ Less

Submitted 28 January, 2020; v1 submitted 20 December, 2017; originally announced December 2017.

Comments: 29 pages, 11 figures, final version published in Neurocomputing

Report number: CERN-TH-2017-275