Showing 1–3 of 3 results for author: Barnfield, N

Ziv-Merhav estimation for hidden-Markov processes

Authors: Nicholas Barnfield, Raphaël Grondin, Gaia Pozzoli, Renaud Raquépas

Abstract: We present a proof of strong consistency of a Ziv-Merhav-type estimator of the cross entropy rate for pairs of hidden-Markov processes. Our proof strategy has two novel aspects: the focus on decoupling properties of the laws and the use of tools from the thermodynamic formalism. We present a proof of strong consistency of a Ziv-Merhav-type estimator of the cross entropy rate for pairs of hidden-Markov processes. Our proof strategy has two novel aspects: the focus on decoupling properties of the laws and the use of tools from the thermodynamic formalism. △ Less

Submitted 16 August, 2024; originally announced August 2024.

Comments: Short note prepared for the IEEE International Symposium on Information Theory 2024 on a special case of arXiv:2312.02098

MSC Class: 94A17; 37M25

Journal ref: IEEE International Symposium on Information Theory 2024, 3606-3611

On the Ziv-Merhav theorem beyond Markovianity II: leveraging the thermodynamic formalism

Authors: Nicholas Barnfield, Raphaël Grondin, Gaia Pozzoli, Renaud Raquépas

Abstract: We prove asymptotic results for a modification of the cross-entropy estimator originally introduced by Ziv and Merhav in the Markovian setting in 1993. Our results concern a more general class of decoupled measures on shift spaces over a finite alphabet and in particular imply strong asymptotic consistency of the modified estimator for all pairs of functions of stationary, irreducible, finite-stat… ▽ More We prove asymptotic results for a modification of the cross-entropy estimator originally introduced by Ziv and Merhav in the Markovian setting in 1993. Our results concern a more general class of decoupled measures on shift spaces over a finite alphabet and in particular imply strong asymptotic consistency of the modified estimator for all pairs of functions of stationary, irreducible, finite-state Markov chains satisfying a mild decay condition. Our approach is based on the study of a rescaled cumulant-generating function called the cross-entropic pressure, importing to information theory some techniques from the study of large deviations within the thermodynamic formalism. △ Less

Submitted 25 March, 2024; v1 submitted 4 December, 2023; originally announced December 2023.

MSC Class: 94A17; 37M25; 60F15; 37D35

On the Ziv-Merhav theorem beyond Markovianity

Authors: Nicholas Barnfield, Raphaël Grondin, Gaia Pozzoli, Renaud Raquépas

Abstract: We generalize to a broader class of decoupled measures a result of Ziv and Merhav on universal estimation of the specific cross (or relative) entropy for a pair of multi-level Markov measures. The result covers pairs of suitably regular g-measures and pairs of equilibrium measures arising from the small space of interactions in mathematical statistical mechanics. We generalize to a broader class of decoupled measures a result of Ziv and Merhav on universal estimation of the specific cross (or relative) entropy for a pair of multi-level Markov measures. The result covers pairs of suitably regular g-measures and pairs of equilibrium measures arising from the small space of interactions in mathematical statistical mechanics. △ Less

Submitted 2 October, 2023; originally announced October 2023.

MSC Class: 94A17; 37M25; 37B10