Showing 1–1 of 1 results for author: Parker, A E

The Lack of Convexity of the Relevance-Compression Function

Authors: Albert E Parker, Tomas Gedeon, Alexander Dimitrov

Abstract: In this paper we investigate the convexity of the relevance-compression function for the Information Bottleneck and the Information Distortion problems. This curve is an analog of the rate-distortion curve, which is convex. In the problems we discuss in this paper, the distortion function is not a linear function of the quantizer, and the relevance-compression function is not necessarily convex (c… ▽ More In this paper we investigate the convexity of the relevance-compression function for the Information Bottleneck and the Information Distortion problems. This curve is an analog of the rate-distortion curve, which is convex. In the problems we discuss in this paper, the distortion function is not a linear function of the quantizer, and the relevance-compression function is not necessarily convex (concave), but can change its convexity. We relate this phenomena with existence of first order phase transitions in the corresponding Lagrangian as a function of the annealing parameter. △ Less

Submitted 22 April, 2022; originally announced April 2022.

Comments: 8 pages, 2 figures

MSC Class: 68P30 94A34