Showing 1–7 of 7 results for author: Šenk, V

SISO Decoding of Z4 Linear Kerdock and Preparata Codes

Authors: Aleksandar Minja, Vojin Šenk

Abstract: Some nonlinear codes, such as Kerdock and Preparata codes, can be represented as binary images under the Gray map of linear codes over rings. This paper introduces MAP decoding of Kerdock and Preparata codes by working with their quaternary representation (linear codes over Z4 ) with the complexity of O(N2log2N), where N is the code length in Z4. A sub-optimal bitwise APP decoder with good error-c… ▽ More Some nonlinear codes, such as Kerdock and Preparata codes, can be represented as binary images under the Gray map of linear codes over rings. This paper introduces MAP decoding of Kerdock and Preparata codes by working with their quaternary representation (linear codes over Z4 ) with the complexity of O(N2log2N), where N is the code length in Z4. A sub-optimal bitwise APP decoder with good error-correcting performance and complexity of O(Nlog2N) that is constructed using the decoder lifting technique is also introduced. This APP decoder extends upon the original lifting decoder by working with likelihoods instead of hard decisions and is not limited to Kerdock and Preparata code families. Simulations show that our novel decoders significantly outperform several popular decoders in terms of error rate. △ Less

Submitted 30 November, 2023; originally announced December 2023.

Journal ref: IEEE Transactions on Communications, vol. 70, no. 3, pp. 1497-1507, March 2022

Convolutional Codes with Optimum Bidirectional Distance Profile

Authors: Ivan Stanojević, Vojin Šenk

Abstract: We define the bidirectional distance profile (BDP) of a convolutional code as the minimum of the distance profiles of the code and its corresponding "reverse" code. We present tables of codes with the optimum BDP (OBDP), which minimize the average complexity of bidirectional sequential decoding algorithms. The computer search is accelerated by the facts that optimum distance profile (ODP) codes of… ▽ More We define the bidirectional distance profile (BDP) of a convolutional code as the minimum of the distance profiles of the code and its corresponding "reverse" code. We present tables of codes with the optimum BDP (OBDP), which minimize the average complexity of bidirectional sequential decoding algorithms. The computer search is accelerated by the facts that optimum distance profile (ODP) codes of larger memory must have ODP codes of smaller memory as their "prefixes", and that OBDP codes can be obtained by "concatenating" ODP and reverse ODP codes of smaller memory. We compare the performance of OBDP codes and other codes by simulation. △ Less

Submitted 28 November, 2023; v1 submitted 27 October, 2022; originally announced October 2022.

IP Session continuity in heterogeneous mobile networks using Software Defined Networking

Authors: Petar D. Bojović, Živko Bojović, Dragana Bajić, Vojin Šenk

Abstract: Smart environment requires uninterrupted connection when moving from one network to another. This is best accomplished at the network level (L3). Full interoperability and integration of heterogeneous networks is necessary for communication session continuity. Software Defined Networking (SDN) with virtual IP addresses solves the problem. Implementing a homogeneous SDN is expensive, given the enor… ▽ More Smart environment requires uninterrupted connection when moving from one network to another. This is best accomplished at the network level (L3). Full interoperability and integration of heterogeneous networks is necessary for communication session continuity. Software Defined Networking (SDN) with virtual IP addresses solves the problem. Implementing a homogeneous SDN is expensive, given the enormous investments in existing networks. To solve this second problem, we deploy the least set of SDN features to provide full L3 mobility. We use a common controller to manage the IP address translations. △ Less

Submitted 13 November, 2017; originally announced November 2017.

Comments: Accepted for publishing at Journal of Communications and Networks, Special issue on Wireless SDN

Journal ref: Journal of Communications and Networks 19(6):563-568, December 2017

Information-Geometric Equivalence of Transportation Polytopes

Authors: Mladen Kovačević, Ivan Stanojević, Vojin Šenk

Abstract: This paper deals with transportation polytopes in the probability simplex (that is, sets of categorical bivariate probability distributions with prescribed marginals). Information projections between such polytopes are studied, and a sufficient condition is described under which these mappings are homeomorphisms. This paper deals with transportation polytopes in the probability simplex (that is, sets of categorical bivariate probability distributions with prescribed marginals). Information projections between such polytopes are studied, and a sufficient condition is described under which these mappings are homeomorphisms. △ Less

Submitted 6 July, 2015; v1 submitted 13 February, 2014; originally announced February 2014.

Comments: 6 pages, 1 figure. v2: A remark concerning Frechet-Hoeffding bounds is added

MSC Class: 94A17; 52B11; 52B12; 62B10; 62H17; 54C99

Journal ref: Probl. Inf. Transm., vol. 51, no. 2, pp. 103-109, Apr. 2015

On the Entropy of Couplings

Authors: Mladen Kovačević, Ivan Stanojević, Vojin Šenk

Abstract: In this paper, some general properties of Shannon information measures are investigated over sets of probability distributions with restricted marginals. Certain optimization problems associated with these functionals are shown to be NP-hard, and their special cases are found to be essentially information-theoretic restatements of well-known computational problems, such as the SUBSET SUM and the… ▽ More In this paper, some general properties of Shannon information measures are investigated over sets of probability distributions with restricted marginals. Certain optimization problems associated with these functionals are shown to be NP-hard, and their special cases are found to be essentially information-theoretic restatements of well-known computational problems, such as the SUBSET SUM and the 3-PARTITION. The notion of minimum entropy coupling is introduced and its relevance is demonstrated in information-theoretic, computational, and statistical contexts. Finally, a family of pseudometrics (on the space of discrete probability distributions) defined by these couplings is studied, in particular their relation to the total variation distance, and a new characterization of the conditional entropy is given. △ Less

Submitted 22 March, 2015; v1 submitted 13 March, 2013; originally announced March 2013.

Comments: 18 pages (single-column). Compared to v1, the material is reorganized, Section IV.C is removed (the results will possible appear elsewhere), Propositions 3.2 and 3.7 are added. Accepted for publication in Information and Computation

MSC Class: 94A17; 60E99; 68Q17

Journal ref: Inf. Comput., vol. 242, pp. 369-382, June 2015

On the Hardness of Entropy Minimization and Related Problems

Authors: Mladen Kovačević, Ivan Stanojević, Vojin Šenk

Abstract: We investigate certain optimization problems for Shannon information measures, namely, minimization of joint and conditional entropies $H(X,Y)$, $H(X|Y)$, $H(Y|X)$, and maximization of mutual information $I(X;Y)$, over convex regions. When restricted to the so-called transportation polytopes (sets of distributions with fixed marginals), very simple proofs of NP-hardness are obtained for these prob… ▽ More We investigate certain optimization problems for Shannon information measures, namely, minimization of joint and conditional entropies $H(X,Y)$, $H(X|Y)$, $H(Y|X)$, and maximization of mutual information $I(X;Y)$, over convex regions. When restricted to the so-called transportation polytopes (sets of distributions with fixed marginals), very simple proofs of NP-hardness are obtained for these problems because in that case they are all equivalent, and their connection to the well-known \textsc{Subset sum} and \textsc{Partition} problems is revealed. The computational intractability of the more general problems over arbitrary polytopes is then a simple consequence. Further, a simple class of polytopes is shown over which the above problems are not equivalent and their complexity differs sharply, namely, minimization of $H(X,Y)$ and $H(Y|X)$ is trivial, while minimization of $H(X|Y)$ and maximization of $I(X;Y)$ are strongly NP-hard problems. Finally, two new (pseudo)metrics on the space of discrete probability distributions are introduced, based on the so-called variation of information quantity, and NP-hardness of their computation is shown. △ Less

Submitted 5 July, 2012; originally announced July 2012.

Comments: IEEE Information Theory Workshop (ITW) 2012

MSC Class: 94A17; 68Q17

Some Properties of Rényi Entropy over Countably Infinite Alphabets

Authors: Mladen Kovačević, Ivan Stanojević, Vojin Šenk

Abstract: In this paper we study certain properties of Rényi entropy functionals $H_α(\mathcal{P})$ on the space of probability distributions over $\mathbb{Z}_+$. Primarily, continuity and convergence issues are addressed. Some properties shown parallel those known in the finite alphabet case, while others illustrate a quite different behaviour of Rényi entropy in the infinite case. In particular, it is sho… ▽ More In this paper we study certain properties of Rényi entropy functionals $H_α(\mathcal{P})$ on the space of probability distributions over $\mathbb{Z}_+$. Primarily, continuity and convergence issues are addressed. Some properties shown parallel those known in the finite alphabet case, while others illustrate a quite different behaviour of Rényi entropy in the infinite case. In particular, it is shown that, for any distribution $\mathcal P$ and any $r\in[0,\infty]$, there exists a sequence of distributions $\mathcal{P}_n$ converging to $\mathcal{P}$ with respect to the total variation distance, such that $\lim_{n\to\infty}\lim_{α\to{1+}} H_α(\mathcal{P}_n) = \lim_{α\to{1+}}\lim_{n\to\infty} H_α(\mathcal{P}_n) + r$. △ Less

Submitted 27 February, 2013; v1 submitted 25 June, 2011; originally announced June 2011.

Comments: 13 pages (single-column)

MSC Class: 94A17 ACM Class: H.1.1

Journal ref: Probl. Inf. Transm., vol. 49, no. 2, pp. 99-110, Apr. 2013