-
Workshop on Information Theory and Related Fields -- In Memory of Ning Cai
Authors:
Christian Deppe,
Holger Boche,
Rami Ezzine,
Wafa Labidi
Abstract:
Sadly, our esteemed colleague and friend Ning Cai passed away on 25th May, 2023. In his memory, Ingo Althöfer, Holger Boche, Christian Deppe, Jens Stoye, Ulrich Tamm, Andreas Winter, and Raymond Yeung have organized the "Workshop on Information Theory and Related Fields" at the Bielefeld ZiF (Center for Interdisciplinary Research). This special event will be held from 24th November to 26th Novembe…
▽ More
Sadly, our esteemed colleague and friend Ning Cai passed away on 25th May, 2023. In his memory, Ingo Althöfer, Holger Boche, Christian Deppe, Jens Stoye, Ulrich Tamm, Andreas Winter, and Raymond Yeung have organized the "Workshop on Information Theory and Related Fields" at the Bielefeld ZiF (Center for Interdisciplinary Research). This special event will be held from 24th November to 26th November, 2023. The workshop aims to celebrate Ning Cai's remarkable contributions to the field of information theory and to provide a platform for discussing current research in related areas. Ning Cai's work has had a significant impact on many domains, and this gathering will bring together colleagues, collaborators, and young researchers who have been influenced by his pioneering efforts.
△ Less
Submitted 25 September, 2024; v1 submitted 3 August, 2024;
originally announced August 2024.
-
Common Randomness Generation from Sources with Infinite Polish Alphabet
Authors:
Wafa Labidi,
Rami Ezzine,
Moritz Wiese,
Christian Deppe,
Holger Boche
Abstract:
We investigate the problem of common randomness (CR) generation in the basic two-party communication setting in which a sender and a receiver aim to agree on a common random variable with high probability. The terminals observe independent and identically distributed (i.i.d.) samples of sources with an arbitrary distribution defined on a Polish alphabet and are allowed to communicate as little as…
▽ More
We investigate the problem of common randomness (CR) generation in the basic two-party communication setting in which a sender and a receiver aim to agree on a common random variable with high probability. The terminals observe independent and identically distributed (i.i.d.) samples of sources with an arbitrary distribution defined on a Polish alphabet and are allowed to communicate as little as possible over a noisy, memoryless channel. We establish single-letter upper and lower bounds on the CR capacity for the specified model. The derived bounds hold with equality except for at most countably many points where discontinuity issues might arise.
△ Less
Submitted 3 May, 2024;
originally announced May 2024.
-
Common Randomness Generation from Finite Compound Sources
Authors:
Rami Ezzine,
Moritz Wiese,
Christian Deppe,
Holger Boche
Abstract:
We investigate the problem of generating common randomness (CR) from finite compound sources aided by unidirectional communication over rate-limited perfect channels. The two communicating parties, often referred to as terminals, observe independent and identically distributed (i.i.d.) samples of a finite compound source and aim to agree on a common random variable with a high probability for ever…
▽ More
We investigate the problem of generating common randomness (CR) from finite compound sources aided by unidirectional communication over rate-limited perfect channels. The two communicating parties, often referred to as terminals, observe independent and identically distributed (i.i.d.) samples of a finite compound source and aim to agree on a common random variable with a high probability for every possible realization of the source state. Both parties know the set of source states as well as their statistics. However, they are unaware of the actual realization of the source state. We establish a single-letter lower and upper bound on the compound CR capacity for the specified model. Furthermore, we present two special scenarios where the established bounds coincide.
△ Less
Submitted 25 January, 2024;
originally announced January 2024.
-
A Lower and Upper Bound on the Epsilon-Uniform Common Randomness Capacity
Authors:
Rami Ezzine,
Moritz Wiese,
Christian Deppe,
Holger Boche
Abstract:
We consider a standard two-source model for uniform common randomness (UCR) generation, in which Alice and Bob observe independent and identically distributed (i.i.d.) samples of a correlated finite source and where Alice is allowed to send information to Bob over an arbitrary single-user channel. We study the \(\boldsymbolε\)-UCR capacity for the proposed model, defined as the maximum common rand…
▽ More
We consider a standard two-source model for uniform common randomness (UCR) generation, in which Alice and Bob observe independent and identically distributed (i.i.d.) samples of a correlated finite source and where Alice is allowed to send information to Bob over an arbitrary single-user channel. We study the \(\boldsymbolε\)-UCR capacity for the proposed model, defined as the maximum common randomness rate one can achieve such that the probability that Alice and Bob do not agree on a common uniform or nearly uniform random variable does not exceed \(\boldsymbolε.\)
We establish a lower and an upper bound on the \(\boldsymbolε\)-UCR capacity using the bounds on the \(\boldsymbolε\)-transmission capacity proved by Verdú and Han for arbitrary point-to-point channels.
△ Less
Submitted 9 May, 2023;
originally announced May 2023.
-
Message Transmission and Common Randomness Generation over MIMO Slow Fading Channels with Arbitrary Channel State Distribution
Authors:
Rami Ezzine,
Moritz Wiese,
Christian Deppe,
Holger Boche
Abstract:
We investigate the problem of message transmission and the problem of common randomness (CR) generation over single-user multiple-input multiple-output (MIMO) slow fading channels with average input power constraint, additive white Gaussian noise (AWGN), arbitrary state distribution and with complete channel state information available at the receiver side (CSIR). First, we derive a lower and an u…
▽ More
We investigate the problem of message transmission and the problem of common randomness (CR) generation over single-user multiple-input multiple-output (MIMO) slow fading channels with average input power constraint, additive white Gaussian noise (AWGN), arbitrary state distribution and with complete channel state information available at the receiver side (CSIR). First, we derive a lower and an upper bound on the outage transmission capacity of MIMO slow fading channels for arbitrary state distribution and show that the bounds coincide except possibly at the points of discontinuity of the outage transmission capacity, of which there are, at most, countably many. To prove the lower bound on the outage transmission capacity, we also establish the capacity of a specific compound MIMO Gaussian channel. Second, we define the outage CR capacity for a two-source model with unidirectional communication over a MIMO slow fading channel with arbitrary state distribution and establish a lower and an upper bound on it using our bounds on the outage transmission capacity of the MIMO slow fading channel.
△ Less
Submitted 21 October, 2022;
originally announced October 2022.
-
Common Randomness Generation from Sources with Countable Alphabet
Authors:
Wafa Labidi,
Rami Ezzine,
Christian Deppe,
Moritz Wiese,
Holger Boche
Abstract:
We study a standard two-source model for common randomness (CR) generation in which Alice and Bob generate a common random variable with high probability of agreement by observing independent and identically distributed (i.i.d.) samples of correlated sources on countably infinite alphabets. The two parties are additionally allowed to communicate as little as possible over a noisy memoryless channe…
▽ More
We study a standard two-source model for common randomness (CR) generation in which Alice and Bob generate a common random variable with high probability of agreement by observing independent and identically distributed (i.i.d.) samples of correlated sources on countably infinite alphabets. The two parties are additionally allowed to communicate as little as possible over a noisy memoryless channel. In our work, we give a single-letter formula for the CR capacity for the proposed model and provide a rigorous proof of it. This is a challenging scenario because some of the finite alphabet properties, namely of the entropy can not be extended to the countably infinite case. Notably, it is known that the Shannon entropy is in fact discontinuous at all probability distributions with countably infinite support.
△ Less
Submitted 14 October, 2022; v1 submitted 10 October, 2022;
originally announced October 2022.
-
A Single-Letter Capacity Formula for MIMO Gauss-Markov Rayleigh Fading Channels
Authors:
Rami Ezzine,
Moritz Wiese,
Christian Deppe,
Holger Boche
Abstract:
Over the past decades, the problem of communication over finite-state Markov channels (FSMCs) has been investigated in many researches and the capacity of FSMCs has been studied in closed form under the assumption of the availability of partial/complete channel state information at the sender and/or the receiver. In our work, we focus on infinite-state Markov channels by investigating the problem…
▽ More
Over the past decades, the problem of communication over finite-state Markov channels (FSMCs) has been investigated in many researches and the capacity of FSMCs has been studied in closed form under the assumption of the availability of partial/complete channel state information at the sender and/or the receiver. In our work, we focus on infinite-state Markov channels by investigating the problem of message transmission over time-varying single-user multiple-input multiple-output (MIMO) Gauss-Markov Rayleigh fading channels with average power constraint and with complete channel state information available at the receiver side (CSIR). We completely solve the problem by giving a single-letter characterization of the channel capacity in closed form and by providing a proof of it.
△ Less
Submitted 27 July, 2022;
originally announced July 2022.
-
A General Formula for Uniform Common Randomness Capacity
Authors:
Rami Ezzine,
Moritz Wiese,
Christian Deppe,
Holger Boche
Abstract:
We generalize the uniform common randomness capacity formula, initially established by Ahslwede and Csiszár for a two-source model for common randomness generation from independent and identically distributed (i.i.d.) discrete sources with unidirectional communication over rate-limited discrete noiseless channels to the case when the one-way communication is over arbitrary single-user channels. In…
▽ More
We generalize the uniform common randomness capacity formula, initially established by Ahslwede and Csiszár for a two-source model for common randomness generation from independent and identically distributed (i.i.d.) discrete sources with unidirectional communication over rate-limited discrete noiseless channels to the case when the one-way communication is over arbitrary single-user channels. In our proof, we will make use of the transmission capacity formula established by Verdú and Han for arbitrary point-to-point channels.
△ Less
Submitted 9 September, 2022; v1 submitted 9 May, 2022;
originally announced May 2022.
-
Common Randomness Generation from Gaussian Sources
Authors:
Wafa Labidi,
Rami Ezzine,
Christian Deppe,
Holger Boche
Abstract:
We study the problem of common randomness (CR) generation in the basic two-party communication setting in which the sender and the receiver aim to agree on a common random variable with high probability by observing independent and identically distributed (i.i.d.) samples of correlated Gaussian sources and while communicating as little as possible over a noisy memoryless channel. We completely sol…
▽ More
We study the problem of common randomness (CR) generation in the basic two-party communication setting in which the sender and the receiver aim to agree on a common random variable with high probability by observing independent and identically distributed (i.i.d.) samples of correlated Gaussian sources and while communicating as little as possible over a noisy memoryless channel. We completely solve the problem by giving a single-letter characterization of the CR capacity for the proposed model and by providing a rigorous proof of it. Interestingly, we prove that the CR capacity is infinite when the Gaussian sources are perfectly correlated.
△ Less
Submitted 26 January, 2022;
originally announced January 2022.
-
A Rigorous Proof of the Capacity of MIMO Gauss-Markov Rayleigh Fading Channels
Authors:
Rami Ezzine,
Moritz Wiese,
Christian Deppe,
Holger Boche
Abstract:
We investigate the problem of message transmission over time-varying single-user multiple-input multiple-output (MIMO) Rayleigh fading channels with average power constraint and with complete channel state information available at the receiver side (CSIR). To describe the channel variations over the time, we consider a first-order Gauss-Markov model. We completely solve the problem by giving a sin…
▽ More
We investigate the problem of message transmission over time-varying single-user multiple-input multiple-output (MIMO) Rayleigh fading channels with average power constraint and with complete channel state information available at the receiver side (CSIR). To describe the channel variations over the time, we consider a first-order Gauss-Markov model. We completely solve the problem by giving a single-letter characterization of the channel capacity in closed form and by providing a rigorous proof of it.
△ Less
Submitted 13 April, 2022; v1 submitted 10 January, 2022;
originally announced January 2022.
-
Outage Common Randomness Capacity Characterization of Multiple-Antenna Slow Fading Channels
Authors:
Rami Ezzine,
Moritz Wiese,
Christian Deppe,
Holger Boche
Abstract:
We investigate the problem of common randomness (CR) generation from discrete correlated sources aided by one-way communication over single-user multiple-input multiple-output (MIMO) slow fading channels with additive white Gaussian noise (AWGN), arbitrary state distribution and with channel state information available at the receiver side (CSIR). We completely solve the problem by first character…
▽ More
We investigate the problem of common randomness (CR) generation from discrete correlated sources aided by one-way communication over single-user multiple-input multiple-output (MIMO) slow fading channels with additive white Gaussian noise (AWGN), arbitrary state distribution and with channel state information available at the receiver side (CSIR). We completely solve the problem by first characterizing the channel outage capacity of MIMO slow fading channels for arbitrary state distribution. For this purpose, we also provide an achievable rate for a specific compound MIMO Gaussian channel. Second, we define the outage CR capacity of the MIMO slow fading channel and establish a single-letter characterization of it using our result on its outage transmission capacity.
△ Less
Submitted 18 October, 2021; v1 submitted 13 May, 2021;
originally announced May 2021.
-
Common Randomness Generation over Slow Fading Channels
Authors:
Rami Ezzine,
Moritz Wiese,
Christian Deppe,
Holger Boche
Abstract:
This paper analyzes the problem of common randomness (CR) generation from correlated discrete sources aided by unidirectional communication over Single-Input Single-Output (SISO) slow fading channels with additive white Gaussian noise (AWGN) and arbitrary state distribution. Slow fading channels are practically relevant for wireless communications.
We completely solve the SISO slow fading case b…
▽ More
This paper analyzes the problem of common randomness (CR) generation from correlated discrete sources aided by unidirectional communication over Single-Input Single-Output (SISO) slow fading channels with additive white Gaussian noise (AWGN) and arbitrary state distribution. Slow fading channels are practically relevant for wireless communications.
We completely solve the SISO slow fading case by establishing its corresponding outage CR capacity using our characterization of its channel outage capacity.
The generated CR could be exploited to improve the performance gain in the identification scheme. The latter is known to be more efficient than the classical transmission scheme in many new applications, which demand ultra-reliable low latency communication.
△ Less
Submitted 7 June, 2021; v1 submitted 1 February, 2021;
originally announced February 2021.