-
Real-time oblivious erasure correction with linear time decoding and constant feedback
Authors:
Shashwat Silas
Abstract:
We continue the study of rateless codes for transmission of information across channels whose rate of erasure is unknown. In such a code, an infinite stream of encoding symbols can be generated from the message and sent across the erasure channel, and the decoder can decode the message after it has successfully collected a certain number of encoding symbols. A rateless erasure code is real-time ob…
▽ More
We continue the study of rateless codes for transmission of information across channels whose rate of erasure is unknown. In such a code, an infinite stream of encoding symbols can be generated from the message and sent across the erasure channel, and the decoder can decode the message after it has successfully collected a certain number of encoding symbols. A rateless erasure code is real-time oblivious if rather than collecting encoding symbols as they are received, the receiver either immediately decodes or discards each symbol it receives.
Efficient real-time oblivious erasure correction uses a feedback channel in order to maximize the probability that a received encoding symbol is decoded rather than discarded. We construct codes which are real-time oblivious, but require fewer feedback messages and have faster decoding compared to previous work. Specifically, for a message of length $k'$, we improve the expected complexity of the feedback channel from $O(\sqrt{k'})$ to $O(1)$, and the expected decoding complexity from $O(k'\log(k'))$ to $O(k')$. Our method involves using an appropriate block erasure code to first encode the $k'$ message symbols, and then using a truncated version of the real-time oblivious erasure correction of Beimel et al (2007) to transmit the encoded message to the receiver, which then uses the decoding algorithm for the outer code to recover the message.
△ Less
Submitted 26 January, 2021;
originally announced January 2021.
-
Threshold rates for properties of random codes
Authors:
Venkatesan Guruswami,
Jonathan Mosheiff,
Nicolas Resch,
Shashwat Silas,
Mary Wootters
Abstract:
Suppose that $P$ is a property that may be satisfied by a random code $C \subset Σ^n$. For example, for some $p \in (0,1)$, ${P}$ might be the property that there exist three elements of $C$ that lie in some Hamming ball of radius $pn$. We say that $R^*$ is the threshold rate for ${P}$ if a random code of rate $R^* + ε$ is very likely to satisfy ${P}$, while a random code of rate $R^* - ε$ is very…
▽ More
Suppose that $P$ is a property that may be satisfied by a random code $C \subset Σ^n$. For example, for some $p \in (0,1)$, ${P}$ might be the property that there exist three elements of $C$ that lie in some Hamming ball of radius $pn$. We say that $R^*$ is the threshold rate for ${P}$ if a random code of rate $R^* + ε$ is very likely to satisfy ${P}$, while a random code of rate $R^* - ε$ is very unlikely to satisfy ${P}$. While random codes are well-studied in coding theory, even the threshold rates for relatively simple properties like the one above are not well understood.
We characterize threshold rates for a rich class of properties. These properties, like the example above, are defined by the inclusion of specific sets of codewords which are also suitably "symmetric". For properties in this class, we show that the threshold rate is in fact equal to the lower bound that a simple first-moment calculation obtains. Our techniques not only pin down the threshold rate for the property ${P}$ above, they give sharp bounds on the threshold rate for list-recovery in several parameter regimes, as well as an efficient algorithm for estimating the threshold rates for list-recovery in general.
△ Less
Submitted 6 June, 2024; v1 submitted 9 September, 2020;
originally announced September 2020.
-
Bounds for list-decoding and list-recovery of random linear codes
Authors:
Venkatesan Guruswami,
Ray Li,
Jonathan Mosheiff,
Nicolas Resch,
Shashwat Silas,
Mary Wootters
Abstract:
A family of error-correcting codes is list-decodable from error fraction $p$ if, for every code in the family, the number of codewords in any Hamming ball of fractional radius $p$ is less than some integer $L$ that is independent of the code length. It is said to be list-recoverable for input list size $\ell$ if for every sufficiently large subset of codewords (of size $L$ or more), there is a coo…
▽ More
A family of error-correcting codes is list-decodable from error fraction $p$ if, for every code in the family, the number of codewords in any Hamming ball of fractional radius $p$ is less than some integer $L$ that is independent of the code length. It is said to be list-recoverable for input list size $\ell$ if for every sufficiently large subset of codewords (of size $L$ or more), there is a coordinate where the codewords take more than $\ell$ values. The parameter $L$ is said to be the "list size" in either case. The capacity, i.e., the largest possible rate for these notions as the list size $L \to \infty$, is known to be $1-h_q(p)$ for list-decoding, and $1-\log_q \ell$ for list-recovery, where $q$ is the alphabet size of the code family.
In this work, we study the list size of random linear codes for both list-decoding and list-recovery as the rate approaches capacity. We show the following claims hold with high probability over the choice of the code (below, $ε> 0$ is the gap to capacity).
(1) A random linear code of rate $1 - \log_q(\ell) - ε$ requires list size $L \ge \ell^{Ω(1/ε)}$ for list-recovery from input list size $\ell$. This is surprisingly in contrast to completely random codes, where $L = O(\ell/ε)$ suffices w.h.p.
(2) A random linear code of rate $1 - h_q(p) - ε$ requires list size $L \ge \lfloor h_q(p)/ε+0.99 \rfloor$ for list-decoding from error fraction $p$, when $ε$ is sufficiently small.
(3) A random binary linear code of rate $1 - h_2(p) - ε$ is list-decodable from average error fraction $p$ with list size with $L \leq \lfloor h_2(p)/ε\rfloor + 2$.
The second and third results together precisely pin down the list sizes for binary random linear codes for both list-decoding and average-radius list-decoding to three possible values.
△ Less
Submitted 18 June, 2020; v1 submitted 27 April, 2020;
originally announced April 2020.
-
LDPC Codes Achieve List Decoding Capacity
Authors:
Jonathan Mosheiff,
Nicolas Resch,
Noga Ron-Zewi,
Shashwat Silas,
Mary Wootters
Abstract:
We show that Gallager's ensemble of Low-Density Parity Check (LDPC) codes achieves list-decoding capacity with high probability. These are the first graph-based codes shown to have this property. This result opens up a potential avenue towards truly linear-time list-decodable codes that achieve list-decoding capacity.
Our result on list decoding follows from a much more general result: any…
▽ More
We show that Gallager's ensemble of Low-Density Parity Check (LDPC) codes achieves list-decoding capacity with high probability. These are the first graph-based codes shown to have this property. This result opens up a potential avenue towards truly linear-time list-decodable codes that achieve list-decoding capacity.
Our result on list decoding follows from a much more general result: any $\textit{local}$ property satisfied with high probability by a random linear code is also satisfied with high probability by a random LDPC code from Gallager's distribution. Local properties are properties characterized by the exclusion of small sets of codewords, and include list-decodability, list-recoverability and average-radius list-decodability.
In order to prove our results on LDPC codes, we establish sharp thresholds for when local properties are satisfied by a random linear code. More precisely, we show that for any local property $\mathcal{P}$, there is some $R^*$ so that random linear codes of rate slightly less than $R^*$ satisfy $\mathcal{P}$ with high probability, while random linear codes of rate slightly more than $R^*$, with high probability, do not. We also give a characterization of the threshold rate $R^*$.
△ Less
Submitted 17 November, 2021; v1 submitted 13 September, 2019;
originally announced September 2019.
-
Load-Balanced Fractional Repetition Codes
Authors:
Alexandra Porter,
Shashwat Silas,
Mary Wootters
Abstract:
We introduce load-balanced fractional repetition (LBFR) codes, which are a strengthening of fractional repetition (FR) codes. LBFR codes have the additional property that multiple node failures can be sequentially repaired by downloading no more than one block from any other node. This allows for better use of the network, and can additionally reduce the number of disk reads necessary to repair mu…
▽ More
We introduce load-balanced fractional repetition (LBFR) codes, which are a strengthening of fractional repetition (FR) codes. LBFR codes have the additional property that multiple node failures can be sequentially repaired by downloading no more than one block from any other node. This allows for better use of the network, and can additionally reduce the number of disk reads necessary to repair multiple nodes. We characterize LBFR codes in terms of their adjacency graphs, and use this characterization to present explicit constructions LBFR codes with storage capacity comparable existing FR codes. Surprisingly, in some parameter regimes, our constructions of LBFR codes match the parameters of the best constructions of FR codes.
△ Less
Submitted 30 October, 2019; v1 submitted 2 February, 2018;
originally announced February 2018.
-
Randomly Generated Subgroups of the Symmetric Group and Random Lifts of Graphs
Authors:
Shashwat Silas
Abstract:
Amit and Linial showed that a random lift of a graph with minimum degree $δ\ge3$ is asymptotically almost surely $δ$-connected, and mentioned the problem of estimating this probability as a function of the degree of the lift. We relate a randomly generated subgroup of the symmetric group on $n$ elements to random $n$-lifts of a graph and use it to provide such an estimate along with related result…
▽ More
Amit and Linial showed that a random lift of a graph with minimum degree $δ\ge3$ is asymptotically almost surely $δ$-connected, and mentioned the problem of estimating this probability as a function of the degree of the lift. We relate a randomly generated subgroup of the symmetric group on $n$ elements to random $n$-lifts of a graph and use it to provide such an estimate along with related results. We also improve their later result showing a lower bound on the edge expansion on random lifts. Our proofs rely on new ideas from group theory which make several improvements possible. We exactly calculate the probability that a random lift of a connected graph with first Betti number $l$ is connected by showing that it is equal to the probability that a subgroup of the symmetric group generated by $l$ random elements is transitive. We also calculate the probability that a subgroup of a wreath product of symmetric groups generated by $l$ random generators is transitive. We show the existence of homotopy invariants in random covering graphs which reduces some of their properties to those of random regular multigraphs, and in particular makes it possible to compute the exact probability with which random regular multigraphs are connected. All our results about random lifts easily extend to iterated random lifts.
△ Less
Submitted 2 August, 2016; v1 submitted 5 July, 2016;
originally announced July 2016.
