-
List-Recovery of Random Linear Codes over Small Fields
Authors:
Dean Doron,
Jonathan Mosheiff,
Nicolas Resch,
João Ribeiro
Abstract:
We study list-recoverability of random linear codes over small fields, both from errors and from erasures. We consider codes of rate $ε$-close to capacity, and aim to bound the dependence of the output list size $L$ on $ε$, the input list size $\ell$, and the alphabet size $q$. Prior to our work, the best upper bound was $L = q^{O(\ell/ε)}$ (Zyablov and Pinsker, Prob. Per. Inf. 1981).
Previous w…
▽ More
We study list-recoverability of random linear codes over small fields, both from errors and from erasures. We consider codes of rate $ε$-close to capacity, and aim to bound the dependence of the output list size $L$ on $ε$, the input list size $\ell$, and the alphabet size $q$. Prior to our work, the best upper bound was $L = q^{O(\ell/ε)}$ (Zyablov and Pinsker, Prob. Per. Inf. 1981).
Previous work has identified cases in which linear codes provably perform worse than non-linear codes with respect to list-recovery. While there exist non-linear codes that achieve $L=O(\ell/ε)$, we know that $L \ge \ell^{Ω(1/ε)}$ is necessary for list recovery from erasures over fields of small characteristic, and for list recovery from errors over large alphabets. We show that in other relevant regimes there is no significant price to pay for linearity, in the sense that we get the correct dependence on the gap-to-capacity $ε$ and go beyond the Zyablov-Pinsker bound for the first time. Specifically, when $q$ is constant and $ε$ approaches zero:
- For list-recovery from erasures over prime fields, we show that $L \leq C_1/ε$. By prior work, such a result cannot be obtained for low-characteristic fields.
- For list-recovery from errors over arbitrary fields, we prove that $L \leq C_2/ε$.
Above, $C_1$ and $C_2$ depend on the decoding radius, input list size, and field size. We provide concrete bounds on the constants above, and the upper bounds on $L$ improve upon the Zyablov-Pinsker bound whenever $q\leq 2^{(1/ε)^c}$ for some small universal constant $c>0$.
△ Less
Submitted 9 May, 2025;
originally announced May 2025.
-
Let's Have Both! Optimal List-Recoverability via Alphabet Permutation Codes
Authors:
Sergey Komech,
Jonathan Mosheiff
Abstract:
We introduce alphabet-permutation (AP) codes, a new family of error-correcting codes defined by iteratively applying random coordinate-wise permutations to a fixed initial word. A special case recovers random additive codes and random binary linear codes, where each permutation corresponds to an additive shift over a finite field.
We show that when these permutations are drawn from a suitably ``…
▽ More
We introduce alphabet-permutation (AP) codes, a new family of error-correcting codes defined by iteratively applying random coordinate-wise permutations to a fixed initial word. A special case recovers random additive codes and random binary linear codes, where each permutation corresponds to an additive shift over a finite field.
We show that when these permutations are drawn from a suitably ``mixing'' distribution, the resulting code is almost surely list-recoverable with list size proportional to the inverse of the gap to capacity. Compared to any linear code, our construction achieves exponentially smaller list sizes at the same rate. Previously, only fully random codes were known to attain such parameters, requiring exponentially many random bits and offering no structure. In contrast, AP codes are structured and require only polynomially many random bits -- providing the first such construction to match the list-recovery guarantees of random codes.
△ Less
Submitted 8 May, 2025; v1 submitted 9 February, 2025;
originally announced February 2025.
-
Random Reed-Solomon Codes and Random Linear Codes are Locally Equivalent
Authors:
Matan Levi,
Jonathan Mosheiff,
Nikhil Shagrithaya
Abstract:
We establish an equivalence between two important random ensembles of linear codes: random linear codes (RLCs) and random Reed-Solomon (RS) codes. Specifically, we show that these models exhibit identical behavior with respect to key combinatorial properties -- such as list-decodability and list-recoverability -- when the alphabet size is sufficiently large.
We introduce monotone-decreasing loca…
▽ More
We establish an equivalence between two important random ensembles of linear codes: random linear codes (RLCs) and random Reed-Solomon (RS) codes. Specifically, we show that these models exhibit identical behavior with respect to key combinatorial properties -- such as list-decodability and list-recoverability -- when the alphabet size is sufficiently large.
We introduce monotone-decreasing local coordinate-wise linear (LCL) properties, a new class of properties tailored for the large alphabet regime. This class encompasses list-decodability, list-recoverability, and their average-weight variants. We develop a framework for analyzing these properties and prove a threshold theorem for RLCs: for any LCL property ${P}$, there exists a threshold rate $R_{P}$ such that RLCs are likely to satisfy ${P}$ when $R < R_{P}$ and unlikely to do so when $R > R_{P}$. We extend this threshold theorem to random RS codes and show that they share the same threshold $ R_{P} $, thereby establishing the equivalence between the two ensembles and enabling a unified analysis of list-recoverability and related properties.
Applying our framework, we compute the threshold rate for list-decodability, proving that both random RS codes and RLCs achieve the generalized Singleton bound. This recovers a recent result of Alrabiah, Guruswami, and Li (2023) via elementary methods. Additionally, we prove an upper bound on the list-recoverability threshold and conjecture that this bound is tight.
Our approach suggests a plausible pathway for proving this conjecture and thereby pinpointing the list-recoverability parameters of both models. Indeed, following the release of a prior version of this paper, Li and Shagrithaya (2025) used our equivalence theorem to show that random RS codes are near-optimally list-recoverable.
△ Less
Submitted 9 April, 2025; v1 submitted 4 June, 2024;
originally announced June 2024.
-
Low-Degree Polynomials Are Good Extractors
Authors:
Omar Alrabiah,
Jesse Goodman,
Jonathan Mosheiff,
João Ribeiro
Abstract:
We prove that random low-degree polynomials (over $\mathbb{F}_2$) are unbiased, in an extremely general sense. That is, we show that random low-degree polynomials are good randomness extractors for a wide class of distributions. Prior to our work, such results were only known for the small families of (1) uniform sources, (2) affine sources, and (3) local sources. We significantly generalize these…
▽ More
We prove that random low-degree polynomials (over $\mathbb{F}_2$) are unbiased, in an extremely general sense. That is, we show that random low-degree polynomials are good randomness extractors for a wide class of distributions. Prior to our work, such results were only known for the small families of (1) uniform sources, (2) affine sources, and (3) local sources. We significantly generalize these results, and prove the following.
1. Low-degree polynomials extract from small families. We show that a random low-degree polynomial is a good low-error extractor for any small family of sources. In particular, we improve the positive result of Alrabiah, Chattopadhyay, Goodman, Li, and Ribeiro (ICALP 2022) for local sources, and give new results for polynomial and variety sources via a single unified approach.
2. Low-degree polynomials extract from sumset sources. We show that a random low-degree polynomial is a good extractor for sumset sources, which are the most general large family of sources (capturing independent sources, interleaved sources, small-space sources, and more). Formally, for any even $d$, we show that a random degree $d$ polynomial is an $\varepsilon$-error extractor for $n$-bit sumset sources with min-entropy $k=O(d(n/\varepsilon^2)^{2/d})$. This is nearly tight in the polynomial error regime.
Our results on sumset extractors imply new complexity separations for linear ROBPs, and the tools that go into its proof may be of independent interest. The two main tools we use are a new structural result on sumset-punctured Reed-Muller codes, paired with a novel type of reduction between extractors. Using the new structural result, we obtain new limits on the power of sumset extractors, strengthening and generalizing the impossibility results of Chattopadhyay, Goodman, and Gurumukhani (ITCS 2024).
△ Less
Submitted 21 April, 2025; v1 submitted 16 May, 2024;
originally announced May 2024.
-
When Do Low-Rate Concatenated Codes Approach The Gilbert-Varshamov Bound?
Authors:
Dean Doron,
Jonathan Mosheiff,
Mary Wootters
Abstract:
The Gilbert--Varshamov (GV) bound is a classical existential result in coding theory. It implies that a random linear binary code of rate $ε^2$ has relative distance at least $\frac{1}{2} - O(ε)$ with high probability. However, it is a major challenge to construct explicit codes with similar parameters.
One hope to derandomize the Gilbert--Varshamov construction is with code concatenation: We be…
▽ More
The Gilbert--Varshamov (GV) bound is a classical existential result in coding theory. It implies that a random linear binary code of rate $ε^2$ has relative distance at least $\frac{1}{2} - O(ε)$ with high probability. However, it is a major challenge to construct explicit codes with similar parameters.
One hope to derandomize the Gilbert--Varshamov construction is with code concatenation: We begin with a (hopefully explicit) outer code ${C}_\mathrm{out}$ over a large alphabet, and concatenate that with a small binary random linear code ${C}_\mathrm{in}$. It is known that when we use independent small codes for each coordinate, then the result lies on the GV bound with high probability, but this still uses a lot of randomness. In this paper, we consider the question of whether code concatenation with a single random linear inner code ${C}_\mathrm{in}$ can lie on the GV bound; and if so what conditions on ${C}_\mathrm{out}$ are sufficient for this.
We show that first, there do exist linear outer codes ${C}_\mathrm{out}$ that are "good" for concatenation in this sense (in fact, most linear codes codes are good). We also provide two sufficient conditions for ${C}_\mathrm{out}$, so that if ${C}_\mathrm{out}$ satisfies these, ${C}_\mathrm{out}\circ {C}_\mathrm{in}$ will likely lie on the GV bound. We hope that these conditions may inspire future work towards constructing explicit codes ${C}_\mathrm{out}$.
△ Less
Submitted 10 July, 2024; v1 submitted 14 May, 2024;
originally announced May 2024.
-
Randomness-Efficient Constructions of Capacity-Achieving List-Decodable Codes
Authors:
Jonathan Mosheiff,
Nicolas Resch,
Kuo Shang,
Chen Yuan
Abstract:
We wish to generate list-decodable codes over small alphabets using as little randomness as possible. Specifically, we hope to generate codes achieving what we term the Elias bound, which means that they are $(ρ,L)$-list-decodable with rate $R \geq 1-h(ρ)-O(1/L)$. A long line of work shows that uniformly random linear codes (RLCs) achieve the Elias bound: hence, we know $O(n^2)$ random bits suffic…
▽ More
We wish to generate list-decodable codes over small alphabets using as little randomness as possible. Specifically, we hope to generate codes achieving what we term the Elias bound, which means that they are $(ρ,L)$-list-decodable with rate $R \geq 1-h(ρ)-O(1/L)$. A long line of work shows that uniformly random linear codes (RLCs) achieve the Elias bound: hence, we know $O(n^2)$ random bits suffice. Prior works demonstrate that just $O(Ln)$ random bits suffice, via puncturing of low-bias codes. These recent constructions are combinatorial.
We provide two new constructions, which are algebraic. Compared to prior works, our constructions are simpler and more direct. Furthermore, our codes are designed in such a way that their duals are also quite easy to analyze. Our first construction -- which can be seen as a generalization of the Wozencraft ensemble -- achieves the Elias bound and consumes $Ln$ random bits. Additionally, its dual code achieves the GV-bound with high probability, and both the primal and dual admit quasilinear-time encoding algorithms. The second construction consumes $2nL$ random bits and yields a code where both it and its dual achieve the Elias bound. As we discuss, properties of a dual code are often crucial for applications in cryptography.
In all of the above cases -- including the prior works achieving randomness complexity $O(Ln)$ -- the codes are designed to "approximate" RLCs. Namely, for a given locality parameter $L$ we construct codes achieving the same $L$-local properties as RLCs. This allows one to appeal to known list-decodability results for RLCs and thereby conclude that the code approximating an RLC also achieves the Elias bound. As a final contribution, we indicate that such a proof strategy is inherently unable to generate list-decodable codes of rate $R$ over $\mathbb F_q$ with less than $L(1-R)n\log_2(q)$ bits of randomness.
△ Less
Submitted 15 May, 2024; v1 submitted 18 February, 2024;
originally announced February 2024.
-
Sparsity and $\ell_p$-Restricted Isometry
Authors:
Venkatesan Guruswami,
Peter Manohar,
Jonathan Mosheiff
Abstract:
A matrix $A$ is said to have the $\ell_p$-Restricted Isometry Property ($\ell_p$-RIP) if for all vectors $x$ of up to some sparsity $k$, $\|{Ax}\|_p$ is roughly proportional to $\|{x}\|_p$. We study this property for $m \times n$ matrices of rank proportional to $n$ and $k = Θ(n)$. In this parameter regime, $\ell_p$-RIP matrices are closely connected to Euclidean sections, and are "real analogs" o…
▽ More
A matrix $A$ is said to have the $\ell_p$-Restricted Isometry Property ($\ell_p$-RIP) if for all vectors $x$ of up to some sparsity $k$, $\|{Ax}\|_p$ is roughly proportional to $\|{x}\|_p$. We study this property for $m \times n$ matrices of rank proportional to $n$ and $k = Θ(n)$. In this parameter regime, $\ell_p$-RIP matrices are closely connected to Euclidean sections, and are "real analogs" of testing matrices for locally testable codes.
It is known that with high probability, random dense $m\times n$ matrices (e.g., with i.i.d. $\pm 1$ entries) are $\ell_2$-RIP with $k \approx m/\log n$, and sparse random matrices are $\ell_p$-RIP for $p \in [1,2)$ when $k, m = Θ(n)$. However, when $m = Θ(n)$, sparse random matrices are known to not be $\ell_2$-RIP with high probability.
Against this backdrop, we show that sparse matrices cannot be $\ell_2$-RIP in our parameter regime. On the other hand, for $p \neq 2$, we show that every $\ell_p$-RIP matrix must be sparse. Thus, sparsity is incompatible with $\ell_2$-RIP, but necessary for $\ell_p$-RIP for $p \neq 2$.
Under a suitable interpretation, our negative result about $\ell_2$-RIP gives an impossibility result for a certain continuous analog of "$c^3$-LTCs": locally testable codes of constant rate, constant distance and constant locality that were constructed in recent breakthroughs.
△ Less
Submitted 7 May, 2023; v1 submitted 13 May, 2022;
originally announced May 2022.
-
Testability in group theory
Authors:
Oren Becker,
Alexander Lubotzky,
Jonathan Mosheiff
Abstract:
This paper is a journal counterpart to our FOCS 2021 paper, in which we initiate the study of property testing problems concerning a finite system of relations $E$ between permutations, generalizing the study of stability in permutations. To every such system $E$, a group $Γ=Γ_E$ is associated and the testability of $E$ depends only on $Γ$ (just like in Galois theory, where the solvability of a po…
▽ More
This paper is a journal counterpart to our FOCS 2021 paper, in which we initiate the study of property testing problems concerning a finite system of relations $E$ between permutations, generalizing the study of stability in permutations. To every such system $E$, a group $Γ=Γ_E$ is associated and the testability of $E$ depends only on $Γ$ (just like in Galois theory, where the solvability of a polynomial is determined by the solvability of the associated group). This leads to the notion of testable groups, and, more generally, Benjamini-Schramm rigid groups. The paper presents an ensemble of tools to check if a given group $Γ$ is testable/BS-rigid or not.
△ Less
Submitted 9 April, 2022;
originally announced April 2022.
-
Punctured Low-Bias Codes Behave Like Random Linear Codes
Authors:
Venkatesan Guruswami,
Jonathan Mosheiff
Abstract:
Random linear codes are a workhorse in coding theory, and are used to show the existence of codes with the best known or even near-optimal trade-offs in many noise models. However, they have little structure besides linearity, and are not amenable to tractable error-correction algorithms.
In this work, we prove a general derandomization result applicable to random linear codes. Namely, in settin…
▽ More
Random linear codes are a workhorse in coding theory, and are used to show the existence of codes with the best known or even near-optimal trade-offs in many noise models. However, they have little structure besides linearity, and are not amenable to tractable error-correction algorithms.
In this work, we prove a general derandomization result applicable to random linear codes. Namely, in settings where the coding-theoretic property of interest is "local" (in the sense of forbidding certain bad configurations involving few vectors -- code distance and list-decodability being notable examples), one can replace random linear codes (RLCs) with a significantly derandomized variant with essentially no loss in parameters. Specifically, instead of randomly sampling coordinates of the (long) Hadamard code (which is an equivalent way to describe RLCs), one can randomly sample coordinates of any code with low bias. Over large alphabets, the low bias requirement can be weakened to just large distance. Furthermore, large distance suffices even with a small alphabet in order to match the current best known bounds for RLC list-decodability.
In particular, by virtue of our result, all current (and future) achievability bounds for list-decodability of random linear codes extend automatically to random puncturings of any low-bias (or large alphabet) "mother" code. We also show that our punctured codes emulate the behavior of RLCs on stochastic channels, thus giving a derandomization of RLCs in the context of achieving Shannon capacity as well. Thus, we have a randomness-efficient way to sample codes achieving capacity in both worst-case and stochastic settings that can further inherit algebraic or other algorithmically useful structural properties of the mother code.
△ Less
Submitted 6 June, 2024; v1 submitted 23 September, 2021;
originally announced September 2021.
-
$\ell_p$-Spread and Restricted Isometry Properties of Sparse Random Matrices
Authors:
Venkatesan Guruswami,
Peter Manohar,
Jonathan Mosheiff
Abstract:
Random subspaces $X$ of $\mathbb{R}^n$ of dimension proportional to $n$ are, with high probability, well-spread with respect to the $\ell_2$-norm. Namely, every nonzero $x \in X$ is "robustly non-sparse" in the following sense: $x$ is $\varepsilon \|x\|_2$-far in $\ell_2$-distance from all $δn$-sparse vectors, for positive constants $\varepsilon, δ$ bounded away from $0$. This "$\ell_2$-spread" pr…
▽ More
Random subspaces $X$ of $\mathbb{R}^n$ of dimension proportional to $n$ are, with high probability, well-spread with respect to the $\ell_2$-norm. Namely, every nonzero $x \in X$ is "robustly non-sparse" in the following sense: $x$ is $\varepsilon \|x\|_2$-far in $\ell_2$-distance from all $δn$-sparse vectors, for positive constants $\varepsilon, δ$ bounded away from $0$. This "$\ell_2$-spread" property is the natural counterpart, for subspaces over the reals, of the minimum distance of linear codes over finite fields, and corresponds to $X$ being a Euclidean section of the $\ell_1$ unit ball. Explicit $\ell_2$-spread subspaces of dimension $Ω(n)$, however, are unknown, and the best known constructions (which achieve weaker spread properties), are analogs of low density parity check (LDPC) codes over the reals, i.e., they are kernels of sparse matrices.
We study the spread properties of the kernels of sparse random matrices. Rather surprisingly, we prove that with high probability such subspaces contain vectors $x$ that are $o(1)\cdot \|x\|_2$-close to $o(n)$-sparse with respect to the $\ell_2$-norm, and in particular are not $\ell_2$-spread.
On the other hand, for $p < 2$ we prove that such subspaces are $\ell_p$-spread with high probability. Moreover, we show that a random sparse matrix has the stronger restricted isometry property (RIP) with respect to the $\ell_p$ norm, and this follows solely from the unique expansion of a random biregular graph, yielding a somewhat unexpected generalization of a similar result for the $\ell_1$ norm [BGI+08]. Instantiating this with explicit expanders, we obtain the first explicit constructions of $\ell_p$-RIP matrices for $1 \leq p < p_0$, where $1 < p_0 < 2$ is an absolute constant.
△ Less
Submitted 13 May, 2022; v1 submitted 30 August, 2021;
originally announced August 2021.
-
Testability of relations between permutations
Authors:
Oren Becker,
Alexander Lubotzky,
Jonathan Mosheiff
Abstract:
We initiate the study of property testing problems concerning relations between permutations. In such problems, the input is a tuple $(σ_1,\dotsc,σ_d)$ of permutations on $\{1,\dotsc,n\}$, and one wishes to determine whether this tuple satisfies a certain system of relations $E$, or is far from every tuple that satisfies $E$. If this computational problem can be solved by querying only a small num…
▽ More
We initiate the study of property testing problems concerning relations between permutations. In such problems, the input is a tuple $(σ_1,\dotsc,σ_d)$ of permutations on $\{1,\dotsc,n\}$, and one wishes to determine whether this tuple satisfies a certain system of relations $E$, or is far from every tuple that satisfies $E$. If this computational problem can be solved by querying only a small number of entries of the given permutations, we say that $E$ is testable. For example, when $d=2$ and $E$ consists of the single relation $\mathsf{XY=YX}$, this corresponds to testing whether $σ_1σ_2=σ_2σ_1$, where $σ_1σ_2$ and $σ_2σ_1$ denote composition of permutations.
We define a collection of graphs, naturally associated with the system $E$, that encodes all the information relevant to the testability of $E$. We then prove two theorems that provide criteria for testability and non-testability in terms of expansion properties of these graphs. By virtue of a deep connection with group theory, both theorems are applicable to wide classes of systems of relations.
In addition, we formulate the well-studied group-theoretic notion of stability in permutations as a special case of the testability notion above, interpret all previous works on stability as testability results, survey previous results on stability from a computational perspective, and describe many directions for future research on stability and testability.
△ Less
Submitted 13 October, 2021; v1 submitted 10 November, 2020;
originally announced November 2020.
-
Threshold rates for properties of random codes
Authors:
Venkatesan Guruswami,
Jonathan Mosheiff,
Nicolas Resch,
Shashwat Silas,
Mary Wootters
Abstract:
Suppose that $P$ is a property that may be satisfied by a random code $C \subset Σ^n$. For example, for some $p \in (0,1)$, ${P}$ might be the property that there exist three elements of $C$ that lie in some Hamming ball of radius $pn$. We say that $R^*$ is the threshold rate for ${P}$ if a random code of rate $R^* + ε$ is very likely to satisfy ${P}$, while a random code of rate $R^* - ε$ is very…
▽ More
Suppose that $P$ is a property that may be satisfied by a random code $C \subset Σ^n$. For example, for some $p \in (0,1)$, ${P}$ might be the property that there exist three elements of $C$ that lie in some Hamming ball of radius $pn$. We say that $R^*$ is the threshold rate for ${P}$ if a random code of rate $R^* + ε$ is very likely to satisfy ${P}$, while a random code of rate $R^* - ε$ is very unlikely to satisfy ${P}$. While random codes are well-studied in coding theory, even the threshold rates for relatively simple properties like the one above are not well understood.
We characterize threshold rates for a rich class of properties. These properties, like the example above, are defined by the inclusion of specific sets of codewords which are also suitably "symmetric". For properties in this class, we show that the threshold rate is in fact equal to the lower bound that a simple first-moment calculation obtains. Our techniques not only pin down the threshold rate for the property ${P}$ above, they give sharp bounds on the threshold rate for list-recovery in several parameter regimes, as well as an efficient algorithm for estimating the threshold rates for list-recovery in general.
△ Less
Submitted 6 June, 2024; v1 submitted 9 September, 2020;
originally announced September 2020.
-
Bounds for list-decoding and list-recovery of random linear codes
Authors:
Venkatesan Guruswami,
Ray Li,
Jonathan Mosheiff,
Nicolas Resch,
Shashwat Silas,
Mary Wootters
Abstract:
A family of error-correcting codes is list-decodable from error fraction $p$ if, for every code in the family, the number of codewords in any Hamming ball of fractional radius $p$ is less than some integer $L$ that is independent of the code length. It is said to be list-recoverable for input list size $\ell$ if for every sufficiently large subset of codewords (of size $L$ or more), there is a coo…
▽ More
A family of error-correcting codes is list-decodable from error fraction $p$ if, for every code in the family, the number of codewords in any Hamming ball of fractional radius $p$ is less than some integer $L$ that is independent of the code length. It is said to be list-recoverable for input list size $\ell$ if for every sufficiently large subset of codewords (of size $L$ or more), there is a coordinate where the codewords take more than $\ell$ values. The parameter $L$ is said to be the "list size" in either case. The capacity, i.e., the largest possible rate for these notions as the list size $L \to \infty$, is known to be $1-h_q(p)$ for list-decoding, and $1-\log_q \ell$ for list-recovery, where $q$ is the alphabet size of the code family.
In this work, we study the list size of random linear codes for both list-decoding and list-recovery as the rate approaches capacity. We show the following claims hold with high probability over the choice of the code (below, $ε> 0$ is the gap to capacity).
(1) A random linear code of rate $1 - \log_q(\ell) - ε$ requires list size $L \ge \ell^{Ω(1/ε)}$ for list-recovery from input list size $\ell$. This is surprisingly in contrast to completely random codes, where $L = O(\ell/ε)$ suffices w.h.p.
(2) A random linear code of rate $1 - h_q(p) - ε$ requires list size $L \ge \lfloor h_q(p)/ε+0.99 \rfloor$ for list-decoding from error fraction $p$, when $ε$ is sufficiently small.
(3) A random binary linear code of rate $1 - h_2(p) - ε$ is list-decodable from average error fraction $p$ with list size with $L \leq \lfloor h_2(p)/ε\rfloor + 2$.
The second and third results together precisely pin down the list sizes for binary random linear codes for both list-decoding and average-radius list-decoding to three possible values.
△ Less
Submitted 18 June, 2020; v1 submitted 27 April, 2020;
originally announced April 2020.
-
LDPC Codes Achieve List Decoding Capacity
Authors:
Jonathan Mosheiff,
Nicolas Resch,
Noga Ron-Zewi,
Shashwat Silas,
Mary Wootters
Abstract:
We show that Gallager's ensemble of Low-Density Parity Check (LDPC) codes achieves list-decoding capacity with high probability. These are the first graph-based codes shown to have this property. This result opens up a potential avenue towards truly linear-time list-decodable codes that achieve list-decoding capacity.
Our result on list decoding follows from a much more general result: any…
▽ More
We show that Gallager's ensemble of Low-Density Parity Check (LDPC) codes achieves list-decoding capacity with high probability. These are the first graph-based codes shown to have this property. This result opens up a potential avenue towards truly linear-time list-decodable codes that achieve list-decoding capacity.
Our result on list decoding follows from a much more general result: any $\textit{local}$ property satisfied with high probability by a random linear code is also satisfied with high probability by a random LDPC code from Gallager's distribution. Local properties are properties characterized by the exclusion of small sets of codewords, and include list-decodability, list-recoverability and average-radius list-decodability.
In order to prove our results on LDPC codes, we establish sharp thresholds for when local properties are satisfied by a random linear code. More precisely, we show that for any local property $\mathcal{P}$, there is some $R^*$ so that random linear codes of rate slightly less than $R^*$ satisfy $\mathcal{P}$ with high probability, while random linear codes of rate slightly more than $R^*$, with high probability, do not. We also give a characterization of the threshold rate $R^*$.
△ Less
Submitted 17 November, 2021; v1 submitted 13 September, 2019;
originally announced September 2019.
-
On the weight distribution of random binary linear codes
Authors:
Nati Linial,
Jonathan Mosheiff
Abstract:
We investigate the weight distribution of random binary linear codes. For $0<λ<1$ and $n\to\infty$ pick uniformly at random $λn$ vectors in $\mathbb{F}_2^n$ and let $C \le \mathbb{F}_2^n$ be the orthogonal complement of their span. Given $0<γ<1/2$ with $0< λ< h(γ)$ let $X$ be the random variable that counts the number of words in $C$ of Hamming weight $γn$. In this paper we determine the asymptoti…
▽ More
We investigate the weight distribution of random binary linear codes. For $0<λ<1$ and $n\to\infty$ pick uniformly at random $λn$ vectors in $\mathbb{F}_2^n$ and let $C \le \mathbb{F}_2^n$ be the orthogonal complement of their span. Given $0<γ<1/2$ with $0< λ< h(γ)$ let $X$ be the random variable that counts the number of words in $C$ of Hamming weight $γn$. In this paper we determine the asymptotics of the moments of $X$ of all orders $o(\frac{n}{\log n})$.
△ Less
Submitted 21 June, 2018;
originally announced June 2018.
-
On the Rigidity of Sparse Random Graphs
Authors:
Nati Linial,
Jonathan Mosheiff
Abstract:
A graph with a trivial automorphism group is said to be rigid. Wright proved that for $\frac{\log n}{n}+ω(\frac 1n)\leq p\leq \frac 12$ a random graph $G\in G(n,p)$ is rigid whp. It is not hard to see that this lower bound is sharp and for $p<\frac{(1-ε)\log n}{n}$ with positive probability $\text{aut}(G)$ is nontrivial. We show that in the sparser case…
▽ More
A graph with a trivial automorphism group is said to be rigid. Wright proved that for $\frac{\log n}{n}+ω(\frac 1n)\leq p\leq \frac 12$ a random graph $G\in G(n,p)$ is rigid whp. It is not hard to see that this lower bound is sharp and for $p<\frac{(1-ε)\log n}{n}$ with positive probability $\text{aut}(G)$ is nontrivial. We show that in the sparser case $ω(\frac 1 n)\leq p\leq \frac{\log n}{n}+ω(\frac 1n)$, it holds whp that $G$'s $2$-core is rigid. We conclude that for all $p$, a graph in $G(n,p)$ is reconstrutible whp. In addition this yields for $ω(\frac 1n)\leq p\leq \frac 12$ a canonical labeling algorithm that almost surely runs in polynomial time with $o(1)$ error rate. This extends the range for which such an algorithm is currently known.
△ Less
Submitted 5 May, 2015;
originally announced May 2015.