-
arXiv:1209.4209 [pdf, ps, other]
Tight Sufficient Conditions on Exact Sparsity Pattern Recovery
Abstract: A noisy underdetermined system of linear equations is considered in which a sparse vector (a vector with a few nonzero elements) is subject to measurement. The measurement matrix elements are drawn from a Gaussian distribution. We study the information-theoretic constraints on exact support recovery of a sparse vector from the measurement vector and matrix. We compute a tight, sufficient condition… ▽ More
Submitted 25 June, 2014; v1 submitted 19 September, 2012; originally announced September 2012.
-
Learning sparse messages in networks of neural cliques
Abstract: An extension to a recently introduced binary neural network is proposed in order to allow the learning of sparse messages, in large numbers and with high memory efficiency. This new network is justified both in biological and informational terms. The learning and retrieval rules are detailed and illustrated by various simulation results.
Submitted 20 August, 2012; originally announced August 2012.