mlsanityData to 7 Oct 2026

Just Least Squares: Binary Compressive Sampling with Low Generative Intrinsic Dimension

arXiv 2111.14486 ↗First posted 29 Nov 2021cs.LG eess.SP stat.MLcited by 2

Not on the map. Why?

Abstract (arXiv)

In this paper, we consider recovering n dimensional signals from m binary measurements corrupted by noises and sign flips under the assumption that the target signals have low generative intrinsic dimension, i.e., the target signals can be approximately generated via an L-Lipschitz generator G: ℝkrightarrowℝn, kll n. Although the binary measurements model is highly nonlinear, we propose a least square decoder and prove that, up to a constant c, with high probability, the least square decoder achieves a sharp estimation error O (√fracklog (Ln)m) as long as m≥ O( klog (Ln)). Extensive numerical simulations and comparisons with state-of-the-art methods demonstrated the least square decoder is robust to noise and sign flips, as indicated by our theory. By constructing a ReLU network with properly chosen depth and width, we verify the (approximately) deep generative prior, which is of independent interest.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 17 of its 63 references that are in the map. First posted on arXiv 29 Nov 2021.

Builds on

17 of 63 references.

References · 17

  1. 2013Auto-Encoding Variational Bayescited by 3,980
  2. 2015Variational Inference with Normalizing Flowscited by 2,161
  3. 2017Deep Image Priorcited by 1,097
  4. 2017Compressed Sensing using Generative Modelscited by 337
  5. 2017Nearly-tight VC-dimension and pseudodimension bounds for piecewise linear neural networkscited by 304
  6. 2018Phase Retrieval Under a Generative Priorcited by 73
  7. 2019Deep Compressed Sensingcited by 46
  8. 2021On the Optimal Memorization Power of ReLU Neural Networkscited by 40
  9. 2019Nonlinear Approximation via Compositionscited by 37
  10. 2021An error analysis of generative adversarial networks for learning distributionscited by 35
  11. 2019Information-Theoretic Lower Bounds for Compressive Sensing with Generative Modelscited by 25
  12. 2020Sample Complexity Bounds for 1-bit Compressive Sensing and Binary Stable Embeddings with Generative Priorscited by 21
5 more
  1. 2018A Provably Convergent Scheme for Compressive Sensing under Random Generative Priorscited by 15
  2. 2020The Generalized Lasso with Nonlinear Observations and Generative Priorscited by 15
  3. 2015L1-Regularized Least Squares for Support Recovery of High Dimensional Single Index Models with Gaussian Designscited by 6
  4. 2017An Approach to One-Bit Compressed Sensing Based on Probably Approximately Correct Learning Theorycited by 4
  5. 2015Pinball Loss Minimization for One-bit Compressive Sensing: Convex Models and Algorithmscited by 2

Built on by

Cited by year

Citing papers per year: 2022: 1; 2023: 1.

2 papers.