mlsanityData to 7 Oct 2026

On the Role of Normalization in Binary Iterative Hard Thresholding for 1-bit Compressed Sensing

arXiv 2607.15530 ↗First posted 17 Jul 2026cs.IT cs.DS math.ITcited by 0

Not on the map. Why?

Abstract (arXiv)

Binary Iterative Hard Thresholding (BIHT) is a simple, yet effective, greedy method for recovering a sparse vector from one-bit sign measurements. In its original form, BIHT performs a ``gradient-descent'' step, followed by hard thresholding. A convergence analysis of this algorithm was left open in the introductory work of [Jac+11] and has remained unresolved for over a decade, with subsequent sharp analyses studying a normalized variant instead, that additionally projects every iterate onto the unit sphere. This paper resolves that gap and characterizes when per-iteration normalization is algorithmically necessary. In the noiseless setting, we prove a universal, sample-optimal convergence theorem for the original BIHT algorithm. Specifically, with widetilde O(s/ε) measurements, a deterministic finite-time iterate has directional error at most ε, simultaneously for every s-sparse unit vector. This matches the optimal sample dependence achieved by normalized BIHT in prior work. Thus, in the noiseless regime, per-iterate normalization is unnecessary for optimal recovery. Under sign corruptions, we prove a sharp separation. If at most a τ fraction of signs are flipped adversarially, then BIHT, without per-iterate normalization, still reaches the robust error floor at an early iterate with a matching widetilde O(s/ε) sample complexity rate as its normalized variant. This recovery, however, is not stable. We prove a scalar lower bound showing that any nontrivial corruption pattern, even one that involves only one flipped sign together with one clean sign, forces the iterates to oscillate indefinitely. Consequently, no general last-iterate convergence theorem can hold for BIHT under sign corruptions, while its normalized surrogate provably escapes this instance.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 5 of its 17 references that are in the map. First posted on arXiv 17 Jul 2026.

Builds on

5 of 17 references.

References · 5

  1. 2022Binary Iterative Hard Thresholding Converges with Optimal Number of Measurements for 1-Bit Compressed Sensingcited by 9
  2. 2019Superset Technique for Approximate Recovery in One-Bit Compressed Sensingcited by 5
  3. 2023Robust 1-bit Compressed Sensing with Iterative Hard Thresholdingcited by 4
  4. 2025Learning sparse generalized linear models with binary outcomes via iterative hard thresholdingcited by 4
  5. 2025Low-Rank Tensor Estimation from Nonlinear Observations: A Unified Frameworkcited by 2

Built on by

Not cited yet.