mlsanityData to 14 Oct 2026

Smoothed Agnostic Learning of Halfspaces over the Hypercube

arXiv 2511.17782 ↗First posted 21 Nov 2025cs.LG cs.CC stat.MLcited by 3

Not on the map. Why?

Abstract (arXiv)

Agnostic learning of Boolean halfspaces is a fundamental problem in computational learning theory, but it is known to be computationally hard even for weak learning. Recent work [CKKMK24] proposed smoothed analysis as a way to bypass such hardness, but existing frameworks rely on additive Gaussian perturbations, making them unsuitable for discrete domains. We introduce a new smoothed agnostic learning framework for Boolean inputs, where perturbations are modeled via random bit flips. This defines a natural discrete analogue of smoothed optimality generalizing the Gaussian case. Under strictly subexponential assumptions on the input distribution, we give an efficient algorithm for learning halfspaces in this model, with runtime and sample complexity approximately n raised to a poly(1/(sigma * epsilon)) factor. Previously, such algorithms were known only with strong structural assumptions for the discrete hypercube, for example, independent coordinates or symmetric distributions. Our result provides the first computationally efficient guarantee for smoothed agnostic learning of halfspaces over the Boolean hypercube, bridging the gap between worst-case intractability and practical learnability in discrete settings.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 8 of its 44 references that are in the map. First posted on arXiv 21 Nov 2025.

Builds on

8 of 44 references.

References · 8

  1. 2017A Hitting Time Analysis of Stochastic Gradient Langevin Dynamicscited by 71
  2. 2019Distribution-Independent PAC Learning of Halfspaces with Massart Noisecited by 54
  3. 2020Learning Halfspaces with Massart Noise Under Structured Distributionscited by 45
  4. 2015Efficient Learning of Linear Separators under Bounded Noisecited by 36
  5. 2022Cryptographic Hardness of Learning Halfspaces with Massart Noisecited by 25
  6. 2019Nonconvex sampling with the Metropolis-adjusted Langevin algorithmcited by 15
  7. 2024Smoothed Analysis for Learning Concepts with Low Intrinsic Dimensioncited by 11
  8. 2021Boosting in the Presence of Massart Noisecited by 10

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.