mlsanityData to 7 Oct 2026

Polynomial-time Sparse Measure Recovery: From Mean Field Theory to Algorithm Design

arXiv 2204.07879 ↗First posted 16 Apr 2022cs.LG stat.MLcited by 1

Not on the map. Why?

Abstract (arXiv)

Mean field theory has provided theoretical insights into various algorithms by letting the problem size tend to infinity. We argue that the applications of mean-field theory go beyond theoretical insights as it can inspire the design of practical algorithms. Leveraging mean-field analyses in physics, we propose a novel algorithm for sparse measure recovery. For sparse measures over ℝ, we propose a polynomial-time recovery method from Fourier moments that improves upon convex relaxation methods in a specific parameter regime; then, we demonstrate the application of our results for the optimization of particular two-dimensional, single-layer neural networks in realizable settings.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 12 of its 46 references that are in the map. First posted on arXiv 16 Apr 2022.

Builds on

12 of 46 references.

References · 12

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2018On the Global Convergence of Gradient Descent for Over-parameterized Models using Optimal Transportcited by 422
  3. 2018Gaussian Process Behaviour in Wide Deep Neural Networkscited by 314
  4. 2020The large learning rate phase of deep learning: the catapult mechanismcited by 206
  5. 2018Dynamical Isometry and a Mean Field Theory of CNNs: How to Train 10,000-Layer Vanilla Convolutional Neural Networkscited by 176
  6. 2017Resurrecting the sigmoid in deep learning through dynamical isometry: theory and practicecited by 132
  7. 2018The Emergence of Spectral Universality in Deep Networkscited by 74
  8. 2015A Faster Cutting Plane Method and its Implications for Combinatorial and Convex Optimizationcited by 50
  9. 2019Sparse Optimization on Measures with Over-parameterized Gradient Descentcited by 50
  10. 2013Exact Support Recovery for Sparse Spikes Deconvolutioncited by 22
  11. 2016Polynomial-time Tensor Decompositions with Sum-of-Squarescited by 22
  12. 2021Convergence Rates of Gradient Methods for Convex Optimization in the Space of Measurescited by 19

Built on by

Cited by year

Citing papers per year: 2022: 1.

1 paper.