mlsanityData to 14 Oct 2026

Stochastic Learning Equation using Monotone Increasing Resolution of Quantization

arXiv 2112.13006 ↗First posted 24 Dec 2021cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

In this paper, we propose a quantized learning equation with a monotone increasing resolution of quantization and stochastic analysis for the proposed algorithm. According to the white noise hypothesis for the quantization error with dense and uniform distribution, we can regard the quantization error as i.i.d. white noise. Based on this, we show that the learning equation with monotonically increasing quantization resolution converges weakly as the distribution viewpoint. The analysis of this paper shows that global optimization is possible for a domain that satisfies the Lipschitz condition instead of local convergence properties such as the Hessian constraint of the objective function.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 4 of its 17 references that are in the map. First posted on arXiv 24 Dec 2021.

Builds on

4 of 17 references.

References · 4

  1. 2015Learning both Weights and Connections for Efficient Neural Networkscited by 2,031
  2. 2016Learning Structured Sparsity in Deep Neural Networkscited by 541
  3. 2016Quantized Neural Networks: Training Neural Networks with Low Precision Weights and Activationscited by 426
  4. 2016QSGD: Communication-Efficient SGD via Gradient Quantization and Encodingcited by 147

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2022Quantization-Based Optimization: Alternative Stochastic Approximation of Global Optimization
  2. 2026Quantization Robustness of Monotone Operator Equilibrium Networks
  3. 2023Stochastic Gradient Langevin Dynamics Based on Quantization with Increasing Resolution
  4. 2025High-Dimensional Learning Dynamics of Quantized Models with Straight-Through Estimator
  5. 2023On Uniform Scalar Quantization for Learned Image Compression
  6. 2024Nonlinear Stochastic Gradient Descent and Heavy-tailed Noise: A Unified Framework and High-probability Guarantees
  7. 2024Truncated Non-Uniform Quantization for Distributed SGD
  8. 2024Constant Stepsize Q-learning: Distributional Convergence, Bias and Extrapolation