Quantization Robustness of Monotone Operator Equilibrium Networks
Not on the map. Why?
Abstract (arXiv)
Monotone operator equilibrium networks are implicit-layer models whose output is the unique equilibrium of a monotone operator, guaranteeing existence, uniqueness, and convergence. When deployed on low-precision hardware, weights are quantized, potentially destroying these guarantees. We analyze weight quantization as a spectral perturbation of the underlying monotone inclusion. Convergence of the quantized solver is guaranteed whenever the spectral-norm weight perturbation is smaller than the monotonicity margin; the displacement between quantized and full-precision equilibria is bounded in terms of the perturbation size and margin; and a condition number characterizing the ratio of the operator norm to the margin links quantization precision to forward error. MNIST experiments confirm a phase transition at the predicted threshold: three- and four-bit post-training quantization diverge, while five-bit and above converge. The backward-pass guarantee enables quantization-aware training, which recovers provable convergence at four bits.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 11 of its 25 references that are in the map. First posted on arXiv 11 Mar 2026.
Builds on
11 of 25 references.
References · 11
- 2017Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inferencecited by 1,548
- 2019Deep Equilibrium Modelscited by 603
- 2021A White Paper on Neural Network Quantizationcited by 453
- 2020Monotone operator equilibrium networkscited by 100
- 2020Lipschitz Bounded Equilibrium Networkscited by 49
- 2021Recurrent Equilibrium Networks: Flexible Dynamic Models with Guaranteed Stability and Robustnesscited by 43
- 2018Deep Neural Network Structures Solving Variational Inequalitiescited by 25
- 2021Learning over All Stabilizing Nonlinear Controllers for a Partially-Observed Linear Systemcited by 13
- 2022QEBVerif: Quantization Error Bound Verification of Neural Networkscited by 9
- 2022Synthesis of Stabilizing Recurrent Equilibrium Network Controllerscited by 8
- 2025Circuit realization and hardware linearization of monotone operator equilibrium networkscited by 1
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026A Tilted Bowl Is Not a Slippery Slope: Compressing Looped Models30 Sep 2026
- 2026Quantizing Looped Transformers: Feedback Exposure and Calibration Blindness25 Sep 2026
- 2026Quantizing Recursive Reasoning Models25 Jun 2026