mlsanityData to 14 Oct 2026

Chebyshev Moment Regularization (CMR): Condition-Number Control with Moment Shaping

arXiv 2510.21772 ↗First posted 17 Oct 2025cs.LG cs.NA math.NAcited by 0

Not on the map. Why?

Abstract (arXiv)

We introduce Chebyshev Moment Regularization (CMR), a simple, architecture-agnostic loss that directly optimizes layer spectra. CMR jointly controls spectral edges via a log-condition proxy and shapes the interior via Chebyshev moments, with a decoupled, capped mixing rule that preserves task gradients. We prove strictly monotone descent for the condition proxy, bounded moment gradients, and orthogonal invariance. In an adversarial ``kappa-stress'' setting (MNIST, 15-layer MLP), compared to vanilla training, CMR reduces mean layer condition numbers by ~!103 (from ≈3.9!×!103 to ≈3.4 in 5 epochs), increases average gradient magnitude, and restores test accuracy ( ≈10%!→!≈86% ). These results support optimization-driven spectral preconditioning: directly steering models toward well-conditioned regimes for stable, accurate learning.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 4 of its 9 references that are in the map. First posted on arXiv 17 Oct 2025.

Builds on

4 of 9 references.

References · 4

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 7,005
  3. 2018Spectral Normalization for Generative Adversarial Networkscited by 1,636
  4. 2017Parseval Networks: Improving Robustness to Adversarial Examplescited by 293

Built on by

Not cited yet.