mlsanityData to 14 Oct 2026

FANoS-v2: Feedback-Controlled Momentum with Thermostat Damping for Lightweight Neural Optimization

arXiv 2601.00889 ↗First posted 31 Dec 2025cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

FANOS is a PyTorch optimizer that augments RMS-preconditioned momentum with a scalar feedback controller over update energy. The public reference implementation stores momentum in parameter-update units, applies a non-negative thermostat damping coefficient, supports diagonal, factored, and raw-gradient preconditioning, and exposes diagnostics intended for stability audits. This study gives a complete mathematical specification of the released optimizer, including the exact parameter-unit update, the study-equation physical update mode, bounded log-ratio thermostat control, adaptive preconditioner softening, warmup guardrails, and the experimental Fast profile. We report the v0.2 evidence: five-seed reduced-sample MNIST, Fashion-MNIST, and CIFAR-10 experiments show mean top-1 gains of 0.889, 2.197, and 2.666 percentage points over AdamW for Fast, but with 49.8%, 61.6%, and 56.8% higher wall-clock time. Preliminary scientific, PINN, and EEG smoke tests are mixed and are treated as hypothesis-generating only. The evidence supports FANOS as an alpha-stage research optimizer with a reproducible lightweight-vision signal and an explicit runtime bottleneck.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 3 of its 16 references that are in the map. First posted on arXiv 31 Dec 2025.

Builds on

3 of 16 references.

References · 3

  1. 2017Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithmscited by 4,349
  2. 2018Adafactor: Adaptive Learning Rates with Sublinear Memory Costcited by 905
  3. 2018Shampoo: Preconditioned Stochastic Tensor Optimizationcited by 426

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Greedy Alignment Principle for Optimizer Selection
  2. 2026Neither Precision Nor Architecture Alone: Controlled Tests of Failure Remedies for Physics-Informed Neural Networks
  3. 2025Scalable Thermodynamic Second-order Optimization
  4. 2026Structure-Aware Numerical Stabilization for Half-Precision Proximal Policy Optimization
  5. 2025Tensor-Compressed and Fully-Quantized Training of Neural PDE Solvers
  6. 2026Physics Foundation Models for Efficient Control of Fluid Flows
  7. 2022Flatter, faster: scaling momentum for optimal speedup of SGD
  8. 2026Hybrid Neural World Models