FANoS-v2: Feedback-Controlled Momentum with Thermostat Damping for Lightweight Neural Optimization
Not on the map. Why?
Abstract (arXiv)
FANOS is a PyTorch optimizer that augments RMS-preconditioned momentum with a scalar feedback controller over update energy. The public reference implementation stores momentum in parameter-update units, applies a non-negative thermostat damping coefficient, supports diagonal, factored, and raw-gradient preconditioning, and exposes diagnostics intended for stability audits. This study gives a complete mathematical specification of the released optimizer, including the exact parameter-unit update, the study-equation physical update mode, bounded log-ratio thermostat control, adaptive preconditioner softening, warmup guardrails, and the experimental Fast profile. We report the v0.2 evidence: five-seed reduced-sample MNIST, Fashion-MNIST, and CIFAR-10 experiments show mean top-1 gains of 0.889, 2.197, and 2.666 percentage points over AdamW for Fast, but with 49.8%, 61.6%, and 56.8% higher wall-clock time. Preliminary scientific, PINN, and EEG smoke tests are mixed and are treated as hypothesis-generating only. The evidence supports FANOS as an alpha-stage research optimizer with a reproducible lightweight-vision signal and an explicit runtime bottleneck.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 3 of its 16 references that are in the map. First posted on arXiv 31 Dec 2025.
Builds on
3 of 16 references.
References · 3
- 2017Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithmscited by 4,349
- 2018Adafactor: Adaptive Learning Rates with Sublinear Memory Costcited by 905
- 2018Shampoo: Preconditioned Stochastic Tensor Optimizationcited by 426
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Greedy Alignment Principle for Optimizer Selection
- 2026Neither Precision Nor Architecture Alone: Controlled Tests of Failure Remedies for Physics-Informed Neural Networks
- 2025Scalable Thermodynamic Second-order Optimization
- 2026Structure-Aware Numerical Stabilization for Half-Precision Proximal Policy Optimization
- 2025Tensor-Compressed and Fully-Quantized Training of Neural PDE Solvers
- 2026Physics Foundation Models for Efficient Control of Fluid Flows
- 2022Flatter, faster: scaling momentum for optimal speedup of SGD
- 2026Hybrid Neural World Models