PRISM: Structured Optimization via Anisotropic Spectral Shaping
Not on the map. Why?
Abstract (arXiv)
We propose PRISM, an optimizer that enhances first-order spectral descent methods like Muon with partial second-order information. It constructs an efficient, low-rank quasi-second-order preconditioner via innovation-augmented polar decomposition. This mechanism enables PRISM to perform anisotropic spectral shaping, which adaptively suppresses updates in high-variance subspaces while preserving update strength in signal-dominated directions. Crucially, this is achieved with minimal computational overhead and zero additional memory compared to first-order baselines. PRISM demonstrates a practical strategy for integrating curvature-adaptive properties into the spectral optimization paradigm.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 9 of its 13 references that are in the map. First posted on arXiv 3 Feb 2026.
Builds on
9 of 13 references.
References · 9
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2024Qwen2 Technical Reportcited by 2,120
- 2024The FineWeb Datasets: Decanting the Web for the Finest Text Data at Scalecited by 1,160
- 2025Muon is Scalable for LLM Trainingcited by 428
- 2018Shampoo: Preconditioned Stochastic Tensor Optimizationcited by 426
- 2024Old Optimizer, New Norm: An Anthologycited by 193
- 2024SOAP: Improving and Stabilizing Shampoo using Adamcited by 192
- 2024A New Perspective on Shampoo's Preconditionercited by 59
- 2025Structured Preconditioners in Adaptive Optimization: A Unified Analysiscited by 33
Built on by
Citing papers per year: 2026: 2.
2 papers.
- 2026Dimension-Free Saddle-Point Escape in Muon10 May 2026
- 2026Adam Improves Muon: Adaptive Moment Estimation with Orthogonalized Momentum19 Feb 2026