mlsanityData to 14 Oct 2026

PRISM: Structured Optimization via Anisotropic Spectral Shaping

arXiv 2602.03096 ↗First posted 3 Feb 2026cs.LG cs.AIcited by 2

Not on the map. Why?

Abstract (arXiv)

We propose PRISM, an optimizer that enhances first-order spectral descent methods like Muon with partial second-order information. It constructs an efficient, low-rank quasi-second-order preconditioner via innovation-augmented polar decomposition. This mechanism enables PRISM to perform anisotropic spectral shaping, which adaptively suppresses updates in high-variance subspaces while preserving update strength in signal-dominated directions. Crucially, this is achieved with minimal computational overhead and zero additional memory compared to first-order baselines. PRISM demonstrates a practical strategy for integrating curvature-adaptive properties into the spectral optimization paradigm.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 9 of its 13 references that are in the map. First posted on arXiv 3 Feb 2026.

Builds on

9 of 13 references.

References · 9

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2024Qwen2 Technical Reportcited by 2,120
  3. 2024The FineWeb Datasets: Decanting the Web for the Finest Text Data at Scalecited by 1,160
  4. 2025Muon is Scalable for LLM Trainingcited by 428
  5. 2018Shampoo: Preconditioned Stochastic Tensor Optimizationcited by 426
  6. 2024Old Optimizer, New Norm: An Anthologycited by 193
  7. 2024SOAP: Improving and Stabilizing Shampoo using Adamcited by 192
  8. 2024A New Perspective on Shampoo's Preconditionercited by 59
  9. 2025Structured Preconditioners in Adaptive Optimization: A Unified Analysiscited by 33

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.