# MuCon: Clipped Muon Updates for LLM Training

arXiv: https://arxiv.org/abs/2605.26459 · HTML: https://mlsanity.com/paper/2605.26459/

## Key facts

- Cited by 2 papers in the map (data through 14 Oct 2026).
- Builds on 3 of its 12 references that are in the map.
- First posted on arXiv 26 May 2026.

## Builds on (most cited first, 3 of 3)

- [Tensor Programs V: Tuning Large Neural Networks via Zero-Shot Hyperparameter Transfer](https://mlsanity.com/paper/2203.03466/) (2022)
- [A Spectral Condition for Feature Learning](https://mlsanity.com/paper/2310.17813/) (2023)
- [Don't be lazy: CompleteP enables compute-efficient deep transformers](https://mlsanity.com/paper/2505.01618/) (2025)

## Built on by (most cited first, 2 of 2)

- [Musec: MomentUm SpEctral Clipping for Stable Muon-type Training](https://mlsanity.com/paper/2609.11655/) (2026)
- [Spectrally Targeted Muon](https://mlsanity.com/paper/2610.10965/) (2026)

## Abstract (arXiv)

Muon-style optimizers take a matrix-valued momentum or preconditioned update B = U operatornamediag(σ1,ldots,σr) V^top and replace it with its canonical partial polar factor operatornamePol(B) = U V^top. This maps every nonzero singular value to one. MuCon is the clipped-Muon variant studied here: it applies singular-value clipping to the same Muon matrix, DMuConτ(B) = operatornameMClipτ(B) = U operatornamediagbigl(minσi,τbigr) V^top, qquad τ > 0. Thus, operatornameMClipτ denotes the mathematical clipping operator, while MuCon denotes the optimizer primitive that substitutes this clipped direction for Muon's polar direction. The Muon/MuCon scaling parameterization used in this work is called SpectralP: it is the hidden-matrix scaling recipe under which polar Muon or clipped MuCon directions are applied. The map operatornameMClipτ is the Frobenius projection onto the spectral-norm ball X : |X|2 ≤ τ: it leaves singular values at or below τ unchanged and modifies only the violating singular directions. This paper asks when the MuCon clipping step can be approximated without a full dense SVD. We record two exact identities, a polar/absolute-value formula and a scalar-root formulation leading to a rational Newton filter for the clipped positive-semidefinite factor, and identify the numerical obstruction common to both: singular values near the threshold make sign decisions and rational solves ill-conditioned. Matrix-function methods are therefore useful only when paired with stable polar/square-root primitives or explicit regularization near the clipping boundary.