{"total":72,"rows":[{"id":"2505.16932","title":"The Polar Express: Optimal Matrix Sign Methods and Their Application to the Muon Algorithm","created":"2025-05-22","cited_by_count":110,"area":null},{"id":"2506.04192","title":"Lions and Muons: Optimization via Stochastic Frank-Wolfe under Heavy-Tailed Noise","created":"2025-06-04","cited_by_count":41,"area":null},{"id":"2511.00674","title":"Isotropic Curvature Model for Understanding Deep Learning Optimization: Is Gradient Orthogonalization Optimal?","created":"2025-11-01","cited_by_count":37,"area":null},{"id":"2601.19156","title":"Convergence of Muon with Newton-Schulz","created":"2026-01-27","cited_by_count":36,"area":null},{"id":"2509.15816","title":"On the Convergence of Muon and Beyond","created":"2025-09-19","cited_by_count":31,"area":null},{"id":"2510.09827","title":"An Exploration of Non-Euclidean Gradient Descent: Muon and its Many Variants","created":"2025-10-10","cited_by_count":28,"area":null},{"id":"2510.19933","title":"Beyond the Ideal: Analyzing the Inexact Muon Update","created":"2025-10-22","cited_by_count":27,"area":null},{"id":"2509.14562","title":"LiMuon: Light and Fast Muon Optimizer for Large Models","created":"2025-09-18","cited_by_count":22,"area":null},{"id":"2509.11983","title":"Low-rank Orthogonalization for Large-scale Matrix Optimization with Applications to Foundation Model Training","created":"2025-09-15","cited_by_count":18,"area":null},{"id":"2604.01472","title":"The Newton-Muon Optimizer","created":"2026-04-01","cited_by_count":18,"area":null},{"id":"2605.11181","title":"Muon is Not That Special: Random or Inverted Spectra Work Just as Well","created":"2026-05-11","cited_by_count":14,"area":null},{"id":"2506.16659","title":"Memory-Efficient LLM Pretraining via Minimalist Optimizer Design","created":"2025-06-20","cited_by_count":13,"area":null},{"id":"2602.11948","title":"Insights on Muon from Simple Quadratics","created":"2026-02-12","cited_by_count":13,"area":null},{"id":"2506.23803","title":"SGD with Adaptive Preconditioning: Unified Analysis and Momentum Acceleration","created":"2025-06-30","cited_by_count":12,"area":null},{"id":"2602.17155","title":"Powering Up Zeroth-Order Training via Subspace Gradient Orthogonalization","created":"2026-02-19","cited_by_count":12,"area":null},{"id":"2603.09952","title":"On the Width Scaling of Neural Optimizers Under Matrix Operator Norms I: Row/Column Normalization and Hyperparameter Transfer","created":"2026-03-10","cited_by_count":12,"area":null},{"id":"2510.10777","title":"Preconditioned Norms: A Unified Framework for Steepest Descent, Quasi-Newton and Adaptive Methods","created":"2025-10-12","cited_by_count":11,"area":null},{"id":"2510.21800","title":"MARS-M: When Variance Reduction Meets Matrices","created":"2025-10-20","cited_by_count":10,"area":null},{"id":"2603.14315","title":"Enhancing LLM Training via Spectral Clipping","created":"2026-03-15","cited_by_count":10,"area":null},{"id":"2509.26337","title":"FedMuon: Federated Learning with Bias-corrected LMO-based Optimization","created":"2025-09-30","cited_by_count":8,"area":null},{"id":"2510.03871","title":"Optimal Scaling Needs Optimal Norm","created":"2025-10-04","cited_by_count":8,"area":null},{"id":"2511.11466","title":"Non-Euclidean SGD for Structured Optimization: Unified Analysis and Improved Rates","created":"2025-11-14","cited_by_count":8,"area":null},{"id":"2605.06884","title":"Muon with Nesterov Momentum: Heavy-Tailed Noise and (Randomized) Inexact Polar Decomposition","created":"2026-05-07","cited_by_count":8,"area":null},{"id":"2510.03866","title":"On Provable Benefits of Muon in Federated Learning","created":"2025-10-04","cited_by_count":7,"area":null},{"id":"2512.16598","title":"Muon is Provably Faster with Momentum Variance Reduction","created":"2025-12-18","cited_by_count":7,"area":null},{"id":"2603.21191","title":"On the Role of Batch Size in Stochastic Conditional Gradient Methods","created":"2026-03-22","cited_by_count":7,"area":null},{"id":"2602.13498","title":"TrasMuon: Trust-Region Adaptive Scaling for Orthogonalized Momentum Optimizers","created":"2026-02-13","cited_by_count":6,"area":null},{"id":"2605.09238","title":"Intrinsic Muon: Spectral Optimization on Riemannian Matrix Manifolds","created":"2026-05-10","cited_by_count":6,"area":null},{"id":"2602.05813","title":"Where Does Warm-Up Come From? Adaptive Scheduling for Norm-Constrained Optimizers","created":"2026-02-05","cited_by_count":5,"area":null},{"id":"2510.00823","title":"Non-Euclidean Broximal Point Method: A Blueprint for Geometry-Aware Optimization","created":"2025-10-01","cited_by_count":4,"area":null},{"id":"2510.01377","title":"DeMuon: A Decentralized Muon for Matrix Optimization over Graphs","created":"2025-10-01","cited_by_count":4,"area":null},{"id":"2512.09678","title":"Ky Fan Norms and Beyond: Dual Norms and Combinations for Matrix Optimization","created":"2025-12-10","cited_by_count":4,"area":null},{"id":"2601.22137","title":"PRISM: Distribution-free Adaptive Computation of Matrix Functions for Accelerating Neural Network Training","created":"2026-01-29","cited_by_count":4,"area":null},{"id":"2603.03597","title":"NuMuon: Nuclear-Norm-Constrained Muon for Compressible LLM Training","created":"2026-03-04","cited_by_count":4,"area":null},{"id":"2605.31371","title":"Softsign: Smooth Sign in Your Optimizer For Better Parameter Heterogeneity Handling","created":"2026-05-29","cited_by_count":4,"area":null},{"id":"2510.14009","title":"Noise-Adaptive Layerwise Learning Rates: Accelerating Geometry-Aware Optimization for Deep Neural Network Training","created":"2025-10-15","cited_by_count":3,"area":null},{"id":"2510.22421","title":"Extragradient Method for $(L_0, L_1)$-Lipschitz Root-finding Problems","created":"2025-10-25","cited_by_count":3,"area":null},{"id":"2604.10689","title":"Communication-Efficient Gluon in Federated Learning","created":"2026-04-12","cited_by_count":3,"area":null},{"id":"2605.09552","title":"Phases of Muon: When Muon Eclipses SignSGD","created":"2026-05-10","cited_by_count":3,"area":null},{"id":"2605.19619","title":"MiMuon: Mixed Muon Optimizer with Improved Generalization for Large Models","created":"2026-05-19","cited_by_count":3,"area":null},{"id":"2606.16371","title":"CacheMuon: Using Temporal Preconditioning To Approximate Polar Factor","created":"2026-06-15","cited_by_count":3,"area":null},{"id":"2608.02502","title":"CMuon: Accelerating and Stabilizing Diffusion Transformer Training via Chunked Momentum Orthogonalization","created":"2026-08-03","cited_by_count":3,"area":"diffusion"},{"id":"2605.18174","title":"Ringmaster LMO: Asynchronous Linear Minimization Oracle Momentum Method","created":"2026-05-18","cited_by_count":2,"area":null},{"id":"2605.18528","title":"Tight Complexity of Muon under Heavy-Tailed Noise","created":"2026-05-18","cited_by_count":2,"area":null},{"id":"2605.19811","title":"LionMuon: Alternating Spectral and Sign Descent for Efficient Training","created":"2026-05-19","cited_by_count":2,"area":null},{"id":"2606.14560","title":"Free Heavy-Tailed Lunch for Muon: A Theoretical Justification of Empirical Success","created":"2026-06-12","cited_by_count":2,"area":null},{"id":"2609.11655","title":"Musec: MomentUm SpEctral Clipping for Stable Muon-type Training","created":"2026-09-10","cited_by_count":2,"area":null},{"id":"2512.04632","title":"Turbo-Muon: Almost-Orthogonal Pre-Conditioning for Fast Muon Updates","created":"2025-12-04","cited_by_count":1,"area":null},{"id":"2604.04231","title":"Subspace Control: Turning Constrained Model Steering into Controllable Spectral Optimization","created":"2026-04-05","cited_by_count":1,"area":"safety"},{"id":"2605.18999","title":"Distance-Aware Muon: Adaptive Step Scaling for Normalized Optimization","created":"2026-05-18","cited_by_count":1,"area":null},{"id":"2605.24770","title":"Muon in Vision Transformers: Optimizer-Recipe Interactions and Gradient Spectra","created":"2026-05-23","cited_by_count":1,"area":null},{"id":"2606.08783","title":"OptMuon: Closed-Loop Orthogonalized Momentum Methods for Stochastic Optimization with Zero-Noise Optimality","created":"2026-06-07","cited_by_count":1,"area":null},{"id":"2606.15702","title":"Schattor: Schatten-family methods for deep learning optimization","created":"2026-06-14","cited_by_count":1,"area":null},{"id":"2606.25975","title":"Tensorion: A Tensor-Aware Generalization of the Muon Optimizer","created":"2026-06-24","cited_by_count":1,"area":null},{"id":"2607.13246","title":"Reassessing Muon for Matrix Factorization","created":"2026-07-14","cited_by_count":1,"area":null},{"id":"2608.09763","title":"Second-Order Muon Done Right: A Principled Marriage of Spectral Geometry and Curvature","created":"2026-08-10","cited_by_count":1,"area":null},{"id":"2609.07597","title":"Beyond the Matrix Sign: Quadratic Spectral Descent","created":"2026-09-07","cited_by_count":1,"area":null},{"id":"2609.39595","title":"Convergence of Practical Muon with Finite Newton-Schulz Iterations and Nesterov Momentum","created":"2026-09-30","cited_by_count":1,"area":null},{"id":"2508.19712","title":"Simple Stepsize for Quasi-Newton Methods with Global Convergence Guarantees","created":"2025-08-27","cited_by_count":0,"area":null},{"id":"2601.01306","title":"Towards a Principled Muon under $\\mu\\mathsf{P}$: Ensuring Spectral Conditions throughout Training","created":"2026-01-04","cited_by_count":0,"area":null},{"id":"2602.14462","title":"Silent Inconsistency in Data-Parallel Full Fine-Tuning: Diagnosing Worker-Level Optimization Misalignment","created":"2026-02-16","cited_by_count":0,"area":null},{"id":"2603.22824","title":"Towards The Implicit Bias on Multiclass Separable Data Under Norm Constraints","created":"2026-03-24","cited_by_count":0,"area":null},{"id":"2605.08850","title":"Broximal Gradient Descent: A Projection-Free Sister of Projected Gradient Descent","created":"2026-05-09","cited_by_count":0,"area":null},{"id":"2605.11850","title":"Constrained Stochastic Spectral Preconditioning Converges for Nonconvex Objectives","created":"2026-05-12","cited_by_count":0,"area":null},{"id":"2606.14970","title":"Zero-order Parameter-free Optimization for LMO-based Methods: Novel Approach for Efficient Fine-tuning","created":"2026-06-12","cited_by_count":0,"area":null},{"id":"2607.29674","title":"Sign compression for Muon: SignMuon, MuonSign, and the Limits of Error Feedback","created":"2026-07-31","cited_by_count":0,"area":null},{"id":"2608.12710","title":"Federated Compositional Muon Optimizer for Matrix-Wise Models","created":"2026-08-13","cited_by_count":0,"area":null},{"id":"2609.26811","title":"The Drift Contract: Spectral Updates for Depth-Robust Local Learning","created":"2026-09-16","cited_by_count":0,"area":null},{"id":"2609.35297","title":"LionMuon: Alternating Spectral and Sign Descent for Efficient Training","created":"2026-09-28","cited_by_count":0,"area":null},{"id":"2610.01395","title":"AF-Muon: An AdamW-Free Muon Optimizer for Tied-Embedding Models","created":"2026-10-01","cited_by_count":0,"area":null},{"id":"2610.13773","title":"Geometry-Aware Multi-Objective Optimization: Norm-Constrained Oracles with Entropic Weight Updates","created":"2026-10-09","cited_by_count":0,"area":null},{"id":"2610.14344","title":"On the Depth Transfer of Neural Optimizers via L-Smoothness","created":"2026-10-09","cited_by_count":0,"area":null}],"next_cursor":null}