{"total":110,"rows":[{"id":"2604.12946","title":"Parcae: Scaling Laws For Stable Looped Language Models","created":"2026-04-14","cited_by_count":55,"area":null},{"id":"2511.00674","title":"Isotropic Curvature Model for Understanding Deep Learning Optimization: Is Gradient Orthogonalization Optimal?","created":"2025-11-01","cited_by_count":37,"area":null},{"id":"2510.16981","title":"MuonBP: Faster Muon via Block-Periodic Orthogonalization","created":"2025-10-19","cited_by_count":35,"area":null},{"id":"2608.30320","title":"On the Design of Qwen3.8-Next Architecture: Evaluation, Efficiency, and Training Stability","created":"2026-08-31","cited_by_count":35,"area":"moe"},{"id":"2601.08393","title":"Controlled LLM Training on Spectral Sphere","created":"2026-01-13","cited_by_count":31,"area":"moe"},{"id":"2605.20119","title":"Toto 2.0: Time Series Forecasting Enters the Scaling Era","created":"2026-05-19","cited_by_count":30,"area":null},{"id":"2510.09827","title":"An Exploration of Non-Euclidean Gradient Descent: Muon and its Many Variants","created":"2025-10-10","cited_by_count":28,"area":null},{"id":"2510.19933","title":"Beyond the Ideal: Analyzing the Inexact Muon Update","created":"2025-10-22","cited_by_count":27,"area":null},{"id":"2604.01472","title":"The Newton-Muon Optimizer","created":"2026-04-01","cited_by_count":18,"area":null},{"id":"2506.01913","title":"Generalized Gradient Norm Clipping & Non-Euclidean $(L_0,L_1)$-Smoothness","created":"2025-06-02","cited_by_count":17,"area":null},{"id":"2603.28254","title":"MuonEq: Balancing Before Orthogonalization with Lightweight Equilibration","created":"2026-03-30","cited_by_count":17,"area":null},{"id":"2604.09967","title":"Muon$^2$: Boosting Muon via Adaptive Second-Moment Preconditioning","created":"2026-04-11","cited_by_count":17,"area":null},{"id":"2602.08232","title":"Adaptive Matrix Online Learning through Smoothing with Guarantees for Nonsmooth Nonconvex Optimization","created":"2026-02-09","cited_by_count":14,"area":null},{"id":"2605.11181","title":"Muon is Not That Special: Random or Inverted Spectra Work Just as Well","created":"2026-05-11","cited_by_count":14,"area":null},{"id":"2602.11948","title":"Insights on Muon from Simple Quadratics","created":"2026-02-12","cited_by_count":13,"area":null},{"id":"2602.17155","title":"Powering Up Zeroth-Order Training via Subspace Gradient Orthogonalization","created":"2026-02-19","cited_by_count":12,"area":null},{"id":"2510.10777","title":"Preconditioned Norms: A Unified Framework for Steepest Descent, Quasi-Newton and Adaptive Methods","created":"2025-10-12","cited_by_count":11,"area":null},{"id":"2603.14315","title":"Enhancing LLM Training via Spectral Clipping","created":"2026-03-15","cited_by_count":10,"area":null},{"id":"2603.05002","title":"Non-Euclidean Gradient Descent Operates at the Edge of Stability","created":"2026-03-05","cited_by_count":9,"area":null},{"id":"2509.26337","title":"FedMuon: Federated Learning with Bias-corrected LMO-based Optimization","created":"2025-09-30","cited_by_count":8,"area":null},{"id":"2510.03871","title":"Optimal Scaling Needs Optimal Norm","created":"2025-10-04","cited_by_count":8,"area":null},{"id":"2512.14366","title":"Optimizing Rank for High-Fidelity Implicit Neural Representations","created":"2025-12-16","cited_by_count":8,"area":null},{"id":"2601.21487","title":"Manifold constrained steepest descent for smooth and closed-set optimization","created":"2026-01-29","cited_by_count":8,"area":null},{"id":"2602.09314","title":"Clarifying Shampoo: Adapting Spectral Descent to Stochasticity and the Parameter Trajectory","created":"2026-02-10","cited_by_count":8,"area":null},{"id":"2602.22681","title":"Accelerating LLM Pre-Training through Flat-Direction Dynamics Enhancement","created":"2026-02-26","cited_by_count":8,"area":null},{"id":"2605.06884","title":"Muon with Nesterov Momentum: Heavy-Tailed Noise and (Randomized) Inexact Polar Decomposition","created":"2026-05-07","cited_by_count":8,"area":null},{"id":"2605.19282","title":"Rethinking Muon Beyond Pretraining: Spectral Failures and High-Pass Remedies for VLA and RLVR","created":"2026-05-19","cited_by_count":8,"area":"lr"},{"id":"2605.10468","title":"Can Muon Fine-tune Adam-Pretrained Models?","created":"2026-05-11","cited_by_count":7,"area":null},{"id":"2601.23261","title":"TEON: Tensorized Orthonormalization Beyond Layer-Wise Muon for Large Language Model Pre-Training","created":"2026-01-30","cited_by_count":6,"area":null},{"id":"2602.21545","title":"MUON+: Towards More Effective Muon via One Additional Normalization Step for LLM Pre-training","created":"2026-02-25","cited_by_count":6,"area":null},{"id":"2605.09238","title":"Intrinsic Muon: Spectral Optimization on Riemannian Matrix Manifolds","created":"2026-05-10","cited_by_count":6,"area":null},{"id":"2605.12492","title":"Pion: A Spectrum-Preserving Optimizer via Orthogonal Equivalence Transformation","created":"2026-05-12","cited_by_count":6,"area":null},{"id":"2607.20548","title":"SOAP, Muon, and Beyond: Pushing LLM Pretraining Scales","created":"2026-07-13","cited_by_count":6,"area":null},{"id":"2602.05813","title":"Where Does Warm-Up Come From? Adaptive Scheduling for Norm-Constrained Optimizers","created":"2026-02-05","cited_by_count":5,"area":null},{"id":"2608.26288","title":"Muon with Finite Newton-Schulz: The Smoothing Benefit in Nonsmooth Nonconvex Optimization","created":"2026-08-26","cited_by_count":5,"area":null},{"id":"2512.09678","title":"Ky Fan Norms and Beyond: Dual Norms and Combinations for Matrix Optimization","created":"2025-12-10","cited_by_count":4,"area":null},{"id":"2601.22137","title":"PRISM: Distribution-free Adaptive Computation of Matrix Functions for Accelerating Neural Network Training","created":"2026-01-29","cited_by_count":4,"area":null},{"id":"2603.17970","title":"Beyond Muon: MUD (MomentUm Decorrelation) for Faster Transformer Training","created":"2026-03-18","cited_by_count":4,"area":null},{"id":"2605.31371","title":"Softsign: Smooth Sign in Your Optimizer For Better Parameter Heterogeneity Handling","created":"2026-05-29","cited_by_count":4,"area":null},{"id":"2606.12921","title":"LoRA-Muon: Spectral Steepest Descent on the Low-Rank Manifold","created":"2026-06-11","cited_by_count":4,"area":null},{"id":"2608.11612","title":"Dion3: Full-Stack Orthogonal Updates","created":"2026-08-12","cited_by_count":4,"area":null},{"id":"2605.23061","title":"Anytime Training with Schedule-Free Spectral Optimization","created":"2026-05-21","cited_by_count":3,"area":null},{"id":"2606.16371","title":"CacheMuon: Using Temporal Preconditioning To Approximate Polar Factor","created":"2026-06-15","cited_by_count":3,"area":null},{"id":"2606.23637","title":"Muown Implicitly Performs Angular Step-size Decay","created":"2026-06-22","cited_by_count":3,"area":null},{"id":"2606.27153","title":"DMuon: Efficient Distributed Muon Training with Near-Adam Overhead","created":"2026-06-25","cited_by_count":3,"area":null},{"id":"2608.02502","title":"CMuon: Accelerating and Stabilizing Diffusion Transformer Training via Chunked Momentum Orthogonalization","created":"2026-08-03","cited_by_count":3,"area":"diffusion"},{"id":"2603.10544","title":"SCORE: Replacing Layer Stacking with Contractive Recurrent Depth","created":"2026-03-11","cited_by_count":2,"area":null},{"id":"2605.07067","title":"PolarAdamW: Disentangling Spectral Control and Schur Gauge-Equivariance in Matrix Optimisation","created":"2026-05-08","cited_by_count":2,"area":null},{"id":"2605.11838","title":"Gradient Clipping Beyond Vector Norms: A Spectral Approach for Matrix-Valued Parameters","created":"2026-05-12","cited_by_count":2,"area":null},{"id":"2605.18528","title":"Tight Complexity of Muon under Heavy-Tailed Noise","created":"2026-05-18","cited_by_count":2,"area":null},{"id":"2605.19811","title":"LionMuon: Alternating Spectral and Sign Descent for Efficient Training","created":"2026-05-19","cited_by_count":2,"area":null},{"id":"2605.21803","title":"Same Architecture, Different Capacity: Optimizer-Induced Spectral Scaling Laws","created":"2026-05-20","cited_by_count":2,"area":null},{"id":"2605.26977","title":"Convergence of Spectral Descent for Non-smooth Optimization","created":"2026-05-26","cited_by_count":2,"area":null},{"id":"2606.21514","title":"Towards Understanding the Power and Limits of the Muon Optimizer: A River-Valley Perspective","created":"2026-06-19","cited_by_count":2,"area":null},{"id":"2607.17620","title":"PoLoRA: A Preconditioned Orthogonalized LoRA Optimizer","created":"2026-07-20","cited_by_count":2,"area":null},{"id":"2607.23777","title":"Scale Weight Decay and Train Better","created":"2026-07-26","cited_by_count":2,"area":null},{"id":"2609.30546","title":"Convergence guarantees for Muon: New parameter regimes and generalizations","created":"2026-09-24","cited_by_count":2,"area":null},{"id":"2508.06309","title":"Matrix-Driven Identification and Reconstruction of LLM Weight Homology","created":"2025-08-08","cited_by_count":1,"area":null},{"id":"2512.04632","title":"Turbo-Muon: Almost-Orthogonal Pre-Conditioning for Fast Muon Updates","created":"2025-12-04","cited_by_count":1,"area":null},{"id":"2512.08217","title":"Correction of Decoupled Weight Decay","created":"2025-12-09","cited_by_count":1,"area":null},{"id":"2602.05996","title":"Orthogonal Self-Attention","created":"2026-02-05","cited_by_count":1,"area":null},{"id":"2605.11396","title":"MuonQ: Enhancing Low-Bit Muon Quantization via Directional Fidelity Optimization","created":"2026-05-12","cited_by_count":1,"area":null},{"id":"2605.18999","title":"Distance-Aware Muon: Adaptive Step Scaling for Normalized Optimization","created":"2026-05-18","cited_by_count":1,"area":null},{"id":"2605.23259","title":"Multi-Gate Residuals","created":"2026-05-22","cited_by_count":1,"area":null},{"id":"2605.27605","title":"Laguna M.1/XS.2 Technical Report","created":"2026-05-26","cited_by_count":1,"area":"agents"},{"id":"2605.29157","title":"Parallax: Parameterized Local Linear Attention for Language Modeling","created":"2026-05-27","cited_by_count":1,"area":null},{"id":"2606.01720","title":"A Note on Stability for Orthogonalized Matrix Momentum with Client Sampling","created":"2026-06-01","cited_by_count":1,"area":null},{"id":"2606.05484","title":"Learned Subspace Compression for Communication-Efficient Pipeline Parallelism","created":"2026-06-03","cited_by_count":1,"area":null},{"id":"2606.06470","title":"PC Layer: Polynomial Weight Preconditioning for Improving LLM Pre-Training","created":"2026-06-04","cited_by_count":1,"area":null},{"id":"2606.13867","title":"Muon$^p$: Muon with Fractional Spectral Powers","created":"2026-06-11","cited_by_count":1,"area":null},{"id":"2606.14259","title":"Beyond a Single Explanation of the Adam--SGD Gap","created":"2026-06-12","cited_by_count":1,"area":null},{"id":"2607.08754","title":"SLORR: Simple and Efficient In-Training Low-Rank Regularization","created":"2026-07-09","cited_by_count":1,"area":null},{"id":"2607.13246","title":"Reassessing Muon for Matrix Factorization","created":"2026-07-14","cited_by_count":1,"area":null},{"id":"2607.14536","title":"Muse: Representation Geometry of Muon Beyond Normalized Momentum","created":"2026-07-16","cited_by_count":1,"area":null},{"id":"2607.26001","title":"Sharpness-Aware Minimization and Muon: Robustness under the Spectral Norm","created":"2026-07-28","cited_by_count":1,"area":null},{"id":"2608.05088","title":"MALT: Lightweight Curvature-Aware Muon via Diagonal Preconditioning","created":"2026-08-05","cited_by_count":1,"area":null},{"id":"2608.11749","title":"MOON: Multi-Objective OrthoNormalized Updates for Multitask Learning","created":"2026-08-12","cited_by_count":1,"area":null},{"id":"2608.14492","title":"Approximate Muon with low-rank adapters","created":"2026-08-14","cited_by_count":1,"area":null},{"id":"2608.20818","title":"Scaling Muon for Diffusion Transformers","created":"2026-08-21","cited_by_count":1,"area":"diffusion"},{"id":"2609.07597","title":"Beyond the Matrix Sign: Quadratic Spectral Descent","created":"2026-09-07","cited_by_count":1,"area":null},{"id":"2609.17629","title":"Fenchel-Young Duality Gaps: Certified Early Stopping for Regularized Inverse Problems","created":"2026-09-15","cited_by_count":1,"area":null},{"id":"2601.08131","title":"Attention Projection Mixing with Exogenous Anchors","created":"2026-01-13","cited_by_count":0,"area":null},{"id":"2602.09530","title":"Learning to Discover Iterative Spectral Algorithms","created":"2026-02-10","cited_by_count":0,"area":null},{"id":"2605.11850","title":"Constrained Stochastic Spectral Preconditioning Converges for Nonconvex Objectives","created":"2026-05-12","cited_by_count":0,"area":null},{"id":"2605.12491","title":"Do Vision Transformers Need All-to-All Attention? Global Communication Through Elastic Learned Cores","created":"2026-05-12","cited_by_count":0,"area":null},{"id":"2605.17806","title":"AMO: Operator-level Adaptive Muon Orthogonalization","created":"2026-05-18","cited_by_count":0,"area":null},{"id":"2605.19781","title":"From SGD to Muon: Adaptive Optimization via Schatten-p Norms","created":"2026-05-19","cited_by_count":0,"area":null},{"id":"2605.26327","title":"Reparametrizing Shampoo and SOAP for Subspace Basis Updates and BFloat16 Storage","created":"2026-05-25","cited_by_count":0,"area":null},{"id":"2605.27767","title":"UniMaia: Steering Chess Policies with Language for Human-like Play","created":"2026-05-26","cited_by_count":0,"area":null},{"id":"2606.00371","title":"How Much Orthogonalization Does Muon Need?","created":"2026-05-29","cited_by_count":0,"area":null},{"id":"2606.00442","title":"Exploiting weight-space symmetries for approximating curvature","created":"2026-05-30","cited_by_count":0,"area":null},{"id":"2607.22484","title":"Singular value soft-thresholding via the polar decomposition","created":"2026-07-24","cited_by_count":0,"area":null},{"id":"2608.06218","title":"Muon on the Stiefel Manifold Admits an Exact Closed-Form Update","created":"2026-08-06","cited_by_count":0,"area":null},{"id":"2608.18319","title":"SingularClip: Preventing Spectral Collapse to Maintain Plasticity in Continual and Reinforcement Learning","created":"2026-08-18","cited_by_count":0,"area":"deeprl"},{"id":"2608.22994","title":"A Physical Response-and-Memory Model for Muon Optimization","created":"2026-08-24","cited_by_count":0,"area":null},{"id":"2608.28442","title":"Curvature-Conditioned Multiscale Momentum with Sphere Constraints for LLM Pretraining","created":"2026-08-28","cited_by_count":0,"area":null},{"id":"2609.13677","title":"Nonsmooth Optimization via Orthogonalized Momentum","created":"2026-09-12","cited_by_count":0,"area":null},{"id":"2609.20104","title":"Design of the IBM Granite 5.0 TurboCTC ASR Model","created":"2026-09-17","cited_by_count":0,"area":"inference"},{"id":"2609.32505","title":"Fast Differentiable SVD on GPU via Polar Decomposition","created":"2026-09-26","cited_by_count":0,"area":null},{"id":"2609.32861","title":"Muon Under Gradient Noise and the Limits of Orthogonalization Near Optima","created":"2026-09-26","cited_by_count":0,"area":null}],"next_cursor":"100"}