{"total":30,"rows":[{"id":"2510.16981","title":"MuonBP: Faster Muon via Block-Periodic Orthogonalization","created":"2025-10-19","cited_by_count":35,"area":null},{"id":"2506.03595","title":"Purifying Shampoo: Investigating Shampoo's Heuristics by Decomposing its Preconditioner","created":"2025-06-04","cited_by_count":23,"area":null},{"id":"2512.05620","title":"Hyperparameter Transfer Enables Consistent Gains of Matrix-Preconditioned Optimizers Across Scales","created":"2025-12-05","cited_by_count":21,"area":null},{"id":"2510.09378","title":"The Potential of Second-Order Optimization for LLMs: A Study with Full Gauss-Newton","created":"2025-10-10","cited_by_count":17,"area":null},{"id":"2509.03378","title":"Understanding and Improving Shampoo and SOAP via Kullback-Leibler Minimization","created":"2025-09-03","cited_by_count":16,"area":null},{"id":"2510.25000","title":"What Really Matters in Matrix-Whitening Optimizers?","created":"2025-10-28","cited_by_count":16,"area":null},{"id":"2602.03702","title":"Anytime Pretraining: Horizon-Free Learning-Rate Schedules with Weight Averaging","created":"2026-02-03","cited_by_count":10,"area":null},{"id":"2507.09846","title":"Through the River: Understanding the Benefit of Schedule-Free Methods for Language Model Training","created":"2025-07-14","cited_by_count":9,"area":null},{"id":"2505.11840","title":"On the $O(\\frac{\\sqrt{d}}{K^{1/4}})$ Convergence Rate of AdamW Measured by $\\ell_1$ Norm","created":"2025-05-17","cited_by_count":8,"area":null},{"id":"2602.09314","title":"Clarifying Shampoo: Adapting Spectral Descent to Stochasticity and the Parameter Trajectory","created":"2026-02-10","cited_by_count":8,"area":null},{"id":"2604.15297","title":"Benchmarking Optimizers for MLPs in Tabular Deep Learning","created":"2026-04-16","cited_by_count":5,"area":null},{"id":"2507.08091","title":"Low-rank Momentum Factorization for Memory Efficient Training","created":"2025-07-10","cited_by_count":4,"area":null},{"id":"2605.22432","title":"AMUSE: Anytime Muon with Stable Gradient Evaluation","created":"2026-05-21","cited_by_count":4,"area":null},{"id":"2605.23061","title":"Anytime Training with Schedule-Free Spectral Optimization","created":"2026-05-21","cited_by_count":3,"area":null},{"id":"2606.23357","title":"SOAP-Bubbles: Structured Weight Uncertainty for Neural Networks","created":"2026-06-22","cited_by_count":3,"area":null},{"id":"2505.24005","title":"How far away are truly hyperparameter-free learning algorithms?","created":"2025-05-29","cited_by_count":2,"area":null},{"id":"2510.00236","title":"Per-example gradients: a new frontier for understanding and improving optimizers","created":"2025-09-30","cited_by_count":2,"area":null},{"id":"2605.19811","title":"LionMuon: Alternating Spectral and Sign Descent for Efficient Training","created":"2026-05-19","cited_by_count":2,"area":null},{"id":"2606.02365","title":"FOAM: Frequency and Operator Error-Based Adaptive Damping Method for Reducing Staleness-Oriented Error for Shampoo","created":"2026-06-01","cited_by_count":2,"area":null},{"id":"2505.13397","title":"Learning by solving differential equations","created":"2025-05-19","cited_by_count":1,"area":null},{"id":"2506.18221","title":"These Are Not All the Features You Are Looking For: A Fundamental Bottleneck in Supervised Pretraining","created":"2025-06-23","cited_by_count":1,"area":null},{"id":"2601.07326","title":"Convergence Rate Analysis of the AdamW-style Shampoo: Unifying One-Sided and Two-Sided Preconditioning","created":"2026-01-12","cited_by_count":1,"area":null},{"id":"2603.26954","title":"High dimensional theory of two-phase optimizers","created":"2026-03-27","cited_by_count":1,"area":null},{"id":"2606.14259","title":"Beyond a Single Explanation of the Adam--SGD Gap","created":"2026-06-12","cited_by_count":1,"area":null},{"id":"2605.26327","title":"Reparametrizing Shampoo and SOAP for Subspace Basis Updates and BFloat16 Storage","created":"2026-05-25","cited_by_count":0,"area":null},{"id":"2606.00442","title":"Exploiting weight-space symmetries for approximating curvature","created":"2026-05-30","cited_by_count":0,"area":null},{"id":"2606.00542","title":"Rethinking Bregman Divergences in Kronecker-Factored Optimizers","created":"2026-05-30","cited_by_count":0,"area":null},{"id":"2609.35297","title":"LionMuon: Alternating Spectral and Sign Descent for Efficient Training","created":"2026-09-28","cited_by_count":0,"area":null},{"id":"2610.13036","title":"Towards Easier-to-Tune Training Algorithms: New Results from AlgoPerf","created":"2026-10-09","cited_by_count":0,"area":null},{"id":"2610.18695","title":"A Refresh Interval Does Not Fully Specify a Refresh Schedule: Learning-Rate-Dependent Placement in Kronecker-Preconditioned Language Model Training","created":"2026-10-13","cited_by_count":0,"area":null}],"next_cursor":null}