{"total":38,"rows":[{"id":"2510.09827","title":"An Exploration of Non-Euclidean Gradient Descent: Muon and its Many Variants","created":"2025-10-10","cited_by_count":28,"area":null},{"id":"2510.22980","title":"How Muon's Spectral Design Benefits Generalization: A Study on Imbalanced Data","created":"2025-10-27","cited_by_count":19,"area":null},{"id":"2509.10167","title":"The Hidden Width of Deep ResNets: Tight Error Bounds and Phase Diagram","created":"2025-09-12","cited_by_count":17,"area":null},{"id":"2510.25000","title":"What Really Matters in Matrix-Whitening Optimizers?","created":"2025-10-28","cited_by_count":16,"area":null},{"id":"2506.12543","title":"Is your batch size the problem? Revisiting the Adam-SGD gap in language modeling","created":"2025-06-14","cited_by_count":15,"area":null},{"id":"2602.17080","title":"Adam Improves Muon: Adaptive Moment Estimation with Orthogonalized Momentum","created":"2026-02-19","cited_by_count":14,"area":null},{"id":"2506.04805","title":"Adaptive Preconditioners Trigger Loss Spikes in Adam","created":"2025-06-05","cited_by_count":13,"area":null},{"id":"2602.16340","title":"The Implicit Bias of Adam and Muon on Smooth Homogeneous Neural Networks","created":"2026-02-18","cited_by_count":11,"area":null},{"id":"2603.15958","title":"Deriving Hyperparameter Scaling Laws via Modern Optimization Theory","created":"2026-03-16","cited_by_count":10,"area":null},{"id":"2511.17388","title":"Selective Rotary Position Embedding","created":"2025-11-21","cited_by_count":9,"area":null},{"id":"2505.24275","title":"GradPower: Powering Gradients for Faster Language Model Pre-Training","created":"2025-05-30","cited_by_count":8,"area":null},{"id":"2602.09314","title":"Clarifying Shampoo: Adapting Spectral Descent to Stochasticity and the Parameter Trajectory","created":"2026-02-10","cited_by_count":8,"area":null},{"id":"2602.15322","title":"On Surprising Effectiveness of Masking Updates in Adaptive Optimizers","created":"2026-02-17","cited_by_count":7,"area":null},{"id":"2510.26997","title":"Gradient Descent as Loss Landscape Navigation: a Normative Framework for Deriving Learning Rules","created":"2025-10-30","cited_by_count":4,"area":null},{"id":"2602.01642","title":"The Effect of Mini-Batch Noise on the Implicit Bias of Adam","created":"2026-02-02","cited_by_count":4,"area":null},{"id":"2602.06880","title":"Decoupling Variance and Scale-Invariant Updates in Adaptive Gradient Descent for Unified Vector and Matrix Optimization","created":"2026-02-06","cited_by_count":4,"area":null},{"id":"2602.08372","title":"Dynamic Regret via Discounted-to-Dynamic Reduction with Applications to Curved Losses and Adam Optimizer","created":"2026-02-09","cited_by_count":4,"area":null},{"id":"2605.06152","title":"Grokking or Glitching? How Low-Precision Drives Slingshot Loss Spikes","created":"2026-05-07","cited_by_count":4,"area":null},{"id":"2510.03478","title":"How to Set $\\beta_1, \\beta_2$ in Adam: An Online Learning Perspective","created":"2025-10-03","cited_by_count":2,"area":null},{"id":"2510.26303","title":"Implicit Bias of Per-sample Adam on Separable Data: Departure from the Full-batch Regime","created":"2025-10-30","cited_by_count":2,"area":null},{"id":"2602.03001","title":"Adaptive Batch Sizes Using Non-Euclidean Gradient Noise Scales for Stochastic Sign and Spectral Descent","created":"2026-02-03","cited_by_count":2,"area":null},{"id":"2605.03869","title":"On Adaptivity in Zeroth-Order Optimization","created":"2026-05-05","cited_by_count":2,"area":null},{"id":"2512.08217","title":"Correction of Decoupled Weight Decay","created":"2025-12-09","cited_by_count":1,"area":null},{"id":"2601.07326","title":"Convergence Rate Analysis of the AdamW-style Shampoo: Unifying One-Sided and Two-Sided Preconditioning","created":"2026-01-12","cited_by_count":1,"area":null},{"id":"2601.21739","title":"Why $\\beta_1 = \\beta_2$ Is Dynamically Special in Adam","created":"2026-01-29","cited_by_count":1,"area":null},{"id":"2605.10119","title":"Refresh-Scaling the Memory of Balanced Adam","created":"2026-05-11","cited_by_count":1,"area":null},{"id":"2606.14259","title":"Beyond a Single Explanation of the Adam--SGD Gap","created":"2026-06-12","cited_by_count":1,"area":null},{"id":"2511.20516","title":"Adam Simplified: Bias Correction Debunked","created":"2025-11-25","cited_by_count":0,"area":null},{"id":"2602.05845","title":"Self-Supervised Learning with a Multi-Task Latent Space Objective","created":"2026-02-05","cited_by_count":0,"area":null},{"id":"2602.15814","title":"Avey-B","created":"2026-02-17","cited_by_count":0,"area":null},{"id":"2605.02143","title":"Personalized Federated Learning for Gradient Alignment","created":"2026-05-04","cited_by_count":0,"area":null},{"id":"2605.05794","title":"Revealing Modular Gradient Noise Imbalance in LLMs: Calibrating Adam via Signal-to-Noise Ratio","created":"2026-05-07","cited_by_count":0,"area":null},{"id":"2605.06166","title":"One Algorithm, Two Goals: Dual Scoring for Parameter and Data Selection in LLM Fine-Tuning","created":"2026-05-07","cited_by_count":0,"area":null},{"id":"2605.17806","title":"AMO: Operator-level Adaptive Muon Orthogonalization","created":"2026-05-18","cited_by_count":0,"area":null},{"id":"2605.21104","title":"HORST: Composing Optimizer Geometries for Sparse Transformer Training","created":"2026-05-20","cited_by_count":0,"area":null},{"id":"2606.22326","title":"Adam Converges in Nonsmooth Nonconvex Optimization","created":"2026-06-21","cited_by_count":0,"area":null},{"id":"2608.04050","title":"FM4WiFi: Flow Matching for Multi-AP Coordination in Dense Deployments of Beyond Wi-Fi 8 Networks","created":"2026-08-04","cited_by_count":0,"area":null},{"id":"2609.35392","title":"The Hidden Ratio in Adam: Stable Structure, Compression, and Sign Dynamics","created":"2026-09-28","cited_by_count":0,"area":null}],"next_cursor":null}