{"total":31,"rows":[{"id":"2210.05643","title":"A Kernel-Based View of Language Model Fine-Tuning","created":"2022-10-11","cited_by_count":121,"area":null},{"id":"2205.10287","title":"On the SDEs and Scaling Rules for Adaptive Gradient Algorithms","created":"2022-05-20","cited_by_count":104,"area":null},{"id":"2207.14484","title":"Adaptive Gradient Methods at the Edge of Stability","created":"2022-07-29","cited_by_count":101,"area":null},{"id":"2309.00079","title":"On the Implicit Bias of Adam","created":"2023-08-31","cited_by_count":27,"area":null},{"id":"2505.19227","title":"Scaling Laws for Gradient Descent and Sign Descent for Linear Bigram Models under Zipf's Law","created":"2025-05-25","cited_by_count":24,"area":null},{"id":"2503.12811","title":"A Multi-Power Law for Loss Curve Prediction Across Learning Rate Schedules","created":"2025-03-17","cited_by_count":22,"area":null},{"id":"2305.12133","title":"Loss Spike in Training Neural Networks","created":"2023-05-20","cited_by_count":16,"area":null},{"id":"2506.04805","title":"Adaptive Preconditioners Trigger Loss Spikes in Adam","created":"2025-06-05","cited_by_count":13,"area":null},{"id":"2511.04622","title":"ODE approximation for the Adam algorithm: General and overparametrized setting","created":"2025-11-06","cited_by_count":10,"area":null},{"id":"2308.06703","title":"Understanding the robustness difference between stochastic gradient descent and adaptive gradient methods","created":"2023-08-13","cited_by_count":8,"area":null},{"id":"2502.02132","title":"How Memory in Optimization Algorithms Implicitly Modifies the Loss","created":"2025-02-04","cited_by_count":6,"area":null},{"id":"2502.11034","title":"AdaGC: Enhancing LLM Pretraining Stability via Adaptive Gradient Clipping","created":"2025-02-16","cited_by_count":6,"area":null},{"id":"2602.01642","title":"The Effect of Mini-Batch Noise on the Implicit Bias of Adam","created":"2026-02-02","cited_by_count":4,"area":null},{"id":"2603.09581","title":"Towards Understanding Adam Convergence on Highly Degenerate Polynomials","created":"2026-03-10","cited_by_count":4,"area":null},{"id":"2605.06152","title":"Grokking or Glitching? How Low-Precision Drives Slingshot Loss Spikes","created":"2026-05-07","cited_by_count":4,"area":null},{"id":"2410.14158","title":"A Mirror Descent Perspective of Smoothed Sign Descent","created":"2024-10-18","cited_by_count":3,"area":null},{"id":"2509.21614","title":"Effective continuous equations for adaptive SGD: a stochastic analysis view","created":"2025-09-25","cited_by_count":1,"area":null},{"id":"2601.21739","title":"Why $\\beta_1 = \\beta_2$ Is Dynamically Special in Adam","created":"2026-01-29","cited_by_count":1,"area":null},{"id":"2605.10119","title":"Refresh-Scaling the Memory of Balanced Adam","created":"2026-05-11","cited_by_count":1,"area":null},{"id":"2605.12878","title":"Adam-SHANG: A Convergent Adam-Type Method for Stochastic Smooth Convex Optimization","created":"2026-05-13","cited_by_count":1,"area":null},{"id":"2607.21005","title":"Weight-norm Criticality: A Mechanism for Loss Spikes Induced by the Normalization and Weight Decay","created":"2026-07-23","cited_by_count":1,"area":null},{"id":"2608.19762","title":"Finite-Horizon Input-Output Dynamics of Minibatch Perturbations in AdamW","created":"2026-08-20","cited_by_count":1,"area":null},{"id":"2411.15795","title":"Beyond adaptive gradient: Fast-Controlled Minibatch Algorithm for large-scale optimization","created":"2024-11-24","cited_by_count":0,"area":null},{"id":"2504.14882","title":"Some Optimizers are More Equal: Understanding the Role of Optimizers in Group Fairness","created":"2025-04-21","cited_by_count":0,"area":null},{"id":"2603.02620","title":"Same Error, Different Function: The Optimizer as an Implicit Prior in Financial Time Series","created":"2026-03-03","cited_by_count":0,"area":null},{"id":"2605.19392","title":"Understanding Dynamics of Adam in Zero-Sum Games: An ODE Approach","created":"2026-05-19","cited_by_count":0,"area":null},{"id":"2608.30382","title":"Convergence rates for the RMSprop optimizer with full control of the hyperparameters","created":"2026-08-31","cited_by_count":0,"area":null},{"id":"2609.05516","title":"An Exploratory Study of Frequency-Aware Task Weighting for YOLOv8-Based Unified Driving Perception","created":"2026-08-31","cited_by_count":0,"area":null},{"id":"2609.18314","title":"Beyond Quadratic Loss: The Stability Phase Diagram of Adam","created":"2026-09-16","cited_by_count":0,"area":null},{"id":"2610.02798","title":"Muon Learns Facts Better: Understanding the Role of Spectral Orthogonalization","created":"2026-10-02","cited_by_count":0,"area":null},{"id":"2610.04405","title":"CEENs: Causality-enforced evolutional networks for solving time-dependent partial differential equations","created":"2026-10-03","cited_by_count":0,"area":null}],"next_cursor":null}