{"total":53,"rows":[{"id":"2208.09632","title":"Adam Can Converge Without Any Modification On Update Rules","created":"2022-08-20","cited_by_count":114,"area":null},{"id":"2308.08165","title":"Stochastic Controlled Averaging for Federated Learning with Communication Compression","created":"2023-08-16","cited_by_count":101,"area":null},{"id":"2102.04761","title":"Quasi-Global Momentum: Accelerating Decentralized Deep Learning on Heterogeneous Data","created":"2021-02-09","cited_by_count":69,"area":null},{"id":"2306.16504","title":"Momentum Benefits Non-IID Federated Learning Simply and Provably","created":"2023-06-28","cited_by_count":38,"area":null},{"id":"2202.04295","title":"On Almost Sure Convergence Rates of Stochastic Gradient Methods","created":"2022-02-09","cited_by_count":35,"area":null},{"id":"2103.17182","title":"Positive-Negative Momentum: Manipulating Stochastic Gradient Noise to Improve Generalization","created":"2021-03-31","cited_by_count":28,"area":null},{"id":"2101.05471","title":"Towards Practical Adam: Non-Convexity, Convergence Theory, and Mini-Batch Acceleration","created":"2021-01-14","cited_by_count":25,"area":null},{"id":"2110.03891","title":"Does Momentum Change the Implicit Regularization on Separable Data?","created":"2021-10-08","cited_by_count":22,"area":null},{"id":"2402.03982","title":"On Convergence of Adam for Stochastic Optimization under Relaxed Assumptions","created":"2024-02-06","cited_by_count":21,"area":null},{"id":"2209.15505","title":"Momentum Tracking: Momentum Acceleration for Decentralized Deep Learning on Heterogeneous Data","created":"2022-09-30","cited_by_count":20,"area":null},{"id":"2307.15196","title":"The Marginal Value of Momentum for Small Learning Rate SGD","created":"2023-07-27","cited_by_count":18,"area":null},{"id":"2109.03194","title":"On the Convergence of Decentralized Adaptive Gradient Methods","created":"2021-09-07","cited_by_count":17,"area":null},{"id":"2106.03696","title":"Dynamics of Stochastic Momentum Methods on Large-scale, Quadratic Models","created":"2021-06-07","cited_by_count":16,"area":null},{"id":"2206.07553","title":"On the fast convergence of minibatch heavy ball momentum","created":"2022-06-15","cited_by_count":13,"area":null},{"id":"2406.04142","title":"Stochastic Polyak Step-sizes and Momentum: Convergence Guarantees and Practical Performance","created":"2024-06-06","cited_by_count":13,"area":null},{"id":"2106.03034","title":"Minibatch and Momentum Model-based Methods for Stochastic Weakly Convex Optimization","created":"2021-06-06","cited_by_count":10,"area":null},{"id":"2305.17665","title":"Acceleration of stochastic gradient descent with momentum by averaging: finite-sample rates and asymptotic normality","created":"2023-05-28","cited_by_count":9,"area":null},{"id":"2110.09057","title":"Training Deep Neural Networks with Adaptive Momentum Inspired by the Quadratic Optimization","created":"2021-10-18","cited_by_count":8,"area":null},{"id":"2411.19671","title":"On the Performance Analysis of Momentum Method: A Frequency Domain Perspective","created":"2024-11-29","cited_by_count":8,"area":null},{"id":"2212.12532","title":"Generalization Bounds for Few-Shot Transfer Learning with Pretrained Classifiers","created":"2022-12-23","cited_by_count":7,"area":null},{"id":"2210.14560","title":"Hierarchical Federated Learning with Momentum Acceleration in Multi-Tier Networks","created":"2022-10-26","cited_by_count":6,"area":null},{"id":"2205.14811","title":"Last-iterate convergence analysis of stochastic momentum methods for neural networks","created":"2022-05-30","cited_by_count":5,"area":null},{"id":"2209.01199","title":"Revisiting Outer Optimization in Adversarial Training","created":"2022-09-02","cited_by_count":5,"area":null},{"id":"2312.01432","title":"Fast Dual Subgradient Optimization of the Integrated Transportation Distance Between Stochastic Kernels","created":"2023-12-03","cited_by_count":4,"area":null},{"id":"2605.31371","title":"Softsign: Smooth Sign in Your Optimizer For Better Parameter Heterogeneity Handling","created":"2026-05-29","cited_by_count":4,"area":null},{"id":"2311.18578","title":"Communication-Efficient Heterogeneous Federated Learning with Generalized Heavy-Ball Momentum","created":"2023-11-30","cited_by_count":3,"area":null},{"id":"2106.02888","title":"Bandwidth-based Step-Sizes for Non-Convex Stochastic Optimization","created":"2021-06-05","cited_by_count":2,"area":null},{"id":"2403.00853","title":"Parallel Momentum Methods Under Biased Gradient Estimations","created":"2024-02-29","cited_by_count":2,"area":null},{"id":"2409.04022","title":"Heterogeneity-Aware Cooperative Federated Edge Learning with Adaptive Computation and Communication Compression","created":"2024-09-06","cited_by_count":2,"area":null},{"id":"2412.18790","title":"Torque-Aware Momentum","created":"2024-12-25","cited_by_count":2,"area":null},{"id":"2501.08883","title":"Increasing Batch Size Improves Convergence of Stochastic Gradient Descent with Momentum","created":"2025-01-15","cited_by_count":2,"area":null},{"id":"2505.17300","title":"Statistical Inference for Online Algorithms","created":"2025-05-22","cited_by_count":2,"area":null},{"id":"2511.14501","title":"Improved Convergence in Parameter-Agnostic Error Feedback through Momentum","created":"2025-11-18","cited_by_count":2,"area":null},{"id":"2606.17526","title":"MGUP: A Momentum-Gradient Alignment Update Policy for Stochastic Optimization","created":"2026-06-16","cited_by_count":2,"area":null},{"id":"2402.11224","title":"Neural Networks with (Low-Precision) Polynomial Approximations: New Insights and Techniques for Accuracy Improvement","created":"2024-02-17","cited_by_count":1,"area":null},{"id":"2506.11904","title":"Convergence of Momentum-Based Optimization Algorithms with Time-Varying Parameters","created":"2025-06-13","cited_by_count":1,"area":null},{"id":"2506.23544","title":"Both Asymptotic and Non-Asymptotic Convergence of Quasi-Hyperbolic Momentum using Increasing Batch Size","created":"2025-06-30","cited_by_count":1,"area":null},{"id":"2507.19627","title":"Federated Calculation of the Free-Support Transportation Barycenter by Single-Loop Dual Decomposition","created":"2025-07-25","cited_by_count":1,"area":null},{"id":"2508.03105","title":"Accelerating SGDM via Learning Rate and Batch Size Schedules: A Lyapunov-Based Analysis","created":"2025-08-05","cited_by_count":1,"area":null},{"id":"2510.04988","title":"Adaptive Memory Momentum via a Model-Based Framework for Deep Learning Optimization","created":"2025-10-06","cited_by_count":1,"area":null},{"id":"2605.28517","title":"Stochastic Gradient Descent with Momentum is Algorithmically Stable","created":"2026-05-27","cited_by_count":1,"area":null},{"id":"2606.21917","title":"Pre-Generation Hallucination Detection in Large Language Models via Soft-Target Attention Probing","created":"2026-06-20","cited_by_count":1,"area":null},{"id":"2104.13818","title":"NUQSGD: Provably Communication-efficient Data-parallel SGD via Nonuniform Quantization","created":"2021-04-28","cited_by_count":0,"area":null},{"id":"2110.08531","title":"A theoretical and empirical study of new adaptive algorithms with additional momentum steps and shifted updates for stochastic non-convex optimization","created":"2021-10-16","cited_by_count":0,"area":null},{"id":"2208.02208","title":"SGEM: stochastic gradient with energy and momentum","created":"2022-08-03","cited_by_count":0,"area":null},{"id":"2303.00179","title":"A Unified Momentum-based Paradigm of Decentralized SGD for Non-Convex Models and Heterogeneous Data","created":"2023-03-01","cited_by_count":0,"area":null},{"id":"2405.13765","title":"On the stability of gradient descent with second order dynamics for time-varying cost functions","created":"2024-05-22","cited_by_count":0,"area":null},{"id":"2504.12742","title":"Decentralized Nonconvex Composite Federated Learning with Gradient Tracking and Momentum","created":"2025-04-17","cited_by_count":0,"area":null},{"id":"2505.12526","title":"Never Skip a Batch: Dense Learning of Temporal GNNs via Adaptive Pseudo-Supervision","created":"2025-05-18","cited_by_count":0,"area":null},{"id":"2605.18609","title":"Perfect Parallelization in Mini-Batch SGD with Classical Momentum Acceleration","created":"2026-05-18","cited_by_count":0,"area":null},{"id":"2608.11061","title":"Batch Size or Negatives? A Selection Rule for Memory-Constrained Recommender Training","created":"2026-08-11","cited_by_count":0,"area":null},{"id":"2608.16760","title":"On the Principles Behind Neural Network Optimizers","created":"2026-08-17","cited_by_count":0,"area":null},{"id":"2609.32465","title":"PolyStepOR: Learning to Decide Without Optimal Decisions","created":"2026-09-26","cited_by_count":0,"area":null}],"next_cursor":null}