{"total":101,"rows":[{"id":"2103.05032","title":"Convergence and Accuracy Trade-Offs in Federated Learning and Meta-Learning","created":"2021-03-08","cited_by_count":52,"area":null},{"id":"2207.05931","title":"Towards understanding how momentum improves generalization in deep learning","created":"2022-07-13","cited_by_count":40,"area":null},{"id":"2110.04261","title":"Extragradient Method: $O(1/K)$ Last-Iterate Convergence for Monotone Variational Inequalities and Connections With Cocoercivity","created":"2021-10-08","cited_by_count":39,"area":null},{"id":"2102.09468","title":"Near-optimal Local Convergence of Alternating Gradient Descent-Ascent for Minimax Optimization","created":"2021-02-18","cited_by_count":31,"area":null},{"id":"2111.11309","title":"No-Regret Dynamics in the Fenchel Game: A Unified Framework for Algorithmic Convex Optimization","created":"2021-11-22","cited_by_count":20,"area":null},{"id":"2204.09228","title":"Tight Last-Iterate Convergence of the Extragradient and the Optimistic Gradient Descent-Ascent Algorithm for Constrained Monotone Variational Inequalities","created":"2022-04-20","cited_by_count":19,"area":null},{"id":"2102.02167","title":"Algorithmic Instabilities of Accelerated Gradient Descent","created":"2021-02-03","cited_by_count":16,"area":null},{"id":"2109.03861","title":"Recurrent Neural Network Controllers Synthesis with Stability Guarantees for Partially Observed Systems","created":"2021-09-08","cited_by_count":16,"area":null},{"id":"2312.12670","title":"On the Role of Server Momentum in Federated Learning","created":"2023-12-19","cited_by_count":16,"area":null},{"id":"2103.01338","title":"Acceleration via Fractal Learning Rate Schedules","created":"2021-03-01","cited_by_count":13,"area":null},{"id":"2206.07553","title":"On the fast convergence of minibatch heavy ball momentum","created":"2022-06-15","cited_by_count":13,"area":null},{"id":"2406.04558","title":"On PI Controllers for Updating Lagrange Multipliers in Constrained Optimization","created":"2024-06-07","cited_by_count":12,"area":null},{"id":"2201.04040","title":"PEPit: computer-assisted worst-case analyses of first-order optimization methods in Python","created":"2022-01-11","cited_by_count":11,"area":null},{"id":"2206.11872","title":"Provable Acceleration of Heavy Ball beyond Quadratics for a Class of Polyak-\\L{}ojasiewicz Functions when the Non-Convexity is Averaged-Out","created":"2022-06-22","cited_by_count":11,"area":null},{"id":"2410.03883","title":"DiSK: Differentially Private Optimizer with Simplified Kalman Filter for Noise Reduction","created":"2024-10-04","cited_by_count":11,"area":null},{"id":"2202.03525","title":"Nesterov Accelerated Shuffling Gradient Method for Convex Optimization","created":"2022-02-07","cited_by_count":10,"area":null},{"id":"2302.09160","title":"Identifying Equivalent Training Dynamics","created":"2023-02-17","cited_by_count":9,"area":null},{"id":"2104.12384","title":"Wasserstein distance estimates for the distributions of numerical approximations to ergodic stochastic differential equations","created":"2021-04-26","cited_by_count":8,"area":null},{"id":"2106.02985","title":"Escaping Saddle Points Faster with Stochastic Momentum","created":"2021-06-05","cited_by_count":8,"area":null},{"id":"2302.03550","title":"Exponential convergence rates for momentum stochastic gradient descent in the overparametrized setting","created":"2023-02-07","cited_by_count":8,"area":null},{"id":"2107.01832","title":"Provable Convergence of Nesterov's Accelerated Gradient Method for Over-Parameterized Neural Networks","created":"2021-07-05","cited_by_count":7,"area":null},{"id":"2111.06171","title":"Convergence and Stability of the Stochastic Proximal Point Algorithm with Momentum","created":"2021-11-11","cited_by_count":7,"area":null},{"id":"2403.09389","title":"Learning to optimize with convergence guarantees using nonlinear system theory","created":"2024-03-14","cited_by_count":7,"area":null},{"id":"2410.08395","title":"Nesterov acceleration in benignly non-convex landscapes","created":"2024-10-10","cited_by_count":7,"area":null},{"id":"2102.11537","title":"Revisiting the Role of Euler Numerical Integration on Acceleration and Stability in Convex Optimization","created":"2021-02-23","cited_by_count":6,"area":null},{"id":"2103.17106","title":"Linear systems with neural network nonlinearities: Improved stability analysis via acausal Zames-Falb multipliers","created":"2021-03-31","cited_by_count":6,"area":null},{"id":"2305.12056","title":"Uniform-in-Time Wasserstein Stability Bounds for (Noisy) Stochastic Gradient Descent","created":"2023-05-20","cited_by_count":6,"area":null},{"id":"2102.11755","title":"Analytical Study of Momentum-Based Acceleration Methods in Paradigmatic High-Dimensional Non-Convex Problems","created":"2021-02-23","cited_by_count":5,"area":null},{"id":"2106.10708","title":"Memory Augmented Optimizers for Deep Learning","created":"2021-06-20","cited_by_count":5,"area":null},{"id":"2404.13831","title":"Data-Driven Performance Guarantees for Classical and Learned Optimizers","created":"2024-04-22","cited_by_count":5,"area":null},{"id":"2101.12101","title":"Potential Function-based Framework for Making the Gradients Small in Convex and Min-Max Optimization","created":"2021-01-28","cited_by_count":4,"area":null},{"id":"2204.08306","title":"A Convergence Analysis of Nesterov's Accelerated Gradient Method in Training Deep Linear Neural Networks","created":"2022-04-18","cited_by_count":4,"area":null},{"id":"2207.12395","title":"Tuning Stochastic Gradient Algorithms for Statistical Inference via Large-Sample Asymptotics","created":"2022-07-25","cited_by_count":4,"area":null},{"id":"2301.07902","title":"A Nonstochastic Control Approach to Optimization","created":"2023-01-19","cited_by_count":4,"area":null},{"id":"2403.09090","title":"Dissipative Gradient Descent Ascent Method: A Control Theory Inspired Algorithm for Min-max Optimization","created":"2024-03-14","cited_by_count":4,"area":null},{"id":"2405.05236","title":"Stability and Performance Analysis of Discrete-Time ReLU Recurrent Neural Networks","created":"2024-05-08","cited_by_count":4,"area":null},{"id":"2104.14101","title":"Fast Convex Quadratic Optimization Solvers with Adaptive Sketching-based Preconditioners","created":"2021-04-29","cited_by_count":3,"area":null},{"id":"2202.06922","title":"Convex Programs and Lyapunov Functions for Reinforcement Learning: A Unified Perspective on the Analysis of Value-Based Methods","created":"2022-02-14","cited_by_count":3,"area":null},{"id":"2405.10618","title":"Distributed Event-Based Learning via ADMM","created":"2024-05-17","cited_by_count":3,"area":null},{"id":"2410.16849","title":"Polyak's Heavy Ball Method Achieves Accelerated Local Rate of Convergence under Polyak-Lojasiewicz Inequality","created":"2024-10-22","cited_by_count":3,"area":null},{"id":"2507.03404","title":"On the Effectiveness of the z-Transform Method in Quadratic Optimization","created":"2025-07-04","cited_by_count":3,"area":null},{"id":"2508.00775","title":"Learning to optimize with guarantees: a complete characterization of linearly convergent algorithms","created":"2025-08-01","cited_by_count":3,"area":null},{"id":"2603.09355","title":"SHANG++: Robust Stochastic Acceleration under Multiplicative Noise","created":"2026-03-10","cited_by_count":3,"area":null},{"id":"2103.08017","title":"Transient growth of accelerated optimization algorithms","created":"2021-03-14","cited_by_count":2,"area":null},{"id":"2105.14385","title":"On Centralized and Distributed Mirror Descent: Convergence Analysis Using Quadratic Constraints","created":"2021-05-29","cited_by_count":2,"area":null},{"id":"2204.12663","title":"Understanding A Class of Decentralized and Federated Optimization Algorithms: A Multi-Rate Feedback Control Perspective","created":"2022-04-27","cited_by_count":2,"area":null},{"id":"2208.13006","title":"Neural Observer with Lyapunov Stability Guarantee for Uncertain Nonlinear Systems","created":"2022-08-27","cited_by_count":2,"area":null},{"id":"2303.04328","title":"The Novel Adaptive Fractional Order Gradient Decent Algorithms Design via Robust Control","created":"2023-03-08","cited_by_count":2,"area":null},{"id":"2305.08658","title":"On the connections between optimization algorithms, Lyapunov functions, and differential equations: theory and insights","created":"2023-05-15","cited_by_count":2,"area":null},{"id":"2311.02002","title":"A Variational Perspective on High-Resolution ODEs","created":"2023-11-03","cited_by_count":2,"area":null},{"id":"2312.12067","title":"Optimistic Policy Gradient in Multi-Player Markov Games with a Single Controller: Convergence Beyond the Minty Property","created":"2023-12-19","cited_by_count":2,"area":null},{"id":"2501.08883","title":"Increasing Batch Size Improves Convergence of Stochastic Gradient Descent with Momentum","created":"2025-01-15","cited_by_count":2,"area":null},{"id":"2505.17965","title":"Bias-Optimal Bounds for SGD: A Computer-Aided Lyapunov Analysis","created":"2025-05-23","cited_by_count":2,"area":null},{"id":"2606.17364","title":"A Polyak-Ruppert Central Limit Theorem for SA-Adam with Momentum and Non-Convergent Adaptive Preconditioning","created":"2026-06-15","cited_by_count":2,"area":null},{"id":"2609.30546","title":"Convergence guarantees for Muon: New parameter regimes and generalizations","created":"2026-09-24","cited_by_count":2,"area":null},{"id":"2106.06753","title":"Scaling transition from momentum stochastic gradient descent to plain stochastic gradient descent","created":"2021-06-12","cited_by_count":1,"area":null},{"id":"2106.07620","title":"Fast symplectic integrator for Nesterov-type acceleration method","created":"2021-06-01","cited_by_count":1,"area":null},{"id":"2209.11920","title":"Tradeoffs between convergence rate and noise amplification for momentum-based accelerated optimization algorithms","created":"2022-09-24","cited_by_count":1,"area":null},{"id":"2302.08484","title":"FOSI: Hybrid First and Second Order Optimization","created":"2023-02-16","cited_by_count":1,"area":null},{"id":"2305.01377","title":"Random Function Descent","created":"2023-05-02","cited_by_count":1,"area":null},{"id":"2411.19242","title":"Controlling Participation in Federated Learning with Feedback","created":"2024-11-28","cited_by_count":1,"area":null},{"id":"2503.23600","title":"Online Convex Optimization and Integral Quadratic Constraints: An automated approach to regret analysis","created":"2025-03-30","cited_by_count":1,"area":null},{"id":"2509.13628","title":"Accelerated Gradient Methods with Biased Gradient Estimates: Risk Sensitivity, High-Probability Guarantees, and Large Deviation Bounds","created":"2025-09-17","cited_by_count":1,"area":null},{"id":"2605.08488","title":"A Unified Lyapunov-IQC Framework for Uniform Stability of Smooth Quadratic First-Order Accelerated Optimizers","created":"2026-05-08","cited_by_count":1,"area":null},{"id":"2606.25086","title":"Training for the Model You Return: Improving Optimization for Iterate-Averaged Language Models","created":"2026-06-23","cited_by_count":1,"area":null},{"id":"2608.18415","title":"The Road Taken: The Role of Optimizers at the Edge of Stability","created":"2026-08-19","cited_by_count":1,"area":null},{"id":"2102.09111","title":"Online Optimization and Ambiguity-based Learning of Distributionally Uncertain Dynamic Systems","created":"2021-02-18","cited_by_count":0,"area":null},{"id":"2102.13653","title":"On the Generalization of Stochastic Gradient Descent with Momentum","created":"2021-02-26","cited_by_count":0,"area":null},{"id":"2106.08775","title":"Momentum-inspired Low-Rank Coordinate Descent for Diagonally Constrained SDPs","created":"2021-06-16","cited_by_count":0,"area":null},{"id":"2108.08670","title":"On Accelerating Distributed Convex Optimizations","created":"2021-08-19","cited_by_count":0,"area":null},{"id":"2201.08311","title":"Accelerated Gradient Flow: Risk, Stability, and Implicit Regularization","created":"2022-01-20","cited_by_count":0,"area":null},{"id":"2204.09801","title":"Exact Formulas for Finite-Time Estimation Errors of Decentralized Temporal Difference Learning with Linear Function Approximation","created":"2022-04-20","cited_by_count":0,"area":null},{"id":"2205.02591","title":"PI-NLF: A Proportional-Integral Approach for Non-negative Latent Factor Analysis","created":"2022-05-05","cited_by_count":0,"area":null},{"id":"2208.03941","title":"Provable Acceleration of Nesterov's Accelerated Gradient Method over Heavy Ball Method in Training Over-Parameterized Neural Networks","created":"2022-08-08","cited_by_count":0,"area":null},{"id":"2212.03765","title":"Generalized Gradient Flows with Provable Fixed-Time Convergence and Fast Evasion of Non-Degenerate Saddle Points","created":"2022-12-07","cited_by_count":0,"area":null},{"id":"2304.10640","title":"Distributed Linear Solvers and Data Heterogeneity","created":"2023-04-20","cited_by_count":0,"area":null},{"id":"2307.09638","title":"Promoting Exploration in Memory-Augmented Adam using Critical Momenta","created":"2023-07-18","cited_by_count":0,"area":null},{"id":"2405.13765","title":"On the stability of gradient descent with second order dynamics for time-varying cost functions","created":"2024-05-22","cited_by_count":0,"area":null},{"id":"2409.00913","title":"Generalized Continuous-Time Models for Nesterov's Accelerated Gradient Methods","created":"2024-09-02","cited_by_count":0,"area":null},{"id":"2501.00389","title":"Momentum-based minimization of the Ginzburg-Landau functional on Euclidean spaces and graphs","created":"2024-12-31","cited_by_count":0,"area":null},{"id":"2502.17373","title":"A Concise Lyapunov Analysis of Nesterov's Accelerated Gradient Method","created":"2025-02-24","cited_by_count":0,"area":null},{"id":"2504.19259","title":"Convergence Properties of Natural Gradient Descent for Minimizing KL Divergence","created":"2025-04-27","cited_by_count":0,"area":null},{"id":"2505.14670","title":"Quantum Optimization via Gradient-Based Hamiltonian Descent","created":"2025-05-20","cited_by_count":0,"area":null},{"id":"2512.05915","title":"LDLT $\\mathcal{L}$-Lipschitz Network: Generalized Deep End-To-End Lipschitz Network Construction","created":"2025-12-05","cited_by_count":0,"area":null},{"id":"2512.06791","title":"Small-Gain Nash: Certified Contraction to Nash Equilibria in Differentiable Games","created":"2025-12-07","cited_by_count":0,"area":null},{"id":"2512.10033","title":"Robust Gradient Descent via Heavy-Ball Momentum with Predictive Extrapolation","created":"2025-12-10","cited_by_count":0,"area":null},{"id":"2512.17598","title":"A Systems-Theoretic View on the Convergence of Algorithms under Disturbances","created":"2025-12-19","cited_by_count":0,"area":null},{"id":"2604.00449","title":"Convergence of Byzantine-Resilient Gradient Tracking via Probabilistic Edge Dropout","created":"2026-04-01","cited_by_count":0,"area":null},{"id":"2604.17145","title":"Negative Momentum for Convex-Concave Optimization","created":"2026-04-18","cited_by_count":0,"area":null},{"id":"2604.17645","title":"On The Mathematics of the Natural Physics of Optimization","created":"2026-04-19","cited_by_count":0,"area":null},{"id":"2604.25372","title":"From Cursed to Competitive: Closing the ZO-FO Gap via Input-to-State Stability","created":"2026-04-28","cited_by_count":0,"area":null},{"id":"2606.04031","title":"Pseudospectral Bounds for Transient Amplification in Coupled Gradient Descent","created":"2026-06-01","cited_by_count":0,"area":null},{"id":"2606.28123","title":"Dangerous Liaisons of Convex Learning and Non-Affine Aggregation","created":"2026-06-26","cited_by_count":0,"area":null},{"id":"2607.07206","title":"Causal Optimizer Interaction Calculus: Hidden Geometric Relaxation and Identifiable Interventions","created":"2026-07-08","cited_by_count":0,"area":null},{"id":"2607.15505","title":"Fast and Scalable Caputo Fractional Gradient Descent via Perturbation-Preserving Memory Compression","created":"2026-07-16","cited_by_count":0,"area":null},{"id":"2607.23008","title":"Nesterov acceleration in optimizing over probability measures","created":"2026-07-25","cited_by_count":0,"area":null},{"id":"2608.30431","title":"Generalization as a robust performance property of learning-enabled dynamical systems","created":"2026-08-31","cited_by_count":0,"area":null},{"id":"2609.08656","title":"A Lower Bound for the Heavy-Ball Method on Smooth Convex Functions","created":"2026-09-08","cited_by_count":0,"area":null},{"id":"2609.22576","title":"Scalable Incremental Robustness Analysis of Neural Network Feedback Systems","created":"2026-09-18","cited_by_count":0,"area":null},{"id":"2609.32290","title":"A Journey to the Edge of Stability","created":"2026-09-26","cited_by_count":0,"area":null}],"next_cursor":"100"}