{"total":48,"rows":[{"id":"2106.08208","title":"SUPER-ADAM: Faster and Universal Framework of Adaptive Gradients","created":"2021-06-15","cited_by_count":40,"area":null},{"id":"2202.05963","title":"Private Adaptive Optimization with Side Information","created":"2022-02-12","cited_by_count":38,"area":null},{"id":"2101.05471","title":"Towards Practical Adam: Non-Convexity, Convergence Theory, and Mini-Batch Acceleration","created":"2021-01-14","cited_by_count":25,"area":null},{"id":"2402.03496","title":"Can We Remove the Square-Root in Adaptive Gradient Methods? A Second-Order Perspective","created":"2024-02-05","cited_by_count":25,"area":null},{"id":"2308.06058","title":"Adaptive SGD with Polyak stepsize and Line-search: Robust Convergence and Variance Reduction","created":"2023-08-11","cited_by_count":23,"area":null},{"id":"2406.15244","title":"AdaGrad under Anisotropic Smoothness","created":"2024-06-21","cited_by_count":22,"area":null},{"id":"2206.00743","title":"Nest Your Adaptive Algorithm for Parameter-Agnostic Nonconvex Minimax Optimization","created":"2022-06-01","cited_by_count":16,"area":null},{"id":"2406.06420","title":"An Improved Empirical Fisher Approximation for Natural Gradient Descent","created":"2024-06-10","cited_by_count":15,"area":null},{"id":"2307.11782","title":"Convergence of Adam for Non-convex Objectives: Relaxed Hyperparameters and Non-ergodic Case","created":"2023-07-20","cited_by_count":14,"area":null},{"id":"2305.10459","title":"AnalogNAS: A Neural Network Design Framework for Accurate Inference with Analog In-Memory Computing","created":"2023-05-17","cited_by_count":10,"area":null},{"id":"2101.00238","title":"Adam revisited: a weighted past gradients perspective","created":"2021-01-01","cited_by_count":9,"area":null},{"id":"2101.06070","title":"Efficient Semi-Implicit Variational Inference","created":"2021-01-15","cited_by_count":9,"area":null},{"id":"2109.14213","title":"On the One-sided Convergence of Adam-type Algorithms in Non-convex Non-concave Min-max Optimization","created":"2021-09-29","cited_by_count":9,"area":null},{"id":"2102.07314","title":"The Role of Momentum Parameters in the Optimal Convergence of Adaptive Polyak's Heavy-ball Methods","created":"2021-02-15","cited_by_count":7,"area":null},{"id":"2107.03331","title":"KOALA: A Kalman Optimization Algorithm with Loss Adaptivity","created":"2021-07-07","cited_by_count":6,"area":null},{"id":"2310.14085","title":"Adaptive, Doubly Optimal No-Regret Learning in Strongly Monotone and Exp-Concave Games with Gradient Feedback","created":"2023-10-21","cited_by_count":6,"area":null},{"id":"2405.19705","title":"Universal Online Convex Optimization with $1$ Projection per Round","created":"2024-05-30","cited_by_count":6,"area":null},{"id":"2105.03681","title":"Universal Online Convex Optimization Meets Second-order Bounds","created":"2021-05-08","cited_by_count":4,"area":null},{"id":"2109.08282","title":"AdaLoss: A computationally-efficient and provably convergent adaptive gradient method","created":"2021-09-17","cited_by_count":4,"area":null},{"id":"2209.01608","title":"Dynamic Regret of Adaptive Gradient Methods for Strongly Convex Problems","created":"2022-09-04","cited_by_count":4,"area":null},{"id":"2301.13360","title":"Skeleton-based Human Action Recognition via Convolutional Neural Networks (CNN)","created":"2023-01-31","cited_by_count":4,"area":null},{"id":"2410.08809","title":"DCNet: A Data-Driven Framework for DVL Calibration","created":"2024-10-11","cited_by_count":4,"area":null},{"id":"2104.06677","title":"Multi-Party Dual Learning","created":"2021-04-14","cited_by_count":3,"area":null},{"id":"2201.12678","title":"A Stochastic Bundle Method for Interpolating Networks","created":"2022-01-29","cited_by_count":3,"area":null},{"id":"2302.06103","title":"FedDA: Faster Framework of Local Adaptive Gradient Methods via Restarted Dual Averaging","created":"2023-02-13","cited_by_count":2,"area":null},{"id":"2402.13945","title":"Probabilistic Neural Networks (PNNs) for Modeling Aleatoric Uncertainty in Scientific Machine Learning","created":"2024-02-21","cited_by_count":2,"area":null},{"id":"2412.19444","title":"Towards Simple and Provable Parameter-Free Adaptive Gradient Methods","created":"2024-12-27","cited_by_count":2,"area":null},{"id":"2502.10784","title":"Preconditioned Inexact Stochastic ADMM for Deep Model","created":"2025-02-15","cited_by_count":2,"area":null},{"id":"2604.17423","title":"A unified convergence theory for adaptive first-order methods in the nonconvex case, including AdaNorm, full and diagonal AdaGrad and Muon","created":"2026-04-19","cited_by_count":2,"area":null},{"id":"2101.09192","title":"Gravity Optimizer: a Kinematic Approach on Optimization in Deep Learning","created":"2021-01-22","cited_by_count":1,"area":null},{"id":"2504.14814","title":"A Diagnostic Evaluation of Neural Networks Trained with the Error Diffusion Learning Algorithm","created":"2025-04-21","cited_by_count":1,"area":null},{"id":"2602.19096","title":"The Power of Decaying Steps: Enhancing Attack Stability and Transferability for Sign-based Optimizers","created":"2026-02-22","cited_by_count":1,"area":null},{"id":"2607.28902","title":"Adaptivity via a Parallel Architecture for Stochastic Gradient Methods","created":"2026-07-31","cited_by_count":1,"area":null},{"id":"2104.01730","title":"Training Deep Neural Networks via Branch-and-Bound","created":"2021-04-05","cited_by_count":0,"area":null},{"id":"2104.05447","title":"Meta-Regularization: An Approach to Adaptive Choice of the Learning Rate in Gradient Descent","created":"2021-04-12","cited_by_count":0,"area":null},{"id":"2104.13790","title":"FastAdaBelief: Improving Convergence Rate for Belief-based Adaptive Optimizers by Exploiting Strong Convexity","created":"2021-04-28","cited_by_count":0,"area":null},{"id":"2109.05635","title":"Mixing between the Cross Entropy and the Expectation Loss Terms","created":"2021-09-12","cited_by_count":0,"area":null},{"id":"2207.12631","title":"A Learning and Control Perspective for Microfinance","created":"2022-07-26","cited_by_count":0,"area":null},{"id":"2211.00731","title":"Comparision Of Adversarial And Non-Adversarial LSTM Music Generative Models","created":"2022-11-01","cited_by_count":0,"area":null},{"id":"2301.08949","title":"Estimation of Sea State Parameters from Ship Motion Responses Using Attention-based Neural Networks","created":"2023-01-21","cited_by_count":0,"area":null},{"id":"2306.06613","title":"Parameter-free version of Adaptive Gradient Methods for Strongly-Convex Functions","created":"2023-06-11","cited_by_count":0,"area":null},{"id":"2403.11163","title":"A Selective Review on Statistical Methods for Massive Data Computation: Distributed Computing, Subsampling, and Minibatch Techniques","created":"2024-03-17","cited_by_count":0,"area":null},{"id":"2406.15936","title":"An Automated SQL Query Grading System Using An Attention-Based Convolutional Neural Network","created":"2024-06-22","cited_by_count":0,"area":null},{"id":"2503.10005","title":"Adaptive Moment Estimation Optimization Algorithm Using Projection Gradient for Deep Learning","created":"2025-03-13","cited_by_count":0,"area":null},{"id":"2512.14188","title":"Optimizing the Adversarial Perturbation with a Momentum-based Adaptive Matrix","created":"2025-12-16","cited_by_count":0,"area":null},{"id":"2607.24518","title":"Low-Rank Dependence Decomposition via Accelerated Symmetric Non-negative Matrix Factorization","created":"2026-07-27","cited_by_count":0,"area":null},{"id":"2608.30382","title":"Convergence rates for the RMSprop optimizer with full control of the hyperparameters","created":"2026-08-31","cited_by_count":0,"area":null},{"id":"2609.32729","title":"Revisiting AdaGrad in Stochastic Convex Optimization: Last Iterates, High Probability, and Lower Bounds","created":"2026-09-26","cited_by_count":0,"area":null}],"next_cursor":null}