{"total":126,"rows":[{"id":"2203.08065","title":"Surrogate Gap Minimization Improves Sharpness-Aware Training","created":"2022-03-15","cited_by_count":172,"area":null},{"id":"2205.10287","title":"On the SDEs and Scaling Rules for Adaptive Gradient Algorithms","created":"2022-05-20","cited_by_count":104,"area":null},{"id":"2207.14484","title":"Adaptive Gradient Methods at the Edge of Stability","created":"2022-07-29","cited_by_count":101,"area":null},{"id":"2302.07011","title":"A Modern Look at the Relationship between Sharpness and Generalization","created":"2023-02-14","cited_by_count":92,"area":null},{"id":"2202.00661","title":"When Do Flat Minima Optimizers Work?","created":"2022-02-01","cited_by_count":78,"area":null},{"id":"2102.12470","title":"On the Validity of Modeling SGD with Stochastic Differential Equations (SDEs)","created":"2021-02-24","cited_by_count":73,"area":null},{"id":"2111.13171","title":"Intrinsic Dimension, Persistent Homology and Generalization in Neural Networks","created":"2021-11-25","cited_by_count":70,"area":null},{"id":"2207.02628","title":"The alignment property of SGD noise and how it helps select flat minima: A stability analysis","created":"2022-07-06","cited_by_count":64,"area":null},{"id":"2105.13462","title":"On Linear Stability of SGD and Input-Smoothness of Neural Networks","created":"2021-05-27","cited_by_count":63,"area":null},{"id":"2109.14119","title":"Stochastic Training is Not Necessary for Generalization","created":"2021-09-29","cited_by_count":63,"area":null},{"id":"2412.05270","title":"APOLLO: SGD-like Memory, AdamW-level Performance","created":"2024-12-06","cited_by_count":54,"area":null},{"id":"2403.12350","title":"Friendly Sharpness-Aware Minimization","created":"2024-03-19","cited_by_count":53,"area":null},{"id":"2110.03677","title":"Large Learning Rate Tames Homogeneity: Convergence and Balancing Effect","created":"2021-10-07","cited_by_count":50,"area":null},{"id":"2108.11371","title":"Understanding the Generalization of Adam in Learning Neural Networks with Proper Regularization","created":"2021-08-25","cited_by_count":49,"area":null},{"id":"2106.03795","title":"Heavy Tails in SGD and Compressibility of Overparametrized Neural Networks","created":"2021-06-07","cited_by_count":44,"area":null},{"id":"2410.01623","title":"Fira: Can We Achieve Full-rank Training of LLMs Under Low-rank Constraint?","created":"2024-10-02","cited_by_count":43,"area":null},{"id":"2211.10578","title":"ABINet++: Autonomous, Bidirectional and Iterative Language Modeling for Scene Text Spotting","created":"2022-11-19","cited_by_count":40,"area":null},{"id":"2106.15324","title":"Effective Evaluation of Deep Active Learning on Image Classification Tasks","created":"2021-06-16","cited_by_count":37,"area":null},{"id":"2303.02749","title":"Revisiting the Noise Model of Stochastic Gradient Descent","created":"2023-03-05","cited_by_count":36,"area":null},{"id":"2406.10650","title":"The Implicit Bias of Adam on Separable Data","created":"2024-06-15","cited_by_count":36,"area":null},{"id":"2210.17216","title":"Symmetries, flat minima, and the conserved quantities of gradient flow","created":"2022-10-31","cited_by_count":35,"area":null},{"id":"2210.14355","title":"Parameter-free Regret in High Probability with Heavy Tails","created":"2022-10-25","cited_by_count":28,"area":null},{"id":"2309.00079","title":"On the Implicit Bias of Adam","created":"2023-08-31","cited_by_count":27,"area":null},{"id":"2510.00977","title":"It Takes Two: Your GRPO Is Secretly DPO","created":"2025-10-01","cited_by_count":26,"area":"lr"},{"id":"2106.02588","title":"Stochastic gradient descent with noise of machine learning type. Part II: Continuous time analysis","created":"2021-06-04","cited_by_count":25,"area":null},{"id":"2111.04906","title":"The Role of Adaptive Optimizers for Honest Private Hyperparameter Selection","created":"2021-11-09","cited_by_count":25,"area":null},{"id":"2203.10036","title":"On the Generalization Mystery in Deep Learning","created":"2022-03-18","cited_by_count":25,"area":null},{"id":"2305.12475","title":"Two Sides of One Coin: the Limits of Untuned SGD and the Power of Adaptive Methods","created":"2023-05-21","cited_by_count":23,"area":null},{"id":"2305.13404","title":"Improving Convergence and Generalization Using Parameter Symmetries","created":"2023-05-22","cited_by_count":23,"area":null},{"id":"2301.08203","title":"An SDE for Modeling SAM: Theory and Insights","created":"2023-01-19","cited_by_count":22,"area":null},{"id":"2303.12277","title":"Stochastic Nonsmooth Convex Optimization with Heavy-Tailed Noises: High-Probability Bound, In-Expectation Rate and Initial Distance Adaptation","created":"2023-03-22","cited_by_count":20,"area":null},{"id":"2402.04553","title":"Curvature-Informed SGD via General Purpose Lie-Group Preconditioners","created":"2024-02-07","cited_by_count":16,"area":null},{"id":"2510.27486","title":"FedAdamW: A Communication-Efficient Optimizer with Convergence and Generalization Guarantees for Federated Large Models","created":"2025-10-31","cited_by_count":15,"area":null},{"id":"2505.24022","title":"The Rich and the Simple: On the Implicit Bias of Adam and SGD","created":"2025-05-29","cited_by_count":13,"area":null},{"id":"2102.07006","title":"Asymmetric Heavy Tails and Implicit Bias in Gaussian Noise Injections","created":"2021-02-13","cited_by_count":12,"area":null},{"id":"2107.05840","title":"NucMM Dataset: 3D Neuronal Nuclei Instance Segmentation at Sub-Cubic Millimeter Scale","created":"2021-07-13","cited_by_count":12,"area":null},{"id":"2206.01274","title":"Algorithmic Stability of Heavy-Tailed Stochastic Gradient Descent on Least Squares","created":"2022-06-02","cited_by_count":12,"area":null},{"id":"2206.10011","title":"When Does Re-initialization Work?","created":"2022-06-20","cited_by_count":12,"area":null},{"id":"2201.06714","title":"AdaTerm: Adaptive T-Distribution Estimated Robust Moments for Noise-Robust Stochastic Gradient Optimization","created":"2022-01-18","cited_by_count":11,"area":null},{"id":"2406.09958","title":"Memory-Efficient Optimization with Factorized Hamiltonian Descent","created":"2024-06-14","cited_by_count":11,"area":null},{"id":"2602.16340","title":"The Implicit Bias of Adam and Muon on Smooth Homogeneous Neural Networks","created":"2026-02-18","cited_by_count":11,"area":null},{"id":"2310.00692","title":"A Theoretical Analysis of Noise Geometry in Stochastic Gradient Descent","created":"2023-10-01","cited_by_count":9,"area":null},{"id":"2107.13490","title":"Adaptive Precision Training (AdaPT): A dynamic fixed point quantized training approach for DNNs","created":"2021-07-28","cited_by_count":8,"area":null},{"id":"2302.11085","title":"Learning to Generalize Provably in Learning to Optimize","created":"2023-02-22","cited_by_count":8,"area":null},{"id":"2304.02720","title":"Domain Generalization with Adversarial Intensity Attack for Medical Image Segmentation","created":"2023-04-05","cited_by_count":8,"area":null},{"id":"2311.10361","title":"Video-based Sequential Bayesian Homography Estimation for Soccer Field Registration","created":"2023-11-17","cited_by_count":8,"area":null},{"id":"2401.07250","title":"Stabilizing Sharpness-aware Minimization Through A Simple Renormalization Strategy","created":"2024-01-14","cited_by_count":8,"area":null},{"id":"2505.11411","title":"Is Grokking a Computational Glass Relaxation?","created":"2025-05-16","cited_by_count":8,"area":null},{"id":"2602.22681","title":"Accelerating LLM Pre-Training through Flat-Direction Dynamics Enhancement","created":"2026-02-26","cited_by_count":8,"area":null},{"id":"2102.07927","title":"Structured Dropout Variational Inference for Bayesian Neural Networks","created":"2021-02-16","cited_by_count":7,"area":null},{"id":"2106.14749","title":"A Theory-Driven Self-Labeling Refinement Method for Contrastive Representation Learning","created":"2021-06-28","cited_by_count":7,"area":null},{"id":"2304.02911","title":"Heavy-Tailed Regularization of Weight Matrices in Deep Neural Networks","created":"2023-04-06","cited_by_count":7,"area":null},{"id":"2306.14522","title":"Nonconvex Stochastic Bregman Proximal Gradient Method with Application to Deep Learning","created":"2023-06-26","cited_by_count":7,"area":null},{"id":"2309.03004","title":"A Theoretical Explanation of Activation Sparsity through Flat Minima and Adversarial Robustness","created":"2023-09-06","cited_by_count":7,"area":null},{"id":"2409.10489","title":"Flash STU: Fast Spectral Transform Units","created":"2024-09-16","cited_by_count":7,"area":null},{"id":"2106.11514","title":"Rethinking Adam: A Twofold Exponential Moving Average Approach","created":"2021-06-22","cited_by_count":6,"area":null},{"id":"2401.11600","title":"Understanding the Generalization Benefits of Late Learning Rate Decay","created":"2024-01-21","cited_by_count":6,"area":null},{"id":"2306.08125","title":"Implicit Compressibility of Overparametrized Neural Networks Trained with Heavy-Tailed SGD","created":"2023-06-13","cited_by_count":5,"area":null},{"id":"2310.08858","title":"Adam-family Methods with Decoupled Weight Decay in Deep Learning","created":"2023-10-13","cited_by_count":5,"area":null},{"id":"2404.07164","title":"PIM-Opt: Demystifying Distributed Optimization Algorithms on a Real-World Processing-In-Memory System","created":"2024-04-10","cited_by_count":5,"area":null},{"id":"2506.06866","title":"SAFE: Finding Sparse and Flat Minima to Improve Pruning","created":"2025-06-07","cited_by_count":5,"area":null},{"id":"2509.24218","title":"Conda: Column-Normalized Adam for Training Large Language Models Faster","created":"2025-09-29","cited_by_count":5,"area":null},{"id":"2111.00463","title":"FastCover: An Unsupervised Learning Framework for Multi-Hop Influence Maximization in Social Networks","created":"2021-10-31","cited_by_count":4,"area":null},{"id":"2205.01515","title":"Multitask Network for Joint Object Detection, Semantic Segmentation and Human Pose Estimation in Vehicle Occupancy Monitoring","created":"2022-05-03","cited_by_count":4,"area":null},{"id":"2309.16369","title":"Bringing the Discussion of Minima Sharpness to the Audio Domain: a Filter-Normalised Evaluation for Acoustic Scene Classification","created":"2023-09-28","cited_by_count":4,"area":null},{"id":"2407.20724","title":"Exploring Loss Landscapes through the Lens of Spin Glass Theory","created":"2024-07-30","cited_by_count":4,"area":null},{"id":"2412.20269","title":"TeLU Activation Function for Fast and Stable Deep Learning","created":"2024-12-28","cited_by_count":4,"area":null},{"id":"2503.13145","title":"High-entropy Advantage in Neural Networks' Generalizability","created":"2025-03-17","cited_by_count":4,"area":null},{"id":"2506.00181","title":"On the Interaction of Batch Noise, Adaptivity, and Compression, under $(L_0,L_1)$-Smoothness: An SDE Approach","created":"2025-05-30","cited_by_count":4,"area":null},{"id":"2602.01642","title":"The Effect of Mini-Batch Noise on the Implicit Bias of Adam","created":"2026-02-02","cited_by_count":4,"area":null},{"id":"2602.18116","title":"Cut Less, Fold More: Model Compression through the Lens of Projection Geometry","created":"2026-02-20","cited_by_count":4,"area":null},{"id":"2103.14689","title":"Exploiting Adam-like Optimization Algorithms to Improve the Performance of Convolutional Neural Networks","created":"2021-03-26","cited_by_count":3,"area":null},{"id":"2108.12539","title":"High performing ensemble of convolutional neural networks for insect pest image detection","created":"2021-08-28","cited_by_count":3,"area":null},{"id":"2304.03486","title":"Can we learn better with hard samples?","created":"2023-04-07","cited_by_count":3,"area":null},{"id":"2310.10958","title":"Enhancing Deep Neural Network Training Efficiency and Performance through Linear Prediction","created":"2023-10-17","cited_by_count":3,"area":null},{"id":"2310.18455","title":"Approximate Heavy Tails in Offline (Multi-Pass) Stochastic Gradient Descent","created":"2023-10-27","cited_by_count":3,"area":null},{"id":"2311.06138","title":"Minimum norm interpolation by perceptra: Explicit regularization and implicit bias","created":"2023-11-10","cited_by_count":3,"area":null},{"id":"2403.08585","title":"Improving Implicit Regularization of SGD with Preconditioning for Least Square Problems","created":"2024-03-13","cited_by_count":3,"area":null},{"id":"2406.20006","title":"On the Trade-off between Flatness and Optimization in Distributed Learning","created":"2024-06-28","cited_by_count":3,"area":null},{"id":"2408.15578","title":"FireFly-S: Exploiting Dual-Side Sparsity for Spiking Neural Networks Acceleration with Reconfigurable Spatial Architecture","created":"2024-08-28","cited_by_count":3,"area":null},{"id":"2502.18153","title":"SASSHA: Sharpness-aware Adaptive Second-order Optimization with Stable Hessian Approximation","created":"2025-02-25","cited_by_count":3,"area":null},{"id":"2503.22478","title":"Almost Bayesian: The Fractal Dynamics of Stochastic Gradient Descent","created":"2025-03-28","cited_by_count":2,"area":null},{"id":"2604.27715","title":"Improving Calibration in Test-Time Prompt Tuning for Vision-Language Models via Data-Free Flatness-Aware Prompt Pretraining","created":"2026-04-30","cited_by_count":2,"area":"mllm"},{"id":"2606.00571","title":"On the Difficulty of Learning a Meta-network for Training Data Selection","created":"2026-05-30","cited_by_count":2,"area":null},{"id":"2107.12207","title":"Image-Based Parking Space Occupancy Classification: Dataset and Baseline","created":"2021-07-26","cited_by_count":1,"area":null},{"id":"2112.11619","title":"A Convergent ADMM Framework for Efficient Neural Network Training","created":"2021-12-22","cited_by_count":1,"area":null},{"id":"2302.08484","title":"FOSI: Hybrid First and Second Order Optimization","created":"2023-02-16","cited_by_count":1,"area":null},{"id":"2303.17109","title":"Efficient Sampling of Stochastic Differential Equations with Positive Semi-Definite Models","created":"2023-03-30","cited_by_count":1,"area":null},{"id":"2307.07189","title":"Multiplicative update rules for accelerating deep learning training and increasing robustness","created":"2023-07-14","cited_by_count":1,"area":null},{"id":"2401.09622","title":"Is Hyper-Parameter Optimization Different for Software Analytics?","created":"2024-01-17","cited_by_count":1,"area":null},{"id":"2410.16476","title":"In Search of the Successful Interpolation: On the Role of Sharpness in CLIP Generalization","created":"2024-10-21","cited_by_count":1,"area":null},{"id":"2411.12697","title":"Attribute Inference Attacks for Federated Regression Tasks","created":"2024-11-19","cited_by_count":1,"area":null},{"id":"2412.02153","title":"Revisiting the Initial Steps in Adaptive Gradient Descent Optimization","created":"2024-12-03","cited_by_count":1,"area":null},{"id":"2502.06192","title":"Right Time to Learn:Promoting Generalization via Bio-inspired Spacing Effect in Knowledge Distillation","created":"2025-02-10","cited_by_count":1,"area":"distill"},{"id":"2509.21614","title":"Effective continuous equations for adaptive SGD: a stochastic analysis view","created":"2025-09-25","cited_by_count":1,"area":null},{"id":"2509.24411","title":"Hybrid Layer-Wise ANN-SNN With Surrogate Spike Encoding-Decoding Structure","created":"2025-09-29","cited_by_count":1,"area":null},{"id":"2606.14259","title":"Beyond a Single Explanation of the Adam--SGD Gap","created":"2026-06-12","cited_by_count":1,"area":null},{"id":"2104.00722","title":"GABO: Graph Augmentations with Bi-level Optimization","created":"2021-04-01","cited_by_count":0,"area":null},{"id":"2105.14694","title":"Combining resampling and reweighting for faithful stochastic optimization","created":"2021-05-31","cited_by_count":0,"area":null},{"id":"2107.01525","title":"AdaL: Adaptive Gradient Transformation Contributes to Convergences and Generalizations","created":"2021-07-04","cited_by_count":0,"area":null}],"next_cursor":"100"}