{"total":513,"rows":[{"id":"2201.02177","title":"Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets","created":"2022-01-06","cited_by_count":629,"area":null},{"id":"2102.08604","title":"SWAD: Domain Generalization by Seeking Flat Minima","created":"2021-02-17","cited_by_count":434,"area":null},{"id":"2102.11600","title":"ASAM: Adaptive Sharpness-Aware Minimization for Scale-Invariant Learning of Deep Neural Networks","created":"2021-02-23","cited_by_count":293,"area":null},{"id":"2203.05740","title":"QDrop: Randomly Dropping Quantization for Extremely Low-bit Post-Training Quantization","created":"2022-03-11","cited_by_count":180,"area":null},{"id":"2203.08065","title":"Surrogate Gap Minimization Improves Sharpness-Aware Training","created":"2022-03-15","cited_by_count":172,"area":null},{"id":"2106.02073","title":"Neural Collapse Under MSE Loss: Proximity to and Dynamics on the Central Path","created":"2021-06-03","cited_by_count":158,"area":null},{"id":"2209.15594","title":"Self-Stabilization: The Implicit Bias of Gradient Descent at the Edge of Stability","created":"2022-09-30","cited_by_count":155,"area":null},{"id":"2206.06232","title":"Towards Understanding Sharpness-Aware Minimization","created":"2022-06-13","cited_by_count":146,"area":null},{"id":"2110.10090","title":"Inductive Biases and Variable Creation in Self-Attention Mechanisms","created":"2021-10-19","cited_by_count":144,"area":null},{"id":"2211.11004","title":"Minimizing the Accumulated Trajectory Error to Improve Dataset Distillation","created":"2022-11-20","cited_by_count":142,"area":null},{"id":"2106.09647","title":"Deep Learning Through the Lens of Example Difficulty","created":"2021-06-17","cited_by_count":141,"area":null},{"id":"2110.03141","title":"Efficient Sharpness-aware Minimization for Improved Training of Neural Networks","created":"2021-10-07","cited_by_count":137,"area":null},{"id":"2205.09745","title":"Understanding Gradient Descent on Edge of Stability in Deep Learning","created":"2022-05-19","cited_by_count":128,"area":null},{"id":"2111.01549","title":"Overcoming Catastrophic Forgetting in Incremental Few-Shot Learning by Finding Flat Minima","created":"2021-10-30","cited_by_count":118,"area":null},{"id":"2106.13799","title":"Assessing Generalization of SGD via Disagreement","created":"2021-06-25","cited_by_count":117,"area":null},{"id":"2107.03315","title":"Predicting with Confidence on Unseen Distributions","created":"2021-07-07","cited_by_count":116,"area":null},{"id":"2111.14213","title":"Local Learning Matters: Rethinking Data Heterogeneity in Federated Learning","created":"2021-11-28","cited_by_count":114,"area":null},{"id":"2104.04975","title":"Scalable Marginal Likelihood Estimation for Model Selection in Deep Learning","created":"2021-04-11","cited_by_count":106,"area":null},{"id":"2111.10603","title":"Reasonable Effectiveness of Random Weighting: A Litmus Test for Multi-Task Learning","created":"2021-11-20","cited_by_count":101,"area":null},{"id":"2203.11834","title":"Improving Generalization in Federated Learning by Seeking Flat Minima","created":"2022-03-22","cited_by_count":98,"area":null},{"id":"2205.14083","title":"Sharpness-Aware Training for Free","created":"2022-05-27","cited_by_count":95,"area":null},{"id":"2302.07011","title":"A Modern Look at the Relationship between Sharpness and Generalization","created":"2023-02-14","cited_by_count":92,"area":null},{"id":"2203.06176","title":"More Than a Toy: Random Matrix Models Predict How Real-World Neural Representations Generalize","created":"2022-03-11","cited_by_count":91,"area":null},{"id":"2206.04920","title":"Fisher SAM: Information Geometry and Sharpness Aware Minimisation","created":"2022-06-10","cited_by_count":84,"area":null},{"id":"2210.14199","title":"Same Pre-training Loss, Better Downstream: Implicit Bias Matters for Language Models","created":"2022-10-25","cited_by_count":84,"area":null},{"id":"2110.13905","title":"Gradient Descent on Two-layer Nets: Margin Maximization and Simplicity Bias","created":"2021-10-26","cited_by_count":83,"area":null},{"id":"2106.03880","title":"Encoding-dependent generalization bounds for parametrized quantum circuits","created":"2021-06-07","cited_by_count":82,"area":null},{"id":"2212.14034","title":"Cramming: Training a Language Model on a Single GPU in One Day","created":"2022-12-28","cited_by_count":81,"area":null},{"id":"2202.00661","title":"When Do Flat Minima Optimizers Work?","created":"2022-02-01","cited_by_count":78,"area":null},{"id":"2402.09963","title":"Why are Sensitive Functions Hard for Transformers?","created":"2024-02-15","cited_by_count":74,"area":null},{"id":"2310.04415","title":"Why Do We Need Weight Decay in Modern Deep Learning?","created":"2023-10-06","cited_by_count":72,"area":null},{"id":"2201.07395","title":"Overview frequency principle/spectral bias in deep learning","created":"2022-01-19","cited_by_count":69,"area":null},{"id":"2210.05968","title":"Boosting the Transferability of Adversarial Attacks with Reverse Adversarial Perturbation","created":"2022-10-12","cited_by_count":68,"area":null},{"id":"2211.05729","title":"How Does Sharpness-Aware Minimization Minimize Sharpness?","created":"2022-11-10","cited_by_count":65,"area":null},{"id":"2106.05961","title":"What Does Rotation Prediction Tell Us about Classifier Accuracy under Varying Testing Environments?","created":"2021-06-10","cited_by_count":63,"area":null},{"id":"2109.14119","title":"Stochastic Training is Not Necessary for Generalization","created":"2021-09-29","cited_by_count":63,"area":null},{"id":"2206.03996","title":"Sharp-MAML: Sharpness-Aware Model-Agnostic Meta Learning","created":"2022-06-08","cited_by_count":58,"area":null},{"id":"2104.04448","title":"Relating Adversarially Robust Generalization to Flat Minima","created":"2021-04-09","cited_by_count":57,"area":null},{"id":"2202.11678","title":"Bayesian Model Selection, the Marginal Likelihood, and Generalization","created":"2022-02-23","cited_by_count":57,"area":null},{"id":"2206.10654","title":"On the Maximum Hessian Eigenvalue and Generalization","created":"2022-06-21","cited_by_count":57,"area":null},{"id":"2303.03108","title":"Gradient Norm Aware Minimization Seeks First-Order Flatness and Improves Generalization","created":"2023-03-03","cited_by_count":57,"area":null},{"id":"2503.02113","title":"Deep Learning is Not So Mysterious or Different","created":"2025-03-03","cited_by_count":56,"area":null},{"id":"2106.01606","title":"Exploring Memorization in Adversarial Training","created":"2021-06-03","cited_by_count":55,"area":null},{"id":"2308.12108","title":"The Local Learning Coefficient: A Singularity-Aware Complexity Measure","created":"2023-08-23","cited_by_count":51,"area":null},{"id":"2110.01584","title":"Information-theoretic generalization bounds for black-box learning algorithms","created":"2021-10-04","cited_by_count":49,"area":null},{"id":"2306.13461","title":"Understanding quantum machine learning also requires rethinking generalization","created":"2023-06-23","cited_by_count":49,"area":null},{"id":"2306.05225","title":"Boosting Adversarial Transferability by Achieving Flat Local Maxima","created":"2023-06-08","cited_by_count":48,"area":null},{"id":"2207.01164","title":"Aug-NeRF: Training Stronger Neural Radiance Fields with Triple-Level Physically-Grounded Augmentations","created":"2022-07-04","cited_by_count":46,"area":null},{"id":"2111.04578","title":"Improved Regularization and Robustness for Fine-tuning in Neural Networks","created":"2021-11-08","cited_by_count":45,"area":null},{"id":"2304.14647","title":"An Adaptive Policy to Employ Sharpness-Aware Minimization","created":"2023-04-28","cited_by_count":43,"area":null},{"id":"2202.02831","title":"Anticorrelated Noise Injection for Improved Generalization","created":"2022-02-06","cited_by_count":42,"area":null},{"id":"2203.06020","title":"Enhancing Adversarial Training with Second-Order Statistics of Weights","created":"2022-03-11","cited_by_count":42,"area":null},{"id":"2111.12229","title":"Subspace Adversarial Training","created":"2021-11-24","cited_by_count":41,"area":null},{"id":"2210.01620","title":"SAM as an Optimal Relaxation of Bayes","created":"2022-10-04","cited_by_count":41,"area":null},{"id":"2111.06977","title":"Scalable Diverse Model Selection for Accessible Transfer Learning","created":"2021-11-12","cited_by_count":40,"area":null},{"id":"2211.14699","title":"A Theoretical Study of Inductive Biases in Contrastive Learning","created":"2022-11-27","cited_by_count":40,"area":null},{"id":"2302.04451","title":"Generalization in Graph Neural Networks: Improved PAC-Bayesian Bounds on Graph Diffusion","created":"2023-02-09","cited_by_count":40,"area":null},{"id":"2412.13337","title":"Unveiling the Secret Recipe: A Guide For Supervised Fine-Tuning Small LLMs","created":"2024-12-17","cited_by_count":40,"area":null},{"id":"2201.08025","title":"Low-Pass Filtering SGD for Recovering Flat Optima in the Deep Learning Optimization Landscape","created":"2022-01-20","cited_by_count":39,"area":null},{"id":"2202.00155","title":"Fortuitous Forgetting in Connectionist Networks","created":"2022-02-01","cited_by_count":39,"area":null},{"id":"2209.13083","title":"Why neural networks find simple solutions: the many regularizers of geometric complexity","created":"2022-09-27","cited_by_count":39,"area":null},{"id":"2307.11007","title":"Sharpness Minimization Algorithms Do Not Only Minimize Sharpness To Achieve Better Generalization","created":"2023-07-20","cited_by_count":39,"area":null},{"id":"2305.16292","title":"Sharpness-Aware Minimization Leads to Low-Rank Features","created":"2023-05-25","cited_by_count":38,"area":null},{"id":"2209.07529","title":"On the Soft-Subnetwork for Few-shot Class Incremental Learning","created":"2022-09-15","cited_by_count":37,"area":null},{"id":"2309.15639","title":"Enhancing Sharpness-Aware Optimization Through Variance Suppression","created":"2023-09-27","cited_by_count":37,"area":null},{"id":"2405.16002","title":"Does SGD really happen in tiny subspaces?","created":"2024-05-25","cited_by_count":36,"area":null},{"id":"2306.13253","title":"Predicting Grokking Long Before it Happens: A look into the loss landscape of models which grok","created":"2023-06-23","cited_by_count":35,"area":null},{"id":"2104.05641","title":"Generalization bounds via distillation","created":"2021-04-12","cited_by_count":34,"area":null},{"id":"2107.11228","title":"Taxonomizing local versus global structure in neural network loss landscapes","created":"2021-07-23","cited_by_count":34,"area":null},{"id":"2206.02659","title":"Robust Fine-Tuning of Deep Neural Networks with Hessian-based Generalization Guarantees","created":"2022-06-06","cited_by_count":34,"area":null},{"id":"2207.11347","title":"An Impartial Take to the CNN vs Transformer Robustness Contest","created":"2022-07-22","cited_by_count":34,"area":null},{"id":"2402.14547","title":"OmniPred: Language Models as Universal Regressors","created":"2024-02-22","cited_by_count":34,"area":null},{"id":"2206.01136","title":"Transforming medical imaging with Transformers? A comparative review of key properties, current progresses, and future perspectives","created":"2022-06-02","cited_by_count":33,"area":null},{"id":"2402.18377","title":"Out-of-Domain Generalization in Dynamical Systems Reconstruction","created":"2024-02-28","cited_by_count":33,"area":null},{"id":"2105.11686","title":"Towards Understanding the Condensation of Neural Networks at Initial Training","created":"2021-05-25","cited_by_count":32,"area":null},{"id":"2110.03128","title":"On the Generalization of Models Trained with SGD: Information-Theoretic Bounds and Implications","created":"2021-10-07","cited_by_count":31,"area":null},{"id":"2306.04815","title":"Catapults in SGD: spikes in the training loss and their impact on generalization through feature learning","created":"2023-06-07","cited_by_count":31,"area":null},{"id":"2308.07815","title":"ImbSAM: A Closer Look at Sharpness-Aware Minimization in Class-Imbalanced Recognition","created":"2023-08-15","cited_by_count":31,"area":null},{"id":"2408.11804","title":"Approaching Deep Learning through the Spectral Dynamics of Weights","created":"2024-08-21","cited_by_count":31,"area":null},{"id":"2102.06589","title":"Generalization Bounds for Meta-Learning via PAC-Bayes and Uniform Stability","created":"2021-02-12","cited_by_count":30,"area":null},{"id":"2203.05126","title":"PACTran: PAC-Bayesian Metrics for Estimating the Transferability of Pretrained Models to Classification Tasks","created":"2022-03-10","cited_by_count":30,"area":null},{"id":"2210.09759","title":"Pareto Manifold Learning: Tackling multiple tasks via ensembles of single-task models","created":"2022-10-18","cited_by_count":29,"area":null},{"id":"2107.01163","title":"Unveiling the structure of wide flat minima in neural networks","created":"2021-07-02","cited_by_count":28,"area":null},{"id":"2202.03038","title":"Deep Networks on Toroids: Removing Symmetries Reveals the Structure of Flat Regions in the Landscape Geometry","created":"2022-02-07","cited_by_count":28,"area":null},{"id":"2303.10653","title":"Randomized Adversarial Training via Taylor Expansion","created":"2023-03-19","cited_by_count":28,"area":null},{"id":"2108.00781","title":"Generalization Bounds using Lower Tail Exponents in Stochastic Optimizers","created":"2021-08-02","cited_by_count":27,"area":null},{"id":"2306.04226","title":"Normalization Layers Are All That Sharpness-Aware Minimization Needs","created":"2023-06-07","cited_by_count":27,"area":null},{"id":"2206.04613","title":"Explicit Regularization in Overparametrized Models via Noise Injection","created":"2022-06-09","cited_by_count":26,"area":null},{"id":"2206.08684","title":"Sparse Double Descent: Where Network Pruning Aggravates Overfitting","created":"2022-06-17","cited_by_count":26,"area":null},{"id":"2305.15287","title":"The Crucial Role of Normalization in Sharpness-Aware Minimization","created":"2023-05-24","cited_by_count":26,"area":null},{"id":"2106.03314","title":"Measuring Generalization with Optimal Transport","created":"2021-06-07","cited_by_count":25,"area":null},{"id":"2111.12273","title":"Sharpness-aware Quantization for Deep Neural Networks","created":"2021-11-24","cited_by_count":25,"area":null},{"id":"2305.14247","title":"Evaluation of the MACE Force Field Architecture: from Medicinal Chemistry to Materials Science","created":"2023-05-23","cited_by_count":25,"area":null},{"id":"2206.08491","title":"Revisiting Self-Distillation","created":"2022-06-17","cited_by_count":24,"area":"distill"},{"id":"2110.09246","title":"Single Layer Predictive Normalized Maximum Likelihood for Out-of-Distribution Detection","created":"2021-10-18","cited_by_count":23,"area":null},{"id":"2207.07065","title":"On the Strong Correlation Between Model Invariance and Generalization","created":"2022-07-14","cited_by_count":23,"area":null},{"id":"2210.00364","title":"DCI-ES: An Extended Disentanglement Framework with Connections to Identifiability","created":"2022-10-01","cited_by_count":23,"area":null},{"id":"2411.07681","title":"What Do Learning Dynamics Reveal About Generalization in LLM Reasoning?","created":"2024-11-12","cited_by_count":23,"area":"lr"},{"id":"2102.01670","title":"Keep the Gradients Flowing: Using Gradient Flow to Study Sparse Network Optimization","created":"2021-02-02","cited_by_count":22,"area":null},{"id":"2110.03891","title":"Does Momentum Change the Implicit Regularization on Separable Data?","created":"2021-10-08","cited_by_count":22,"area":null}],"next_cursor":"100"}